2024-09-14T11:05:38.740 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T11:05:38.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:05:38.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177 branch: main description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904177' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMosFq9obtVFkVTvsjN6VN3zo+RFn0QoWAiCXM+8KIbKgtJqjigb0tP22Yer08c/GWhN7MEk3pYpeTtI4vUK7M= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkDiInCp8olwzAODIHzJfwE7U4M4p2cPKif2W0AcPCaAzgG+8VgulrGTX/lNtFLntpOSwje9CjOlEHC7RoNOfk= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T11:05:38.852 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T11:05:38.853 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T11:05:38.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T11:05:38.855 INFO:teuthology.task.internal:Checking packages... 2024-09-14T11:05:38.877 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T11:05:38.877 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T11:05:38.877 INFO:teuthology.packaging:ref: None 2024-09-14T11:05:38.877 INFO:teuthology.packaging:tag: None 2024-09-14T11:05:38.877 INFO:teuthology.packaging:branch: main 2024-09-14T11:05:38.877 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:05:38.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T11:05:39.099 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T11:05:39.100 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T11:05:39.108 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T11:05:39.108 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T11:05:39.143 INFO:teuthology.task.internal:Saving configuration 2024-09-14T11:05:39.159 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T11:05:39.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T11:05:39.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 11:00:25.947555', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMosFq9obtVFkVTvsjN6VN3zo+RFn0QoWAiCXM+8KIbKgtJqjigb0tP22Yer08c/GWhN7MEk3pYpeTtI4vUK7M='} 2024-09-14T11:05:39.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 11:00:25.945589', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkDiInCp8olwzAODIHzJfwE7U4M4p2cPKif2W0AcPCaAzgG+8VgulrGTX/lNtFLntpOSwje9CjOlEHC7RoNOfk='} 2024-09-14T11:05:39.213 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T11:05:39.225 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:05:39.225 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:05:39.225 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T11:05:39.289 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f66119bd120>, signals=[15]) 2024-09-14T11:05:39.289 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T11:05:39.302 INFO:teuthology.task.internal:Opening connections... 2024-09-14T11:05:39.302 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:05:39.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:05:39.382 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:05:39.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:05:39.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T11:05:39.476 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-14T11:05:39.495 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-14T11:05:39.495 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-14T11:05:39.553 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:05:39.554 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:05:39.555 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:05:39.555 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-14T11:05:39.572 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-14T11:05:39.591 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-14T11:05:39.591 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-14T11:05:39.648 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:05:39.649 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:05:39.650 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-14T11:05:39.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T11:05:39.687 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T11:05:39.702 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T11:05:39.702 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:05:39.705 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:05:39.721 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T11:05:39.732 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T11:05:39.733 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:05:39.763 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:05:39.869 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T11:05:39.933 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T11:05:39.954 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T11:05:39.954 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T11:05:39.954 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:05:39.955 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:05:39.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:05:39.972 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-14T11:05:39.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:05:39.973 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T11:05:40.029 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:05:40.029 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-503.el9.x86_64 2024-09-14T11:05:40.029 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-09-14T11:05:40.031 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:05:40.031 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-14T11:05:40.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-14T11:05:42.399 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-14T11:05:42.466 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T11:05:44.458 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-14T11:05:45.559 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-14T11:05:49.850 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-14T11:05:50.934 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-14T11:05:51.443 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-14T11:05:52.222 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T11:05:52.389 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-14T11:05:53.447 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-14T11:05:57.681 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T11:05:58.803 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-14T11:05:59.725 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:05:59.725 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:05:59.814 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T11:05:59.821 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T11:05:59.822 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-14T11:05:59.823 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:05:59.823 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 79 M 2024-09-14T11:05:59.823 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 126 M 2024-09-14T11:05:59.823 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T11:06:00.195 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 249 kB/s | 23 kB 00:00 2024-09-14T11:06:00.579 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-14T11:06:00.834 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:06:00.835 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:06:00.935 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T11:06:00.943 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:06:00.943 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-14T11:06:00.944 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:06:00.945 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-14T11:06:00.945 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-14T11:06:00.945 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T11:06:01.004 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 35 MB/s | 29 MB 00:00 2024-09-14T11:06:01.313 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-14T11:06:01.313 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:06:01.313 INFO:teuthology.orchestra.run.smithi164.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-14T11:06:01.321 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 192 kB/s | 23 kB 00:00 2024-09-14T11:06:01.630 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-14T11:06:01.999 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T11:06:02.038 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 40 MB/s | 29 MB 00:00 2024-09-14T11:06:02.387 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T11:06:02.387 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T11:06:02.472 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-14T11:06:02.472 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:06:02.472 INFO:teuthology.orchestra.run.smithi116.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-14T11:06:03.154 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T11:06:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T11:06:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T11:06:03.510 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T11:06:03.510 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T11:06:04.484 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T11:06:04.484 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T11:06:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T11:06:06.453 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:06:06.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:06.941 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T11:06:07.676 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:06:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:09.357 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:09.482 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:10.533 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:10.684 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:14.314 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:14.441 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:15.496 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:15.534 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:19.270 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:20.388 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:57.310 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:57.350 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:57.651 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:57.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:06:57.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:57.652 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:58.486 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:06:58.487 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T11:06:58.567 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:58.605 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:58.855 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:06:58.942 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:06:58.943 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:06:58.943 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:06:58.943 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:06:58.943 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:06:58.943 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T11:06:58.943 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:06:58.944 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:06:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:06:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:06:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:06:59.002 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:06:59.003 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:06:59.003 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-14T11:06:59.038 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:06:59.039 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:06:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:06:59.041 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:06:59.041 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:06:59.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:06:59.657 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-14T11:06:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:06:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:06:59.855 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T11:06:59.855 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:06:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:06:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:06:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:06:59.856 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:06:59.856 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T11:07:00.206 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:07:00.287 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:07:00.287 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:07:00.287 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:07:00.287 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:07:00.288 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:07:00.288 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T11:07:00.288 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:07:00.288 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:07:00.347 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:07:00.347 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:07:00.347 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-14T11:07:00.388 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-14T11:07:00.388 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-14T11:07:00.388 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:07:00.389 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:07:00.390 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:07:00.391 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:07:00.391 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:07:00.392 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:07:01.001 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:07:01.031 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-14T11:07:01.034 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-14T11:07:01.036 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-14T11:07:01.052 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.NgmCTu46hT 2024-09-14T11:07:01.053 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NgmCTu46hT 2024-09-14T11:07:01.119 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.NgmCTu46hT 2024-09-14T11:07:01.254 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.NgmCTu46hT is 6KB 2024-09-14T11:07:01.303 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.NgmCTu46hT 2024-09-14T11:07:01.318 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:07:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:07:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:07:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:07:01.385 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:07:01.387 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:07:01.549 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-14T11:07:02.361 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:07:02.401 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-14T11:07:02.403 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T11:07:02.419 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.74O73pqOFd 2024-09-14T11:07:02.419 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.74O73pqOFd 2024-09-14T11:07:02.486 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.74O73pqOFd 2024-09-14T11:07:02.629 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.74O73pqOFd is 6KB 2024-09-14T11:07:02.677 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.74O73pqOFd 2024-09-14T11:07:02.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:07:02.755 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:07:02.755 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:07:02.755 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:07:02.755 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:07:02.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:07:02.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-14T11:07:31.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T11:07:31.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:07:31.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:32.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T11:07:32.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:07:32.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:49.953 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-14T11:07:51.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-14T11:07:58.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:07:58.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:00.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:08:00.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:02.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-14T11:08:03.549 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-14T11:08:14.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:08:14.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:15.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:08:15.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:08:47.670 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T11:08:48.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:08:48.197 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:08:48.197 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T11:08:48.234 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:08:48.234 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:08:48.234 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:08:48.235 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:08:49.235 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:08:49.235 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:08:49.296 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-14T11:08:49.352 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:14.028 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:09:29.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:09:29.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:09:29.424 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-14T11:09:29.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:09:29.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:09:29.759 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-14T11:09:29.778 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:09:29.778 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:09:29.778 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:09:29.778 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:09:30.779 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:09:30.779 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:09:30.844 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-14T11:09:30.874 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:30.874 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:09:30.884 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:09:30.884 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:09:30.887 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:09:30.906 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:09:30.911 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:09:30.921 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:09:30.921 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:09:30.946 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:09:31.030 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:09:31.036 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:09:31.037 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:09:31.039 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:09:31.068 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:09:31.075 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:09:31.079 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:09:31.087 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:09:31.089 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:09:31.097 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:09:31.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:09:31.124 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:09:31.157 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:09:31.166 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:09:31.166 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:09:31.192 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:09:31.214 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:09:31.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:09:31.340 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:09:31.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:09:31.463 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:09:31.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:09:31.527 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:09:31.573 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:09:31.629 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:09:31.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:09:31.758 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:09:31.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:09:31.826 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-14T11:09:31.828 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-14T11:09:31.869 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:09:31.913 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:09:32.351 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:09:32.358 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:09:32.358 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:09:32.371 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:09:32.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-14T11:09:32.449 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-14T11:09:32.451 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-14T11:09:32.496 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-14T11:09:32.498 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:09:32.498 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-14T11:09:32.527 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-14T11:09:32.528 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-14T11:09:32.553 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-14T11:09:32.554 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-09-14T11:09:32.554 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:09:32.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:32.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:09:32.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:32.623 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:09:32.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:09:32.665 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:09:32.703 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:09:32.712 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:09:32.723 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:09:32.724 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:13:15.234 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-14T11:13:15.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:13:15.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:13:15.314 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T11:13:15.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T11:13:15.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:13:15.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:13:15.472 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-14T11:13:15.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T11:13:15.553 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:13:15.563 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:13:15.563 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:13:15.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:13:15.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:13:15.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:13:15.593 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:13:15.607 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:13:15.622 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:13:15.631 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-14T11:13:15.636 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:13:15.642 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-14T11:13:15.656 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:13:15.662 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-14T11:13:15.670 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:13:15.673 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-14T11:13:15.687 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:13:15.701 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:13:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.733 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.758 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.761 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:13:15.762 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:13:15.770 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:13:15.770 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:13:15.770 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:13:15.770 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:13:15.775 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:13:15.775 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:13:15.776 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:13:15.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:13:15.778 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:13:15.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:13:15.922 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:13:15.922 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:13:15.927 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:13:15.927 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:13:16.030 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:13:16.030 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:13:16.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:13:16.037 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:13:16.037 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:13:16.038 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:13:16.056 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:13:16.056 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:13:16.065 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:13:16.065 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:13:16.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:13:16.131 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:13:16.197 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:13:16.206 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:13:16.261 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-14T11:13:16.263 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-14T11:13:16.270 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-14T11:13:16.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-14T11:13:16.490 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-14T11:13:16.499 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-14T11:13:16.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:13:16.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:13:17.076 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-14T11:13:17.093 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-14T11:13:17.368 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T11:13:17.385 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T11:13:17.643 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T11:13:17.661 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T11:13:18.388 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-14T11:13:18.610 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.2 MB 00:00 2024-09-14T11:13:20.361 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-14T11:13:24.638 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-14T11:13:26.047 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-14T11:13:27.168 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-14T11:13:32.649 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:13:35.042 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:13:35.042 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:13:35.133 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================================== 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================================== 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:13:35.164 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:13:35.165 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:13:35.166 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:13:35.167 INFO:teuthology.orchestra.run.smithi116.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:13:35.168 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:13:35.169 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:13:35.170 INFO:teuthology.orchestra.run.smithi116.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:13:35.171 INFO:teuthology.orchestra.run.smithi116.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:13:35.172 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:13:35.173 INFO:teuthology.orchestra.run.smithi116.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:13:35.174 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:13:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:13:35.176 INFO:teuthology.orchestra.run.smithi116.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:13:35.177 INFO:teuthology.orchestra.run.smithi116.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:13:35.178 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:13:35.179 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:13:35.180 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:13:35.181 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:13:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:13:35.183 INFO:teuthology.orchestra.run.smithi116.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:13:35.184 INFO:teuthology.orchestra.run.smithi116.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:13:35.185 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================================== 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:Install 284 Packages 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 327 M 2024-09-14T11:13:35.186 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T11:13:35.717 INFO:teuthology.orchestra.run.smithi116.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-14T11:13:36.192 INFO:teuthology.orchestra.run.smithi116.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.9 MB/s | 900 kB 00:00 2024-09-14T11:13:36.306 INFO:teuthology.orchestra.run.smithi116.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.2 MB/s | 145 kB 00:00 2024-09-14T11:13:36.626 INFO:teuthology.orchestra.run.smithi116.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 4.5 MB/s | 5.5 MB 00:01 2024-09-14T11:13:36.784 INFO:teuthology.orchestra.run.smithi116.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 5.0 MB/s | 2.4 MB 00:00 2024-09-14T11:13:36.817 INFO:teuthology.orchestra.run.smithi116.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 8.0 MB/s | 1.5 MB 00:00 2024-09-14T11:13:37.964 INFO:teuthology.orchestra.run.smithi116.stdout:(7/286): ceph-osd-19.3.0-4907.ga2782315.el9.x86 15 MB/s | 17 MB 00:01 2024-09-14T11:13:38.035 INFO:teuthology.orchestra.run.smithi116.stdout:(8/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 3.8 MB/s | 4.8 MB 00:01 2024-09-14T11:13:38.243 INFO:teuthology.orchestra.run.smithi116.stdout:(9/286): ceph-common-19.3.0-4907.ga2782315.el9. 7.6 MB/s | 22 MB 00:02 2024-09-14T11:13:38.268 INFO:teuthology.orchestra.run.smithi116.stdout:(10/286): ceph-selinux-19.3.0-4907.ga2782315.el 108 kB/s | 25 kB 00:00 2024-09-14T11:13:38.310 INFO:teuthology.orchestra.run.smithi116.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 763 kB/s | 32 kB 00:00 2024-09-14T11:13:38.644 INFO:teuthology.orchestra.run.smithi116.stdout:(12/286): ceph-radosgw-19.3.0-4907.ga2782315.el 16 MB/s | 11 MB 00:00 2024-09-14T11:13:38.669 INFO:teuthology.orchestra.run.smithi116.stdout:(13/286): libcephfs2-19.3.0-4907.ga2782315.el9. 2.1 MB/s | 756 kB 00:00 2024-09-14T11:13:38.693 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-14T11:13:38.695 INFO:teuthology.orchestra.run.smithi116.stdout:(14/286): libcephsqlite-19.3.0-4907.ga2782315.e 3.2 MB/s | 161 kB 00:00 2024-09-14T11:13:38.720 INFO:teuthology.orchestra.run.smithi116.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 2.5 MB/s | 127 kB 00:00 2024-09-14T11:13:38.754 INFO:teuthology.orchestra.run.smithi116.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 8.5 MB/s | 508 kB 00:00 2024-09-14T11:13:38.804 INFO:teuthology.orchestra.run.smithi116.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 905 kB/s | 45 kB 00:00 2024-09-14T11:13:38.862 INFO:teuthology.orchestra.run.smithi116.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.4 MB/s | 143 kB 00:00 2024-09-14T11:13:38.930 INFO:teuthology.orchestra.run.smithi116.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.4 MB/s | 161 kB 00:00 2024-09-14T11:13:39.005 INFO:teuthology.orchestra.run.smithi116.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 4.2 MB/s | 320 kB 00:00 2024-09-14T11:13:39.072 INFO:teuthology.orchestra.run.smithi116.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 4.5 MB/s | 305 kB 00:00 2024-09-14T11:13:39.139 INFO:teuthology.orchestra.run.smithi116.stdout:(22/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.5 MB/s | 99 kB 00:00 2024-09-14T11:13:39.189 INFO:teuthology.orchestra.run.smithi116.stdout:(23/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T11:13:39.348 INFO:teuthology.orchestra.run.smithi116.stdout:(24/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 20 MB/s | 3.2 MB 00:00 2024-09-14T11:13:39.431 INFO:teuthology.orchestra.run.smithi116.stdout:(25/286): librgw2-19.3.0-4907.ga2782315.el9.x86 7.8 MB/s | 5.5 MB 00:00 2024-09-14T11:13:39.457 INFO:teuthology.orchestra.run.smithi116.stdout:(26/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 1.5 MB/s | 171 kB 00:00 2024-09-14T11:13:39.482 INFO:teuthology.orchestra.run.smithi116.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 682 kB/s | 34 kB 00:00 2024-09-14T11:13:39.507 INFO:teuthology.orchestra.run.smithi116.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 3.0 MB/s | 154 kB 00:00 2024-09-14T11:13:39.816 INFO:teuthology.orchestra.run.smithi116.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 24 MB/s | 7.4 MB 00:00 2024-09-14T11:13:39.901 INFO:teuthology.orchestra.run.smithi116.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 3.4 MB/s | 291 kB 00:00 2024-09-14T11:13:39.950 INFO:teuthology.orchestra.run.smithi116.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 1.0 MB/s | 49 kB 00:00 2024-09-14T11:13:40.000 INFO:teuthology.orchestra.run.smithi116.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 330 kB/s | 16 kB 00:00 2024-09-14T11:13:40.059 INFO:teuthology.orchestra.run.smithi116.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 4.8 MB/s | 285 kB 00:00 2024-09-14T11:13:40.134 INFO:teuthology.orchestra.run.smithi116.stdout:(34/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T11:13:40.393 INFO:teuthology.orchestra.run.smithi116.stdout:(35/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.3 MB/s | 335 kB 00:00 2024-09-14T11:13:40.451 INFO:teuthology.orchestra.run.smithi116.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 1.4 MB/s | 85 kB 00:00 2024-09-14T11:13:40.810 INFO:teuthology.orchestra.run.smithi116.stdout:(37/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 11 MB/s | 14 MB 00:01 2024-09-14T11:13:40.835 INFO:teuthology.orchestra.run.smithi116.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2024-09-14T11:13:40.936 INFO:teuthology.orchestra.run.smithi116.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 799 kB/s | 80 kB 00:00 2024-09-14T11:13:41.420 INFO:teuthology.orchestra.run.smithi116.stdout:(40/286): ceph-test-19.3.0-4907.ga2782315.el9.x 16 MB/s | 50 MB 00:03 2024-09-14T11:13:41.445 INFO:teuthology.orchestra.run.smithi116.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 413 kB/s | 262 kB 00:00 2024-09-14T11:13:41.487 INFO:teuthology.orchestra.run.smithi116.stdout:(42/286): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-14T11:13:41.529 INFO:teuthology.orchestra.run.smithi116.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-14T11:13:41.554 INFO:teuthology.orchestra.run.smithi116.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-09-14T11:13:41.587 INFO:teuthology.orchestra.run.smithi116.stdout:(45/286): libpciaccess-0.16-7.el9.x86_64.rpm 161 kB/s | 27 kB 00:00 2024-09-14T11:13:41.621 INFO:teuthology.orchestra.run.smithi116.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-14T11:13:41.663 INFO:teuthology.orchestra.run.smithi116.stdout:(47/286): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-14T11:13:41.696 INFO:teuthology.orchestra.run.smithi116.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-14T11:13:41.722 INFO:teuthology.orchestra.run.smithi116.stdout:(49/286): python3-ply-3.11-14.el9.noarch.rpm 794 kB/s | 106 kB 00:00 2024-09-14T11:13:41.747 INFO:teuthology.orchestra.run.smithi116.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-14T11:13:41.772 INFO:teuthology.orchestra.run.smithi116.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-14T11:13:42.598 INFO:teuthology.orchestra.run.smithi116.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 743 kB/s | 650 kB 00:00 2024-09-14T11:13:42.623 INFO:teuthology.orchestra.run.smithi116.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 616 kB/s | 523 kB 00:00 2024-09-14T11:13:43.048 INFO:teuthology.orchestra.run.smithi116.stdout:(54/286): adwaita-icon-theme-40.1.1-3.el9.noarc 9.2 MB/s | 12 MB 00:01 2024-09-14T11:13:43.340 INFO:teuthology.orchestra.run.smithi116.stdout:(55/286): apache-commons-cli-1.4-17.el9.noarch. 96 kB/s | 71 kB 00:00 2024-09-14T11:13:43.523 INFO:teuthology.orchestra.run.smithi116.stdout:(56/286): apache-commons-codec-1.15-7.el9.noarc 335 kB/s | 302 kB 00:00 2024-09-14T11:13:43.849 INFO:teuthology.orchestra.run.smithi116.stdout:(57/286): apache-commons-io-2.8.0-8.el9.noarch. 354 kB/s | 283 kB 00:00 2024-09-14T11:13:44.216 INFO:teuthology.orchestra.run.smithi116.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 639 kB/s | 559 kB 00:00 2024-09-14T11:13:44.241 INFO:teuthology.orchestra.run.smithi116.stdout:(59/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 121 kB/s | 87 kB 00:00 2024-09-14T11:13:44.608 INFO:teuthology.orchestra.run.smithi116.stdout:(60/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 257 kB/s | 195 kB 00:00 2024-09-14T11:13:44.750 INFO:teuthology.orchestra.run.smithi116.stdout:(61/286): atinject-1.0.3-6.el9.noarch.rpm 44 kB/s | 23 kB 00:00 2024-09-14T11:13:44.928 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-14T11:13:45.083 INFO:teuthology.orchestra.run.smithi116.stdout:(62/286): atk-2.36.0-5.el9.x86_64.rpm 346 kB/s | 292 kB 00:00 2024-09-14T11:13:45.108 INFO:teuthology.orchestra.run.smithi116.stdout:(63/286): avahi-glib-0.8-21.el9.x86_64.rpm 30 kB/s | 15 kB 00:00 2024-09-14T11:13:45.409 INFO:teuthology.orchestra.run.smithi116.stdout:(64/286): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-09-14T11:13:45.684 INFO:teuthology.orchestra.run.smithi116.stdout:(65/286): cdi-api-2.0.2-6.el9.noarch.rpm 89 kB/s | 53 kB 00:00 2024-09-14T11:13:45.868 INFO:teuthology.orchestra.run.smithi116.stdout:(66/286): colord-libs-1.4.5-4.el9.x86_64.rpm 302 kB/s | 229 kB 00:00 2024-09-14T11:13:46.043 INFO:teuthology.orchestra.run.smithi116.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 96 kB/s | 61 kB 00:00 2024-09-14T11:13:46.285 INFO:teuthology.orchestra.run.smithi116.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 47 kB/s | 28 kB 00:00 2024-09-14T11:13:46.535 INFO:teuthology.orchestra.run.smithi116.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 169 kB/s | 113 kB 00:00 2024-09-14T11:13:46.845 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-14T11:13:46.919 INFO:teuthology.orchestra.run.smithi116.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 599 kB/s | 525 kB 00:00 2024-09-14T11:13:47.194 INFO:teuthology.orchestra.run.smithi116.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 1.1 MB/s | 980 kB 00:00 2024-09-14T11:13:47.444 INFO:teuthology.orchestra.run.smithi116.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 860 kB/s | 781 kB 00:00 2024-09-14T11:13:47.599 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-14T11:13:47.728 INFO:teuthology.orchestra.run.smithi116.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 402 kB/s | 325 kB 00:00 2024-09-14T11:13:47.945 INFO:teuthology.orchestra.run.smithi116.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 291 kB/s | 218 kB 00:00 2024-09-14T11:13:48.262 INFO:teuthology.orchestra.run.smithi116.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 40 kB/s | 22 kB 00:00 2024-09-14T11:13:48.454 INFO:teuthology.orchestra.run.smithi116.stdout:(76/286): flatpak-1.12.9-1.el9.x86_64.rpm 1.7 MB/s | 1.7 MB 00:01 2024-09-14T11:13:48.654 INFO:teuthology.orchestra.run.smithi116.stdout:(77/286): flatpak-session-helper-1.12.9-1.el9.x 104 kB/s | 73 kB 00:00 2024-09-14T11:13:48.812 INFO:teuthology.orchestra.run.smithi116.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-14T11:13:49.154 INFO:teuthology.orchestra.run.smithi116.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-14T11:13:49.496 INFO:teuthology.orchestra.run.smithi116.stdout:(80/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-14T11:13:49.538 INFO:teuthology.orchestra.run.smithi116.stdout:(81/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 123 kB/s | 89 kB 00:00 2024-09-14T11:13:49.897 INFO:teuthology.orchestra.run.smithi116.stdout:(82/286): geoclue2-2.6.0-7.el9.x86_64.rpm 168 kB/s | 124 kB 00:00 2024-09-14T11:13:50.072 INFO:teuthology.orchestra.run.smithi116.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 84 kB/s | 49 kB 00:00 2024-09-14T11:13:50.439 INFO:teuthology.orchestra.run.smithi116.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 526 kB/s | 473 kB 00:00 2024-09-14T11:13:50.514 INFO:teuthology.orchestra.run.smithi116.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 104 kB/s | 64 kB 00:00 2024-09-14T11:13:50.631 INFO:teuthology.orchestra.run.smithi116.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 61 kB/s | 34 kB 00:00 2024-09-14T11:13:51.181 INFO:teuthology.orchestra.run.smithi116.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 60 kB/s | 33 kB 00:00 2024-09-14T11:13:51.490 INFO:teuthology.orchestra.run.smithi116.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:01 2024-09-14T11:13:51.532 INFO:teuthology.orchestra.run.smithi116.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 2.2 MB/s | 2.2 MB 00:01 2024-09-14T11:13:52.290 INFO:teuthology.orchestra.run.smithi116.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 289 kB/s | 219 kB 00:00 2024-09-14T11:13:52.441 INFO:teuthology.orchestra.run.smithi116.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 3.9 MB/s | 4.9 MB 00:01 2024-09-14T11:13:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 2.2 MB/s | 2.3 MB 00:01 2024-09-14T11:13:52.980 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:13:53.183 INFO:teuthology.orchestra.run.smithi116.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 737 kB/s | 657 kB 00:00 2024-09-14T11:13:53.333 INFO:teuthology.orchestra.run.smithi116.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 709 kB/s | 632 kB 00:00 2024-09-14T11:13:53.633 INFO:teuthology.orchestra.run.smithi116.stdout:(95/286): iso-codes-4.6.0-3.el9.noarch.rpm 3.2 MB/s | 3.5 MB 00:01 2024-09-14T11:13:53.867 INFO:teuthology.orchestra.run.smithi116.stdout:(96/286): jakarta-annotations-1.3.5-13.el9.noar 66 kB/s | 45 kB 00:00 2024-09-14T11:13:54.017 INFO:teuthology.orchestra.run.smithi116.stdout:(97/286): jansi-2.3.3-6.el9.x86_64.rpm 160 kB/s | 110 kB 00:00 2024-09-14T11:13:54.526 INFO:teuthology.orchestra.run.smithi116.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 463 kB/s | 413 kB 00:00 2024-09-14T11:13:54.935 INFO:teuthology.orchestra.run.smithi116.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 3.1 MB/s | 3.3 MB 00:01 2024-09-14T11:13:55.043 INFO:teuthology.orchestra.run.smithi116.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 25 kB/s | 13 kB 00:00 2024-09-14T11:13:55.393 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:13:55.394 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:13:55.488 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T11:13:55.510 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================== 2024-09-14T11:13:55.510 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T11:13:55.510 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================== 2024-09-14T11:13:55.510 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:13:55.511 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:13:55.512 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:13:55.513 INFO:teuthology.orchestra.run.smithi164.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:13:55.514 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:13:55.515 INFO:teuthology.orchestra.run.smithi164.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:13:55.516 INFO:teuthology.orchestra.run.smithi164.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:13:55.517 INFO:teuthology.orchestra.run.smithi164.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:13:55.518 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:13:55.519 INFO:teuthology.orchestra.run.smithi164.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:13:55.520 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:13:55.521 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:13:55.522 INFO:teuthology.orchestra.run.smithi164.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:13:55.523 INFO:teuthology.orchestra.run.smithi164.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:13:55.524 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:13:55.525 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:13:55.526 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:13:55.527 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:13:55.528 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:13:55.529 INFO:teuthology.orchestra.run.smithi164.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-14T11:13:55.530 INFO:teuthology.orchestra.run.smithi164.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:13:55.531 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:====================================================================================================== 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:Install 284 Packages 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 327 M 2024-09-14T11:13:55.532 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T11:13:55.535 INFO:teuthology.orchestra.run.smithi116.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 88 kB/s | 53 kB 00:00 2024-09-14T11:13:55.568 INFO:teuthology.orchestra.run.smithi116.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 46 kB/s | 24 kB 00:00 2024-09-14T11:13:56.102 INFO:teuthology.orchestra.run.smithi116.stdout:(103/286): java-11-openjdk-headless-11.0.20.1.1 19 MB/s | 39 MB 00:02 2024-09-14T11:13:56.148 INFO:teuthology.orchestra.run.smithi164.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-14T11:13:56.382 INFO:teuthology.orchestra.run.smithi164.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-14T11:13:56.490 INFO:teuthology.orchestra.run.smithi164.stdout:(3/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-14T11:13:56.494 INFO:teuthology.orchestra.run.smithi116.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 38 kB/s | 35 kB 00:00 2024-09-14T11:13:56.516 INFO:teuthology.orchestra.run.smithi164.stdout:(4/286): ceph-immutable-object-cache-19.3.0-490 1.1 MB/s | 145 kB 00:00 2024-09-14T11:13:56.627 INFO:teuthology.orchestra.run.smithi116.stdout:(105/286): jsoup-1.13.1-10.el9.noarch.rpm 345 kB/s | 377 kB 00:01 2024-09-14T11:13:56.650 INFO:teuthology.orchestra.run.smithi164.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 15 MB/s | 2.4 MB 00:00 2024-09-14T11:13:56.758 INFO:teuthology.orchestra.run.smithi164.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-14T11:13:56.894 INFO:teuthology.orchestra.run.smithi116.stdout:(106/286): lcms2-2.12-3.el9.x86_64.rpm 214 kB/s | 168 kB 00:00 2024-09-14T11:13:56.942 INFO:teuthology.orchestra.run.smithi164.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-14T11:13:56.953 INFO:teuthology.orchestra.run.smithi116.stdout:(107/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 24 kB/s | 11 kB 00:00 2024-09-14T11:13:57.167 INFO:teuthology.orchestra.run.smithi164.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 19 MB/s | 22 MB 00:01 2024-09-14T11:13:57.200 INFO:teuthology.orchestra.run.smithi164.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 760 kB/s | 25 kB 00:00 2024-09-14T11:13:57.253 INFO:teuthology.orchestra.run.smithi116.stdout:(108/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 39 kB/s | 24 kB 00:00 2024-09-14T11:13:57.470 INFO:teuthology.orchestra.run.smithi116.stdout:(109/286): libXcursor-1.2.0-7.el9.x86_64.rpm 54 kB/s | 31 kB 00:00 2024-09-14T11:13:57.495 INFO:teuthology.orchestra.run.smithi116.stdout:(110/286): libXdamage-1.1.5-7.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-14T11:13:57.618 INFO:teuthology.orchestra.run.smithi164.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 16 MB/s | 11 MB 00:00 2024-09-14T11:13:57.659 INFO:teuthology.orchestra.run.smithi164.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 770 kB/s | 32 kB 00:00 2024-09-14T11:13:57.735 INFO:teuthology.orchestra.run.smithi164.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 9.8 MB/s | 756 kB 00:00 2024-09-14T11:13:57.737 INFO:teuthology.orchestra.run.smithi116.stdout:(111/286): libXfixes-5.0.3-16.el9.x86_64.rpm 41 kB/s | 20 kB 00:00 2024-09-14T11:13:57.802 INFO:teuthology.orchestra.run.smithi164.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.4 MB/s | 161 kB 00:00 2024-09-14T11:13:57.868 INFO:teuthology.orchestra.run.smithi164.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.9 MB/s | 127 kB 00:00 2024-09-14T11:13:57.944 INFO:teuthology.orchestra.run.smithi164.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 6.6 MB/s | 508 kB 00:00 2024-09-14T11:13:57.963 INFO:teuthology.orchestra.run.smithi116.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 32 kB/s | 15 kB 00:00 2024-09-14T11:13:58.038 INFO:teuthology.orchestra.run.smithi116.stdout:(113/286): libXi-1.7.10-8.el9.x86_64.rpm 71 kB/s | 40 kB 00:00 2024-09-14T11:13:58.144 INFO:teuthology.orchestra.run.smithi164.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 17 MB 00:01 2024-09-14T11:13:58.178 INFO:teuthology.orchestra.run.smithi164.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 1.3 MB/s | 45 kB 00:00 2024-09-14T11:13:58.236 INFO:teuthology.orchestra.run.smithi164.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.4 MB/s | 143 kB 00:00 2024-09-14T11:13:58.303 INFO:teuthology.orchestra.run.smithi164.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.4 MB/s | 161 kB 00:00 2024-09-14T11:13:58.305 INFO:teuthology.orchestra.run.smithi116.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 50 kB/s | 28 kB 00:00 2024-09-14T11:13:58.387 INFO:teuthology.orchestra.run.smithi164.stdout:(20/286): librgw2-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-14T11:13:58.412 INFO:teuthology.orchestra.run.smithi164.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 2.9 MB/s | 320 kB 00:00 2024-09-14T11:13:58.446 INFO:teuthology.orchestra.run.smithi164.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.1 MB/s | 305 kB 00:00 2024-09-14T11:13:58.471 INFO:teuthology.orchestra.run.smithi164.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.7 MB/s | 99 kB 00:00 2024-09-14T11:13:58.497 INFO:teuthology.orchestra.run.smithi164.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T11:13:58.497 INFO:teuthology.orchestra.run.smithi116.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 40 kB/s | 21 kB 00:00 2024-09-14T11:13:58.547 INFO:teuthology.orchestra.run.smithi164.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-14T11:13:58.563 INFO:teuthology.orchestra.run.smithi116.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 36 kB/s | 19 kB 00:00 2024-09-14T11:13:58.614 INFO:teuthology.orchestra.run.smithi164.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 516 kB/s | 34 kB 00:00 2024-09-14T11:13:58.724 INFO:teuthology.orchestra.run.smithi164.stdout:(27/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 13 MB/s | 3.2 MB 00:00 2024-09-14T11:13:58.756 INFO:teuthology.orchestra.run.smithi164.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.1 MB/s | 154 kB 00:00 2024-09-14T11:13:58.805 INFO:teuthology.orchestra.run.smithi116.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 38 kB/s | 19 kB 00:00 2024-09-14T11:13:59.064 INFO:teuthology.orchestra.run.smithi116.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 54 kB/s | 30 kB 00:00 2024-09-14T11:13:59.198 INFO:teuthology.orchestra.run.smithi116.stdout:(119/286): libcanberra-0.30-27.el9.x86_64.rpm 136 kB/s | 86 kB 00:00 2024-09-14T11:13:59.381 INFO:teuthology.orchestra.run.smithi116.stdout:(120/286): libcanberra-gtk3-0.30-27.el9.x86_64. 55 kB/s | 32 kB 00:00 2024-09-14T11:13:59.598 INFO:teuthology.orchestra.run.smithi164.stdout:(29/286): ceph-test-19.3.0-4907.ga2782315.el9.x 21 MB/s | 50 MB 00:02 2024-09-14T11:13:59.690 INFO:teuthology.orchestra.run.smithi164.stdout:(30/286): ceph-mgr-diskprediction-local-19.3.0- 7.9 MB/s | 7.4 MB 00:00 2024-09-14T11:13:59.716 INFO:teuthology.orchestra.run.smithi164.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.4 MB/s | 291 kB 00:00 2024-09-14T11:13:59.741 INFO:teuthology.orchestra.run.smithi164.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 981 kB/s | 49 kB 00:00 2024-09-14T11:13:59.766 INFO:teuthology.orchestra.run.smithi164.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 327 kB/s | 16 kB 00:00 2024-09-14T11:13:59.773 INFO:teuthology.orchestra.run.smithi116.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 227 kB/s | 161 kB 00:00 2024-09-14T11:13:59.817 INFO:teuthology.orchestra.run.smithi164.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 3.7 MB/s | 285 kB 00:00 2024-09-14T11:13:59.850 INFO:teuthology.orchestra.run.smithi164.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-14T11:14:00.015 INFO:teuthology.orchestra.run.smithi116.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 296 kB/s | 241 kB 00:00 2024-09-14T11:14:00.059 INFO:teuthology.orchestra.run.smithi164.stdout:(36/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 11 MB/s | 14 MB 00:01 2024-09-14T11:14:00.190 INFO:teuthology.orchestra.run.smithi116.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 539 kB/s | 435 kB 00:00 2024-09-14T11:14:00.351 INFO:teuthology.orchestra.run.smithi164.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 169 kB/s | 85 kB 00:00 2024-09-14T11:14:00.399 INFO:teuthology.orchestra.run.smithi116.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 50 kB/s | 31 kB 00:00 2024-09-14T11:14:00.443 INFO:teuthology.orchestra.run.smithi164.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2024-09-14T11:14:00.476 INFO:teuthology.orchestra.run.smithi164.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 508 kB/s | 335 kB 00:00 2024-09-14T11:14:00.651 INFO:teuthology.orchestra.run.smithi164.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 383 kB/s | 80 kB 00:00 2024-09-14T11:14:00.674 INFO:teuthology.orchestra.run.smithi116.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 127 kB/s | 83 kB 00:00 2024-09-14T11:14:00.685 INFO:teuthology.orchestra.run.smithi164.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 784 kB/s | 262 kB 00:00 2024-09-14T11:14:00.760 INFO:teuthology.orchestra.run.smithi164.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 248 kB/s | 27 kB 00:00 2024-09-14T11:14:00.810 INFO:teuthology.orchestra.run.smithi164.stdout:(43/286): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-14T11:14:00.836 INFO:teuthology.orchestra.run.smithi164.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-14T11:14:00.870 INFO:teuthology.orchestra.run.smithi164.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 863 kB/s | 94 kB 00:00 2024-09-14T11:14:00.928 INFO:teuthology.orchestra.run.smithi164.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-14T11:14:00.958 INFO:teuthology.orchestra.run.smithi116.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 177 kB/s | 135 kB 00:00 2024-09-14T11:14:00.983 INFO:teuthology.orchestra.run.smithi116.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 63 kB/s | 37 kB 00:00 2024-09-14T11:14:00.987 INFO:teuthology.orchestra.run.smithi164.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-14T11:14:01.045 INFO:teuthology.orchestra.run.smithi164.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-14T11:14:01.104 INFO:teuthology.orchestra.run.smithi164.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-14T11:14:01.163 INFO:teuthology.orchestra.run.smithi164.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-14T11:14:01.230 INFO:teuthology.orchestra.run.smithi164.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-14T11:14:01.280 INFO:teuthology.orchestra.run.smithi164.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.6 MB/s | 650 kB 00:00 2024-09-14T11:14:01.322 INFO:teuthology.orchestra.run.smithi164.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.7 MB/s | 71 kB 00:00 2024-09-14T11:14:01.364 INFO:teuthology.orchestra.run.smithi164.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 7.1 MB/s | 302 kB 00:00 2024-09-14T11:14:01.397 INFO:teuthology.orchestra.run.smithi164.stdout:(55/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 3.1 MB/s | 523 kB 00:00 2024-09-14T11:14:01.423 INFO:teuthology.orchestra.run.smithi164.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-14T11:14:01.433 INFO:teuthology.orchestra.run.smithi116.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 188 kB/s | 142 kB 00:00 2024-09-14T11:14:01.456 INFO:teuthology.orchestra.run.smithi164.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 9.4 MB/s | 559 kB 00:00 2024-09-14T11:14:01.481 INFO:teuthology.orchestra.run.smithi164.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-14T11:14:01.515 INFO:teuthology.orchestra.run.smithi164.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.2 MB/s | 195 kB 00:00 2024-09-14T11:14:01.541 INFO:teuthology.orchestra.run.smithi164.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 395 kB/s | 23 kB 00:00 2024-09-14T11:14:01.566 INFO:teuthology.orchestra.run.smithi164.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:14:01.583 INFO:teuthology.orchestra.run.smithi164.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 356 kB/s | 15 kB 00:00 2024-09-14T11:14:01.608 INFO:teuthology.orchestra.run.smithi164.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-14T11:14:01.625 INFO:teuthology.orchestra.run.smithi164.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.2 MB/s | 53 kB 00:00 2024-09-14T11:14:01.642 INFO:teuthology.orchestra.run.smithi116.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 120 kB/s | 79 kB 00:00 2024-09-14T11:14:01.659 INFO:teuthology.orchestra.run.smithi164.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-14T11:14:01.676 INFO:teuthology.orchestra.run.smithi164.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:14:01.693 INFO:teuthology.orchestra.run.smithi164.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 846 kB/s | 28 kB 00:00 2024-09-14T11:14:01.718 INFO:teuthology.orchestra.run.smithi164.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 2.6 MB/s | 113 kB 00:00 2024-09-14T11:14:01.750 INFO:teuthology.orchestra.run.smithi116.stdout:(130/286): libgsf-1.14.47-5.el9.x86_64.rpm 334 kB/s | 256 kB 00:00 2024-09-14T11:14:01.752 INFO:teuthology.orchestra.run.smithi164.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 8.7 MB/s | 525 kB 00:00 2024-09-14T11:14:01.785 INFO:teuthology.orchestra.run.smithi164.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 14 MB/s | 980 kB 00:00 2024-09-14T11:14:01.827 INFO:teuthology.orchestra.run.smithi164.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-14T11:14:01.861 INFO:teuthology.orchestra.run.smithi164.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.2 MB/s | 325 kB 00:00 2024-09-14T11:14:01.886 INFO:teuthology.orchestra.run.smithi164.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-09-14T11:14:01.945 INFO:teuthology.orchestra.run.smithi164.stdout:(74/286): flatpak-1.12.9-1.el9.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-09-14T11:14:01.962 INFO:teuthology.orchestra.run.smithi164.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 287 kB/s | 22 kB 00:00 2024-09-14T11:14:01.987 INFO:teuthology.orchestra.run.smithi164.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.7 MB/s | 73 kB 00:00 2024-09-14T11:14:02.004 INFO:teuthology.orchestra.run.smithi164.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 779 kB/s | 33 kB 00:00 2024-09-14T11:14:02.076 INFO:teuthology.orchestra.run.smithi116.stdout:(131/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 95 kB/s | 61 kB 00:00 2024-09-14T11:14:02.130 INFO:teuthology.orchestra.run.smithi164.stdout:(78/286): adwaita-icon-theme-40.1.1-3.el9.noarc 12 MB/s | 12 MB 00:00 2024-09-14T11:14:02.147 INFO:teuthology.orchestra.run.smithi164.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 128 kB/s | 18 kB 00:00 2024-09-14T11:14:02.172 INFO:teuthology.orchestra.run.smithi164.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 2.1 MB/s | 89 kB 00:00 2024-09-14T11:14:02.197 INFO:teuthology.orchestra.run.smithi164.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-14T11:14:02.201 INFO:teuthology.orchestra.run.smithi116.stdout:(132/286): libldac-2.0.2.3-10.el9.x86_64.rpm 74 kB/s | 41 kB 00:00 2024-09-14T11:14:02.223 INFO:teuthology.orchestra.run.smithi164.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-09-14T11:14:02.256 INFO:teuthology.orchestra.run.smithi164.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 7.9 MB/s | 473 kB 00:00 2024-09-14T11:14:02.281 INFO:teuthology.orchestra.run.smithi164.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:14:02.306 INFO:teuthology.orchestra.run.smithi164.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 681 kB/s | 34 kB 00:00 2024-09-14T11:14:02.348 INFO:teuthology.orchestra.run.smithi164.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 21 MB/s | 1.4 MB 00:00 2024-09-14T11:14:02.399 INFO:teuthology.orchestra.run.smithi164.stdout:(87/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-14T11:14:02.424 INFO:teuthology.orchestra.run.smithi164.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 438 kB/s | 33 kB 00:00 2024-09-14T11:14:02.474 INFO:teuthology.orchestra.run.smithi164.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 13 MB/s | 2.2 MB 00:00 2024-09-14T11:14:02.533 INFO:teuthology.orchestra.run.smithi164.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 21 MB/s | 2.3 MB 00:00 2024-09-14T11:14:02.558 INFO:teuthology.orchestra.run.smithi164.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.6 MB/s | 219 kB 00:00 2024-09-14T11:14:02.593 INFO:teuthology.orchestra.run.smithi116.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 203 kB/s | 171 kB 00:00 2024-09-14T11:14:02.625 INFO:teuthology.orchestra.run.smithi164.stdout:(92/286): gtk3-3.24.31-5.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-14T11:14:02.643 INFO:teuthology.orchestra.run.smithi116.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 77 kB/s | 44 kB 00:00 2024-09-14T11:14:02.684 INFO:teuthology.orchestra.run.smithi164.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-14T11:14:02.709 INFO:teuthology.orchestra.run.smithi164.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.1 MB/s | 632 kB 00:00 2024-09-14T11:14:02.735 INFO:teuthology.orchestra.run.smithi164.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 897 kB/s | 45 kB 00:00 2024-09-14T11:14:02.760 INFO:teuthology.orchestra.run.smithi164.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T11:14:02.787 INFO:teuthology.orchestra.run.smithi164.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.0 MB/s | 413 kB 00:00 2024-09-14T11:14:02.788 INFO:teuthology.orchestra.run.smithi116.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 57 kB/s | 34 kB 00:00 2024-09-14T11:14:02.852 INFO:teuthology.orchestra.run.smithi164.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 16 MB/s | 3.5 MB 00:00 2024-09-14T11:14:02.911 INFO:teuthology.orchestra.run.smithi164.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 22 MB/s | 3.3 MB 00:00 2024-09-14T11:14:02.928 INFO:teuthology.orchestra.run.smithi164.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 173 kB/s | 13 kB 00:00 2024-09-14T11:14:02.945 INFO:teuthology.orchestra.run.smithi164.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.6 MB/s | 53 kB 00:00 2024-09-14T11:14:02.962 INFO:teuthology.orchestra.run.smithi164.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 717 kB/s | 24 kB 00:00 2024-09-14T11:14:02.987 INFO:teuthology.orchestra.run.smithi164.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 8.8 MB/s | 377 kB 00:00 2024-09-14T11:14:03.004 INFO:teuthology.orchestra.run.smithi164.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 850 kB/s | 35 kB 00:00 2024-09-14T11:14:03.029 INFO:teuthology.orchestra.run.smithi164.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 3.9 MB/s | 168 kB 00:00 2024-09-14T11:14:03.046 INFO:teuthology.orchestra.run.smithi164.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 265 kB/s | 11 kB 00:00 2024-09-14T11:14:03.063 INFO:teuthology.orchestra.run.smithi164.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 722 kB/s | 24 kB 00:00 2024-09-14T11:14:03.080 INFO:teuthology.orchestra.run.smithi164.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 917 kB/s | 31 kB 00:00 2024-09-14T11:14:03.097 INFO:teuthology.orchestra.run.smithi164.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 679 kB/s | 23 kB 00:00 2024-09-14T11:14:03.114 INFO:teuthology.orchestra.run.smithi164.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 591 kB/s | 20 kB 00:00 2024-09-14T11:14:03.131 INFO:teuthology.orchestra.run.smithi164.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 1.2 MB/s | 40 kB 00:00 2024-09-14T11:14:03.148 INFO:teuthology.orchestra.run.smithi164.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 448 kB/s | 15 kB 00:00 2024-09-14T11:14:03.165 INFO:teuthology.orchestra.run.smithi164.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 848 kB/s | 28 kB 00:00 2024-09-14T11:14:03.182 INFO:teuthology.orchestra.run.smithi164.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 642 kB/s | 21 kB 00:00 2024-09-14T11:14:03.207 INFO:teuthology.orchestra.run.smithi164.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 456 kB/s | 19 kB 00:00 2024-09-14T11:14:03.224 INFO:teuthology.orchestra.run.smithi164.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 446 kB/s | 19 kB 00:00 2024-09-14T11:14:03.241 INFO:teuthology.orchestra.run.smithi164.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 906 kB/s | 30 kB 00:00 2024-09-14T11:14:03.266 INFO:teuthology.orchestra.run.smithi164.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2024-09-14T11:14:03.283 INFO:teuthology.orchestra.run.smithi164.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 758 kB/s | 32 kB 00:00 2024-09-14T11:14:03.360 INFO:teuthology.orchestra.run.smithi116.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2024-09-14T11:14:03.372 INFO:teuthology.orchestra.run.smithi164.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2024-09-14T11:14:03.385 INFO:teuthology.orchestra.run.smithi116.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-14T11:14:03.426 INFO:teuthology.orchestra.run.smithi164.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-09-14T11:14:03.427 INFO:teuthology.orchestra.run.smithi116.stdout:(138/286): libosinfo-1.10.0-1.el9.x86_64.rpm 382 kB/s | 319 kB 00:00 2024-09-14T11:14:03.451 INFO:teuthology.orchestra.run.smithi164.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 5.4 MB/s | 435 kB 00:00 2024-09-14T11:14:03.476 INFO:teuthology.orchestra.run.smithi164.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 616 kB/s | 31 kB 00:00 2024-09-14T11:14:03.510 INFO:teuthology.orchestra.run.smithi164.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-14T11:14:03.535 INFO:teuthology.orchestra.run.smithi164.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-14T11:14:03.561 INFO:teuthology.orchestra.run.smithi164.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 732 kB/s | 37 kB 00:00 2024-09-14T11:14:03.586 INFO:teuthology.orchestra.run.smithi164.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T11:14:03.611 INFO:teuthology.orchestra.run.smithi164.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T11:14:03.637 INFO:teuthology.orchestra.run.smithi164.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T11:14:03.662 INFO:teuthology.orchestra.run.smithi164.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:14:03.687 INFO:teuthology.orchestra.run.smithi164.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 826 kB/s | 41 kB 00:00 2024-09-14T11:14:03.721 INFO:teuthology.orchestra.run.smithi164.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-14T11:14:03.746 INFO:teuthology.orchestra.run.smithi164.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 745 kB/s | 44 kB 00:00 2024-09-14T11:14:03.771 INFO:teuthology.orchestra.run.smithi164.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 670 kB/s | 34 kB 00:00 2024-09-14T11:14:03.805 INFO:teuthology.orchestra.run.smithi164.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-14T11:14:03.830 INFO:teuthology.orchestra.run.smithi164.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-14T11:14:03.864 INFO:teuthology.orchestra.run.smithi164.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-14T11:14:03.906 INFO:teuthology.orchestra.run.smithi164.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-14T11:14:03.931 INFO:teuthology.orchestra.run.smithi164.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-14T11:14:03.957 INFO:teuthology.orchestra.run.smithi164.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:14:03.982 INFO:teuthology.orchestra.run.smithi164.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-14T11:14:04.007 INFO:teuthology.orchestra.run.smithi164.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-14T11:14:04.036 INFO:teuthology.orchestra.run.smithi116.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-09-14T11:14:04.041 INFO:teuthology.orchestra.run.smithi164.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 605 kB/s | 36 kB 00:00 2024-09-14T11:14:04.067 INFO:teuthology.orchestra.run.smithi164.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-14T11:14:04.092 INFO:teuthology.orchestra.run.smithi164.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-14T11:14:04.117 INFO:teuthology.orchestra.run.smithi164.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-14T11:14:04.142 INFO:teuthology.orchestra.run.smithi164.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 665 kB/s | 33 kB 00:00 2024-09-14T11:14:04.168 INFO:teuthology.orchestra.run.smithi164.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 386 kB/s | 19 kB 00:00 2024-09-14T11:14:04.170 INFO:teuthology.orchestra.run.smithi116.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 278 kB/s | 206 kB 00:00 2024-09-14T11:14:04.193 INFO:teuthology.orchestra.run.smithi164.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-14T11:14:04.218 INFO:teuthology.orchestra.run.smithi164.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 832 kB/s | 42 kB 00:00 2024-09-14T11:14:04.228 INFO:teuthology.orchestra.run.smithi116.stdout:(141/286): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-09-14T11:14:04.246 INFO:teuthology.orchestra.run.smithi164.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.2 MB/s | 277 kB 00:00 2024-09-14T11:14:04.271 INFO:teuthology.orchestra.run.smithi164.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.5 MB/s | 133 kB 00:00 2024-09-14T11:14:04.297 INFO:teuthology.orchestra.run.smithi164.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 250 kB/s | 13 kB 00:00 2024-09-14T11:14:04.322 INFO:teuthology.orchestra.run.smithi164.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 717 kB/s | 36 kB 00:00 2024-09-14T11:14:04.347 INFO:teuthology.orchestra.run.smithi164.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:14:04.373 INFO:teuthology.orchestra.run.smithi164.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-14T11:14:04.406 INFO:teuthology.orchestra.run.smithi164.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-14T11:14:04.431 INFO:teuthology.orchestra.run.smithi164.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 303 kB/s | 18 kB 00:00 2024-09-14T11:14:04.473 INFO:teuthology.orchestra.run.smithi164.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-14T11:14:04.499 INFO:teuthology.orchestra.run.smithi164.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-14T11:14:04.524 INFO:teuthology.orchestra.run.smithi164.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 10 MB/s | 517 kB 00:00 2024-09-14T11:14:04.549 INFO:teuthology.orchestra.run.smithi164.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.9 MB/s | 151 kB 00:00 2024-09-14T11:14:04.575 INFO:teuthology.orchestra.run.smithi164.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T11:14:04.617 INFO:teuthology.orchestra.run.smithi164.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 271 kB/s | 11 kB 00:00 2024-09-14T11:14:04.659 INFO:teuthology.orchestra.run.smithi164.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 139 kB 00:00 2024-09-14T11:14:04.759 INFO:teuthology.orchestra.run.smithi164.stdout:(166/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 42 MB/s | 8.8 MB 00:00 2024-09-14T11:14:04.778 INFO:teuthology.orchestra.run.smithi116.stdout:(142/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 65 kB/s | 36 kB 00:00 2024-09-14T11:14:04.785 INFO:teuthology.orchestra.run.smithi164.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-14T11:14:04.810 INFO:teuthology.orchestra.run.smithi164.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 723 kB/s | 36 kB 00:00 2024-09-14T11:14:04.820 INFO:teuthology.orchestra.run.smithi116.stdout:(143/286): libtheora-1.1.1-31.el9.x86_64.rpm 209 kB/s | 164 kB 00:00 2024-09-14T11:14:04.835 INFO:teuthology.orchestra.run.smithi164.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 915 kB/s | 46 kB 00:00 2024-09-14T11:14:04.860 INFO:teuthology.orchestra.run.smithi164.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 643 kB/s | 32 kB 00:00 2024-09-14T11:14:04.886 INFO:teuthology.orchestra.run.smithi164.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-14T11:14:04.904 INFO:teuthology.orchestra.run.smithi116.stdout:(144/286): libtiff-4.4.0-13.el9.x86_64.rpm 270 kB/s | 198 kB 00:00 2024-09-14T11:14:04.928 INFO:teuthology.orchestra.run.smithi164.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-14T11:14:04.995 INFO:teuthology.orchestra.run.smithi164.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 37 MB/s | 4.9 MB 00:00 2024-09-14T11:14:05.020 INFO:teuthology.orchestra.run.smithi164.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2024-09-14T11:14:05.062 INFO:teuthology.orchestra.run.smithi164.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 2.7 MB/s | 183 kB 00:00 2024-09-14T11:14:05.096 INFO:teuthology.orchestra.run.smithi164.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 6.9 MB/s | 531 kB 00:00 2024-09-14T11:14:05.129 INFO:teuthology.orchestra.run.smithi164.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-14T11:14:05.163 INFO:teuthology.orchestra.run.smithi164.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 6.8 MB/s | 468 kB 00:00 2024-09-14T11:14:05.188 INFO:teuthology.orchestra.run.smithi164.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-14T11:14:05.222 INFO:teuthology.orchestra.run.smithi164.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-14T11:14:05.247 INFO:teuthology.orchestra.run.smithi164.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 977 kB/s | 57 kB 00:00 2024-09-14T11:14:05.273 INFO:teuthology.orchestra.run.smithi164.stdout:(182/286): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-14T11:14:05.306 INFO:teuthology.orchestra.run.smithi164.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.3 MB/s | 135 kB 00:00 2024-09-14T11:14:05.365 INFO:teuthology.orchestra.run.smithi164.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-09-14T11:14:05.390 INFO:teuthology.orchestra.run.smithi164.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.2 MB/s | 192 kB 00:00 2024-09-14T11:14:05.415 INFO:teuthology.orchestra.run.smithi164.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-14T11:14:05.441 INFO:teuthology.orchestra.run.smithi164.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T11:14:05.466 INFO:teuthology.orchestra.run.smithi164.stdout:(188/286): plexus-containers-component-annotati 365 kB/s | 18 kB 00:00 2024-09-14T11:14:05.491 INFO:teuthology.orchestra.run.smithi164.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 80 kB 00:00 2024-09-14T11:14:05.517 INFO:teuthology.orchestra.run.smithi164.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 670 kB/s | 34 kB 00:00 2024-09-14T11:14:05.538 INFO:teuthology.orchestra.run.smithi116.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 200 kB/s | 144 kB 00:00 2024-09-14T11:14:05.550 INFO:teuthology.orchestra.run.smithi164.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 254 kB 00:00 2024-09-14T11:14:05.588 INFO:teuthology.orchestra.run.smithi116.stdout:(146/286): libtracker-sparql-3.1.2-3.el9.x86_64 400 kB/s | 324 kB 00:00 2024-09-14T11:14:05.593 INFO:teuthology.orchestra.run.smithi164.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-14T11:14:05.622 INFO:teuthology.orchestra.run.smithi116.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 269 kB/s | 193 kB 00:00 2024-09-14T11:14:05.643 INFO:teuthology.orchestra.run.smithi164.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-14T11:14:05.668 INFO:teuthology.orchestra.run.smithi164.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T11:14:05.702 INFO:teuthology.orchestra.run.smithi164.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-14T11:14:05.727 INFO:teuthology.orchestra.run.smithi164.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-14T11:14:05.761 INFO:teuthology.orchestra.run.smithi164.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-14T11:14:05.803 INFO:teuthology.orchestra.run.smithi164.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 5.7 MB/s | 245 kB 00:00 2024-09-14T11:14:06.089 INFO:teuthology.orchestra.run.smithi116.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 39 kB/s | 19 kB 00:00 2024-09-14T11:14:06.113 INFO:teuthology.orchestra.run.smithi116.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 26 kB/s | 13 kB 00:00 2024-09-14T11:14:06.145 INFO:teuthology.orchestra.run.smithi164.stdout:(199/286): java-11-openjdk-headless-11.0.20.1.1 12 MB/s | 39 MB 00:03 2024-09-14T11:14:06.147 INFO:teuthology.orchestra.run.smithi116.stdout:(150/286): libwayland-client-1.21.0-1.el9.x86_6 55 kB/s | 33 kB 00:00 2024-09-14T11:14:06.170 INFO:teuthology.orchestra.run.smithi164.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 677 kB/s | 248 kB 00:00 2024-09-14T11:14:06.195 INFO:teuthology.orchestra.run.smithi164.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 512 kB/s | 26 kB 00:00 2024-09-14T11:14:06.221 INFO:teuthology.orchestra.run.smithi164.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-14T11:14:06.296 INFO:teuthology.orchestra.run.smithi164.stdout:(203/286): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-09-14T11:14:06.321 INFO:teuthology.orchestra.run.smithi164.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 347 kB/s | 35 kB 00:00 2024-09-14T11:14:06.346 INFO:teuthology.orchestra.run.smithi164.stdout:(205/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-14T11:14:06.372 INFO:teuthology.orchestra.run.smithi164.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-14T11:14:06.397 INFO:teuthology.orchestra.run.smithi164.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.3 MB/s | 222 kB 00:00 2024-09-14T11:14:06.422 INFO:teuthology.orchestra.run.smithi164.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T11:14:06.456 INFO:teuthology.orchestra.run.smithi164.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 721 kB/s | 42 kB 00:00 2024-09-14T11:14:06.481 INFO:teuthology.orchestra.run.smithi164.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-14T11:14:06.506 INFO:teuthology.orchestra.run.smithi164.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T11:14:06.532 INFO:teuthology.orchestra.run.smithi164.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T11:14:06.557 INFO:teuthology.orchestra.run.smithi164.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T11:14:06.582 INFO:teuthology.orchestra.run.smithi164.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-14T11:14:06.624 INFO:teuthology.orchestra.run.smithi164.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-14T11:14:06.681 INFO:teuthology.orchestra.run.smithi116.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 70 kB/s | 42 kB 00:00 2024-09-14T11:14:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:(216/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T11:14:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-14T11:14:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 861 kB/s | 36 kB 00:00 2024-09-14T11:14:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-14T11:14:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-09-14T11:14:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 12 MB/s | 510 kB 00:00 2024-09-14T11:14:06.835 INFO:teuthology.orchestra.run.smithi164.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-14T11:14:06.860 INFO:teuthology.orchestra.run.smithi164.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-14T11:14:06.885 INFO:teuthology.orchestra.run.smithi164.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 7.5 MB/s | 383 kB 00:00 2024-09-14T11:14:06.898 INFO:teuthology.orchestra.run.smithi116.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 353 kB/s | 277 kB 00:00 2024-09-14T11:14:06.911 INFO:teuthology.orchestra.run.smithi164.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-14T11:14:06.932 INFO:teuthology.orchestra.run.smithi116.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 170 kB/s | 133 kB 00:00 2024-09-14T11:14:06.944 INFO:teuthology.orchestra.run.smithi164.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-14T11:14:06.986 INFO:teuthology.orchestra.run.smithi164.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-14T11:14:07.012 INFO:teuthology.orchestra.run.smithi164.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 795 kB/s | 53 kB 00:00 2024-09-14T11:14:07.037 INFO:teuthology.orchestra.run.smithi164.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T11:14:07.062 INFO:teuthology.orchestra.run.smithi164.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T11:14:07.088 INFO:teuthology.orchestra.run.smithi164.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T11:14:07.113 INFO:teuthology.orchestra.run.smithi164.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-14T11:14:07.138 INFO:teuthology.orchestra.run.smithi164.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-14T11:14:07.157 INFO:teuthology.orchestra.run.smithi116.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 27 kB/s | 13 kB 00:00 2024-09-14T11:14:07.164 INFO:teuthology.orchestra.run.smithi164.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 847 kB/s | 42 kB 00:00 2024-09-14T11:14:07.197 INFO:teuthology.orchestra.run.smithi164.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.5 MB/s | 385 kB 00:00 2024-09-14T11:14:07.223 INFO:teuthology.orchestra.run.smithi164.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-14T11:14:07.256 INFO:teuthology.orchestra.run.smithi164.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 14 MB/s | 859 kB 00:00 2024-09-14T11:14:07.281 INFO:teuthology.orchestra.run.smithi164.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:14:07.307 INFO:teuthology.orchestra.run.smithi164.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.9 MB/s | 505 kB 00:00 2024-09-14T11:14:07.365 INFO:teuthology.orchestra.run.smithi164.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-14T11:14:07.457 INFO:teuthology.orchestra.run.smithi116.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 65 kB/s | 36 kB 00:00 2024-09-14T11:14:07.516 INFO:teuthology.orchestra.run.smithi164.stdout:(241/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-14T11:14:07.566 INFO:teuthology.orchestra.run.smithi164.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-09-14T11:14:07.591 INFO:teuthology.orchestra.run.smithi164.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-14T11:14:07.616 INFO:teuthology.orchestra.run.smithi164.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 3.3 MB/s | 308 kB 00:00 2024-09-14T11:14:07.642 INFO:teuthology.orchestra.run.smithi164.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T11:14:07.667 INFO:teuthology.orchestra.run.smithi164.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:14:07.693 INFO:teuthology.orchestra.run.smithi164.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T11:14:07.726 INFO:teuthology.orchestra.run.smithi164.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-14T11:14:07.733 INFO:teuthology.orchestra.run.smithi116.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 365 kB/s | 292 kB 00:00 2024-09-14T11:14:07.760 INFO:teuthology.orchestra.run.smithi164.stdout:(249/286): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-14T11:14:07.810 INFO:teuthology.orchestra.run.smithi164.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-14T11:14:07.827 INFO:teuthology.orchestra.run.smithi164.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-09-14T11:14:07.844 INFO:teuthology.orchestra.run.smithi164.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-14T11:14:07.861 INFO:teuthology.orchestra.run.smithi164.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 845 kB/s | 14 kB 00:00 2024-09-14T11:14:07.886 INFO:teuthology.orchestra.run.smithi164.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-14T11:14:07.899 INFO:teuthology.orchestra.run.smithi116.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2024-09-14T11:14:07.911 INFO:teuthology.orchestra.run.smithi164.stdout:(255/286): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-14T11:14:07.945 INFO:teuthology.orchestra.run.smithi164.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T11:14:07.971 INFO:teuthology.orchestra.run.smithi164.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T11:14:08.004 INFO:teuthology.orchestra.run.smithi164.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T11:14:08.029 INFO:teuthology.orchestra.run.smithi164.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-14T11:14:08.097 INFO:teuthology.orchestra.run.smithi164.stdout:(260/286): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-09-14T11:14:08.122 INFO:teuthology.orchestra.run.smithi164.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-09-14T11:14:08.147 INFO:teuthology.orchestra.run.smithi164.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-14T11:14:08.166 INFO:teuthology.orchestra.run.smithi116.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 213 kB/s | 151 kB 00:00 2024-09-14T11:14:08.172 INFO:teuthology.orchestra.run.smithi164.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T11:14:08.197 INFO:teuthology.orchestra.run.smithi164.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-14T11:14:08.223 INFO:teuthology.orchestra.run.smithi164.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:14:08.233 INFO:teuthology.orchestra.run.smithi116.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 35 kB/s | 18 kB 00:00 2024-09-14T11:14:08.248 INFO:teuthology.orchestra.run.smithi164.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:14:08.273 INFO:teuthology.orchestra.run.smithi164.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:14:08.307 INFO:teuthology.orchestra.run.smithi164.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-14T11:14:08.332 INFO:teuthology.orchestra.run.smithi164.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-14T11:14:08.374 INFO:teuthology.orchestra.run.smithi164.stdout:(270/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-14T11:14:08.416 INFO:teuthology.orchestra.run.smithi164.stdout:(271/286): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-14T11:14:08.442 INFO:teuthology.orchestra.run.smithi164.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-09-14T11:14:08.467 INFO:teuthology.orchestra.run.smithi164.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 670 kB/s | 90 kB 00:00 2024-09-14T11:14:08.492 INFO:teuthology.orchestra.run.smithi164.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-14T11:14:08.517 INFO:teuthology.orchestra.run.smithi164.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T11:14:08.551 INFO:teuthology.orchestra.run.smithi164.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-14T11:14:08.576 INFO:teuthology.orchestra.run.smithi164.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 886 kB/s | 74 kB 00:00 2024-09-14T11:14:08.602 INFO:teuthology.orchestra.run.smithi164.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T11:14:08.627 INFO:teuthology.orchestra.run.smithi164.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-14T11:14:08.652 INFO:teuthology.orchestra.run.smithi164.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-14T11:14:08.667 INFO:teuthology.orchestra.run.smithi116.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 18 kB/s | 9.0 kB 00:00 2024-09-14T11:14:08.678 INFO:teuthology.orchestra.run.smithi164.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:14:08.703 INFO:teuthology.orchestra.run.smithi164.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:14:08.728 INFO:teuthology.orchestra.run.smithi164.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-14T11:14:08.779 INFO:teuthology.orchestra.run.smithi164.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:14:08.970 INFO:teuthology.orchestra.run.smithi164.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 13 MB/s | 3.5 MB 00:00 2024-09-14T11:14:09.001 INFO:teuthology.orchestra.run.smithi116.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 1.3 MB/s | 1.5 MB 00:01 2024-09-14T11:14:09.029 INFO:teuthology.orchestra.run.smithi164.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:14:09.035 INFO:teuthology.orchestra.run.smithi164.stdout:Total 24 MB/s | 327 MB 00:13 2024-09-14T11:14:09.076 INFO:teuthology.orchestra.run.smithi116.stdout:(162/286): maven-resolver-1.6.1-10.el9.noarch.r 614 kB/s | 517 kB 00:00 2024-09-14T11:14:09.418 INFO:teuthology.orchestra.run.smithi116.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 201 kB/s | 151 kB 00:00 2024-09-14T11:14:09.685 INFO:teuthology.orchestra.run.smithi116.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 164 kB/s | 112 kB 00:00 2024-09-14T11:14:09.885 INFO:teuthology.orchestra.run.smithi116.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 24 kB/s | 11 kB 00:00 2024-09-14T11:14:10.310 INFO:teuthology.orchestra.run.smithi116.stdout:(166/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 7.1 MB/s | 8.8 MB 00:01 2024-09-14T11:14:10.377 INFO:teuthology.orchestra.run.smithi116.stdout:(167/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 200 kB/s | 139 kB 00:00 2024-09-14T11:14:10.677 INFO:teuthology.orchestra.run.smithi116.stdout:(168/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 215 kB/s | 171 kB 00:00 2024-09-14T11:14:10.869 INFO:teuthology.orchestra.run.smithi116.stdout:(169/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 65 kB/s | 36 kB 00:00 2024-09-14T11:14:10.970 INFO:teuthology.orchestra.run.smithi116.stdout:(170/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 77 kB/s | 46 kB 00:00 2024-09-14T11:14:11.270 INFO:teuthology.orchestra.run.smithi116.stdout:(171/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 55 kB/s | 32 kB 00:00 2024-09-14T11:14:11.503 INFO:teuthology.orchestra.run.smithi116.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 61 kB/s | 38 kB 00:00 2024-09-14T11:14:12.004 INFO:teuthology.orchestra.run.smithi116.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 223 kB/s | 163 kB 00:00 2024-09-14T11:14:12.068 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T11:14:12.104 INFO:teuthology.orchestra.run.smithi116.stdout:(174/286): openblas-openmp-0.3.26-2.el9.x86_64. 4.4 MB/s | 4.9 MB 00:01 2024-09-14T11:14:12.246 INFO:teuthology.orchestra.run.smithi116.stdout:(175/286): opus-1.3.1-10.el9.x86_64.rpm 272 kB/s | 200 kB 00:00 2024-09-14T11:14:12.255 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T11:14:12.255 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T11:14:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:(176/286): orc-0.4.31-8.el9.x86_64.rpm 239 kB/s | 183 kB 00:00 2024-09-14T11:14:12.880 INFO:teuthology.orchestra.run.smithi116.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 118 kB/s | 74 kB 00:00 2024-09-14T11:14:12.980 INFO:teuthology.orchestra.run.smithi116.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 606 kB/s | 531 kB 00:00 2024-09-14T11:14:13.597 INFO:teuthology.orchestra.run.smithi116.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 567 kB/s | 468 kB 00:00 2024-09-14T11:14:13.647 INFO:teuthology.orchestra.run.smithi116.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 160 kB/s | 107 kB 00:00 2024-09-14T11:14:13.681 INFO:teuthology.orchestra.run.smithi116.stdout:(181/286): p11-kit-server-0.25.3-2.el9.x86_64.r 307 kB/s | 246 kB 00:00 2024-09-14T11:14:14.097 INFO:teuthology.orchestra.run.smithi116.stdout:(182/286): pipewire-jack-audio-connection-kit-1 20 kB/s | 9.1 kB 00:00 2024-09-14T11:14:14.206 INFO:teuthology.orchestra.run.smithi116.stdout:(183/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 94 kB/s | 57 kB 00:00 2024-09-14T11:14:14.431 INFO:teuthology.orchestra.run.smithi116.stdout:(184/286): pipewire-jack-audio-connection-kit-l 180 kB/s | 135 kB 00:00 2024-09-14T11:14:14.940 INFO:teuthology.orchestra.run.smithi116.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 262 kB/s | 192 kB 00:00 2024-09-14T11:14:14.982 INFO:teuthology.orchestra.run.smithi116.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 48 kB/s | 26 kB 00:00 2024-09-14T11:14:15.074 INFO:teuthology.orchestra.run.smithi116.stdout:(187/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 2.0 MB/s | 1.9 MB 00:00 2024-09-14T11:14:15.467 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T11:14:15.468 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T11:14:15.482 INFO:teuthology.orchestra.run.smithi116.stdout:(188/286): plexus-containers-component-annotati 37 kB/s | 18 kB 00:00 2024-09-14T11:14:15.550 INFO:teuthology.orchestra.run.smithi116.stdout:(189/286): plexus-classworlds-2.6.0-11.el9.noar 99 kB/s | 60 kB 00:00 2024-09-14T11:14:15.708 INFO:teuthology.orchestra.run.smithi116.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 126 kB/s | 80 kB 00:00 2024-09-14T11:14:16.067 INFO:teuthology.orchestra.run.smithi116.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 58 kB/s | 34 kB 00:00 2024-09-14T11:14:16.334 INFO:teuthology.orchestra.run.smithi116.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 324 kB/s | 254 kB 00:00 2024-09-14T11:14:16.626 INFO:teuthology.orchestra.run.smithi116.stdout:(193/286): poppler-21.01.0-21.el9.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2024-09-14T11:14:17.034 INFO:teuthology.orchestra.run.smithi116.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 217 kB/s | 152 kB 00:00 2024-09-14T11:14:17.135 INFO:teuthology.orchestra.run.smithi116.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 1.8 MB/s | 1.9 MB 00:01 2024-09-14T11:14:17.535 INFO:teuthology.orchestra.run.smithi116.stdout:(196/286): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-14T11:14:17.710 INFO:teuthology.orchestra.run.smithi116.stdout:(197/286): publicsuffix-list-20210518-3.el9.noa 122 kB/s | 83 kB 00:00 2024-09-14T11:14:18.035 INFO:teuthology.orchestra.run.smithi116.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 754 kB/s | 679 kB 00:00 2024-09-14T11:14:18.502 INFO:teuthology.orchestra.run.smithi116.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 309 kB/s | 245 kB 00:00 2024-09-14T11:14:18.752 INFO:teuthology.orchestra.run.smithi116.stdout:(200/286): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-14T11:14:18.803 INFO:teuthology.orchestra.run.smithi116.stdout:(201/286): python3-jinja2-2.11.3-6.el9.noarch.r 324 kB/s | 248 kB 00:00 2024-09-14T11:14:19.078 INFO:teuthology.orchestra.run.smithi116.stdout:(202/286): python3-jsonpatch-1.21-16.el9.noarch 45 kB/s | 26 kB 00:00 2024-09-14T11:14:19.278 INFO:teuthology.orchestra.run.smithi116.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 37 kB/s | 19 kB 00:00 2024-09-14T11:14:19.595 INFO:teuthology.orchestra.run.smithi116.stdout:(204/286): python3-mako-1.1.4-6.el9.noarch.rpm 217 kB/s | 172 kB 00:00 2024-09-14T11:14:19.629 INFO:teuthology.orchestra.run.smithi116.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 63 kB/s | 35 kB 00:00 2024-09-14T11:14:20.362 INFO:teuthology.orchestra.run.smithi116.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 327 kB/s | 250 kB 00:00 2024-09-14T11:14:20.388 INFO:teuthology.orchestra.run.smithi116.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 293 kB/s | 222 kB 00:00 2024-09-14T11:14:20.529 INFO:teuthology.orchestra.run.smithi116.stdout:(208/286): python3-numpy-1.20.1-5.el9.x86_64.rp 4.1 MB/s | 5.1 MB 00:01 2024-09-14T11:14:21.021 INFO:teuthology.orchestra.run.smithi116.stdout:(209/286): python3-packaging-20.9-5.el9.noarch. 117 kB/s | 77 kB 00:00 2024-09-14T11:14:21.071 INFO:teuthology.orchestra.run.smithi116.stdout:(210/286): python3-prettytable-0.7.2-27.el9.noa 62 kB/s | 42 kB 00:00 2024-09-14T11:14:21.314 INFO:teuthology.orchestra.run.smithi116.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 344 kB/s | 269 kB 00:00 2024-09-14T11:14:21.805 INFO:teuthology.orchestra.run.smithi116.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 203 kB/s | 159 kB 00:00 2024-09-14T11:14:21.831 INFO:teuthology.orchestra.run.smithi116.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 367 kB/s | 279 kB 00:00 2024-09-14T11:14:21.906 INFO:teuthology.orchestra.run.smithi116.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-14T11:14:22.398 INFO:teuthology.orchestra.run.smithi116.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 91 kB/s | 54 kB 00:00 2024-09-14T11:14:22.481 INFO:teuthology.orchestra.run.smithi116.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-14T11:14:23.040 INFO:teuthology.orchestra.run.smithi116.stdout:(217/286): qatlib-service-24.02.0-1.el9.x86_64. 64 kB/s | 36 kB 00:00 2024-09-14T11:14:23.265 INFO:teuthology.orchestra.run.smithi116.stdout:(218/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-14T11:14:23.299 INFO:teuthology.orchestra.run.smithi116.stdout:(219/286): qatlib-24.02.0-1.el9.x86_64.rpm 245 kB/s | 221 kB 00:00 2024-09-14T11:14:23.699 INFO:teuthology.orchestra.run.smithi116.stdout:(220/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-09-14T11:14:23.883 INFO:teuthology.orchestra.run.smithi116.stdout:(221/286): rtkit-0.11-29.el9.x86_64.rpm 91 kB/s | 56 kB 00:00 2024-09-14T11:14:24.125 INFO:teuthology.orchestra.run.smithi116.stdout:(222/286): sisu-0.3.4-10.el9.noarch.rpm 618 kB/s | 510 kB 00:00 2024-09-14T11:14:24.325 INFO:teuthology.orchestra.run.smithi116.stdout:(223/286): slf4j-1.7.30-13.el9.noarch.rpm 110 kB/s | 69 kB 00:00 2024-09-14T11:14:24.667 INFO:teuthology.orchestra.run.smithi116.stdout:(224/286): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-09-14T11:14:25.000 INFO:teuthology.orchestra.run.smithi116.stdout:(225/286): sound-theme-freedesktop-0.8-17.el9.n 438 kB/s | 383 kB 00:00 2024-09-14T11:14:25.025 INFO:teuthology.orchestra.run.smithi116.stdout:(226/286): totem-pl-parser-3.26.6-2.el9.x86_64. 218 kB/s | 152 kB 00:00 2024-09-14T11:14:25.509 INFO:teuthology.orchestra.run.smithi116.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 659 kB/s | 555 kB 00:00 2024-09-14T11:14:25.518 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:14:25.643 INFO:teuthology.orchestra.run.smithi116.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 86 kB/s | 53 kB 00:00 2024-09-14T11:14:25.682 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:14:25.837 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T11:14:25.910 INFO:teuthology.orchestra.run.smithi116.stdout:(229/286): tracker-miners-3.1.2-4.el9.x86_64.rp 1.0 MB/s | 944 kB 00:00 2024-09-14T11:14:26.100 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:14:26.134 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:14:26.220 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:14:26.260 INFO:teuthology.orchestra.run.smithi116.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 306 kB/s | 230 kB 00:00 2024-09-14T11:14:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:14:26.321 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:14:26.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:14:26.386 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:14:26.410 INFO:teuthology.orchestra.run.smithi116.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 225 kB/s | 173 kB 00:00 2024-09-14T11:14:26.434 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:14:26.752 INFO:teuthology.orchestra.run.smithi116.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 363 kB/s | 306 kB 00:00 2024-09-14T11:14:26.778 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:14:26.903 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:14:26.994 INFO:teuthology.orchestra.run.smithi116.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 132 kB/s | 96 kB 00:00 2024-09-14T11:14:27.026 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:14:27.054 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:14:27.146 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:14:27.175 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:14:27.202 INFO:teuthology.orchestra.run.smithi116.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 452 kB/s | 358 kB 00:00 2024-09-14T11:14:27.231 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:14:27.259 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:14:27.286 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:14:27.312 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:14:27.345 INFO:teuthology.orchestra.run.smithi116.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 72 kB/s | 42 kB 00:00 2024-09-14T11:14:27.351 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:14:27.384 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:14:27.411 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:14:27.439 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:14:27.629 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:14:27.756 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:14:27.803 INFO:teuthology.orchestra.run.smithi116.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 481 kB/s | 385 kB 00:00 2024-09-14T11:14:27.811 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:14:27.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:14:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:14:27.912 INFO:teuthology.orchestra.run.smithi116.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 190 kB/s | 134 kB 00:00 2024-09-14T11:14:27.969 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:14:27.998 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:14:28.045 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:14:28.069 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:14:28.092 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:14:28.114 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:14:28.270 INFO:teuthology.orchestra.run.smithi116.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 929 kB/s | 859 kB 00:00 2024-09-14T11:14:28.311 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:14:28.337 INFO:teuthology.orchestra.run.smithi116.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 336 kB/s | 22 kB 00:00 2024-09-14T11:14:28.342 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:14:28.454 INFO:teuthology.orchestra.run.smithi116.stdout:(240/286): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-14T11:14:28.462 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:14:28.489 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:14:28.504 INFO:teuthology.orchestra.run.smithi116.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-14T11:14:28.524 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:14:28.529 INFO:teuthology.orchestra.run.smithi116.stdout:(242/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-09-14T11:14:28.571 INFO:teuthology.orchestra.run.smithi116.stdout:(243/286): gperftools-libs-2.9.1-3.el9.x86_64.r 4.6 MB/s | 308 kB 00:00 2024-09-14T11:14:28.590 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:14:28.597 INFO:teuthology.orchestra.run.smithi116.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-14T11:14:28.622 INFO:teuthology.orchestra.run.smithi116.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T11:14:28.635 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:14:28.647 INFO:teuthology.orchestra.run.smithi116.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:14:28.673 INFO:teuthology.orchestra.run.smithi116.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-14T11:14:28.683 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:14:28.698 INFO:teuthology.orchestra.run.smithi116.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-14T11:14:28.726 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:14:28.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:14:28.757 INFO:teuthology.orchestra.run.smithi116.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-14T11:14:28.778 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:14:28.782 INFO:teuthology.orchestra.run.smithi116.stdout:(250/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 581 kB/s | 505 kB 00:00 2024-09-14T11:14:28.803 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:14:28.824 INFO:teuthology.orchestra.run.smithi116.stdout:(251/286): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-14T11:14:28.828 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:14:28.849 INFO:teuthology.orchestra.run.smithi116.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-14T11:14:28.864 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:14:28.874 INFO:teuthology.orchestra.run.smithi116.stdout:(253/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-14T11:14:28.897 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:14:28.900 INFO:teuthology.orchestra.run.smithi116.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-14T11:14:28.922 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:14:28.933 INFO:teuthology.orchestra.run.smithi116.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-14T11:14:28.959 INFO:teuthology.orchestra.run.smithi116.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T11:14:28.971 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:14:28.984 INFO:teuthology.orchestra.run.smithi116.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-14T11:14:29.004 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:14:29.051 INFO:teuthology.orchestra.run.smithi116.stdout:(258/286): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-14T11:14:29.070 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:14:29.076 INFO:teuthology.orchestra.run.smithi116.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-14T11:14:29.101 INFO:teuthology.orchestra.run.smithi116.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-14T11:14:29.126 INFO:teuthology.orchestra.run.smithi116.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-14T11:14:29.147 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:14:29.152 INFO:teuthology.orchestra.run.smithi116.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-14T11:14:29.177 INFO:teuthology.orchestra.run.smithi116.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T11:14:29.179 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:14:29.202 INFO:teuthology.orchestra.run.smithi116.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-14T11:14:29.228 INFO:teuthology.orchestra.run.smithi116.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:14:29.231 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:14:29.253 INFO:teuthology.orchestra.run.smithi116.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:14:29.276 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:14:29.278 INFO:teuthology.orchestra.run.smithi116.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:14:29.308 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:14:29.312 INFO:teuthology.orchestra.run.smithi116.stdout:(268/286): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-14T11:14:29.337 INFO:teuthology.orchestra.run.smithi116.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-14T11:14:29.362 INFO:teuthology.orchestra.run.smithi116.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-14T11:14:29.385 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:14:29.388 INFO:teuthology.orchestra.run.smithi116.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-14T11:14:29.421 INFO:teuthology.orchestra.run.smithi116.stdout:(272/286): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-14T11:14:29.427 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:14:29.446 INFO:teuthology.orchestra.run.smithi116.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:14:29.470 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:14:29.472 INFO:teuthology.orchestra.run.smithi116.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-14T11:14:29.489 INFO:teuthology.orchestra.run.smithi116.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-09-14T11:14:29.512 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:14:29.514 INFO:teuthology.orchestra.run.smithi116.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-14T11:14:29.539 INFO:teuthology.orchestra.run.smithi116.stdout:(277/286): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-14T11:14:29.588 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:14:29.590 INFO:teuthology.orchestra.run.smithi116.stdout:(278/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-14T11:14:29.615 INFO:teuthology.orchestra.run.smithi116.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-14T11:14:29.640 INFO:teuthology.orchestra.run.smithi116.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-14T11:14:29.666 INFO:teuthology.orchestra.run.smithi116.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:14:29.691 INFO:teuthology.orchestra.run.smithi116.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:14:29.716 INFO:teuthology.orchestra.run.smithi116.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-14T11:14:29.724 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:14:29.767 INFO:teuthology.orchestra.run.smithi116.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:14:29.790 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:14:29.975 INFO:teuthology.orchestra.run.smithi116.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-14T11:14:30.084 INFO:teuthology.orchestra.run.smithi116.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 8.8 MB/s | 3.5 MB 00:00 2024-09-14T11:14:30.092 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:14:30.092 INFO:teuthology.orchestra.run.smithi116.stdout:Total 6.0 MB/s | 327 MB 00:54 2024-09-14T11:14:30.327 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:14:30.403 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:14:30.440 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:14:30.533 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:14:30.578 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:14:30.614 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:14:30.644 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:14:30.714 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:14:30.746 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:14:30.779 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:14:30.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:14:30.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:14:30.885 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:14:30.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:14:30.968 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:14:31.026 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:14:31.061 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:14:31.097 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:14:31.192 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:14:31.254 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:14:31.329 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:14:31.377 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:14:31.413 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:14:31.460 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:14:31.514 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:14:31.555 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:14:31.695 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:14:31.732 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:14:31.774 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:14:31.877 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:14:31.924 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:14:31.973 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:14:32.014 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:14:32.039 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:14:32.125 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:14:32.258 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:14:32.300 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:14:32.508 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:14:32.551 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:14:32.582 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:14:32.613 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:14:32.654 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:14:32.682 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:14:32.695 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:14:32.696 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:14:32.696 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:14:32.878 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:14:32.961 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:14:33.016 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:14:33.039 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:14:33.063 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:14:33.077 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T11:14:33.090 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:14:33.259 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T11:14:33.259 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T11:14:33.532 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:33.575 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:14:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:14:33.618 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:14:33.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:14:33.694 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:14:33.735 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:14:33.770 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:14:33.859 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:14:33.909 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:14:33.939 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:14:34.046 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:14:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:14:35.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:14:35.238 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:14:35.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:14:35.373 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:14:35.410 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:14:35.594 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:14:35.653 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:14:35.702 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:14:36.213 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:14:36.269 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:14:36.307 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:14:36.341 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:14:36.374 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:14:36.431 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T11:14:36.431 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T11:14:36.557 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:14:36.588 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:14:36.676 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:14:37.374 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:14:37.489 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:14:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:14:38.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:14:38.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:14:38.952 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:14:38.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:14:39.000 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:14:39.012 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:14:39.012 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:14:39.012 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:14:39.069 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:14:39.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:14:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:14:39.453 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:14:39.496 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:14:39.594 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:14:39.636 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:14:39.668 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:14:39.697 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:14:39.755 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:14:39.788 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:14:39.814 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:14:39.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:14:39.879 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:14:40.151 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:14:40.189 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:14:40.217 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:14:40.242 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:14:40.268 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:14:40.293 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:14:40.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:14:40.346 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:14:40.391 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:14:40.451 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:14:40.483 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:14:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:14:40.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:14:41.013 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:14:41.151 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:14:41.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:14:41.258 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:14:41.286 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:14:41.365 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:14:41.419 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:14:41.451 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:14:41.470 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:14:41.497 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:14:41.523 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:14:41.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:14:41.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:14:46.381 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:14:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:14:46.687 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T11:14:46.758 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:14:46.796 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:14:46.878 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:14:46.920 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:14:46.972 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:14:47.006 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:14:47.040 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:14:47.086 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:14:47.417 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:14:47.532 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:14:47.647 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:14:47.675 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:14:47.750 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:14:47.779 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:14:47.826 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:14:47.855 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:14:47.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:14:47.915 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:14:47.955 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:14:47.988 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:14:48.015 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:14:48.043 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:14:48.179 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:14:48.291 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:14:48.330 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:14:48.381 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:14:48.425 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:14:48.531 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:14:48.568 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:14:48.631 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:14:48.664 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:14:48.695 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:14:48.720 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:14:48.914 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:14:48.945 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:14:49.067 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:14:49.101 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:14:49.136 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:14:49.210 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:14:49.254 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:14:49.302 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:14:49.346 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:14:49.379 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:14:49.414 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:14:49.448 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:14:49.474 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:14:49.502 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:14:49.535 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:14:49.568 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:14:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:14:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:14:49.736 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:14:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:14:49.839 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:14:49.893 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:14:49.928 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:14:49.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:14:50.039 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:14:50.078 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:14:50.122 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:14:50.164 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:14:50.240 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:14:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:14:50.443 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:14:50.990 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:14:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:14:51.124 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:14:51.193 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:14:51.231 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:14:51.267 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:14:51.305 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:14:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:14:51.416 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:14:51.449 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:14:51.484 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:14:51.523 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:14:51.580 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:14:51.629 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:14:51.671 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:14:51.729 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:14:51.764 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:14:51.809 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:14:51.903 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:14:51.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:14:52.039 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:14:52.086 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:14:52.122 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:14:52.170 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:14:52.214 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:14:52.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:14:52.396 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:14:52.442 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:14:52.483 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:14:52.588 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:14:52.625 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:14:52.666 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:14:52.707 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:14:52.731 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:14:52.843 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:14:52.969 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:14:53.017 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:14:53.223 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:14:53.255 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:14:53.260 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:14:53.291 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:14:53.296 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:14:53.321 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:14:53.325 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:14:53.362 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:14:53.368 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:14:53.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:14:53.399 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:14:53.404 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:14:53.404 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:14:53.405 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:14:53.435 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:14:53.595 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:14:53.670 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:14:53.723 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:14:53.747 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:14:53.772 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:14:53.799 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:14:53.957 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:14:53.990 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:14:54.069 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:14:54.101 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:14:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:54.324 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:14:54.324 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:14:54.325 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:14:54.367 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:14:54.402 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:14:54.435 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:14:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:14:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:14:54.599 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:14:54.671 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:14:54.714 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:14:54.828 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:14:54.891 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:14:55.635 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:14:55.851 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:14:55.977 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:14:56.184 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:14:56.424 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:14:56.429 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:14:56.467 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:14:56.469 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:14:56.522 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:14:57.017 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:14:57.034 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:14:57.053 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:14:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:14:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:14:57.154 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:14:57.154 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:14:57.155 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:14:57.155 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:14:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:14:57.188 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:14:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:14:57.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:14:57.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:14:57.501 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:14:58.179 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:14:58.297 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:14:59.562 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:14:59.640 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:14:59.691 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:14:59.733 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:14:59.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:14:59.782 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:14:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:14:59.794 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:14:59.794 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:14:59.850 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:14:59.878 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:14:59.906 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:15:00.240 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:15:00.302 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:15:00.394 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:15:00.426 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:15:00.458 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:15:00.487 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:15:00.561 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:15:00.604 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:15:00.629 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:15:00.668 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:15:00.693 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:15:00.937 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:15:00.978 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:15:01.007 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:15:01.032 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:15:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:15:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:15:01.108 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:15:01.136 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:15:01.172 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:15:01.219 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:15:01.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:15:01.312 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:15:01.348 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:15:01.807 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:15:01.940 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:15:02.005 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:15:02.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:15:02.058 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:15:02.129 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:15:02.182 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:15:02.206 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:15:02.225 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:15:02.252 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:15:02.278 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:15:02.325 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:15:02.350 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:15:06.501 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:15:06.501 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-14T11:15:06.501 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-14T11:15:06.501 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-14T11:15:06.502 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-14T11:15:06.502 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-14T11:15:06.502 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-14T11:15:06.502 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-14T11:15:06.502 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:06.679 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:08.155 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:15:08.182 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:08.405 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:15:08.429 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:08.873 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:15:08.896 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:08.999 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:15:11.832 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:15:11.940 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:15:12.005 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:15:12.079 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:15:12.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:15:12.319 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:15:12.397 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:15:12.486 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:15:12.634 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:15:12.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:15:12.720 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:15:13.585 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:15:13.651 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:15:14.014 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:15:14.066 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:15:14.090 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:15:14.097 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:15:14.124 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:15:14.133 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:15:14.160 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:15:14.161 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:15:14.197 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:15:14.204 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:15:14.224 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:15:14.236 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:15:14.250 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:15:14.272 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:15:14.284 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:15:14.309 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:15:14.335 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:15:14.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:15:14.387 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:15:14.440 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:15:14.471 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:15:14.506 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:15:14.542 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:15:14.573 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:15:14.607 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:15:14.641 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:15:14.678 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:15:14.718 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:15:14.769 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:15:14.786 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:15:14.814 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:15:14.818 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:15:14.845 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:15:14.877 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:15:14.898 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:15:14.928 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:15:14.938 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:15:14.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:15:15.010 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:15:15.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:15:15.064 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:15:15.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:15:15.264 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:15:15.291 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:15:15.318 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:15:15.351 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:15:15.483 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:15:15.541 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:15:15.610 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:15:15.639 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:15:15.755 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:15:15.802 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:15:15.817 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:15:15.847 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:15:15.870 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:15:16.294 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:16.325 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:16.341 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:16.341 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:15:16.341 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:16.583 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:15:16.652 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:15:16.717 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:15:16.753 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:15:16.787 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:15:17.160 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:17.191 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:17.206 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:17.257 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:15:17.293 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:15:17.746 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:15:17.827 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:15:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:15:17.866 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:15:17.894 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:15:17.905 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:15:17.996 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:15:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:15:17.996 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:15:17.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:18.023 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:15:18.094 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:15:18.146 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:15:18.173 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:15:18.194 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:15:18.241 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:15:18.304 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:15:18.335 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:15:18.346 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:15:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:15:18.418 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:15:18.445 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:15:18.833 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:15:18.859 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:15:18.893 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:15:18.967 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:15:18.992 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:15:22.163 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:15:22.222 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:15:23.181 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:15:23.214 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:15:23.329 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:15:23.493 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:15:23.517 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:15:23.540 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:23.584 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:15:23.595 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:15:23.618 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:15:23.647 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:15:23.696 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:15:23.720 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:15:23.735 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:15:23.735 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:15:23.735 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:24.729 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:15:24.755 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:24.805 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:15:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:15:24.828 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:24.828 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:15:24.828 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:25.166 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:15:25.189 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:15:25.190 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:25.190 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:15:25.190 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:15:25.190 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:15:25.190 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:27.270 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:15:27.270 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-14T11:15:27.271 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:27.446 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:15:27.461 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:15:27.461 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:27.461 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:15:27.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:28.922 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:15:28.948 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:15:28.948 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:28.949 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:15:28.949 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:15:28.949 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:15:28.949 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:29.172 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:15:29.194 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:15:29.194 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:29.195 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:15:29.195 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:15:29.195 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:15:29.195 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:29.639 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:15:29.662 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:15:29.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:15:29.935 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:15:29.967 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:15:30.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:15:30.126 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:15:30.158 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:15:30.158 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:15:30.251 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:15:30.251 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:30.367 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:30.389 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:15:30.394 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:15:30.403 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:15:30.413 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:15:30.413 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:15:30.413 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:15:30.414 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:30.476 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:15:30.544 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:15:32.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:15:32.699 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:15:32.756 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:15:32.820 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:15:33.006 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:15:33.060 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:15:33.131 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:15:33.226 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:15:33.360 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:15:33.405 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:15:33.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:15:34.295 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:15:34.352 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:15:34.708 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:15:34.742 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:15:34.765 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:15:34.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:15:34.827 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:15:34.864 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:15:34.891 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:15:34.917 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:15:34.943 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:15:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:15:34.994 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:15:35.019 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:15:35.046 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:15:35.077 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:15:35.104 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:15:35.139 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:15:35.175 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:15:35.206 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:15:35.240 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:15:35.274 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:15:35.311 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:15:35.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:15:35.392 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:15:35.436 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:15:35.468 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:15:35.491 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:15:35.544 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:15:35.577 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:15:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:15:35.644 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:15:35.670 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:15:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:15:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:15:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:15:35.924 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:15:35.957 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:15:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:15:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:15:36.207 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:15:36.236 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:15:36.343 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:15:36.383 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:15:36.398 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:15:36.428 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:15:36.451 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:15:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:15:36.963 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:15:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:15:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:15:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:15:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:15:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:15:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:15:38.365 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:15:38.442 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:15:38.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:15:38.508 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:15:38.705 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:15:38.761 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:15:38.788 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:15:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:15:38.838 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:15:38.901 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:15:38.933 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:15:38.943 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:15:38.975 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:15:38.999 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:15:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:15:39.455 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:15:39.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:15:39.515 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:15:39.582 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:15:39.606 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:15:40.524 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:15:40.525 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:15:40.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:15:40.527 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:15:40.528 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:15:40.529 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:15:40.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:15:40.531 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:15:40.532 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:15:40.533 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:15:40.534 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:15:40.535 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:15:40.536 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:15:40.537 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:15:40.538 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:15:40.539 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:15:40.540 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:15:40.541 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:15:40.542 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:15:40.543 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:15:40.544 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:15:42.794 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:15:42.845 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:15:43.809 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:15:43.845 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:15:43.961 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T11:15:43.974 INFO:teuthology.orchestra.run.smithi164.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:15:43.975 INFO:teuthology.orchestra.run.smithi164.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.976 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:15:43.977 INFO:teuthology.orchestra.run.smithi164.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:15:43.978 INFO:teuthology.orchestra.run.smithi164.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:15:43.979 INFO:teuthology.orchestra.run.smithi164.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:15:43.980 INFO:teuthology.orchestra.run.smithi164.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:15:43.981 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:15:43.982 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:15:43.983 INFO:teuthology.orchestra.run.smithi164.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:15:43.984 INFO:teuthology.orchestra.run.smithi164.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.985 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:15:43.986 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:15:43.987 INFO:teuthology.orchestra.run.smithi164.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.988 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:15:43.989 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:15:43.990 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.991 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:15:43.992 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:15:43.993 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:15:43.994 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:15:43.995 INFO:teuthology.orchestra.run.smithi164.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:15:43.995 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:15:43.995 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T11:15:44.125 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:15:44.156 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:15:44.179 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:15:44.179 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:44.180 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:15:44.180 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:15:44.180 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:15:44.180 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:44.231 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:15:44.243 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:15:44.266 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:15:44.295 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:15:44.343 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:15:44.367 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:15:44.382 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:15:44.382 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:15:44.382 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:44.420 DEBUG:teuthology.parallel:result is None 2024-09-14T11:15:45.334 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:15:45.357 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:15:45.357 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:45.357 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:15:45.357 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:15:45.358 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:15:45.358 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:45.402 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:15:45.424 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:15:45.424 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:45.424 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:15:45.425 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:45.736 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:15:45.758 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:15:45.759 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:15:45.759 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:15:45.759 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:15:45.759 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:15:45.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:50.461 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:15:50.505 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:15:50.537 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:15:50.641 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:15:50.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:15:50.736 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:15:50.737 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:15:50.829 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:15:50.829 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:50.928 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:15:50.954 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:15:50.961 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:15:50.969 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:15:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:15:50.979 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:15:50.979 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:15:50.979 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:15:51.034 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:15:51.101 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:16:01.058 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:16:01.059 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:16:01.060 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:16:01.081 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:16:01.082 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:16:01.083 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:16:01.084 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:16:01.085 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:16:01.086 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:16:01.087 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:16:01.088 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:16:01.089 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:16:01.090 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:16:01.091 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:16:01.092 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:16:01.093 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:16:01.094 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:16:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:16:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:16:01.097 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:16:01.098 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:16:01.099 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:16:04.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:16:04.655 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:04.655 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-14T11:16:04.655 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.655 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:16:04.656 INFO:teuthology.orchestra.run.smithi116.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.658 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:16:04.659 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:16:04.660 INFO:teuthology.orchestra.run.smithi116.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:16:04.661 INFO:teuthology.orchestra.run.smithi116.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:16:04.662 INFO:teuthology.orchestra.run.smithi116.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:16:04.663 INFO:teuthology.orchestra.run.smithi116.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:16:04.664 INFO:teuthology.orchestra.run.smithi116.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:16:04.665 INFO:teuthology.orchestra.run.smithi116.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:16:04.666 INFO:teuthology.orchestra.run.smithi116.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:16:04.667 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:16:04.668 INFO:teuthology.orchestra.run.smithi116.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:16:04.669 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:16:04.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:16:04.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:16:04.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:16:04.675 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:16:04.676 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:16:04.677 INFO:teuthology.orchestra.run.smithi116.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:16:04.677 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:04.677 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T11:16:05.101 DEBUG:teuthology.parallel:result is None 2024-09-14T11:16:05.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:16:05.323 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:16:05.384 INFO:teuthology.orchestra.run.smithi116.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:16:05.385 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:16:05.385 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:16:05.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:16:05.535 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:16:05.610 INFO:teuthology.orchestra.run.smithi164.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:16:05.610 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:16:05.610 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:16:05.612 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:16:05.612 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:05.612 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:16:05.653 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:05.653 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:16:05.700 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:16:05.700 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:05.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:16:05.738 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:16:05.817 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:05.817 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:16:05.858 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:16:05.938 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:16:05.939 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:05.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:16:05.977 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:16:06.054 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:06.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:16:06.096 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:16:06.175 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:16:06.175 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:06.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:16:06.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:16:06.291 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:06.291 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:16:06.330 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:16:06.409 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:16:06.488 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:16:06.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-09-14T11:16:06.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-14T11:16:06.537 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:16:06.537 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:16:06.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:16:06.608 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:16:06.609 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:16:06.647 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:16:06.703 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:16:06.703 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:16:06.703 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904177', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMMosFq9obtVFkVTvsjN6VN3zo+RFn0QoWAiCXM+8KIbKgtJqjigb0tP22Yer08c/GWhN7MEk3pYpeTtI4vUK7M=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIkDiInCp8olwzAODIHzJfwE7U4M4p2cPKif2W0AcPCaAzgG+8VgulrGTX/lNtFLntpOSwje9CjOlEHC7RoNOfk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:16:06.704 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:16:06.725 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:16:06.759 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:16:06.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:16:06.838 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:06.838 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:16:06.902 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:16:06.902 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-14T11:16:06.970 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:16:06.970 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 11:15:52.132587902 +0000 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 11:12:55.442378094 +0000 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 11:12:55.442378094 +0000 2024-09-14T11:16:06.971 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 11:12:55.442378094 +0000 2024-09-14T11:16:06.971 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:16:07.048 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T11:16:07.048 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T11:16:07.048 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000235228 s, 2.2 MB/s 2024-09-14T11:16:07.049 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:16:07.119 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 11:15:52.132587902 +0000 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 11:12:55.770372619 +0000 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 11:12:55.770372619 +0000 2024-09-14T11:16:07.188 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 11:12:55.770372619 +0000 2024-09-14T11:16:07.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:16:07.266 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T11:16:07.266 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T11:16:07.266 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000282124 s, 1.8 MB/s 2024-09-14T11:16:07.267 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:16:07.337 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-14T11:16:07.405 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 11:15:52.133587885 +0000 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 11:12:56.097367160 +0000 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 11:12:56.097367160 +0000 2024-09-14T11:16:07.406 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 11:12:56.097367160 +0000 2024-09-14T11:16:07.406 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:16:07.483 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T11:16:07.484 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T11:16:07.484 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000230419 s, 2.2 MB/s 2024-09-14T11:16:07.485 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:16:07.554 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 11:15:52.133587885 +0000 2024-09-14T11:16:07.624 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 11:12:56.419361785 +0000 2024-09-14T11:16:07.625 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 11:12:56.419361785 +0000 2024-09-14T11:16:07.625 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 11:12:56.419361785 +0000 2024-09-14T11:16:07.625 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:16:07.701 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T11:16:07.701 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T11:16:07.701 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000182985 s, 2.8 MB/s 2024-09-14T11:16:07.702 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:16:07.772 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:07.772 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:07.773 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:16:07.804 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:16:07.804 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-14T11:16:07.874 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:16:07.874 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:07.874 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 11:15:31.571377453 +0000 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 11:12:55.456941376 +0000 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 11:12:55.456941376 +0000 2024-09-14T11:16:07.875 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 11:12:55.456941376 +0000 2024-09-14T11:16:07.875 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:16:07.951 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T11:16:07.952 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T11:16:07.952 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000208793 s, 2.5 MB/s 2024-09-14T11:16:07.953 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:16:08.024 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-14T11:16:08.092 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 11:15:31.571377453 +0000 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 11:12:55.784935568 +0000 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 11:12:55.784935568 +0000 2024-09-14T11:16:08.093 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 11:12:55.784935568 +0000 2024-09-14T11:16:08.093 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:16:08.169 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T11:16:08.170 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T11:16:08.170 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000197208 s, 2.6 MB/s 2024-09-14T11:16:08.171 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:16:08.240 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-14T11:16:08.308 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 11:15:31.572377435 +0000 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 11:12:56.097930025 +0000 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 11:12:56.097930025 +0000 2024-09-14T11:16:08.309 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 11:12:56.097930025 +0000 2024-09-14T11:16:08.309 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:16:08.386 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T11:16:08.387 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T11:16:08.387 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000226915 s, 2.3 MB/s 2024-09-14T11:16:08.388 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:16:08.458 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 11:15:31.572377435 +0000 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 11:12:56.415924393 +0000 2024-09-14T11:16:08.527 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 11:12:56.415924393 +0000 2024-09-14T11:16:08.528 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 11:12:56.415924393 +0000 2024-09-14T11:16:08.528 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:16:08.605 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T11:16:08.605 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T11:16:08.605 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000218563 s, 2.3 MB/s 2024-09-14T11:16:08.606 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:16:08.675 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:08.676 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:16:08.676 INFO:tasks.ceph:Generating config... 2024-09-14T11:16:08.677 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:16:08.677 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:16:08.678 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:16:08.678 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:16:08.679 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:16:08.679 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T11:16:08.679 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:16:08.679 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:16:08.679 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T11:16:08.679 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:16:08.679 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:16:08.679 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:16:08.679 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:16:08.680 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T11:16:08.681 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:16:08.681 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:16:08.681 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:16:08.681 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:16:08.752 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:16:08.754 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:16:08.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:16:08.850 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]'), ('mon.b', '172.21.15.164')] 2024-09-14T11:16:08.850 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.164', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:16:08.851 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:08.851 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:16:08.919 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --add b 172.21.15.164 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:09.019 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:09.019 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:16:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = quincy 2024-09-14T11:16:09.020 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2024-09-14T11:16:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:16:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:16:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:16:09.021 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 17 (quincy) 2024-09-14T11:16:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2024-09-14T11:16:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:16:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:16:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:16:09.022 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:16:09.024 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:16:09.053 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9ea4f55e-d790-4296-a9e1-7e935db87a03... 2024-09-14T11:16:09.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:16:09.096 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-09-14T11:16:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-09-14T11:16:09.152 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.153 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.164" 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: mon client directed command retry = 5 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: ms inject socket failures = 5000 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: osd heartbeat grace = 40 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:16:09.154 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-09-14T11:16:09.155 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-09-14T11:16:09.156 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug objclass = 20 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-09-14T11:16:09.157 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: osd fast shutdown = False 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: osd shutdown pgref assert = True 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T11:16:09.158 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-09-14T11:16:09.159 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:16:09.160 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd crush smoke test = False 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: debug rgw = 20 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: debug rgw notification = 20 2024-09-14T11:16:09.161 INFO:teuthology.orchestra.run.smithi116.stdout: rgw bucket counters cache = True 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw crypt require ssl = False 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw s3 auth use sts = True 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw torrent flag = True 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: rgw user counters cache = True 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: setgroup = ceph 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: setuser = ceph 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-09-14T11:16:09.162 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-14T11:16:09.163 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:16:09.164 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-14T11:16:09.165 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.164" 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon client directed command retry = 5 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: ms inject socket failures = 5000 2024-09-14T11:16:09.166 INFO:teuthology.orchestra.run.smithi164.stdout: osd heartbeat grace = 40 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-14T11:16:09.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug objclass = 20 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-09-14T11:16:09.169 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: osd fast shutdown = False 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: osd shutdown pgref assert = True 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:16:09.170 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.171 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd crush smoke test = False 2024-09-14T11:16:09.172 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: debug rgw = 20 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: debug rgw notification = 20 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw bucket counters cache = True 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw crypt require ssl = False 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:16:09.173 INFO:teuthology.orchestra.run.smithi164.stdout: rgw s3 auth use sts = True 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout: rgw torrent flag = True 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout: rgw user counters cache = True 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout: setgroup = ceph 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout: setuser = ceph 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-09-14T11:16:09.174 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-09-14T11:16:09.175 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:16:09.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:16:09.244 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:16:09.244 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:09.244 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:16:09.273 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:09.273 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:16:09.341 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:16:09.341 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:09.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:16:09.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:16:09.428 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:09.429 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:09.497 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:16:09.497 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:09.497 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:16:09.498 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:16:09.547 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:09.548 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:09.617 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:16:09.617 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:16:09.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:16:09.682 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:16:09.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:16:09.779 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:16:09.782 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:16:09.782 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:16:09.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:16:09.838 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:16:09.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:16:09.906 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:16:09.919 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:16:09.919 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:16:09.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:16:09.958 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:09.958 INFO:tasks.ceph:role: osd.0 2024-09-14T11:16:09.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:16:09.959 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:10.043 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:10.536 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T11:16:10.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T11:16:10.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:16:10.623 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:16:10.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:16:10.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:10.704 INFO:tasks.ceph:role: osd.1 2024-09-14T11:16:10.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:16:10.704 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:16:10.789 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:10.789 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:10.790 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:11.247 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T11:16:11.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T11:16:11.249 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:16:11.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:16:11.337 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:16:11.415 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:11.415 INFO:tasks.ceph:role: osd.2 2024-09-14T11:16:11.415 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:16:11.416 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:11.502 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:11.503 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:11.503 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:11.982 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T11:16:11.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T11:16:11.984 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:16:12.047 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:16:12.090 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:16:12.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:12.168 INFO:tasks.ceph:role: osd.3 2024-09-14T11:16:12.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:16:12.168 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:12.254 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:12.759 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T11:16:12.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T11:16:12.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:16:12.861 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:16:12.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:13.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:13.017+0000 7f2fb140c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:16:13.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:13.021+0000 7f2fb140c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:16:13.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:13.021+0000 7f2fb140c640 -1 bdev(0x555f12a95800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:13.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:13.021+0000 7f2fb140c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:16:16.176 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:16:16.219 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:16.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:16.322+0000 7f547d125640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:16:16.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:16.322+0000 7f547d125640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:16:16.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:16.322+0000 7f547d125640 -1 bdev(0x5616dcd4f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:16.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:16.322+0000 7f547d125640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:16:19.467 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:16:19.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:19.607+0000 7f4f58460640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:16:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:19.607+0000 7f4f58460640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:16:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:19.607+0000 7f4f58460640 -1 bdev(0x55b6843e1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:19.608+0000 7f4f58460640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:16:22.762 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:16:22.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:22.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:22.873+0000 7fe7c1e10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:16:22.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:22.874+0000 7fe7c1e10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:16:22.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:22.874+0000 7fe7c1e10640 -1 bdev(0x5593c5085800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:22.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:16:22.874+0000 7fe7c1e10640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:16:25.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:16:25.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:16:25.876 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:25.876 INFO:tasks.ceph:role: osd.4 2024-09-14T11:16:25.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:16:25.876 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:16:25.926 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:25.926 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:25.926 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:25.926 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:25.926 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:25.927 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:25.927 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:25.927 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:25.927 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:25.927 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:26.448 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T11:16:26.450 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T11:16:26.450 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:16:26.541 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:16:26.591 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:16:26.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:26.631 INFO:tasks.ceph:role: osd.5 2024-09-14T11:16:26.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:16:26.631 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:16:26.717 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:26.718 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:27.166 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T11:16:27.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T11:16:27.168 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:16:27.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:16:27.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:16:27.335 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:27.335 INFO:tasks.ceph:role: osd.6 2024-09-14T11:16:27.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:16:27.335 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:27.422 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:27.423 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:27.423 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:27.423 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:27.423 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:27.898 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T11:16:27.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T11:16:27.901 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:16:27.976 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:16:28.019 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:16:28.100 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:16:28.100 INFO:tasks.ceph:role: osd.7 2024-09-14T11:16:28.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:16:28.100 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:16:28.185 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:16:28.185 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:16:28.185 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:16:28.185 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:16:28.186 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:16:28.700 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T11:16:28.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T11:16:28.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:16:28.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:16:28.867 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:28.984+0000 7f4a1f00b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:16:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:28.988+0000 7f4a1f00b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:16:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:28.988+0000 7f4a1f00b640 -1 bdev(0x5565f4bb9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:28.988+0000 7f4a1f00b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:16:32.398 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:16:32.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:32.507+0000 7ff12ee0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:16:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:32.507+0000 7ff12ee0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:16:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:32.507+0000 7ff12ee0b640 -1 bdev(0x564a3e6f1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:32.508+0000 7ff12ee0b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:16:35.408 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:16:35.453 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:35.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:35.559+0000 7f5a30ed4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:16:35.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:35.559+0000 7f5a30ed4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:16:35.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:35.559+0000 7f5a30ed4640 -1 bdev(0x55b721ff1800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:35.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:35.559+0000 7f5a30ed4640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:16:38.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:16:38.504 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:38.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:38.605+0000 7fc88be15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:16:38.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:38.605+0000 7fc88be15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:16:38.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:38.606+0000 7fc88be15640 -1 bdev(0x556cb1627800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:16:38.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T11:16:38.606+0000 7fc88be15640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:16:42.011 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:16:42.055 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:16:42.056 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.056 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:16:42.101 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:16:42.183 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.183 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:16:42.264 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:16:42.344 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.344 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:16:42.422 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.422 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:16:42.467 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.467 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:16:42.549 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.550 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:16:42.631 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:16:42.710 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:16:42.788 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:42.788 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:16:42.817 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:42.817 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:16:42.856 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:16:42.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:16:42.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:16:42.899 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2024-09-14T11:16:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB5cOVm0+7VKBAA5jqhlKHiu8HROYyBPpbSxA== 2024-09-14T11:16:42.899 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-09-14T11:16:42.899 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB9cOVmF1YUARAAtlR+vxDnqM5Koox9TUruWg== 2024-09-14T11:16:42.899 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCAcOVm3EJAExAA6XWQmneZTxh2u3V36FPDew== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCDcOVmEbtEJBAAsRgmbmWhOg1ElOkNL08neQ== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCGcOVmlQsjNBAA6R91ikeuMjpmAmPF2C5tIA== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB5cOVmMwakLhAAKb7EWLHXrylcTlm7vLdKqQ== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCMcOVmkJ+6OhAAxnuSSD6a3AX2faWRV3JWvQ== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCQcOVm9NhNHhAArhDDlGPAhMu1zoQ3i+SGHw== 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2024-09-14T11:16:42.900 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCTcOVmaE9kIRAATs5b9jRz88yLd8M8CaTsJQ== 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCWcOVm/pwlJBAAxv4SiRMO9edGZP8JDe1jYA== 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB5cOVmLIIlMhAAXP9uCWlP3bPIyDmIi+rxMg== 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2024-09-14T11:16:42.901 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB5cOVmSws0NhAA+5YhDex27DJFCtNjEKq4sQ== 2024-09-14T11:16:42.932 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-09-14T11:16:42.932 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB5cOVm0+7VKBAA5jqhlKHiu8HROYyBPpbSxA== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB9cOVmF1YUARAAtlR+vxDnqM5Koox9TUruWg== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCAcOVm3EJAExAA6XWQmneZTxh2u3V36FPDew== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCDcOVmEbtEJBAAsRgmbmWhOg1ElOkNL08neQ== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCGcOVmlQsjNBAA6R91ikeuMjpmAmPF2C5tIA== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB5cOVmMwakLhAAKb7EWLHXrylcTlm7vLdKqQ== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCMcOVmkJ+6OhAAxnuSSD6a3AX2faWRV3JWvQ== 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-09-14T11:16:42.933 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCQcOVm9NhNHhAArhDDlGPAhMu1zoQ3i+SGHw== 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCTcOVmaE9kIRAATs5b9jRz88yLd8M8CaTsJQ== 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQCWcOVm/pwlJBAAxv4SiRMO9edGZP8JDe1jYA== 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB5cOVmLIIlMhAAXP9uCWlP3bPIyDmIi+rxMg== 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout:[client.1] 2024-09-14T11:16:42.934 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB5cOVmSws0NhAA+5YhDex27DJFCtNjEKq4sQ== 2024-09-14T11:16:42.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:16:42.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:16:43.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.108 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.242 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.244 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:16:43.311 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:16:43.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.444 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.577 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:16:43.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:16:43.643 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:16:43.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:16:43.712 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:16:43.779 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:16:43.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:16:43.817 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:16:43.926 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:16:43.964 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:16:44.043 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:16:44.152 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:16:44.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:16:44.231 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:16:44.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:16:44.381 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:44.383 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:16:44.450 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:16:44.450 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:16:44.450 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:16:44.453 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:16:44.453 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:16:44.453 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:16:44.455 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:16:44.455 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:16:44.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:16:44.492 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:16:44.492 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:16:44.493 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:16:44.493 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:16:44.495 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:16:44.495 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:16:44.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:16:44.497 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:16:44.497 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:16:44.498 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:16:44.498 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:16:50.713 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2024-09-14T11:16:50.725 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:16:50.725 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:16:50.725 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:50.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:16:50.763 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:50.763 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:16:50.842 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:50.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:16:50.921 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:16:50.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:16:50.999 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:51.000 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:16:51.040 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:51.040 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:16:51.120 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:51.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:16:51.198 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T11:16:51.198 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:16:51.278 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 5a379627-1eb6-4938-86c2-3f6af8970961 0 2024-09-14T11:16:51.516 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-14T11:16:51.527 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new f7257bc2-c8fe-4d5c-85c5-9614fdc5c376 1 2024-09-14T11:16:51.727 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-14T11:16:51.739 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 73958567-8e54-4d9e-a4a5-1f4e59c56dd5 2 2024-09-14T11:16:51.934 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-14T11:16:51.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new e2e04359-e38e-4b32-b612-98975e4a6de2 3 2024-09-14T11:16:52.144 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-09-14T11:16:52.155 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new d12c1f68-d722-4bb5-9b41-d6d0c01023d5 4 2024-09-14T11:16:52.352 INFO:teuthology.orchestra.run.smithi164.stdout:4 2024-09-14T11:16:52.363 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new db13233b-567b-4f7d-957d-8d18f3851184 5 2024-09-14T11:16:52.564 INFO:teuthology.orchestra.run.smithi164.stdout:5 2024-09-14T11:16:52.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new a35a6e30-031c-4934-a3e2-f790d1a776cc 6 2024-09-14T11:16:52.774 INFO:teuthology.orchestra.run.smithi164.stdout:6 2024-09-14T11:16:52.785 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 10f8a7ac-c6cd-4718-8e18-d869ffc93351 7 2024-09-14T11:16:52.977 INFO:teuthology.orchestra.run.smithi164.stdout:7 2024-09-14T11:16:52.988 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:16:52.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:16:52.991 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:16:52.991 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:16:52.991 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:16:52.993 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:16:52.993 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:16:52.993 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:16:52.995 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:16:52.995 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:16:52.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:16:52.998 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:16:52.998 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:16:52.998 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:16:53.000 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:16:53.000 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:16:53.000 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:16:53.002 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:16:53.002 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:16:53.003 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:16:53.007 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:16:53.007 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:16:53.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:16:53.009 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:16:53.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:16:53.223 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:16:53.224 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":10,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:16:52.978559+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:16:53.235 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:16:53.235 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:16:54.041 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:16:54.210 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T11:16:54.210 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:16:52.978559+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:16:54.220 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:16:54.278 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T11:16:54.280+0000 7fc157c1d640 -1 Falling back to public interface 2024-09-14T11:16:54.472 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-14T11:16:54.473+0000 7f958800d640 -1 Falling back to public interface 2024-09-14T11:16:54.473 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-14T11:16:54.474+0000 7fc14680b640 -1 Falling back to public interface 2024-09-14T11:16:54.483 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T11:16:54.485+0000 7fb9cc3a2640 -1 Falling back to public interface 2024-09-14T11:16:54.496 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-14T11:16:54.497+0000 7f0f83c0e640 -1 Falling back to public interface 2024-09-14T11:16:54.522 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-14T11:16:54.523+0000 7fabd4a18640 -1 Falling back to public interface 2024-09-14T11:16:54.526 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-14T11:16:54.527+0000 7f5680a2e640 -1 Falling back to public interface 2024-09-14T11:16:54.767 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T11:16:54.768+0000 7f82eec64640 -1 Falling back to public interface 2024-09-14T11:16:55.004 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-09-14T11:16:55.006+0000 7f5a016cf640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:16:55.005 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-09-14T11:16:55.006+0000 7f5a016cf640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:16:58.049 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T11:16:58.050+0000 7fb9cc3a2640 -1 osd.0 0 log_to_monitors true 2024-09-14T11:16:58.242 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-14T11:16:58.242+0000 7fc14680b640 -1 osd.5 0 log_to_monitors true 2024-09-14T11:16:58.248 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-14T11:16:58.250+0000 7f958800d640 -1 osd.3 0 log_to_monitors true 2024-09-14T11:16:58.347 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T11:16:58.348+0000 7fc157c1d640 -1 osd.1 0 log_to_monitors true 2024-09-14T11:16:58.491 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-14T11:16:58.491+0000 7f0f83c0e640 -1 osd.4 0 log_to_monitors true 2024-09-14T11:16:58.559 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-14T11:16:58.560+0000 7fabd4a18640 -1 osd.7 0 log_to_monitors true 2024-09-14T11:16:58.590 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-14T11:16:58.591+0000 7f5680a2e640 -1 osd.6 0 log_to_monitors true 2024-09-14T11:16:58.593 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T11:16:58.595+0000 7f82eec64640 -1 osd.2 0 log_to_monitors true 2024-09-14T11:16:59.932 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T11:16:59.934+0000 7fb9c8336640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:16:59.942 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T11:16:59.944+0000 7fb9c0155640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:01.026 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:17:01.458 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T11:17:01.458 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":13,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:17:00.111337+0000","last_up_change":"2024-09-14T11:17:00.111337+0000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6819","nonce":834372472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6821","nonce":834372472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6825","nonce":834372472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6823","nonce":834372472}]},"public_addr":"172.21.15.116:6819/834372472","cluster_addr":"172.21.15.116:6821/834372472","heartbeat_back_addr":"172.21.15.116:6825/834372472","heartbeat_front_addr":"172.21.15.116:6823/834372472","state":["exists","up"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:17:01.475 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-14T11:17:01.752 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T11:17:01.753+0000 7fc1535e8640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:17:01.760 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-09-14T11:17:01.762+0000 7fc14b418640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:01.788 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-14T11:17:01.789+0000 7f95838f2640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:17:01.807 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-14T11:17:01.809+0000 7f957b711640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:01.852 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T11:17:01.853+0000 7f82eabf8640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:17:01.864 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-09-14T11:17:01.866+0000 7f82e2a17640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:02.202 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-14T11:17:02.203+0000 7f0f7f48b640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:17:02.206 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-14T11:17:02.206+0000 7fc142250640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:17:02.208 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-14T11:17:02.209+0000 7fabd02a6640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:17:02.214 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-09-14T11:17:02.215+0000 7f0f772aa640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:02.220 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-09-14T11:17:02.221+0000 7fc13a06f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:02.227 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-09-14T11:17:02.228+0000 7fabc80c5640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:02.230 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-14T11:17:02.231+0000 7f567bf94640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:17:02.253 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-09-14T11:17:02.255+0000 7f5673db3640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:17:08.281 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:17:08.581 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T11:17:08.582 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":19,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:17:06.876293+0000","last_up_change":"2024-09-14T11:17:02.757629+0000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:17:04.015301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6819","nonce":834372472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6821","nonce":834372472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6825","nonce":834372472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6823","nonce":834372472}]},"public_addr":"172.21.15.116:6819/834372472","cluster_addr":"172.21.15.116:6821/834372472","heartbeat_back_addr":"172.21.15.116:6825/834372472","heartbeat_front_addr":"172.21.15.116:6823/834372472","state":["exists","up"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6803","nonce":3246304000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6805","nonce":3246304000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6809","nonce":3246304000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6807","nonce":3246304000}]},"public_addr":"172.21.15.116:6803/3246304000","cluster_addr":"172.21.15.116:6805/3246304000","heartbeat_back_addr":"172.21.15.116:6809/3246304000","heartbeat_front_addr":"172.21.15.116:6807/3246304000","state":["exists","up"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6827","nonce":1774573854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6829","nonce":1774573854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6833","nonce":1774573854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6831","nonce":1774573854}]},"public_addr":"172.21.15.116:6827/1774573854","cluster_addr":"172.21.15.116:6829/1774573854","heartbeat_back_addr":"172.21.15.116:6833/1774573854","heartbeat_front_addr":"172.21.15.116:6831/1774573854","state":["exists","up"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6811","nonce":4152832586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6813","nonce":4152832586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6817","nonce":4152832586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6815","nonce":4152832586}]},"public_addr":"172.21.15.116:6811/4152832586","cluster_addr":"172.21.15.116:6813/4152832586","heartbeat_back_addr":"172.21.15.116:6817/4152832586","heartbeat_front_addr":"172.21.15.116:6815/4152832586","state":["exists","up"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6809","nonce":1086332038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6811","nonce":1086332038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6815","nonce":1086332038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6813","nonce":1086332038}]},"public_addr":"172.21.15.164:6809/1086332038","cluster_addr":"172.21.15.164:6811/1086332038","heartbeat_back_addr":"172.21.15.164:6815/1086332038","heartbeat_front_addr":"172.21.15.164:6813/1086332038","state":["exists","up"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6801","nonce":3190735033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6803","nonce":3190735033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6807","nonce":3190735033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6805","nonce":3190735033}]},"public_addr":"172.21.15.164:6801/3190735033","cluster_addr":"172.21.15.164:6803/3190735033","heartbeat_back_addr":"172.21.15.164:6807/3190735033","heartbeat_front_addr":"172.21.15.164:6805/3190735033","state":["exists","up"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6825","nonce":3391939760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6827","nonce":3391939760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6831","nonce":3391939760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6829","nonce":3391939760}]},"public_addr":"172.21.15.164:6825/3391939760","cluster_addr":"172.21.15.164:6827/3391939760","heartbeat_back_addr":"172.21.15.164:6831/3391939760","heartbeat_front_addr":"172.21.15.164:6829/3391939760","state":["exists","up"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6817","nonce":4224008643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6819","nonce":4224008643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6823","nonce":4224008643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6821","nonce":4224008643}]},"public_addr":"172.21.15.164:6817/4224008643","cluster_addr":"172.21.15.164:6819/4224008643","heartbeat_back_addr":"172.21.15.164:6823/4224008643","heartbeat_front_addr":"172.21.15.164:6821/4224008643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.018027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.346574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.610069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.221144+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.477303+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.251615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595959+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:17:08.593 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:17:08.593 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:17:08.593 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:17:09.895 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'rbd' created 2024-09-14T11:17:09.911 DEBUG:teuthology.orchestra.run.smithi116:> rbd --cluster ceph pool init rbd 2024-09-14T11:17:10.184 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:10.184 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:12.938 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:17:12.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:17:12.939 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:17:13.257 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:13.270 INFO:teuthology.orchestra.run.smithi116.stdout:[{"version":9,"timestamp":"2024-09-14T11:17:02.233898+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5010.069179"}]}] 2024-09-14T11:17:13.270 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:17:13.270 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:17:13.270 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:17:13.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:17:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:13.643 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2191273462},{"type":"v1","addr":"172.21.15.116:6801","nonce":2191273462}]},"active_addr":"172.21.15.116:6801/2191273462","active_change":"2024-09-14T11:16:53.995239+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2124286094}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":155189510}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":1388698612}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":3321516135}]}]} 2024-09-14T11:17:13.647 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:17:13.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:17:13.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:17:13.960 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:13.960 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":23,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:17:12.913400+0000","last_up_change":"2024-09-14T11:17:02.757629+0000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:17:04.015301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:17:08.891946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6819","nonce":834372472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6821","nonce":834372472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6825","nonce":834372472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6823","nonce":834372472}]},"public_addr":"172.21.15.116:6819/834372472","cluster_addr":"172.21.15.116:6821/834372472","heartbeat_back_addr":"172.21.15.116:6825/834372472","heartbeat_front_addr":"172.21.15.116:6823/834372472","state":["exists","up"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6803","nonce":3246304000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6805","nonce":3246304000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6809","nonce":3246304000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6807","nonce":3246304000}]},"public_addr":"172.21.15.116:6803/3246304000","cluster_addr":"172.21.15.116:6805/3246304000","heartbeat_back_addr":"172.21.15.116:6809/3246304000","heartbeat_front_addr":"172.21.15.116:6807/3246304000","state":["exists","up"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6827","nonce":1774573854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6829","nonce":1774573854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6833","nonce":1774573854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6831","nonce":1774573854}]},"public_addr":"172.21.15.116:6827/1774573854","cluster_addr":"172.21.15.116:6829/1774573854","heartbeat_back_addr":"172.21.15.116:6833/1774573854","heartbeat_front_addr":"172.21.15.116:6831/1774573854","state":["exists","up"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6811","nonce":4152832586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6813","nonce":4152832586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6817","nonce":4152832586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6815","nonce":4152832586}]},"public_addr":"172.21.15.116:6811/4152832586","cluster_addr":"172.21.15.116:6813/4152832586","heartbeat_back_addr":"172.21.15.116:6817/4152832586","heartbeat_front_addr":"172.21.15.116:6815/4152832586","state":["exists","up"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6809","nonce":1086332038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6811","nonce":1086332038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6815","nonce":1086332038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6813","nonce":1086332038}]},"public_addr":"172.21.15.164:6809/1086332038","cluster_addr":"172.21.15.164:6811/1086332038","heartbeat_back_addr":"172.21.15.164:6815/1086332038","heartbeat_front_addr":"172.21.15.164:6813/1086332038","state":["exists","up"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6801","nonce":3190735033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6803","nonce":3190735033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6807","nonce":3190735033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6805","nonce":3190735033}]},"public_addr":"172.21.15.164:6801/3190735033","cluster_addr":"172.21.15.164:6803/3190735033","heartbeat_back_addr":"172.21.15.164:6807/3190735033","heartbeat_front_addr":"172.21.15.164:6805/3190735033","state":["exists","up"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6825","nonce":3391939760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6827","nonce":3391939760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6831","nonce":3391939760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6829","nonce":3391939760}]},"public_addr":"172.21.15.164:6825/3391939760","cluster_addr":"172.21.15.164:6827/3391939760","heartbeat_back_addr":"172.21.15.164:6831/3391939760","heartbeat_front_addr":"172.21.15.164:6829/3391939760","state":["exists","up"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6817","nonce":4224008643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6819","nonce":4224008643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6823","nonce":4224008643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6821","nonce":4224008643}]},"public_addr":"172.21.15.164:6817/4224008643","cluster_addr":"172.21.15.164:6819/4224008643","heartbeat_back_addr":"172.21.15.164:6823/4224008643","heartbeat_front_addr":"172.21.15.164:6821/4224008643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.018027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.346574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.610069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.221144+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.477303+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.251615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595959+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:17:13.973 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:17:13.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:17:14.279 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:14.279 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":23,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:17:12.913400+0000","last_up_change":"2024-09-14T11:17:02.757629+0000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:17:04.015301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:17:08.891946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6819","nonce":834372472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6821","nonce":834372472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6825","nonce":834372472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6823","nonce":834372472}]},"public_addr":"172.21.15.116:6819/834372472","cluster_addr":"172.21.15.116:6821/834372472","heartbeat_back_addr":"172.21.15.116:6825/834372472","heartbeat_front_addr":"172.21.15.116:6823/834372472","state":["exists","up"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6803","nonce":3246304000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6805","nonce":3246304000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6809","nonce":3246304000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6807","nonce":3246304000}]},"public_addr":"172.21.15.116:6803/3246304000","cluster_addr":"172.21.15.116:6805/3246304000","heartbeat_back_addr":"172.21.15.116:6809/3246304000","heartbeat_front_addr":"172.21.15.116:6807/3246304000","state":["exists","up"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6827","nonce":1774573854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6829","nonce":1774573854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6833","nonce":1774573854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6831","nonce":1774573854}]},"public_addr":"172.21.15.116:6827/1774573854","cluster_addr":"172.21.15.116:6829/1774573854","heartbeat_back_addr":"172.21.15.116:6833/1774573854","heartbeat_front_addr":"172.21.15.116:6831/1774573854","state":["exists","up"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6811","nonce":4152832586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6813","nonce":4152832586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6817","nonce":4152832586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6815","nonce":4152832586}]},"public_addr":"172.21.15.116:6811/4152832586","cluster_addr":"172.21.15.116:6813/4152832586","heartbeat_back_addr":"172.21.15.116:6817/4152832586","heartbeat_front_addr":"172.21.15.116:6815/4152832586","state":["exists","up"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6809","nonce":1086332038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6811","nonce":1086332038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6815","nonce":1086332038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6813","nonce":1086332038}]},"public_addr":"172.21.15.164:6809/1086332038","cluster_addr":"172.21.15.164:6811/1086332038","heartbeat_back_addr":"172.21.15.164:6815/1086332038","heartbeat_front_addr":"172.21.15.164:6813/1086332038","state":["exists","up"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6801","nonce":3190735033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6803","nonce":3190735033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6807","nonce":3190735033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6805","nonce":3190735033}]},"public_addr":"172.21.15.164:6801/3190735033","cluster_addr":"172.21.15.164:6803/3190735033","heartbeat_back_addr":"172.21.15.164:6807/3190735033","heartbeat_front_addr":"172.21.15.164:6805/3190735033","state":["exists","up"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6825","nonce":3391939760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6827","nonce":3391939760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6831","nonce":3391939760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6829","nonce":3391939760}]},"public_addr":"172.21.15.164:6825/3391939760","cluster_addr":"172.21.15.164:6827/3391939760","heartbeat_back_addr":"172.21.15.164:6831/3391939760","heartbeat_front_addr":"172.21.15.164:6829/3391939760","state":["exists","up"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6817","nonce":4224008643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6819","nonce":4224008643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6823","nonce":4224008643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6821","nonce":4224008643}]},"public_addr":"172.21.15.164:6817/4224008643","cluster_addr":"172.21.15.164:6819/4224008643","heartbeat_back_addr":"172.21.15.164:6823/4224008643","heartbeat_front_addr":"172.21.15.164:6821/4224008643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.018027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.346574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.610069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.221144+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.477303+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.251615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595959+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:17:14.292 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:17:14.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:17:14.293 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:17:14.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:17:14.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:17:14.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:17:14.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:17:14.296 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:17:14.549 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:14.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:17:14.554 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-09-14T11:17:14.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:17:14.556 INFO:teuthology.orchestra.run.smithi116.stdout:64424509447 2024-09-14T11:17:14.556 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:17:14.558 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:14.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:17:14.559 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:14.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:17:14.560 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:14.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:17:14.564 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:14.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:17:14.566 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:14.566 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:17:15.171 INFO:teuthology.orchestra.run.smithi116.stdout:64424509443 2024-09-14T11:17:15.178 INFO:teuthology.orchestra.run.smithi116.stdout:55834574852 2024-09-14T11:17:15.178 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:15.189 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:15.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2024-09-14T11:17:15.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-14T11:17:15.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-14T11:17:15.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-09-14T11:17:15.230 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:15.230 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:15.237 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:15.242 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:15.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-14T11:17:15.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-09-14T11:17:15.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-14T11:17:15.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-14T11:17:16.193 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:17:16.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:17:16.202 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:17:16.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:17:16.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:17:16.253 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:17:16.253 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:17:16.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:17:16.791 INFO:teuthology.orchestra.run.smithi116.stdout:64424509443 2024-09-14T11:17:16.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2024-09-14T11:17:16.826 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:16.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-14T11:17:16.845 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:16.861 INFO:teuthology.orchestra.run.smithi116.stdout:55834574852 2024-09-14T11:17:16.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-09-14T11:17:16.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-14T11:17:16.881 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:16.890 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:16.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-14T11:17:16.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-14T11:17:16.918 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:16.923 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:16.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-14T11:17:16.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-09-14T11:17:17.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:17:17.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:17:17.865 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:17:17.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:17:17.896 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:17:17.903 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:17:17.932 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:17:17.937 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:17:18.360 INFO:teuthology.orchestra.run.smithi116.stdout:64424509444 2024-09-14T11:17:18.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.7 2024-09-14T11:17:18.377 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.446 INFO:teuthology.orchestra.run.smithi116.stdout:64424509447 2024-09-14T11:17:18.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-14T11:17:18.464 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.470 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:18.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-14T11:17:18.488 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.490 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:18.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-14T11:17:18.503 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.509 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-09-14T11:17:18.524 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:18.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-09-14T11:17:18.526 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-14T11:17:18.542 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.546 INFO:teuthology.orchestra.run.smithi116.stdout:64424509446 2024-09-14T11:17:18.557 INFO:teuthology.orchestra.run.smithi116.stdout:64424509445 2024-09-14T11:17:18.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-14T11:17:18.558 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-14T11:17:18.570 DEBUG:teuthology.parallel:result is None 2024-09-14T11:17:18.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:17:18.570 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:17:18.906 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:18.906 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T11:17:18.918 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-14T11:17:18.003039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219272,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755448,"statfs":{"total":773094113280,"available":772869578752,"internally_reserved":0,"allocated":3063808,"data_stored":1814350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.094963"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098327+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T11:17:13.098327+0000","last_peered":"2024-09-14T11:17:13.098327+0000","last_clean":"2024-09-14T11:17:13.098327+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T11:17:13.098327+0000","last_undegraded":"2024-09-14T11:17:13.098327+0000","last_fullsized":"2024-09-14T11:17:13.098327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935913+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T11:17:12.935913+0000","last_peered":"2024-09-14T11:17:12.935913+0000","last_clean":"2024-09-14T11:17:12.935913+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T11:17:12.935913+0000","last_undegraded":"2024-09-14T11:17:12.935913+0000","last_fullsized":"2024-09-14T11:17:12.935913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098634+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T11:17:13.098634+0000","last_peered":"2024-09-14T11:17:13.098634+0000","last_clean":"2024-09-14T11:17:13.098634+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T11:17:13.098634+0000","last_undegraded":"2024-09-14T11:17:13.098634+0000","last_fullsized":"2024-09-14T11:17:13.098634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935986+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T11:17:12.935986+0000","last_peered":"2024-09-14T11:17:12.935986+0000","last_clean":"2024-09-14T11:17:12.935986+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T11:17:12.935986+0000","last_undegraded":"2024-09-14T11:17:12.935986+0000","last_fullsized":"2024-09-14T11:17:12.935986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935085+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T11:17:12.935085+0000","last_peered":"2024-09-14T11:17:12.935085+0000","last_clean":"2024-09-14T11:17:12.935085+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T11:17:12.935085+0000","last_undegraded":"2024-09-14T11:17:12.935085+0000","last_fullsized":"2024-09-14T11:17:12.935085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098577+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T11:17:13.098577+0000","last_peered":"2024-09-14T11:17:13.098577+0000","last_clean":"2024-09-14T11:17:13.098577+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T11:17:13.098577+0000","last_undegraded":"2024-09-14T11:17:13.098577+0000","last_fullsized":"2024-09-14T11:17:13.098577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098465+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T11:17:13.098465+0000","last_peered":"2024-09-14T11:17:13.098465+0000","last_clean":"2024-09-14T11:17:13.098465+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T11:17:13.098465+0000","last_undegraded":"2024-09-14T11:17:13.098465+0000","last_fullsized":"2024-09-14T11:17:13.098465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.933819+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T11:17:12.933819+0000","last_peered":"2024-09-14T11:17:12.933819+0000","last_clean":"2024-09-14T11:17:12.933819+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T11:17:12.933819+0000","last_undegraded":"2024-09-14T11:17:12.933819+0000","last_fullsized":"2024-09-14T11:17:12.933819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098070+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T11:17:13.098070+0000","last_peered":"2024-09-14T11:17:13.098070+0000","last_clean":"2024-09-14T11:17:13.098070+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T11:17:13.098070+0000","last_undegraded":"2024-09-14T11:17:13.098070+0000","last_fullsized":"2024-09-14T11:17:13.098070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:17:18.919 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:17:19.214 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:19.214 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T11:17:19.226 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-14T11:17:18.003039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219272,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755448,"statfs":{"total":773094113280,"available":772869578752,"internally_reserved":0,"allocated":3063808,"data_stored":1814350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.094963"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098327+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T11:17:13.098327+0000","last_peered":"2024-09-14T11:17:13.098327+0000","last_clean":"2024-09-14T11:17:13.098327+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T11:17:13.098327+0000","last_undegraded":"2024-09-14T11:17:13.098327+0000","last_fullsized":"2024-09-14T11:17:13.098327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935913+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T11:17:12.935913+0000","last_peered":"2024-09-14T11:17:12.935913+0000","last_clean":"2024-09-14T11:17:12.935913+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T11:17:12.935913+0000","last_undegraded":"2024-09-14T11:17:12.935913+0000","last_fullsized":"2024-09-14T11:17:12.935913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098634+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T11:17:13.098634+0000","last_peered":"2024-09-14T11:17:13.098634+0000","last_clean":"2024-09-14T11:17:13.098634+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T11:17:13.098634+0000","last_undegraded":"2024-09-14T11:17:13.098634+0000","last_fullsized":"2024-09-14T11:17:13.098634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935986+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T11:17:12.935986+0000","last_peered":"2024-09-14T11:17:12.935986+0000","last_clean":"2024-09-14T11:17:12.935986+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T11:17:12.935986+0000","last_undegraded":"2024-09-14T11:17:12.935986+0000","last_fullsized":"2024-09-14T11:17:12.935986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.935085+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T11:17:12.935085+0000","last_peered":"2024-09-14T11:17:12.935085+0000","last_clean":"2024-09-14T11:17:12.935085+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T11:17:12.935085+0000","last_undegraded":"2024-09-14T11:17:12.935085+0000","last_fullsized":"2024-09-14T11:17:12.935085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098577+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T11:17:13.098577+0000","last_peered":"2024-09-14T11:17:13.098577+0000","last_clean":"2024-09-14T11:17:13.098577+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T11:17:13.098577+0000","last_undegraded":"2024-09-14T11:17:13.098577+0000","last_fullsized":"2024-09-14T11:17:13.098577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098465+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T11:17:13.098465+0000","last_peered":"2024-09-14T11:17:13.098465+0000","last_clean":"2024-09-14T11:17:13.098465+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T11:17:13.098465+0000","last_undegraded":"2024-09-14T11:17:13.098465+0000","last_fullsized":"2024-09-14T11:17:13.098465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:12.933819+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T11:17:12.933819+0000","last_peered":"2024-09-14T11:17:12.933819+0000","last_clean":"2024-09-14T11:17:12.933819+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T11:17:12.933819+0000","last_undegraded":"2024-09-14T11:17:12.933819+0000","last_fullsized":"2024-09-14T11:17:12.933819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-14T11:17:13.098070+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T11:17:13.098070+0000","last_peered":"2024-09-14T11:17:13.098070+0000","last_clean":"2024-09-14T11:17:13.098070+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T11:17:13.098070+0000","last_undegraded":"2024-09-14T11:17:13.098070+0000","last_fullsized":"2024-09-14T11:17:13.098070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":237568,"data_stored":79216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:17:19.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:17:19.227 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:17:19.227 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:17:19.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:17:19.562 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:17:19.574 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:17:19.575 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:17:19.586 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:17:19.604 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T11:17:19.604 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:17:19.604 INFO:tasks.rgw:Creating data pools 2024-09-14T11:17:19.604 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:17:19.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-14T11:17:20.564 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:17:20.582 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:17:21.569 INFO:teuthology.orchestra.run.smithi116.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:17:21.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:17:22.570 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:17:22.591 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:17:23.571 INFO:teuthology.orchestra.run.smithi116.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:17:23.598 DEBUG:tasks.rgw:Pools created 2024-09-14T11:17:23.599 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:17:23.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:17:23.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:17:23.599 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:17:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:23.710 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:25.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.643+0000 7f54ceb71640 0 -- 172.21.15.116:0/4034594829 >> [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] conn(0x7f53a4077140 msgr2=0x7f53a4079600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:25.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.647+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.648+0000 7f54cf372640 0 -- 172.21.15.116:0/2715457125 >> [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] conn(0x7f5394077230 msgr2=0x7f53940796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:25.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 realm 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.649+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.650+0000 7f54d1087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:25.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.650+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.651+0000 7f54d1087800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:17:25.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.651+0000 7f54d1087800 20 searching for the correct realm 2024-09-14T11:17:25.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.662+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.663+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.663+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.663+0000 7f54d1087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.663+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:17:25.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 zone default found 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 4 Realm: () 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 zonegroup default 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:25.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:25.664+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:27.629+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:27.629+0000 7f54d1087800 20 rados->read ofs=0 len=0 2024-09-14T11:17:27.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:27.630+0000 7f54d1087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:27.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:27.630+0000 7f54d1087800 20 started sync module instance, tier type = 2024-09-14T11:17:27.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:27.630+0000 7f54d1087800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:17:29.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=0 2024-09-14T11:17:29.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=1 2024-09-14T11:17:29.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=2 2024-09-14T11:17:29.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=3 2024-09-14T11:17:29.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=4 2024-09-14T11:17:29.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=5 2024-09-14T11:17:29.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.669+0000 7f54d1087800 20 add_watcher() i=6 2024-09-14T11:17:29.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 add_watcher() i=7 2024-09-14T11:17:29.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.670+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:17:29.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.671+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.672+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.672+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.672+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:17:29.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:17:29.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:17:29.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:17:29.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.673+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:17:29.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:17:29.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:17:29.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:17:29.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.674+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:17:29.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:17:29.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.675+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:17:29.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.676+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:17:29.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:17:29.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:17:29.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:17:29.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:17:29.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.677+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.678+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:17:29.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.679+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:17:29.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.680+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:17:29.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:17:29.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.681+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:17:29.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.682+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.683+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:17:29.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.684+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:17:29.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.685+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:17:29.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.686+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:17:29.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:17:29.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.687+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:17:29.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.688+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:17:29.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.689+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.690+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:17:29.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.691+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.692+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.693+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:17:29.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.694+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:17:29.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.695+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.696+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:17:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.697+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:17:29.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:17:29.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:17:29.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.698+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.699+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.700+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:17:29.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.701+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:17:29.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:17:29.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.702+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.703+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:17:29.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.704+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.705+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.705+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:17:29.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.705+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.705+0000 7f54d1087800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.705+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.706+0000 7f54d1087800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.713+0000 7f53817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.713+0000 7f54d1087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:29.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:29.713+0000 7f54d1087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:32.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.645+0000 7f54d1087800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:17:32.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.645+0000 7f54d1087800 5 note: GC not initialized 2024-09-14T11:17:32.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.646+0000 7f52ebfff640 20 reqs_thread_entry: start 2024-09-14T11:17:32.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.646+0000 7f54d1087800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:32.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.646+0000 7f54d1087800 20 Filter name: none 2024-09-14T11:17:32.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.646+0000 7f52e9ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:32.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.673+0000 7f53817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:32.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.676+0000 7f54d1087800 20 remove_watcher() i=0 2024-09-14T11:17:32.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.676+0000 7f54d1087800 2 removed watcher, disabling cache 2024-09-14T11:17:32.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.677+0000 7f54d1087800 20 remove_watcher() i=1 2024-09-14T11:17:32.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.678+0000 7f54d1087800 20 remove_watcher() i=2 2024-09-14T11:17:32.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.680+0000 7f54d1087800 20 remove_watcher() i=3 2024-09-14T11:17:32.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.681+0000 7f54d1087800 20 remove_watcher() i=4 2024-09-14T11:17:32.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.682+0000 7f54d1087800 20 remove_watcher() i=5 2024-09-14T11:17:32.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.683+0000 7f54d1087800 20 remove_watcher() i=6 2024-09-14T11:17:32.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.684+0000 7f54d1087800 20 remove_watcher() i=7 2024-09-14T11:17:32.696 INFO:teuthology.orchestra.run.smithi116.stdout:[] 2024-09-14T11:17:32.697 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:17:32.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:17:32.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:17:32.697 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:17:32.761 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:32.762 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:32.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.787+0000 7f1fcb014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:32.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.787+0000 7f1fcb014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:32.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.792+0000 7f1e897e2640 20 reqs_thread_entry: start 2024-09-14T11:17:32.807 INFO:teuthology.orchestra.run.smithi116.stdout:{"id":"38a4cafb-e998-4940-b6f4-48d3d00371d5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:17:32.807 DEBUG:tasks.util.rgw: json result: {'id': '38a4cafb-e998-4940-b6f4-48d3d00371d5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:17:32.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:17:32.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:17:32.807 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:17:32.863 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:32.863 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:32.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.896+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 realm 2024-09-14T11:17:32.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:32.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.898+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.899+0000 7f879d414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:32.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.899+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.900+0000 7f879d414800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:17:32.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.900+0000 7f879d414800 20 searching for the correct realm 2024-09-14T11:17:32.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.903+0000 7f87903df640 0 -- 172.21.15.116:0/2817726334 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x562f4cf58c70 msgr2=0x562f4cf5b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:32.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.907+0000 7f8798be0640 0 -- 172.21.15.116:0/2817726334 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8780065920 msgr2=0x7f878007b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.911+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:32.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 zone default found 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 4 Realm: () 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 zonegroup default 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.912+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.913+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.913+0000 7f879d414800 20 rados->read ofs=0 len=0 2024-09-14T11:17:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.913+0000 7f879d414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.913+0000 7f879d414800 20 started sync module instance, tier type = 2024-09-14T11:17:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.913+0000 7f879d414800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:17:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=0 2024-09-14T11:17:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=1 2024-09-14T11:17:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=2 2024-09-14T11:17:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=3 2024-09-14T11:17:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=4 2024-09-14T11:17:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=5 2024-09-14T11:17:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.936+0000 7f879d414800 20 add_watcher() i=6 2024-09-14T11:17:32.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.939+0000 7f879d414800 20 add_watcher() i=7 2024-09-14T11:17:32.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.939+0000 7f879d414800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f864efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f879d414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f879d414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f879d414800 5 note: GC not initialized 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f864dfe3640 20 reqs_thread_entry: start 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f879d414800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.942+0000 7f879d414800 20 Filter name: none 2024-09-14T11:17:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.943+0000 7f85bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:32.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.952+0000 7f864efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:32.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.954+0000 7f879d414800 20 remove_watcher() i=0 2024-09-14T11:17:32.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.954+0000 7f879d414800 2 removed watcher, disabling cache 2024-09-14T11:17:32.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.956+0000 7f879d414800 20 remove_watcher() i=1 2024-09-14T11:17:32.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.957+0000 7f879d414800 20 remove_watcher() i=2 2024-09-14T11:17:32.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.958+0000 7f879d414800 20 remove_watcher() i=3 2024-09-14T11:17:32.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.959+0000 7f879d414800 20 remove_watcher() i=4 2024-09-14T11:17:32.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.960+0000 7f879d414800 20 remove_watcher() i=5 2024-09-14T11:17:32.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.961+0000 7f879d414800 20 remove_watcher() i=6 2024-09-14T11:17:32.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:32.962+0000 7f879d414800 20 remove_watcher() i=7 2024-09-14T11:17:32.971 INFO:teuthology.orchestra.run.smithi116.stdout:[] 2024-09-14T11:17:32.971 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:17:32.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:17:32.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:17:32.972 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T11:17:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.059+0000 7f1377328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.059+0000 7f1377328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.063+0000 7f11b9ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:33.078 INFO:teuthology.orchestra.run.smithi116.stdout:{"id":"38a4cafb-e998-4940-b6f4-48d3d00371d5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:17:33.078 DEBUG:tasks.util.rgw: json result: {'id': '38a4cafb-e998-4940-b6f4-48d3d00371d5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:17:33.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:17:33.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:17:33.078 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:17:33.134 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.134 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.167+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 realm 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.169+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.170+0000 7f3f41f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:33.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.170+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.170+0000 7f3f41f2c800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:17:33.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.170+0000 7f3f41f2c800 20 searching for the correct realm 2024-09-14T11:17:33.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.174+0000 7f3f3d44e640 0 -- 172.21.15.116:0/2711080708 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b05636c690 msgr2=0x55b05636eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:33.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.177+0000 7f3f3d44e640 0 -- 172.21.15.116:0/2711080708 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f3f3003b950 msgr2=0x7f3f3004a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:33.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.181+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 zone default found 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 4 Realm: () 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 zonegroup default 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.182+0000 7f3f41f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.183+0000 7f3f41f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.183+0000 7f3f41f2c800 20 started sync module instance, tier type = 2024-09-14T11:17:33.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.183+0000 7f3f41f2c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:17:33.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=0 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=1 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=2 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=3 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=4 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=5 2024-09-14T11:17:33.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.194+0000 7f3f41f2c800 20 add_watcher() i=6 2024-09-14T11:17:33.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.196+0000 7f3f41f2c800 20 add_watcher() i=7 2024-09-14T11:17:33.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.196+0000 7f3f41f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.198+0000 7f3def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.198+0000 7f3f41f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.198+0000 7f3f41f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.198+0000 7f3f41f2c800 5 note: GC not initialized 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.199+0000 7f3dee7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.199+0000 7f3f41f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.199+0000 7f3f41f2c800 20 Filter name: none 2024-09-14T11:17:33.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.199+0000 7f3d5ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:33.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.208+0000 7f3def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:33.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.210+0000 7f3f41f2c800 20 remove_watcher() i=0 2024-09-14T11:17:33.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.210+0000 7f3f41f2c800 2 removed watcher, disabling cache 2024-09-14T11:17:33.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.211+0000 7f3f41f2c800 20 remove_watcher() i=1 2024-09-14T11:17:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.214+0000 7f3f41f2c800 20 remove_watcher() i=2 2024-09-14T11:17:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.215+0000 7f3f41f2c800 20 remove_watcher() i=3 2024-09-14T11:17:33.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.217+0000 7f3f41f2c800 20 remove_watcher() i=4 2024-09-14T11:17:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.218+0000 7f3f41f2c800 20 remove_watcher() i=5 2024-09-14T11:17:33.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.219+0000 7f3f41f2c800 20 remove_watcher() i=6 2024-09-14T11:17:33.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.220+0000 7f3f41f2c800 20 remove_watcher() i=7 2024-09-14T11:17:33.230 INFO:teuthology.orchestra.run.smithi116.stdout:[] 2024-09-14T11:17:33.230 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:17:33.230 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:17:33.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:17:33.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:17:33.230 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:17:33.292 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.292 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.318+0000 7f60a1a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.318+0000 7f60a1a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.322+0000 7f5f0dffb640 20 reqs_thread_entry: start 2024-09-14T11:17:33.338 INFO:teuthology.orchestra.run.smithi116.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:17:33.338 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:17:33.339 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:17:33.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:17:33.339 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:17:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.428+0000 7f0ab0325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.428+0000 7f0ab0325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.432+0000 7f091a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:33.445 INFO:teuthology.orchestra.run.smithi116.stdout:{"id":"38a4cafb-e998-4940-b6f4-48d3d00371d5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:17:33.446 DEBUG:tasks.util.rgw: json result: {'id': '38a4cafb-e998-4940-b6f4-48d3d00371d5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:17:33.446 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:17:33.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:17:33.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:17:33.446 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:17:33.509 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.510 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.535+0000 7f5f7ef3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.535+0000 7f5f7ef3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.539+0000 7f5e3d7e2640 20 reqs_thread_entry: start 2024-09-14T11:17:33.552 INFO:teuthology.orchestra.run.smithi116.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:17:33.553 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:17:33.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:17:33.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:17:33.553 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:17:33.616 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.617 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.642+0000 7fc006863800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.642+0000 7fc006863800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:33.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:17:33.646+0000 7fbe6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:33.664 INFO:teuthology.orchestra.run.smithi116.stdout:{"id":"38a4cafb-e998-4940-b6f4-48d3d00371d5","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:17:33.664 DEBUG:tasks.util.rgw: json result: {'id': '38a4cafb-e998-4940-b6f4-48d3d00371d5', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:17:33.664 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:17:33.664 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T11:17:33.664 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:17:33.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo echo -n http://smithi116.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:17:33.704 INFO:teuthology.orchestra.run.smithi116.stdout:http://smithi116.front.sepia.ceph.com:80 2024-09-14T11:17:33.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:17:33.782 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T11:17:33.782 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:17:33.782 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:17:33.824 INFO:tasks.rgw.client.0:Started 2024-09-14T11:17:33.824 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:33.824 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:34.073 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:17:34.074 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:17:34.074 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:17:34.075 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:17:34.075 INFO:teuthology.orchestra.run.smithi116.stderr:curl: (7) Failed to connect to smithi116.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:17:35.076 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:35.109 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:17:35.109 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:17:35.110 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:17:35.110 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:17:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:curl: (7) Failed to connect to smithi116.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:17:37.111 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:37.144 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:17:37.144 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:17:37.144 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:17:37.145 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:17:37.145 INFO:teuthology.orchestra.run.smithi116.stderr:curl: (7) Failed to connect to smithi116.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:17:41.146 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:41.178 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:17:41.179 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:17:41.179 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:17:41.179 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:17:41.180 INFO:teuthology.orchestra.run.smithi116.stderr:curl: (7) Failed to connect to smithi116.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:17:49.181 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:17:49.213 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:17:49.213 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:17:49.213 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:17:49.214 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:17:49.214 INFO:teuthology.orchestra.run.smithi116.stderr:curl: (7) Failed to connect to smithi116.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:18:05.216 DEBUG:teuthology.orchestra.run.smithi116:> curl http://smithi116.front.sepia.ceph.com:80/ 2024-09-14T11:18:05.255 INFO:teuthology.orchestra.run.smithi116.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:18:05.255 INFO:teuthology.orchestra.run.smithi116.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:18:05.564 INFO:teuthology.orchestra.run.smithi116.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 605 0 --:--:-- --:--:-- --:--:-- 603 2024-09-14T11:18:05.565 INFO:teuthology.orchestra.run.smithi116.stdout:anonymous 2024-09-14T11:18:05.565 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:18:05.576 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:18:05.576 DEBUG:teuthology.orchestra.run.smithi116:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:18:07.868 DEBUG:teuthology.orchestra.run.smithi116:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:18:08.390 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting tox==3.15.0 2024-09-14T11:18:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:18:08.571 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:18:08.585 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:18:08.659 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:18:08.673 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:18:08.746 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting toml>=0.9.4 2024-09-14T11:18:08.760 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:18:08.863 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:18:08.877 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:18:09.148 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:18:09.162 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:18:09.415 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting packaging>=14 2024-09-14T11:18:09.429 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:18:09.524 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:18:09.538 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:18:09.669 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:18:09.683 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:18:09.792 INFO:teuthology.orchestra.run.smithi116.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:18:09.805 INFO:teuthology.orchestra.run.smithi116.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:18:09.929 INFO:teuthology.orchestra.run.smithi116.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T11:18:10.751 INFO:teuthology.orchestra.run.smithi116.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:18:10.957 INFO:teuthology.orchestra.run.smithi116.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T11:18:10.958 INFO:teuthology.orchestra.run.smithi116.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T11:18:11.020 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:18:11.033 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:18:11.033 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:18:11.034 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:11.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:18:11.062 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:18:11.062 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:11.131 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:18:11.131 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:18:11.199 INFO:tasks.workunit:timeout=3h 2024-09-14T11:18:11.199 INFO:tasks.workunit:cleanup=True 2024-09-14T11:18:11.200 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:18:11.268 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:19:07.353 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:07.354 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:19:07.355 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:19:07.459 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:19:07.461 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:19:07.461 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:19:08.050 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:19:08.118 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:19:08.156 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:19:08.158 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:19:08.158 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:19:08.196 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:19:08.199 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:19:08.199 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:19:08.228 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:19:08.229 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:19:08.230 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:19:08.301 INFO:tasks.workunit.client.0.smithi116.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:19:08.302 INFO:tasks.workunit.client.0.smithi116.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:19:08.302 INFO:tasks.workunit.client.0.smithi116.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ deactivate nondestructive 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:19:10.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ export VIRTUAL_ENV 2024-09-14T11:19:10.846 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PATH 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ PS1='(rgw) ' 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PS1 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T11:19:10.847 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install pip --upgrade 2024-09-14T11:19:11.074 INFO:tasks.workunit.client.0.smithi116.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:19:11.252 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting pip 2024-09-14T11:19:11.313 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:19:11.469 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: pip 2024-09-14T11:19:11.469 INFO:tasks.workunit.client.0.smithi116.stdout: Attempting uninstall: pip 2024-09-14T11:19:11.469 INFO:tasks.workunit.client.0.smithi116.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:19:11.619 INFO:tasks.workunit.client.0.smithi116.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:19:11.624 INFO:tasks.workunit.client.0.smithi116.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:19:12.354 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed pip-24.2 2024-09-14T11:19:12.590 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install boto3 2024-09-14T11:19:13.444 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting boto3 2024-09-14T11:19:13.485 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:19:14.141 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:19:14.154 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:19:14.284 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:19:14.298 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:19:14.437 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:19:14.568 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:19:14.582 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:19:14.737 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:19:14.750 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:19:15.033 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:19:15.046 INFO:tasks.workunit.client.0.smithi116.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:19:15.102 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:19:15.174 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:19:15.389 INFO:tasks.workunit.client.0.smithi116.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.1 MB/s eta 0:00:00 2024-09-14T11:19:15.403 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:19:15.450 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:19:15.509 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:19:15.577 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:19:15.643 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:19:15.770 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:19:16.809 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:19:16.925 INFO:tasks.workunit.client.0.smithi116.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:19:17.056 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:19:17.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:17.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:17.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.130+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 realm 2024-09-14T11:19:17.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:17.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.132+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.133+0000 7f5b6d53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:17.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.133+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.133+0000 7f5b6d53e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:17.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.133+0000 7f5b6d53e800 20 searching for the correct realm 2024-09-14T11:19:17.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.136+0000 7f5b60abf640 0 -- 172.21.15.116:0/18528573 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5b5c07b070 msgr2=0x7f5b5c0093e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:17.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.140+0000 7f5b692c0640 0 -- 172.21.15.116:0/18528573 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5b540a6180 msgr2=0x7f5b540ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:17.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:17.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.346+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:17.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:17.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 zone default found 2024-09-14T11:19:17.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 4 Realm: () 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 zonegroup default 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.347+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.348+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.348+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.348+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.348+0000 7f5b6d53e800 20 started sync module instance, tier type = 2024-09-14T11:19:17.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.348+0000 7f5b6d53e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=0 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=1 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=2 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=3 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=4 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=5 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=6 2024-09-14T11:19:17.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 20 add_watcher() i=7 2024-09-14T11:19:17.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.360+0000 7f5b6d53e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:17.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.362+0000 7f5a1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:17.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 5 note: GC not initialized 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5a1efe5640 20 reqs_thread_entry: start 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 20 Filter name: none 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5a1cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:19:17.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.363+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.364+0000 7f5b6d53e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.365+0000 7f5b6d53e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.365+0000 7f5b6d53e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:19:17.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.366+0000 7f5b6d53e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:19:17.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.366+0000 7f5a4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 93889367425600 notifier 4731 bl.length()=593 2024-09-14T11:19:17.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.366+0000 7f5a4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:19:17.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.366+0000 7f5a4cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:19:17.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.391+0000 7f5b6d53e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:19:17.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.391+0000 7f5b6d53e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:19:17.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.391+0000 7f5b6d53e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:19:17.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.392+0000 7f5a4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 93889367418848 notifier 4731 bl.length()=186 2024-09-14T11:19:17.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.392+0000 7f5a4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:19:17.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.392+0000 7f5a4cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:19:17.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.394+0000 7f5a1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.396+0000 7f5b6d53e800 20 remove_watcher() i=0 2024-09-14T11:19:17.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.396+0000 7f5b6d53e800 2 removed watcher, disabling cache 2024-09-14T11:19:17.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.398+0000 7f5b6d53e800 20 remove_watcher() i=1 2024-09-14T11:19:17.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.399+0000 7f5b6d53e800 20 remove_watcher() i=2 2024-09-14T11:19:17.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.400+0000 7f5b6d53e800 20 remove_watcher() i=3 2024-09-14T11:19:17.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.402+0000 7f5b6d53e800 20 remove_watcher() i=4 2024-09-14T11:19:17.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.403+0000 7f5b6d53e800 20 remove_watcher() i=5 2024-09-14T11:19:17.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.404+0000 7f5b6d53e800 20 remove_watcher() i=6 2024-09-14T11:19:17.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:17.405+0000 7f5b6d53e800 20 remove_watcher() i=7 2024-09-14T11:19:19.213 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:19:19.213 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:19.214 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:19:19.243 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:19.243 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:19.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.281+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 realm 2024-09-14T11:19:19.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.283+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.284+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.284+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.284+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.284+0000 7ff80f5af800 20 searching for the correct realm 2024-09-14T11:19:19.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.288+0000 7ff80d8a1640 0 -- 172.21.15.116:0/825430018 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7ff7f8015070 msgr2=0x7ff7f8067ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.291+0000 7ff80d0a0640 0 -- 172.21.15.116:0/825430018 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff7f8066270 msgr2=0x7ff7f80158c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:19.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.498+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 zone default found 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 4 Realm: () 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 zonegroup default 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.499+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.500+0000 7ff80f5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.500+0000 7ff80f5af800 20 started sync module instance, tier type = 2024-09-14T11:19:19.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.500+0000 7ff80f5af800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=0 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=1 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=2 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=3 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=4 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=5 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.510+0000 7ff80f5af800 20 add_watcher() i=6 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.511+0000 7ff80f5af800 20 add_watcher() i=7 2024-09-14T11:19:19.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.511+0000 7ff80f5af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.513+0000 7ff6c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.513+0000 7ff80f5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.513+0000 7ff80f5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.513+0000 7ff80f5af800 5 note: GC not initialized 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.513+0000 7ff6c27e4640 20 reqs_thread_entry: start 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 20 Filter name: none 2024-09-14T11:19:19.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff633fff640 20 reqs_thread_entry: start 2024-09-14T11:19:19.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:19.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.514+0000 7ff80f5af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:19.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.515+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:19.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.516+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:19.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.516+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:19.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.517+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:19.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.518+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:19.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.518+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:19.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.519+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:19.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.519+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:19.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.520+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:19.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.520+0000 7ff80f5af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:19.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.525+0000 7ff6c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.528+0000 7ff80f5af800 20 remove_watcher() i=0 2024-09-14T11:19:19.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.528+0000 7ff80f5af800 2 removed watcher, disabling cache 2024-09-14T11:19:19.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.529+0000 7ff80f5af800 20 remove_watcher() i=1 2024-09-14T11:19:19.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.530+0000 7ff80f5af800 20 remove_watcher() i=2 2024-09-14T11:19:19.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.531+0000 7ff80f5af800 20 remove_watcher() i=3 2024-09-14T11:19:19.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.532+0000 7ff80f5af800 20 remove_watcher() i=4 2024-09-14T11:19:19.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.533+0000 7ff80f5af800 20 remove_watcher() i=5 2024-09-14T11:19:19.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.534+0000 7ff80f5af800 20 remove_watcher() i=6 2024-09-14T11:19:19.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.535+0000 7ff80f5af800 20 remove_watcher() i=7 2024-09-14T11:19:19.544 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:19:19.573 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:19.573 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:19.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.612+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 20 realm 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.613+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.614+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.614+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.615+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.615+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.615+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.615+0000 7fc379020800 20 searching for the correct realm 2024-09-14T11:19:19.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.617+0000 7fc376b0a640 0 -- 172.21.15.116:0/2465999677 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7fc364003bd0 msgr2=0x7fc37009d5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.822+0000 7fc37730b640 0 -- 172.21.15.116:0/2465999677 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fc360062040 msgr2=0x7fc360072430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.828+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 zone default found 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 4 Realm: () 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 zonegroup default 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.829+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.830+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.830+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.830+0000 7fc379020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.830+0000 7fc379020800 20 started sync module instance, tier type = 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.830+0000 7fc379020800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=0 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=1 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=2 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=3 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=4 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=5 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.839+0000 7fc379020800 20 add_watcher() i=6 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.840+0000 7fc379020800 20 add_watcher() i=7 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.840+0000 7fc379020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.843+0000 7fc22d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.843+0000 7fc379020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.843+0000 7fc379020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.843+0000 7fc379020800 5 note: GC not initialized 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc1a7fff640 20 reqs_thread_entry: start 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc379020800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc379020800 20 Filter name: none 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc1a5ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.844+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.845+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.845+0000 7fc379020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.845+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.845+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.845+0000 7fc379020800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.846+0000 7fc379020800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.846+0000 7fc379020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.847+0000 7fc22d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.849+0000 7fc379020800 20 remove_watcher() i=0 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.849+0000 7fc379020800 2 removed watcher, disabling cache 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.851+0000 7fc379020800 20 remove_watcher() i=1 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.852+0000 7fc379020800 20 remove_watcher() i=2 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.853+0000 7fc379020800 20 remove_watcher() i=3 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.854+0000 7fc379020800 20 remove_watcher() i=4 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.855+0000 7fc379020800 20 remove_watcher() i=5 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.857+0000 7fc379020800 20 remove_watcher() i=6 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.858+0000 7fc379020800 20 remove_watcher() i=7 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi116.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 111, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:19:19.900 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:19.900 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:19.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.939+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 20 realm 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.940+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.941+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.941+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.942+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.942+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.942+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.942+0000 7f52d7b0c800 20 searching for the correct realm 2024-09-14T11:19:19.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.945+0000 7f52d5dfe640 0 -- 172.21.15.116:0/2590722797 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f52c003e070 msgr2=0x7f52c0073790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:19.949+0000 7f52d55fd640 0 -- 172.21.15.116:0/2590722797 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f52c0077c10 msgr2=0x7f52c0083460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:20.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:20.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.156+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:20.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 zone default found 2024-09-14T11:19:20.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 4 Realm: () 2024-09-14T11:19:20.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 zonegroup default 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.157+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.158+0000 7f52d7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.158+0000 7f52d7b0c800 20 started sync module instance, tier type = 2024-09-14T11:19:20.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.158+0000 7f52d7b0c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:20.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=0 2024-09-14T11:19:20.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=1 2024-09-14T11:19:20.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=2 2024-09-14T11:19:20.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=3 2024-09-14T11:19:20.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=4 2024-09-14T11:19:20.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=5 2024-09-14T11:19:20.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.174+0000 7f52d7b0c800 20 add_watcher() i=6 2024-09-14T11:19:20.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.177+0000 7f52d7b0c800 20 add_watcher() i=7 2024-09-14T11:19:20.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.177+0000 7f52d7b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:20.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f518b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:20.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f52d7b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:20.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f52d7b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:20.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f52d7b0c800 5 note: GC not initialized 2024-09-14T11:19:20.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f518a7e4640 20 reqs_thread_entry: start 2024-09-14T11:19:20.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f52d7b0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:20.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.180+0000 7f52d7b0c800 20 Filter name: none 2024-09-14T11:19:20.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f50fbfff640 20 reqs_thread_entry: start 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:20.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.181+0000 7f52d7b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:20.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:20.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:20.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.182+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.183+0000 7f52d7b0c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.183+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.183+0000 7f52d7b0c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:19:20.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.183+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.184+0000 7f52d7b0c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.184+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.184+0000 7f52d7b0c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.184+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.185+0000 7f52d7b0c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:19:20.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.185+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:20.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.185+0000 7f52d7b0c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:19:20.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.185+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:20.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.186+0000 7f52d7b0c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:19:20.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.186+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:20.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:19:20.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:20.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:19:20.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:20.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:19:20.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.187+0000 7f52d7b0c800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:19:20.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.188+0000 7f518b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:20.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.191+0000 7f52d7b0c800 20 remove_watcher() i=0 2024-09-14T11:19:20.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.191+0000 7f52d7b0c800 2 removed watcher, disabling cache 2024-09-14T11:19:20.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.195+0000 7f52d7b0c800 20 remove_watcher() i=1 2024-09-14T11:19:20.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.196+0000 7f52d7b0c800 20 remove_watcher() i=2 2024-09-14T11:19:20.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.197+0000 7f52d7b0c800 20 remove_watcher() i=3 2024-09-14T11:19:20.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.199+0000 7f52d7b0c800 20 remove_watcher() i=4 2024-09-14T11:19:20.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.200+0000 7f52d7b0c800 20 remove_watcher() i=5 2024-09-14T11:19:20.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.203+0000 7f52d7b0c800 20 remove_watcher() i=6 2024-09-14T11:19:20.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:20.204+0000 7f52d7b0c800 20 remove_watcher() i=7 2024-09-14T11:19:20.214 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:19:20.621 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:19:22.122 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:22.124 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:19:22.157 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:22.157 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:22.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.196+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.198+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.198+0000 7f273d1af800 20 realm 2024-09-14T11:19:22.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.198+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.199+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.199+0000 7f273d1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:22.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.199+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.199+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.199+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.200+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.200+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.200+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:22.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.200+0000 7f273d1af800 20 searching for the correct realm 2024-09-14T11:19:22.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.202+0000 7f273ac99640 0 -- 172.21.15.116:0/3428355274 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f2734039070 msgr2=0x7f27340663a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:22.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.407+0000 7f273b49a640 0 -- 172.21.15.116:0/3428355274 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f2724060070 msgr2=0x7f27240ab9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.413+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 zone default found 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 4 Realm: () 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 zonegroup default 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.414+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.415+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.415+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.415+0000 7f273d1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.415+0000 7f273d1af800 20 started sync module instance, tier type = 2024-09-14T11:19:22.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.415+0000 7f273d1af800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=0 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=1 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=2 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=3 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=4 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=5 2024-09-14T11:19:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.436+0000 7f273d1af800 20 add_watcher() i=6 2024-09-14T11:19:22.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.438+0000 7f273d1af800 20 add_watcher() i=7 2024-09-14T11:19:22.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.438+0000 7f273d1af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:22.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.440+0000 7f25f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:22.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:22.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 5 note: GC not initialized 2024-09-14T11:19:22.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f256bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:22.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 Filter name: none 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f2569ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.441+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 INFO: main: starting shard=0 2024-09-14T11:19:22.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.442+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:22.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 INFO: main: starting shard=1 2024-09-14T11:19:22.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:22.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 INFO: main: starting shard=2 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.443+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: starting shard=3 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: starting shard=4 2024-09-14T11:19:22.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 INFO: main: starting shard=5 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.444+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.445+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.445+0000 7f273d1af800 20 INFO: main: starting shard=6 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.445+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:22.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 INFO: main: starting shard=7 2024-09-14T11:19:22.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:22.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 INFO: main: starting shard=8 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.446+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.447+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.447+0000 7f273d1af800 20 INFO: main: starting shard=9 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.447+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.448+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.448+0000 7f273d1af800 20 INFO: main: starting shard=10 2024-09-14T11:19:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.448+0000 7f273d1af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:22.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.448+0000 7f273d1af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.448+0000 7f273d1af800 20 INFO: main: done 2024-09-14T11:19:22.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.449+0000 7f25f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.451+0000 7f273d1af800 20 remove_watcher() i=0 2024-09-14T11:19:22.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.451+0000 7f273d1af800 2 removed watcher, disabling cache 2024-09-14T11:19:22.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.453+0000 7f273d1af800 20 remove_watcher() i=1 2024-09-14T11:19:22.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.454+0000 7f273d1af800 20 remove_watcher() i=2 2024-09-14T11:19:22.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.455+0000 7f273d1af800 20 remove_watcher() i=3 2024-09-14T11:19:22.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.456+0000 7f273d1af800 20 remove_watcher() i=4 2024-09-14T11:19:22.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.457+0000 7f273d1af800 20 remove_watcher() i=5 2024-09-14T11:19:22.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.458+0000 7f273d1af800 20 remove_watcher() i=6 2024-09-14T11:19:22.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.459+0000 7f273d1af800 20 remove_watcher() i=7 2024-09-14T11:19:22.583 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:22.584 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:19:22.616 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:22.617 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:22.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.654+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 realm 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:22.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.656+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.657+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.657+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.657+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:22.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.657+0000 7f69c8d32800 20 searching for the correct realm 2024-09-14T11:19:22.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.661+0000 7f69bc1bb640 0 -- 172.21.15.116:0/1965084108 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f69b4087060 msgr2=0x7f69b40c71f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:22.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.665+0000 7f69bc1bb640 0 -- 172.21.15.116:0/1965084108 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f6890084610 msgr2=0x7f6890086a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:22.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:22.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:22.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:22.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:22.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:22.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 zone default found 2024-09-14T11:19:22.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 4 Realm: () 2024-09-14T11:19:22.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:22.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 zonegroup default 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.669+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 started sync module instance, tier type = 2024-09-14T11:19:22.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.670+0000 7f69c8d32800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:22.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=0 2024-09-14T11:19:22.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=1 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=2 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=3 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=4 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=5 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.683+0000 7f69c8d32800 20 add_watcher() i=6 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.684+0000 7f69c8d32800 20 add_watcher() i=7 2024-09-14T11:19:22.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.684+0000 7f69c8d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:22.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f687afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f69c8d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f69c8d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f69c8d32800 5 note: GC not initialized 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f6879fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f69c8d32800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f69c8d32800 20 Filter name: none 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.686+0000 7f67eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:22.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.687+0000 7f69c8d32800 20 INFO: main: starting shard=0 2024-09-14T11:19:22.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:22.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 INFO: main: starting shard=1 2024-09-14T11:19:22.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 INFO: main: starting shard=2 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.688+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 INFO: main: starting shard=3 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 INFO: main: starting shard=4 2024-09-14T11:19:22.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.689+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.690+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.690+0000 7f69c8d32800 20 INFO: main: starting shard=5 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.690+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 INFO: main: starting shard=6 2024-09-14T11:19:22.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 INFO: main: starting shard=7 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.691+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 INFO: main: starting shard=8 2024-09-14T11:19:22.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:22.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 INFO: main: starting shard=9 2024-09-14T11:19:22.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.692+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:22.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.693+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.693+0000 7f69c8d32800 20 INFO: main: starting shard=10 2024-09-14T11:19:22.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.693+0000 7f69c8d32800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:22.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.693+0000 7f69c8d32800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.693+0000 7f69c8d32800 20 INFO: main: done 2024-09-14T11:19:22.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.694+0000 7f687afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.696+0000 7f69c8d32800 20 remove_watcher() i=0 2024-09-14T11:19:22.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.696+0000 7f69c8d32800 2 removed watcher, disabling cache 2024-09-14T11:19:22.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.698+0000 7f69c8d32800 20 remove_watcher() i=1 2024-09-14T11:19:22.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.699+0000 7f69c8d32800 20 remove_watcher() i=2 2024-09-14T11:19:22.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.700+0000 7f69c8d32800 20 remove_watcher() i=3 2024-09-14T11:19:22.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.704+0000 7f69c8d32800 20 remove_watcher() i=4 2024-09-14T11:19:22.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.705+0000 7f69c8d32800 20 remove_watcher() i=5 2024-09-14T11:19:22.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.706+0000 7f69c8d32800 20 remove_watcher() i=6 2024-09-14T11:19:22.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.707+0000 7f69c8d32800 20 remove_watcher() i=7 2024-09-14T11:19:22.827 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:22.829 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:19:22.858 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:22.858 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:22.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.895+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 realm 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.897+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.898+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.898+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.898+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:22.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.898+0000 7fd358f36800 20 searching for the correct realm 2024-09-14T11:19:22.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.902+0000 7fd3554b8640 0 -- 172.21.15.116:0/2969521901 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x556fff169b00 msgr2=0x556fff16bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:22.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.905+0000 7fd3544b6640 0 -- 172.21.15.116:0/2969521901 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd344072040 msgr2=0x7fd344093440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.909+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:22.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 zone default found 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 4 Realm: () 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 zonegroup default 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.910+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.911+0000 7fd358f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:22.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.911+0000 7fd358f36800 20 started sync module instance, tier type = 2024-09-14T11:19:22.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.911+0000 7fd358f36800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=0 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=1 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=2 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=3 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=4 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=5 2024-09-14T11:19:22.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.924+0000 7fd358f36800 20 add_watcher() i=6 2024-09-14T11:19:22.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.925+0000 7fd358f36800 20 add_watcher() i=7 2024-09-14T11:19:22.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.925+0000 7fd358f36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:22.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.926+0000 7fd20b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:22.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:22.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 5 note: GC not initialized 2024-09-14T11:19:22.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd20a7e4640 20 reqs_thread_entry: start 2024-09-14T11:19:22.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:22.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 Filter name: none 2024-09-14T11:19:22.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd203fff640 20 reqs_thread_entry: start 2024-09-14T11:19:22.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.927+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 rados->read ofs=0 len=0 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 INFO: main: starting shard=0 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 INFO: main: starting shard=1 2024-09-14T11:19:22.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.928+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 INFO: main: starting shard=2 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 INFO: main: starting shard=3 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.929+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 INFO: main: starting shard=4 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 INFO: main: starting shard=5 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.930+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 INFO: main: starting shard=6 2024-09-14T11:19:22.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 INFO: main: starting shard=7 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.931+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 INFO: main: starting shard=8 2024-09-14T11:19:22.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 INFO: main: starting shard=9 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.932+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.933+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.933+0000 7fd358f36800 20 INFO: main: starting shard=10 2024-09-14T11:19:22.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.933+0000 7fd358f36800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:22.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.933+0000 7fd358f36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:22.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.933+0000 7fd358f36800 20 INFO: main: done 2024-09-14T11:19:22.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.934+0000 7fd20b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:22.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.936+0000 7fd358f36800 20 remove_watcher() i=0 2024-09-14T11:19:22.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.936+0000 7fd358f36800 2 removed watcher, disabling cache 2024-09-14T11:19:22.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.939+0000 7fd358f36800 20 remove_watcher() i=1 2024-09-14T11:19:22.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.940+0000 7fd358f36800 20 remove_watcher() i=2 2024-09-14T11:19:22.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.941+0000 7fd358f36800 20 remove_watcher() i=3 2024-09-14T11:19:22.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.942+0000 7fd358f36800 20 remove_watcher() i=4 2024-09-14T11:19:22.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.943+0000 7fd358f36800 20 remove_watcher() i=5 2024-09-14T11:19:22.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.944+0000 7fd358f36800 20 remove_watcher() i=6 2024-09-14T11:19:22.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:22.945+0000 7fd358f36800 20 remove_watcher() i=7 2024-09-14T11:19:23.063 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:23.064 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:19:23.095 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:23.095 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:23.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.132+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 realm 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.134+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.135+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:23.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.135+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.136+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:23.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.136+0000 7f1674c0e800 20 searching for the correct realm 2024-09-14T11:19:23.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.139+0000 7f1667fff640 0 -- 172.21.15.116:0/3070965655 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5624b571cd40 msgr2=0x5624b571f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:23.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.142+0000 7f1670259640 0 -- 172.21.15.116:0/3070965655 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f16580a70b0 msgr2=0x7f1658075360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.146+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:23.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 zone default found 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 4 Realm: () 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 zonegroup default 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.147+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.148+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.148+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.148+0000 7f1674c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:23.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.148+0000 7f1674c0e800 20 started sync module instance, tier type = 2024-09-14T11:19:23.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.148+0000 7f1674c0e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.163+0000 7f1674c0e800 20 add_watcher() i=0 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.163+0000 7f1674c0e800 20 add_watcher() i=1 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.163+0000 7f1674c0e800 20 add_watcher() i=2 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.163+0000 7f1674c0e800 20 add_watcher() i=3 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.163+0000 7f1674c0e800 20 add_watcher() i=4 2024-09-14T11:19:23.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.164+0000 7f1674c0e800 20 add_watcher() i=5 2024-09-14T11:19:23.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.166+0000 7f1674c0e800 20 add_watcher() i=6 2024-09-14T11:19:23.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.166+0000 7f1674c0e800 20 add_watcher() i=7 2024-09-14T11:19:23.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.166+0000 7f1674c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:23.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.168+0000 7f1526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.168+0000 7f1674c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.168+0000 7f1674c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.168+0000 7f1674c0e800 5 note: GC not initialized 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1525fdb640 20 reqs_thread_entry: start 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1674c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1674c0e800 20 Filter name: none 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f14977fe640 20 reqs_thread_entry: start 2024-09-14T11:19:23.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:23.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.169+0000 7f1674c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:23.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:23.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: starting shard=0 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: starting shard=1 2024-09-14T11:19:23.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 INFO: main: starting shard=2 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.170+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 INFO: main: starting shard=3 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 INFO: main: starting shard=4 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.171+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.172+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.172+0000 7f1674c0e800 20 INFO: main: starting shard=5 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.172+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: starting shard=6 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: starting shard=7 2024-09-14T11:19:23.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 INFO: main: starting shard=8 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.173+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 INFO: main: starting shard=9 2024-09-14T11:19:23.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 INFO: main: starting shard=10 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.174+0000 7f1674c0e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.175+0000 7f1674c0e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.175+0000 7f1674c0e800 20 INFO: main: done 2024-09-14T11:19:23.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.175+0000 7f1526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:23.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.178+0000 7f1674c0e800 20 remove_watcher() i=0 2024-09-14T11:19:23.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.178+0000 7f1674c0e800 2 removed watcher, disabling cache 2024-09-14T11:19:23.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.179+0000 7f1674c0e800 20 remove_watcher() i=1 2024-09-14T11:19:23.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.180+0000 7f1674c0e800 20 remove_watcher() i=2 2024-09-14T11:19:23.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.182+0000 7f1674c0e800 20 remove_watcher() i=3 2024-09-14T11:19:23.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.184+0000 7f1674c0e800 20 remove_watcher() i=4 2024-09-14T11:19:23.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.185+0000 7f1674c0e800 20 remove_watcher() i=5 2024-09-14T11:19:23.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.187+0000 7f1674c0e800 20 remove_watcher() i=6 2024-09-14T11:19:23.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:23.188+0000 7f1674c0e800 20 remove_watcher() i=7 2024-09-14T11:19:23.222 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:19:23.617 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:19:24.016 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:19:24.016 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:24.017 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:19:24.050 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:24.050 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.087+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.088+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.088+0000 7f0d83fa2800 20 realm 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.088+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.089+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.089+0000 7f0d83fa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.089+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.089+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.089+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.090+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.090+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.090+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.090+0000 7f0d83fa2800 20 searching for the correct realm 2024-09-14T11:19:24.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.095+0000 7f0d8228d640 0 -- 172.21.15.116:0/2245886296 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f0d7806f3f0 msgr2=0x7f0d7806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.301+0000 7f0d81a8c640 0 -- 172.21.15.116:0/2245886296 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x561ae2045b80 msgr2=0x561ae2047f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:24.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:24.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:24.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:24.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.303+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 zone default found 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 4 Realm: () 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:24.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 zonegroup default 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.304+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 started sync module instance, tier type = 2024-09-14T11:19:24.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.305+0000 7f0d83fa2800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=0 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=1 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=2 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=3 2024-09-14T11:19:24.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=4 2024-09-14T11:19:24.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=5 2024-09-14T11:19:24.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.322+0000 7f0d83fa2800 20 add_watcher() i=6 2024-09-14T11:19:24.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.324+0000 7f0d83fa2800 20 add_watcher() i=7 2024-09-14T11:19:24.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.324+0000 7f0d83fa2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:24.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.327+0000 7f0c337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:24.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:24.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 5 note: GC not initialized 2024-09-14T11:19:24.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0c327fc640 20 reqs_thread_entry: start 2024-09-14T11:19:24.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:24.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 20 Filter name: none 2024-09-14T11:19:24.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0ba3fff640 20 reqs_thread_entry: start 2024-09-14T11:19:24.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.328+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:24.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:24.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.329+0000 7f0d83fa2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.330+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.330+0000 7f0d83fa2800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.330+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.330+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.331+0000 7f0d83fa2800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.331+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:24.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.331+0000 7f0d83fa2800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.331+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.332+0000 7f0d83fa2800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.332+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.332+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.333+0000 7f0d83fa2800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:19:24.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.333+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:24.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.334+0000 7f0d83fa2800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:19:24.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.334+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.334+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:24.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:19:24.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:19:24.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:19:24.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:19:24.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:19:24.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.335+0000 7f0d83fa2800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:19:24.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.336+0000 7f0c337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.339+0000 7f0d83fa2800 20 remove_watcher() i=0 2024-09-14T11:19:24.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.339+0000 7f0d83fa2800 2 removed watcher, disabling cache 2024-09-14T11:19:24.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.340+0000 7f0d83fa2800 20 remove_watcher() i=1 2024-09-14T11:19:24.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.341+0000 7f0d83fa2800 20 remove_watcher() i=2 2024-09-14T11:19:24.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.342+0000 7f0d83fa2800 20 remove_watcher() i=3 2024-09-14T11:19:24.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.343+0000 7f0d83fa2800 20 remove_watcher() i=4 2024-09-14T11:19:24.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.344+0000 7f0d83fa2800 20 remove_watcher() i=5 2024-09-14T11:19:24.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.346+0000 7f0d83fa2800 20 remove_watcher() i=6 2024-09-14T11:19:24.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.348+0000 7f0d83fa2800 20 remove_watcher() i=7 2024-09-14T11:19:24.357 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: unlinked entries are not listable 2024-09-14T11:19:24.357 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:24.476 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:19:24.476 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:24.608 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:19:24.608 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:24.610 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:19:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:24.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.681+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 20 realm 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.682+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.683+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.683+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.684+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.684+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.684+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:24.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.684+0000 7f33ca142800 20 searching for the correct realm 2024-09-14T11:19:24.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.688+0000 7f33bffff640 0 -- 172.21.15.116:0/1882434965 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f33b8038070 msgr2=0x7f33b802a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.692+0000 7f33c66ee640 0 -- 172.21.15.116:0/1882434965 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f33b00bc670 msgr2=0x7f33b00c7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:24.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.695+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:24.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 zone default found 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 4 Realm: () 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 zonegroup default 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.696+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.697+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.697+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.697+0000 7f33ca142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.697+0000 7f33ca142800 20 started sync module instance, tier type = 2024-09-14T11:19:24.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.697+0000 7f33ca142800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=0 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=1 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=2 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=3 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=4 2024-09-14T11:19:24.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=5 2024-09-14T11:19:24.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.710+0000 7f33ca142800 20 add_watcher() i=6 2024-09-14T11:19:24.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.712+0000 7f33ca142800 20 add_watcher() i=7 2024-09-14T11:19:24.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.712+0000 7f33ca142800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:24.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.714+0000 7f32777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.714+0000 7f33ca142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.714+0000 7f33ca142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.714+0000 7f33ca142800 5 note: GC not initialized 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f32767fc640 20 reqs_thread_entry: start 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 20 Filter name: none 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f31e7fff640 20 reqs_thread_entry: start 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:24.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:24.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:24.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.715+0000 7f33ca142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.716+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.717+0000 7f33ca142800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:19:24.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.717+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.717+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:24.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.718+0000 7f33ca142800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:19:24.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.718+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:24.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.718+0000 7f33ca142800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:19:24.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.718+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:24.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.719+0000 7f33ca142800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:19:24.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.719+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.719+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.720+0000 7f33ca142800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.720+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.720+0000 7f33ca142800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.720+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.721+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:24.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.721+0000 7f33ca142800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:19:24.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.721+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.721+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.722+0000 7f33ca142800 20 get_obj_state: octx=0x556e8133b380 obj=check-bucket:e state=0x556e816068a8 s->prefetch_data=0 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.722+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.722+0000 7f33ca142800 20 get_obj_state: octx=0x556e813635c0 obj=check-bucket:d state=0x556e81604d28 s->prefetch_data=0 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.722+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: octx=0x556e81603520 obj=check-bucket:c state=0x556e81600ab8 s->prefetch_data=0 2024-09-14T11:19:24.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: octx=0x556e816047a0 obj=check-bucket:f state=0x556e816a0068 s->prefetch_data=0 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 50m8v8ga4vns4n7y902z5o3xcaiyafiz 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state_impl: setting s->olh_tag to h43l8btyls67ne31q8mdyuplo0j7xn1z 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h43l8btyls67ne31q8mdyuplo0j7xn1z 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to w3gwskz1y53qo11klcytwa2nrz9guuoo 2024-09-14T11:19:24.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state_impl: setting s->olh_tag to ze307ylxl2ifrt5s83v21rri90za7nps 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ze307ylxl2ifrt5s83v21rri90za7nps 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 0d1os018ldct6650ov03fpe5r9bdic4m 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state_impl: setting s->olh_tag to siryh34snmk33fbx7vv7au9e06lcy1p9 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=siryh34snmk33fbx7vv7au9e06lcy1p9 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to e6fvouras31bwhf2tbfh4bu63i6mpgyp 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 get_obj_state_impl: setting s->olh_tag to oc7s5j3ob4pvzb8o8vn2jeoortbnt8qn 2024-09-14T11:19:24.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.723+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oc7s5j3ob4pvzb8o8vn2jeoortbnt8qn 2024-09-14T11:19:24.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.727+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.727+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.727+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.727+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.728+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.728+0000 7f33ca142800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.728+0000 7f33ca142800 20 olh_log_entry: epoch=2 op=3 key=e[r5qP7I143Y5R5F.phqd7ot.2xXZefBH] 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.728+0000 7f33ca142800 20 get_obj_state: octx=0x556e8133b380 obj=check-bucket:_:r5qP7I143Y5R5F.phqd7ot.2xXZefBH_e state=0x556e816bc4d8 s->prefetch_data=0 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.729+0000 7f33ca142800 10 manifest: total_size = 22 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.729+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2186954853299086705 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.729+0000 7f33ca142800 20 get_obj_state: octx=0x556e8133b380 obj=check-bucket:_:r5qP7I143Y5R5F.phqd7ot.2xXZefBH_e state=0x556e816bc4d8 s->prefetch_data=0 2024-09-14T11:19:24.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.729+0000 7f33ca142800 20 prepare_atomic_modification: state is not atomic. state=0x556e816bc4d8 2024-09-14T11:19:24.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.729+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 olh_log_entry: epoch=2 op=3 key=f[TgFUZUhfhmuVzxcvJBv6nUgKG7-Yrk1] 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 get_obj_state: octx=0x556e816047a0 obj=check-bucket:_:TgFUZUhfhmuVzxcvJBv6nUgKG7-Yrk1_f state=0x556e816c4498 s->prefetch_data=0 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 olh_log_entry: epoch=3 op=3 key=d[DgXhaszE8vRZNmxzIcx8tlscA1jgvxB] 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 get_obj_state: octx=0x556e813635c0 obj=check-bucket:_:DgXhaszE8vRZNmxzIcx8tlscA1jgvxB_d state=0x556e816cad88 s->prefetch_data=0 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 10 manifest: total_size = 22 2024-09-14T11:19:24.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2173534880299915022 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 get_obj_state: octx=0x556e816047a0 obj=check-bucket:_:TgFUZUhfhmuVzxcvJBv6nUgKG7-Yrk1_f state=0x556e816c4498 s->prefetch_data=0 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 prepare_atomic_modification: state is not atomic. state=0x556e816c4498 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.730+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.731+0000 7f33ca142800 10 manifest: total_size = 22 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.731+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.406329035334619799 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.731+0000 7f33ca142800 20 get_obj_state: octx=0x556e813635c0 obj=check-bucket:_:DgXhaszE8vRZNmxzIcx8tlscA1jgvxB_d state=0x556e816cad88 s->prefetch_data=0 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.731+0000 7f33ca142800 20 prepare_atomic_modification: state is not atomic. state=0x556e816cad88 2024-09-14T11:19:24.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.731+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.732+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 olh_log_entry: epoch=3 op=3 key=c[jAX7XdXCzVDdkkp966zka7rMr2FgqOF] 2024-09-14T11:19:24.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 get_obj_state: octx=0x556e81603520 obj=check-bucket:_:jAX7XdXCzVDdkkp966zka7rMr2FgqOF_c state=0x556e816c2478 s->prefetch_data=0 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 10 manifest: total_size = 9 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6027213081019558470 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 get_obj_state: octx=0x556e81603520 obj=check-bucket:_:jAX7XdXCzVDdkkp966zka7rMr2FgqOF_c state=0x556e816c2478 s->prefetch_data=0 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 prepare_atomic_modification: state is not atomic. state=0x556e816c2478 2024-09-14T11:19:24.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.733+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.735+0000 7f33ca142800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:24.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.735+0000 7f33ca142800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:19:24.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.735+0000 7f33ca142800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:24.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.735+0000 7f33ca142800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:r5qP7I143Y5R5F.phqd7ot.2xXZefBH_.meIY0jqHwBc61xlWu_ozyVpywrezxeD_0 2024-09-14T11:19:24.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:24.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:19:24.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:24.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:DgXhaszE8vRZNmxzIcx8tlscA1jgvxB_.-pH0ZKi1HH_3FJsI6cmcMgrirXrfuj9_0 2024-09-14T11:19:24.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:24.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:19:24.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:24.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:TgFUZUhfhmuVzxcvJBv6nUgKG7-Yrk1_.cp78VrgJXe0DfqgOhLYzHdJc6xreiai_0 2024-09-14T11:19:24.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.738+0000 7f33ca142800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 20 get_obj_state: octx=0x556e8133b380 obj=check-bucket:e state=0x556e816068a8 s->prefetch_data=0 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h43l8btyls67ne31q8mdyuplo0j7xn1z 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f32a97fa640 20 handle_completion(): completion ok for obj=f[TgFUZUhfhmuVzxcvJBv6nUgKG7-Yrk1] 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f32a8ff9640 20 handle_completion(): completion ok for obj=e[r5qP7I143Y5R5F.phqd7ot.2xXZefBH] 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:jAX7XdXCzVDdkkp966zka7rMr2FgqOF_.bfTuYETvr-f6TKkl7_GiYXswJlweXp4_0 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f32a8ff9640 20 handle_completion(): completion ok for obj=d[DgXhaszE8vRZNmxzIcx8tlscA1jgvxB] 2024-09-14T11:19:24.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.743+0000 7f33ca142800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:24.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.744+0000 7f33ca142800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:24.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.746+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.746+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.746+0000 7f32a8ff9640 20 handle_completion(): completion ok for obj=c[jAX7XdXCzVDdkkp966zka7rMr2FgqOF] 2024-09-14T11:19:24.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.746+0000 7f33ca142800 20 get_obj_state: octx=0x556e816047a0 obj=check-bucket:f state=0x556e816a0068 s->prefetch_data=0 2024-09-14T11:19:24.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.746+0000 7f33ca142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oc7s5j3ob4pvzb8o8vn2jeoortbnt8qn 2024-09-14T11:19:24.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.748+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.748+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.748+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.749+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:24.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.749+0000 7f33ca142800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:19:24.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.754+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:24.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.754+0000 7f33ca142800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:19:24.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.754+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:24.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.754+0000 7f33ca142800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:19:24.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.756+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.757+0000 7f33ca142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:24.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.757+0000 7f33ca142800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:19:24.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.757+0000 7f33ca142800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:19:24.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.758+0000 7f32777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:24.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.761+0000 7f33ca142800 20 remove_watcher() i=0 2024-09-14T11:19:24.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.761+0000 7f33ca142800 2 removed watcher, disabling cache 2024-09-14T11:19:24.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.762+0000 7f33ca142800 20 remove_watcher() i=1 2024-09-14T11:19:24.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.763+0000 7f33ca142800 20 remove_watcher() i=2 2024-09-14T11:19:24.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.764+0000 7f33ca142800 20 remove_watcher() i=3 2024-09-14T11:19:24.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.765+0000 7f33ca142800 20 remove_watcher() i=4 2024-09-14T11:19:24.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.766+0000 7f33ca142800 20 remove_watcher() i=5 2024-09-14T11:19:24.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.767+0000 7f33ca142800 20 remove_watcher() i=6 2024-09-14T11:19:24.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:24.768+0000 7f33ca142800 20 remove_watcher() i=7 2024-09-14T11:19:24.861 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:19:24.861 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:25.024 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:19:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:25.025 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:19:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.097+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 20 realm 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.098+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.099+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.099+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.099+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.099+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.100+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.100+0000 7f6f4632c800 20 searching for the correct realm 2024-09-14T11:19:25.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.103+0000 7f6f4273f640 0 -- 172.21.15.116:0/502194694 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6f2c0b8020 msgr2=0x7f6f2c0a45d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.107+0000 7f6f41f3e640 0 -- 172.21.15.116:0/502194694 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6f2c0cccc0 msgr2=0x7f6f2c0cc040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:25.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:25.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.313+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 zone default found 2024-09-14T11:19:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 4 Realm: () 2024-09-14T11:19:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 zonegroup default 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 started sync module instance, tier type = 2024-09-14T11:19:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.314+0000 7f6f4632c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=0 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=1 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=2 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=3 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=4 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=5 2024-09-14T11:19:25.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.324+0000 7f6f4632c800 20 add_watcher() i=6 2024-09-14T11:19:25.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.325+0000 7f6f4632c800 20 add_watcher() i=7 2024-09-14T11:19:25.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.325+0000 7f6f4632c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.327+0000 7f6df37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.327+0000 7f6f4632c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.327+0000 7f6f4632c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.327+0000 7f6f4632c800 5 note: GC not initialized 2024-09-14T11:19:25.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.327+0000 7f6df27fc640 20 reqs_thread_entry: start 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 20 Filter name: none 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6d63fff640 20 reqs_thread_entry: start 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:25.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.328+0000 7f6f4632c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:25.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:25.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:25.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.329+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.330+0000 7f6f4632c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.330+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.330+0000 7f6f4632c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:19:25.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.330+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:19:25.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.331+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:25.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.332+0000 7f6f4632c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:19:25.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.332+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:25.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.332+0000 7f6f4632c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:19:25.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.332+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.333+0000 7f6f4632c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.333+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.333+0000 7f6f4632c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.333+0000 7f6f4632c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.334+0000 7f6f4632c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:19:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.334+0000 7f6f4632c800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:19:25.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.335+0000 7f6df37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.337+0000 7f6f4632c800 20 remove_watcher() i=0 2024-09-14T11:19:25.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.337+0000 7f6f4632c800 2 removed watcher, disabling cache 2024-09-14T11:19:25.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.338+0000 7f6f4632c800 20 remove_watcher() i=1 2024-09-14T11:19:25.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.340+0000 7f6f4632c800 20 remove_watcher() i=2 2024-09-14T11:19:25.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.341+0000 7f6f4632c800 20 remove_watcher() i=3 2024-09-14T11:19:25.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.342+0000 7f6f4632c800 20 remove_watcher() i=4 2024-09-14T11:19:25.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.343+0000 7f6f4632c800 20 remove_watcher() i=5 2024-09-14T11:19:25.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.344+0000 7f6f4632c800 20 remove_watcher() i=6 2024-09-14T11:19:25.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.345+0000 7f6f4632c800 20 remove_watcher() i=7 2024-09-14T11:19:25.544 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:19:25.574 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.574 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.611+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 realm 2024-09-14T11:19:25.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.613+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.614+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.614+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.614+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.614+0000 7fc46dbad800 20 searching for the correct realm 2024-09-14T11:19:25.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.617+0000 7fc46ae96640 0 -- 172.21.15.116:0/404404233 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fc45c09b040 msgr2=0x7fc45c088730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.620+0000 7fc46b697640 0 -- 172.21.15.116:0/404404233 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc4600913c0 msgr2=0x7fc460091840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.826+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 zone default found 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 4 Realm: () 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 zonegroup default 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 started sync module instance, tier type = 2024-09-14T11:19:25.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.827+0000 7fc46dbad800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:25.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=0 2024-09-14T11:19:25.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=1 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=2 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=3 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=4 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=5 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.839+0000 7fc46dbad800 20 add_watcher() i=6 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.840+0000 7fc46dbad800 20 add_watcher() i=7 2024-09-14T11:19:25.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.840+0000 7fc46dbad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.842+0000 7fc321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.842+0000 7fc46dbad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.842+0000 7fc46dbad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.842+0000 7fc46dbad800 5 note: GC not initialized 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.842+0000 7fc320fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc46dbad800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc46dbad800 20 Filter name: none 2024-09-14T11:19:25.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc29a7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:25.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.843+0000 7fc46dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 INFO: main: starting shard=0 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 INFO: main: starting shard=1 2024-09-14T11:19:25.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.844+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:25.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 INFO: main: starting shard=2 2024-09-14T11:19:25.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 INFO: main: starting shard=3 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.845+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: starting shard=4 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: starting shard=5 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 INFO: main: starting shard=6 2024-09-14T11:19:25.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.846+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 INFO: main: starting shard=7 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 INFO: main: starting shard=8 2024-09-14T11:19:25.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.847+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.848+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.848+0000 7fc46dbad800 20 INFO: main: starting shard=9 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.848+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.849+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.849+0000 7fc46dbad800 20 INFO: main: starting shard=10 2024-09-14T11:19:25.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.849+0000 7fc46dbad800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:25.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.849+0000 7fc46dbad800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.849+0000 7fc46dbad800 20 INFO: main: done 2024-09-14T11:19:25.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.850+0000 7fc321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.852+0000 7fc46dbad800 20 remove_watcher() i=0 2024-09-14T11:19:25.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.852+0000 7fc46dbad800 2 removed watcher, disabling cache 2024-09-14T11:19:25.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.854+0000 7fc46dbad800 20 remove_watcher() i=1 2024-09-14T11:19:25.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.855+0000 7fc46dbad800 20 remove_watcher() i=2 2024-09-14T11:19:25.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.856+0000 7fc46dbad800 20 remove_watcher() i=3 2024-09-14T11:19:25.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.857+0000 7fc46dbad800 20 remove_watcher() i=4 2024-09-14T11:19:25.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.859+0000 7fc46dbad800 20 remove_watcher() i=5 2024-09-14T11:19:25.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.860+0000 7fc46dbad800 20 remove_watcher() i=6 2024-09-14T11:19:25.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.861+0000 7fc46dbad800 20 remove_watcher() i=7 2024-09-14T11:19:25.872 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:19:25.902 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:25.902 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:25.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.939+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 realm 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:25.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.941+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.942+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.942+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.942+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:25.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.942+0000 7fb45f13e800 20 searching for the correct realm 2024-09-14T11:19:25.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.946+0000 7fb45b6c1640 0 -- 172.21.15.116:0/595727295 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x555dd982c580 msgr2=0x555dd982e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.949+0000 7fb45a6bf640 0 -- 172.21.15.116:0/595727295 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fb44c0cbef0 msgr2=0x7fb44c0a4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:25.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:25.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:25.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:25.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.953+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 zone default found 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 4 Realm: () 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:25.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 zonegroup default 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.954+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.955+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.955+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.955+0000 7fb45f13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:25.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.955+0000 7fb45f13e800 20 started sync module instance, tier type = 2024-09-14T11:19:25.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.955+0000 7fb45f13e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:25.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=0 2024-09-14T11:19:25.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=1 2024-09-14T11:19:25.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=2 2024-09-14T11:19:25.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=3 2024-09-14T11:19:25.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=4 2024-09-14T11:19:25.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=5 2024-09-14T11:19:25.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.974+0000 7fb45f13e800 20 add_watcher() i=6 2024-09-14T11:19:25.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.975+0000 7fb45f13e800 20 add_watcher() i=7 2024-09-14T11:19:25.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.975+0000 7fb45f13e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:25.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.976+0000 7fb3117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 5 note: GC not initialized 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb28bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 20 Filter name: none 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb289ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:25.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.977+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 INFO: main: starting shard=0 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.978+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:25.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 INFO: main: starting shard=1 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 INFO: main: starting shard=2 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.979+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:25.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 INFO: main: starting shard=3 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 INFO: main: starting shard=4 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.980+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.981+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.981+0000 7fb45f13e800 20 INFO: main: starting shard=5 2024-09-14T11:19:25.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.981+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.981+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 INFO: main: starting shard=6 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 INFO: main: starting shard=7 2024-09-14T11:19:25.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 INFO: main: starting shard=8 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.982+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 INFO: main: starting shard=9 2024-09-14T11:19:25.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:25.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 INFO: main: starting shard=10 2024-09-14T11:19:25.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.983+0000 7fb45f13e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:25.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.984+0000 7fb45f13e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:25.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.984+0000 7fb45f13e800 20 INFO: main: done 2024-09-14T11:19:25.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.985+0000 7fb3117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:25.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.987+0000 7fb45f13e800 20 remove_watcher() i=0 2024-09-14T11:19:25.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.987+0000 7fb45f13e800 2 removed watcher, disabling cache 2024-09-14T11:19:25.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.988+0000 7fb45f13e800 20 remove_watcher() i=1 2024-09-14T11:19:25.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.989+0000 7fb45f13e800 20 remove_watcher() i=2 2024-09-14T11:19:25.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.990+0000 7fb45f13e800 20 remove_watcher() i=3 2024-09-14T11:19:25.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.991+0000 7fb45f13e800 20 remove_watcher() i=4 2024-09-14T11:19:25.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.992+0000 7fb45f13e800 20 remove_watcher() i=5 2024-09-14T11:19:25.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.993+0000 7fb45f13e800 20 remove_watcher() i=6 2024-09-14T11:19:25.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:25.994+0000 7fb45f13e800 20 remove_watcher() i=7 2024-09-14T11:19:26.004 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:19:26.004 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:26.005 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:19:26.036 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:26.036 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:26.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.073+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 realm 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.075+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.076+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.076+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.076+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:26.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.076+0000 7fbfbf30c800 20 searching for the correct realm 2024-09-14T11:19:26.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.080+0000 7fbfbd5fe640 0 -- 172.21.15.116:0/912587483 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fbfa408d940 msgr2=0x7fbfa4056470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.286+0000 7fbfbcdfd640 0 -- 172.21.15.116:0/912587483 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x559d159df5b0 msgr2=0x559d159e1a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.288+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 zone default found 2024-09-14T11:19:26.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 4 Realm: () 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 zonegroup default 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.289+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.290+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.290+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.290+0000 7fbfbf30c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.290+0000 7fbfbf30c800 20 started sync module instance, tier type = 2024-09-14T11:19:26.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.290+0000 7fbfbf30c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:26.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=0 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=1 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=2 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=3 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=4 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=5 2024-09-14T11:19:26.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.305+0000 7fbfbf30c800 20 add_watcher() i=6 2024-09-14T11:19:26.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.308+0000 7fbfbf30c800 20 add_watcher() i=7 2024-09-14T11:19:26.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.308+0000 7fbfbf30c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:26.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbe72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbfbf30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:26.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbfbf30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:26.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbfbf30c800 5 note: GC not initialized 2024-09-14T11:19:26.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbe71fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:26.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbfbf30c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbfbf30c800 20 Filter name: none 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.311+0000 7fbde37fe640 20 reqs_thread_entry: start 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:26.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.312+0000 7fbfbf30c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.313+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.314+0000 7fbfbf30c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:19:26.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.314+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:26.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.314+0000 7fbfbf30c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:19:26.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.314+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.315+0000 7fbfbf30c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.315+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.315+0000 7fbfbf30c800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.315+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.316+0000 7fbfbf30c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.316+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.316+0000 7fbfbf30c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:19:26.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.316+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.317+0000 7fbfbf30c800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.317+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.317+0000 7fbfbf30c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.317+0000 7fbfbf30c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.318+0000 7fbfbf30c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:19:26.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.318+0000 7fbfbf30c800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:19:26.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.319+0000 7fbe72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.321+0000 7fbfbf30c800 20 remove_watcher() i=0 2024-09-14T11:19:26.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.321+0000 7fbfbf30c800 2 removed watcher, disabling cache 2024-09-14T11:19:26.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.323+0000 7fbfbf30c800 20 remove_watcher() i=1 2024-09-14T11:19:26.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.324+0000 7fbfbf30c800 20 remove_watcher() i=2 2024-09-14T11:19:26.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.326+0000 7fbfbf30c800 20 remove_watcher() i=3 2024-09-14T11:19:26.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.327+0000 7fbfbf30c800 20 remove_watcher() i=4 2024-09-14T11:19:26.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.328+0000 7fbfbf30c800 20 remove_watcher() i=5 2024-09-14T11:19:26.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.331+0000 7fbfbf30c800 20 remove_watcher() i=6 2024-09-14T11:19:26.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.331+0000 7fbfbf30c800 20 remove_watcher() i=7 2024-09-14T11:19:26.341 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:19:26.341 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:26.342 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:19:26.374 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:26.374 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:26.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.412+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 20 realm 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.413+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.414+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.414+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.415+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.415+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.415+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:26.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.415+0000 7f0e1f137800 20 searching for the correct realm 2024-09-14T11:19:26.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.419+0000 7f0e1a67c640 0 -- 172.21.15.116:0/401620215 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x5576caf35d00 msgr2=0x5576caf38180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.422+0000 7f0e1a67c640 0 -- 172.21.15.116:0/401620215 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f0e0c064c20 msgr2=0x7f0e0c094930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.426+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 zone default found 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 4 Realm: () 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:26.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 zonegroup default 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 started sync module instance, tier type = 2024-09-14T11:19:26.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.427+0000 7f0e1f137800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:26.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=0 2024-09-14T11:19:26.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=1 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=2 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=3 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=4 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=5 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.449+0000 7f0e1f137800 20 add_watcher() i=6 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.450+0000 7f0e1f137800 20 add_watcher() i=7 2024-09-14T11:19:26.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.450+0000 7f0e1f137800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:26.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.452+0000 7f0cd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.452+0000 7f0e1f137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.452+0000 7f0e1f137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.452+0000 7f0e1f137800 5 note: GC not initialized 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.452+0000 7f0c4bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 20 Filter name: none 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0c49ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:26.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:26.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:26.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:26.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:26.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.453+0000 7f0e1f137800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.454+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:19:26.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.455+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.456+0000 7f0e1f137800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.456+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.456+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cacab360 obj=check-bucket:d state=0x5576caf723a8 s->prefetch_data=0 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.456+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.457+0000 7f0e1f137800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.457+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:26.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.457+0000 7f0e1f137800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:19:26.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.457+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.458+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cacd35a0 obj=check-bucket:c state=0x5576caf6ef48 s->prefetch_data=0 2024-09-14T11:19:26.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.458+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.458+0000 7f0e1f137800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.458+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state: setting s->obj_tag to w3gwskz1y53qo11klcytwa2nrz9guuoo 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state_impl: setting s->olh_tag to ze307ylxl2ifrt5s83v21rri90za7nps 2024-09-14T11:19:26.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state: setting s->obj_tag to 0d1os018ldct6650ov03fpe5r9bdic4m 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state_impl: setting s->olh_tag to siryh34snmk33fbx7vv7au9e06lcy1p9 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 olh_log_entry: epoch=4 op=3 key=c[lMx10SnY4tjZP5RIMGVdMHIhhbjQFPw] 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cafcb3b0 obj=check-bucket:_:lMx10SnY4tjZP5RIMGVdMHIhhbjQFPw_c state=0x5576cafcfdf8 s->prefetch_data=0 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 olh_log_entry: epoch=4 op=3 key=d[a24VwWQBhG28uk2sNJn1SwgmMbprjUS] 2024-09-14T11:19:26.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.459+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cafab3b0 obj=check-bucket:_:a24VwWQBhG28uk2sNJn1SwgmMbprjUS_d state=0x5576cafd9858 s->prefetch_data=0 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.461+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cafab3b0 obj=check-bucket:d state=0x5576cafda9c8 s->prefetch_data=0 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.461+0000 7f0e1f137800 20 get_obj_state: octx=0x5576cafcb3b0 obj=check-bucket:c state=0x5576caf6faa8 s->prefetch_data=0 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 get_obj_state: setting s->obj_tag to w3gwskz1y53qo11klcytwa2nrz9guuoo 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 get_obj_state_impl: setting s->olh_tag to ze307ylxl2ifrt5s83v21rri90za7nps 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ze307ylxl2ifrt5s83v21rri90za7nps 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 get_obj_state: setting s->obj_tag to 0d1os018ldct6650ov03fpe5r9bdic4m 2024-09-14T11:19:26.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 get_obj_state_impl: setting s->olh_tag to siryh34snmk33fbx7vv7au9e06lcy1p9 2024-09-14T11:19:26.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.462+0000 7f0e1f137800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=siryh34snmk33fbx7vv7au9e06lcy1p9 2024-09-14T11:19:26.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.464+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.466+0000 7f0e1f137800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:19:26.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.467+0000 7f0e1f137800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.468+0000 7f0e1f137800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:19:26.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.468+0000 7f0e1f137800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:19:26.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.469+0000 7f0cd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.471+0000 7f0e1f137800 20 remove_watcher() i=0 2024-09-14T11:19:26.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.471+0000 7f0e1f137800 2 removed watcher, disabling cache 2024-09-14T11:19:26.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.472+0000 7f0e1f137800 20 remove_watcher() i=1 2024-09-14T11:19:26.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.473+0000 7f0e1f137800 20 remove_watcher() i=2 2024-09-14T11:19:26.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.475+0000 7f0e1f137800 20 remove_watcher() i=3 2024-09-14T11:19:26.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.476+0000 7f0e1f137800 20 remove_watcher() i=4 2024-09-14T11:19:26.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.477+0000 7f0e1f137800 20 remove_watcher() i=5 2024-09-14T11:19:26.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.478+0000 7f0e1f137800 20 remove_watcher() i=6 2024-09-14T11:19:26.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.479+0000 7f0e1f137800 20 remove_watcher() i=7 2024-09-14T11:19:26.489 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:19:26.521 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:26.521 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:26.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.557+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 realm 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.559+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.560+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.560+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.561+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:26.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.561+0000 7fecc262f800 20 searching for the correct realm 2024-09-14T11:19:26.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.564+0000 7fecc0921640 0 -- 172.21.15.116:0/2624492164 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b3cb448ae0 msgr2=0x55b3cb44af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.567+0000 7fecbf91f640 0 -- 172.21.15.116:0/2624492164 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fecb007d070 msgr2=0x7fecb00d30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.570+0000 7fecc262f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 zone default found 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 4 Realm: () 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 zonegroup default 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.571+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.572+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.572+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.572+0000 7fecc262f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.572+0000 7fecc262f800 20 started sync module instance, tier type = 2024-09-14T11:19:26.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.572+0000 7fecc262f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=0 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=1 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=2 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=3 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=4 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=5 2024-09-14T11:19:26.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.586+0000 7fecc262f800 20 add_watcher() i=6 2024-09-14T11:19:26.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.587+0000 7fecc262f800 20 add_watcher() i=7 2024-09-14T11:19:26.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.587+0000 7fecc262f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.589+0000 7feb76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.589+0000 7fecc262f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.589+0000 7fecc262f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.589+0000 7fecc262f800 5 note: GC not initialized 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.589+0000 7feb75fdb640 20 reqs_thread_entry: start 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7fecc262f800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7fecc262f800 20 Filter name: none 2024-09-14T11:19:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7feae77fe640 20 reqs_thread_entry: start 2024-09-14T11:19:26.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.590+0000 7fecc262f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: starting shard=0 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: starting shard=1 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 INFO: main: starting shard=2 2024-09-14T11:19:26.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.591+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:26.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 INFO: main: starting shard=3 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 INFO: main: starting shard=4 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.592+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 INFO: main: starting shard=5 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 INFO: main: starting shard=6 2024-09-14T11:19:26.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.593+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 INFO: main: starting shard=7 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 INFO: main: starting shard=8 2024-09-14T11:19:26.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.594+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 INFO: main: starting shard=9 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 INFO: main: starting shard=10 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.595+0000 7fecc262f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:26.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.596+0000 7fecc262f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.596+0000 7fecc262f800 20 INFO: main: done 2024-09-14T11:19:26.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.597+0000 7feb76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.599+0000 7fecc262f800 20 remove_watcher() i=0 2024-09-14T11:19:26.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.599+0000 7fecc262f800 2 removed watcher, disabling cache 2024-09-14T11:19:26.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.600+0000 7fecc262f800 20 remove_watcher() i=1 2024-09-14T11:19:26.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.601+0000 7fecc262f800 20 remove_watcher() i=2 2024-09-14T11:19:26.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.602+0000 7fecc262f800 20 remove_watcher() i=3 2024-09-14T11:19:26.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.603+0000 7fecc262f800 20 remove_watcher() i=4 2024-09-14T11:19:26.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.604+0000 7fecc262f800 20 remove_watcher() i=5 2024-09-14T11:19:26.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.605+0000 7fecc262f800 20 remove_watcher() i=6 2024-09-14T11:19:26.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.606+0000 7fecc262f800 20 remove_watcher() i=7 2024-09-14T11:19:26.617 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:19:26.647 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:26.648 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:26.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.685+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.686+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.686+0000 7f936aa2f800 20 realm 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.686+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.687+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.687+0000 7f936aa2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.687+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.687+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.687+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.688+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.688+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.688+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:26.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.688+0000 7f936aa2f800 20 searching for the correct realm 2024-09-14T11:19:26.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.692+0000 7f935fd1f640 0 -- 172.21.15.116:0/2174299713 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f93580bf070 msgr2=0x7f9358058ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.695+0000 7f9368d21640 0 -- 172.21.15.116:0/2174299713 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f9350031040 msgr2=0x7f9350024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:26.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:26.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:26.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:26.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.698+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 zone default found 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 4 Realm: () 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 zonegroup default 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.699+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.700+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.700+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.700+0000 7f936aa2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.700+0000 7f936aa2f800 20 started sync module instance, tier type = 2024-09-14T11:19:26.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.700+0000 7f936aa2f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=0 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=1 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=2 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=3 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=4 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=5 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.711+0000 7f936aa2f800 20 add_watcher() i=6 2024-09-14T11:19:26.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.712+0000 7f936aa2f800 20 add_watcher() i=7 2024-09-14T11:19:26.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.712+0000 7f936aa2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f921efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f936aa2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f936aa2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f936aa2f800 5 note: GC not initialized 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f921dfdb640 20 reqs_thread_entry: start 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f936aa2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.714+0000 7f936aa2f800 20 Filter name: none 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.715+0000 7f918f7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:26.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.715+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.715+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:26.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.715+0000 7f936aa2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:26.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:26.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:26.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: starting shard=0 2024-09-14T11:19:26.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:26.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: starting shard=1 2024-09-14T11:19:26.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 INFO: main: starting shard=2 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.716+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 INFO: main: starting shard=3 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 INFO: main: starting shard=4 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.717+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 INFO: main: starting shard=5 2024-09-14T11:19:26.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 INFO: main: starting shard=6 2024-09-14T11:19:26.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.718+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:26.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 INFO: main: starting shard=7 2024-09-14T11:19:26.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:26.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 INFO: main: starting shard=8 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.719+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 INFO: main: starting shard=9 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 INFO: main: starting shard=10 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.720+0000 7f936aa2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.721+0000 7f936aa2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:26.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.721+0000 7f936aa2f800 20 INFO: main: done 2024-09-14T11:19:26.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.722+0000 7f921efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.724+0000 7f936aa2f800 20 remove_watcher() i=0 2024-09-14T11:19:26.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.724+0000 7f936aa2f800 2 removed watcher, disabling cache 2024-09-14T11:19:26.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.725+0000 7f936aa2f800 20 remove_watcher() i=1 2024-09-14T11:19:26.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.726+0000 7f936aa2f800 20 remove_watcher() i=2 2024-09-14T11:19:26.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.728+0000 7f936aa2f800 20 remove_watcher() i=3 2024-09-14T11:19:26.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.730+0000 7f936aa2f800 20 remove_watcher() i=4 2024-09-14T11:19:26.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.730+0000 7f936aa2f800 20 remove_watcher() i=5 2024-09-14T11:19:26.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.731+0000 7f936aa2f800 20 remove_watcher() i=6 2024-09-14T11:19:26.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.732+0000 7f936aa2f800 20 remove_watcher() i=7 2024-09-14T11:19:26.742 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:19:26.742 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:26.743 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:19:26.774 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:26.774 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:26.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.811+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.812+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.812+0000 7fa01ac20800 20 realm 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.812+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.813+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.813+0000 7fa01ac20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.813+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.813+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.813+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.814+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.814+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.814+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:26.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.814+0000 7fa01ac20800 20 searching for the correct realm 2024-09-14T11:19:26.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.817+0000 7fa017f09640 0 -- 172.21.15.116:0/535331332 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55fedd734a40 msgr2=0x55fedd736f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.820+0000 7fa01870a640 0 -- 172.21.15.116:0/535331332 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa00c061910 msgr2=0x7fa00c07b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:26.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 zone default found 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 4 Realm: () 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 zonegroup default 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.825+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.826+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.826+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.826+0000 7fa01ac20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:26.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.826+0000 7fa01ac20800 20 started sync module instance, tier type = 2024-09-14T11:19:26.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.826+0000 7fa01ac20800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=0 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=1 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=2 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=3 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=4 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=5 2024-09-14T11:19:26.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.847+0000 7fa01ac20800 20 add_watcher() i=6 2024-09-14T11:19:26.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.850+0000 7fa01ac20800 20 add_watcher() i=7 2024-09-14T11:19:26.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.850+0000 7fa01ac20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7f9ece7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7fa01ac20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7fa01ac20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7fa01ac20800 5 note: GC not initialized 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7f9ecd7e2640 20 reqs_thread_entry: start 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7fa01ac20800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.852+0000 7fa01ac20800 20 Filter name: none 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7f9e3effd640 20 reqs_thread_entry: start 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:26.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 20 rados->read ofs=0 len=0 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.853+0000 7fa01ac20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.854+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.854+0000 7fa01ac20800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:19:26.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.854+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.854+0000 7fa01ac20800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.854+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.855+0000 7fa01ac20800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.855+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.855+0000 7fa01ac20800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.855+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:26.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.856+0000 7fa01ac20800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:19:26.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.856+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:26.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.857+0000 7fa01ac20800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:19:26.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.857+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:26.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.857+0000 7fa01ac20800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:19:26.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.857+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:26.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.858+0000 7fa01ac20800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:19:26.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.858+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:26.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.858+0000 7fa01ac20800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:19:26.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.858+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:26.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.859+0000 7fa01ac20800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:19:26.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.859+0000 7fa01ac20800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:26.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.859+0000 7fa01ac20800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:19:26.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.859+0000 7fa01ac20800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:19:26.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.860+0000 7f9ece7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:26.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.862+0000 7fa01ac20800 20 remove_watcher() i=0 2024-09-14T11:19:26.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.862+0000 7fa01ac20800 2 removed watcher, disabling cache 2024-09-14T11:19:26.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.863+0000 7fa01ac20800 20 remove_watcher() i=1 2024-09-14T11:19:26.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.864+0000 7fa01ac20800 20 remove_watcher() i=2 2024-09-14T11:19:26.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.865+0000 7fa01ac20800 20 remove_watcher() i=3 2024-09-14T11:19:26.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.866+0000 7fa01ac20800 20 remove_watcher() i=4 2024-09-14T11:19:26.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.868+0000 7fa01ac20800 20 remove_watcher() i=5 2024-09-14T11:19:26.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.869+0000 7fa01ac20800 20 remove_watcher() i=6 2024-09-14T11:19:26.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:26.870+0000 7fa01ac20800 20 remove_watcher() i=7 2024-09-14T11:19:26.879 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:19:26.879 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:26.997 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:19:26.998 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:19:27.721 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:19:28.110 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:19:29.592 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:29.594 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:19:29.626 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.626 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.663+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.664+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.664+0000 7efcc920f800 20 realm 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.664+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.665+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.665+0000 7efcc920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.665+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.665+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.665+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.666+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.666+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.666+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.666+0000 7efcc920f800 20 searching for the correct realm 2024-09-14T11:19:29.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.669+0000 7efcbffff640 0 -- 172.21.15.116:0/4139226546 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x564c70e720e0 msgr2=0x564c70e744d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.673+0000 7efcc6d00640 0 -- 172.21.15.116:0/4139226546 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7efcb000d0e0 msgr2=0x7efcb0015b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:29.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.677+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 zone default found 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 4 Realm: () 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 zonegroup default 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.678+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.679+0000 7efcc920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.679+0000 7efcc920f800 20 started sync module instance, tier type = 2024-09-14T11:19:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.679+0000 7efcc920f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:29.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=0 2024-09-14T11:19:29.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=1 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=2 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=3 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=4 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=5 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.690+0000 7efcc920f800 20 add_watcher() i=6 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.691+0000 7efcc920f800 20 add_watcher() i=7 2024-09-14T11:19:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.691+0000 7efcc920f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.692+0000 7efb7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 5 note: GC not initialized 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efaf7fff640 20 reqs_thread_entry: start 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 20 Filter name: none 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efaf5ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.693+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:29.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 INFO: main: starting shard=0 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.694+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 INFO: main: starting shard=1 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 INFO: main: starting shard=2 2024-09-14T11:19:29.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.695+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: starting shard=3 2024-09-14T11:19:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: starting shard=4 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 INFO: main: starting shard=5 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.696+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.697+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.697+0000 7efcc920f800 20 INFO: main: starting shard=6 2024-09-14T11:19:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.697+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:29.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 INFO: main: starting shard=7 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 INFO: main: starting shard=8 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.698+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.699+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.699+0000 7efcc920f800 20 INFO: main: starting shard=9 2024-09-14T11:19:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.699+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.700+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.700+0000 7efcc920f800 20 INFO: main: starting shard=10 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.700+0000 7efcc920f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.700+0000 7efcc920f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.700+0000 7efcc920f800 20 INFO: main: done 2024-09-14T11:19:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.701+0000 7efb7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.703+0000 7efcc920f800 20 remove_watcher() i=0 2024-09-14T11:19:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.703+0000 7efcc920f800 2 removed watcher, disabling cache 2024-09-14T11:19:29.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.705+0000 7efcc920f800 20 remove_watcher() i=1 2024-09-14T11:19:29.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.706+0000 7efcc920f800 20 remove_watcher() i=2 2024-09-14T11:19:29.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.708+0000 7efcc920f800 20 remove_watcher() i=3 2024-09-14T11:19:29.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.709+0000 7efcc920f800 20 remove_watcher() i=4 2024-09-14T11:19:29.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.710+0000 7efcc920f800 20 remove_watcher() i=5 2024-09-14T11:19:29.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.711+0000 7efcc920f800 20 remove_watcher() i=6 2024-09-14T11:19:29.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.712+0000 7efcc920f800 20 remove_watcher() i=7 2024-09-14T11:19:29.855 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:29.889 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:19:29.889 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:29.889 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:29.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.924+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 realm 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.926+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.927+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.927+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.927+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:29.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.927+0000 7fbc46142800 20 searching for the correct realm 2024-09-14T11:19:29.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.931+0000 7fbc3bfff640 0 -- 172.21.15.116:0/3855762348 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fbc34055920 msgr2=0x7fbc34044400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.934+0000 7fbc42687640 0 -- 172.21.15.116:0/3855762348 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fbc2c03a430 msgr2=0x7fbc2c03a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:29.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:29.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:29.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.938+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 zone default found 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 4 Realm: () 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 zonegroup default 2024-09-14T11:19:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.939+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.940+0000 7fbc46142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.940+0000 7fbc46142800 20 started sync module instance, tier type = 2024-09-14T11:19:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.940+0000 7fbc46142800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:29.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=0 2024-09-14T11:19:29.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=1 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=2 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=3 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=4 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=5 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.952+0000 7fbc46142800 20 add_watcher() i=6 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.953+0000 7fbc46142800 20 add_watcher() i=7 2024-09-14T11:19:29.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.953+0000 7fbc46142800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:29.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.955+0000 7fbaf3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.955+0000 7fbc46142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.955+0000 7fbc46142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.955+0000 7fbc46142800 5 note: GC not initialized 2024-09-14T11:19:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbaf2ffd640 20 reqs_thread_entry: start 2024-09-14T11:19:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbc46142800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbc46142800 20 Filter name: none 2024-09-14T11:19:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbaf0ff9640 20 reqs_thread_entry: start 2024-09-14T11:19:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.956+0000 7fbc46142800 20 rados->read ofs=0 len=0 2024-09-14T11:19:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 INFO: main: starting shard=0 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 INFO: main: starting shard=1 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.957+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 INFO: main: starting shard=2 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 INFO: main: starting shard=3 2024-09-14T11:19:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.958+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 INFO: main: starting shard=4 2024-09-14T11:19:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 INFO: main: starting shard=5 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.959+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: starting shard=6 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: starting shard=7 2024-09-14T11:19:29.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:29.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 INFO: main: starting shard=8 2024-09-14T11:19:29.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.960+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:29.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 INFO: main: starting shard=9 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 INFO: main: starting shard=10 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.961+0000 7fbc46142800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.962+0000 7fbc46142800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.962+0000 7fbc46142800 20 INFO: main: done 2024-09-14T11:19:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.963+0000 7fbaf3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.965+0000 7fbc46142800 20 remove_watcher() i=0 2024-09-14T11:19:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.965+0000 7fbc46142800 2 removed watcher, disabling cache 2024-09-14T11:19:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.966+0000 7fbc46142800 20 remove_watcher() i=1 2024-09-14T11:19:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.967+0000 7fbc46142800 20 remove_watcher() i=2 2024-09-14T11:19:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.968+0000 7fbc46142800 20 remove_watcher() i=3 2024-09-14T11:19:29.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.969+0000 7fbc46142800 20 remove_watcher() i=4 2024-09-14T11:19:29.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.970+0000 7fbc46142800 20 remove_watcher() i=5 2024-09-14T11:19:29.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.973+0000 7fbc46142800 20 remove_watcher() i=6 2024-09-14T11:19:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:29.974+0000 7fbc46142800 20 remove_watcher() i=7 2024-09-14T11:19:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:30.093 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:19:30.122 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:30.122 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:30.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.160+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 20 realm 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.162+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.163+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.163+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.163+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.163+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.164+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:30.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.164+0000 7f3b9eda7800 20 searching for the correct realm 2024-09-14T11:19:30.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.167+0000 7f3b94090640 0 -- 172.21.15.116:0/798043252 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f3b8c0c5020 msgr2=0x7f3b8c07f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:30.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.171+0000 7f3b9d092640 0 -- 172.21.15.116:0/798043252 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f3b84047140 msgr2=0x7f3b8402a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.174+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:30.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 zone default found 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 4 Realm: () 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 zonegroup default 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.175+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.176+0000 7f3b9eda7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.176+0000 7f3b9eda7800 20 started sync module instance, tier type = 2024-09-14T11:19:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.176+0000 7f3b9eda7800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=0 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=1 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=2 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=3 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=4 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=5 2024-09-14T11:19:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.188+0000 7f3b9eda7800 20 add_watcher() i=6 2024-09-14T11:19:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.189+0000 7f3b9eda7800 20 add_watcher() i=7 2024-09-14T11:19:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.189+0000 7f3b9eda7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:30.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.191+0000 7f3a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:30.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 5 note: GC not initialized 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3a51fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 20 Filter name: none 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f39c37fe640 20 reqs_thread_entry: start 2024-09-14T11:19:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.192+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 INFO: main: starting shard=0 2024-09-14T11:19:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.193+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 INFO: main: starting shard=1 2024-09-14T11:19:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 INFO: main: starting shard=2 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.194+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 INFO: main: starting shard=3 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 INFO: main: starting shard=4 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.195+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: starting shard=5 2024-09-14T11:19:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: starting shard=6 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 INFO: main: starting shard=7 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.196+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 INFO: main: starting shard=8 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 INFO: main: starting shard=9 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.197+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.198+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.198+0000 7f3b9eda7800 20 INFO: main: starting shard=10 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.198+0000 7f3b9eda7800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.198+0000 7f3b9eda7800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.198+0000 7f3b9eda7800 20 INFO: main: done 2024-09-14T11:19:30.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.199+0000 7f3a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:30.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.204+0000 7f3b9eda7800 20 remove_watcher() i=0 2024-09-14T11:19:30.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.204+0000 7f3b9eda7800 2 removed watcher, disabling cache 2024-09-14T11:19:30.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.205+0000 7f3b9eda7800 20 remove_watcher() i=1 2024-09-14T11:19:30.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.206+0000 7f3b9eda7800 20 remove_watcher() i=2 2024-09-14T11:19:30.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.208+0000 7f3b9eda7800 20 remove_watcher() i=3 2024-09-14T11:19:30.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.209+0000 7f3b9eda7800 20 remove_watcher() i=4 2024-09-14T11:19:30.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.210+0000 7f3b9eda7800 20 remove_watcher() i=5 2024-09-14T11:19:30.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.211+0000 7f3b9eda7800 20 remove_watcher() i=6 2024-09-14T11:19:30.211 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.212+0000 7f3b9eda7800 20 remove_watcher() i=7 2024-09-14T11:19:30.330 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:19:30.332 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:19:30.361 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:30.361 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:30.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.398+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 realm 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.400+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.401+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:30.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.401+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.402+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:30.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.402+0000 7ff2d9e2f800 20 searching for the correct realm 2024-09-14T11:19:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.405+0000 7ff2cf118640 0 -- 172.21.15.116:0/1084079491 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55f04f261df0 msgr2=0x55f04f2641e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:30.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.408+0000 7ff2d7919640 0 -- 172.21.15.116:0/1084079491 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff2c005b9a0 msgr2=0x7ff2c001f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:30.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:30.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:30.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.615+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:30.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 zone default found 2024-09-14T11:19:30.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 4 Realm: () 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 zonegroup default 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.616+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.617+0000 7ff2d9e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.617+0000 7ff2d9e2f800 20 started sync module instance, tier type = 2024-09-14T11:19:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.617+0000 7ff2d9e2f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=0 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=1 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=2 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=3 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=4 2024-09-14T11:19:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.631+0000 7ff2d9e2f800 20 add_watcher() i=5 2024-09-14T11:19:30.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.636+0000 7ff2d9e2f800 20 add_watcher() i=6 2024-09-14T11:19:30.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.636+0000 7ff2d9e2f800 20 add_watcher() i=7 2024-09-14T11:19:30.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.636+0000 7ff2d9e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:30.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.638+0000 7ff18dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 5 note: GC not initialized 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff18cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 20 Filter name: none 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff1067fc640 20 reqs_thread_entry: start 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.639+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:19:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 INFO: main: starting shard=0 2024-09-14T11:19:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.640+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: starting shard=1 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: starting shard=2 2024-09-14T11:19:30.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.641+0000 7ff2d9e2f800 20 INFO: main: starting shard=3 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 INFO: main: starting shard=4 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 INFO: main: starting shard=5 2024-09-14T11:19:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.642+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.643+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.643+0000 7ff2d9e2f800 20 INFO: main: starting shard=6 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.643+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 INFO: main: starting shard=7 2024-09-14T11:19:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 INFO: main: starting shard=8 2024-09-14T11:19:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.644+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 INFO: main: starting shard=9 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 INFO: main: starting shard=10 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.645+0000 7ff2d9e2f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.646+0000 7ff2d9e2f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:19:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.646+0000 7ff2d9e2f800 20 INFO: main: done 2024-09-14T11:19:30.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.646+0000 7ff18dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:30.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.649+0000 7ff2d9e2f800 20 remove_watcher() i=0 2024-09-14T11:19:30.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.649+0000 7ff2d9e2f800 2 removed watcher, disabling cache 2024-09-14T11:19:30.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.650+0000 7ff2d9e2f800 20 remove_watcher() i=1 2024-09-14T11:19:30.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.651+0000 7ff2d9e2f800 20 remove_watcher() i=2 2024-09-14T11:19:30.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.652+0000 7ff2d9e2f800 20 remove_watcher() i=3 2024-09-14T11:19:30.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.653+0000 7ff2d9e2f800 20 remove_watcher() i=4 2024-09-14T11:19:30.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.654+0000 7ff2d9e2f800 20 remove_watcher() i=5 2024-09-14T11:19:30.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.657+0000 7ff2d9e2f800 20 remove_watcher() i=6 2024-09-14T11:19:30.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:30.658+0000 7ff2d9e2f800 20 remove_watcher() i=7 2024-09-14T11:19:30.692 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:19:31.094 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:19:31.483 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:19:31.513 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:31.513 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:31.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.551+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 realm 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.552+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.553+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:31.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.553+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.554+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:31.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.554+0000 7fef9cf22800 20 searching for the correct realm 2024-09-14T11:19:31.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.556+0000 7fef98bae640 0 -- 172.21.15.116:0/1240721686 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7fef94028070 msgr2=0x7fef940884f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:31.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.761+0000 7fef993af640 0 -- 172.21.15.116:0/1240721686 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fef80061040 msgr2=0x7fef80062430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.767+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 zone default found 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 4 Realm: () 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 zonegroup default 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.768+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.769+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.769+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.769+0000 7fef9cf22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.769+0000 7fef9cf22800 20 started sync module instance, tier type = 2024-09-14T11:19:31.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.769+0000 7fef9cf22800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:31.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=0 2024-09-14T11:19:31.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=1 2024-09-14T11:19:31.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=2 2024-09-14T11:19:31.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=3 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=4 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=5 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.781+0000 7fef9cf22800 20 add_watcher() i=6 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.782+0000 7fef9cf22800 20 add_watcher() i=7 2024-09-14T11:19:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.782+0000 7fef9cf22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:31.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fee4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fef9cf22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fef9cf22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fef9cf22800 5 note: GC not initialized 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fee4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fef9cf22800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.784+0000 7fef9cf22800 20 Filter name: none 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fee47fff640 20 reqs_thread_entry: start 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.785+0000 7fef9cf22800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.786+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:31.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.787+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:31.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.787+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:31.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.788+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:31.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.788+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:31.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.789+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:31.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.789+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:31.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.790+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:31.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.790+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:31.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.791+0000 7fef9cf22800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:31.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.796+0000 7fee4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:31.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.798+0000 7fef9cf22800 20 remove_watcher() i=0 2024-09-14T11:19:31.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.798+0000 7fef9cf22800 2 removed watcher, disabling cache 2024-09-14T11:19:31.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.799+0000 7fef9cf22800 20 remove_watcher() i=1 2024-09-14T11:19:31.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.801+0000 7fef9cf22800 20 remove_watcher() i=2 2024-09-14T11:19:31.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.802+0000 7fef9cf22800 20 remove_watcher() i=3 2024-09-14T11:19:31.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.803+0000 7fef9cf22800 20 remove_watcher() i=4 2024-09-14T11:19:31.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.804+0000 7fef9cf22800 20 remove_watcher() i=5 2024-09-14T11:19:31.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.805+0000 7fef9cf22800 20 remove_watcher() i=6 2024-09-14T11:19:31.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.806+0000 7fef9cf22800 20 remove_watcher() i=7 2024-09-14T11:19:31.817 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:19:31.851 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:31.851 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:31.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.890+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 realm 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.891+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.892+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:31.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.892+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:31.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.892+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:31.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.892+0000 7f74d8c15800 20 searching for the correct realm 2024-09-14T11:19:31.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:31.895+0000 7f74cbb91640 0 -- 172.21.15.116:0/4137584052 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f74c4045430 msgr2=0x7f74c4045850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:32.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.101+0000 7f74d4392640 0 -- 172.21.15.116:0/4137584052 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f74bc0e5260 msgr2=0x7f74bc0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:32.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.307+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 zone default found 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 4 Realm: () 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 zonegroup default 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.308+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.309+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.309+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.309+0000 7f74d8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.309+0000 7f74d8c15800 20 started sync module instance, tier type = 2024-09-14T11:19:32.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.309+0000 7f74d8c15800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=0 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=1 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=2 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=3 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=4 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.319+0000 7f74d8c15800 20 add_watcher() i=5 2024-09-14T11:19:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.320+0000 7f74d8c15800 20 add_watcher() i=6 2024-09-14T11:19:32.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.320+0000 7f74d8c15800 20 add_watcher() i=7 2024-09-14T11:19:32.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.320+0000 7f74d8c15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:32.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.322+0000 7f738afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:32.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.322+0000 7f74d8c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:32.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.322+0000 7f74d8c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:32.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.322+0000 7f74d8c15800 5 note: GC not initialized 2024-09-14T11:19:32.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f7389fdb640 20 reqs_thread_entry: start 2024-09-14T11:19:32.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 20 Filter name: none 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f72fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 : miss 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.323+0000 7f74d8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 info.flags=0x17 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 to cache LRU end 2024-09-14T11:19:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:32.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:19:32.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1 2024-09-14T11:19:32.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.0 2024-09-14T11:19:32.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:19:32.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.324+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.325+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.2 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.325+0000 7f74d8c15800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.325+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.3 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.326+0000 7f74d8c15800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.326+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.4 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.326+0000 7f74d8c15800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.326+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.327+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.6 2024-09-14T11:19:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.327+0000 7f74d8c15800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:19:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.327+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.7 2024-09-14T11:19:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.328+0000 7f74d8c15800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:19:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.328+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.328+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.9 2024-09-14T11:19:32.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.328+0000 7f74d8c15800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:19:32.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.328+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.329+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.329+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d17380 obj=check-bucket:e state=0x5599a7fdfb48 s->prefetch_data=0 2024-09-14T11:19:32.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.329+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d3f5c0 obj=check-bucket:d state=0x5599a7fdd348 s->prefetch_data=0 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fe0750 obj=check-bucket:c state=0x5599a7fd9e78 s->prefetch_data=0 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fdb110 obj=check-bucket:f state=0x5599a807a688 s->prefetch_data=0 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to t5vvgkhy9d8shu8zv5gomg3xys5n5o7e 2024-09-14T11:19:32.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state_impl: setting s->olh_tag to nultg0zlbstw9bj9aivpmfny8q2yc37y 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nultg0zlbstw9bj9aivpmfny8q2yc37y 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to y5cud8m5755j4jrnj838kxnqgq6h1wln 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 get_obj_state_impl: setting s->olh_tag to tt1d4wa26umdc3u3bk095de3f4pmcy1a 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.330+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tt1d4wa26umdc3u3bk095de3f4pmcy1a 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to v14hrmj89sgh84x9pmlmqpm10hhw9zjm 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 get_obj_state_impl: setting s->olh_tag to wwr5t8v0kdghfd1a7o9ehz8eujw3zeu8 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wwr5t8v0kdghfd1a7o9ehz8eujw3zeu8 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to 3eql2hrpr5nkj5fuf8012ipm8vajyqvn 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 get_obj_state_impl: setting s->olh_tag to t64w2wcl9bzm46dx7mdxsveka8inscno 2024-09-14T11:19:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.331+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t64w2wcl9bzm46dx7mdxsveka8inscno 2024-09-14T11:19:32.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.332+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.332+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.332+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.333+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.333+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 olh_log_entry: epoch=2 op=3 key=e[xpvvAoO9EpVbQ215plbvCSjV408GtBH] 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d17380 obj=check-bucket:_:xpvvAoO9EpVbQ215plbvCSjV408GtBH_e state=0x5599a8096408 s->prefetch_data=0 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 10 manifest: total_size = 11 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6646155443813977432 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d17380 obj=check-bucket:_:xpvvAoO9EpVbQ215plbvCSjV408GtBH_e state=0x5599a8096408 s->prefetch_data=0 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 prepare_atomic_modification: state is not atomic. state=0x5599a8096408 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 olh_log_entry: epoch=2 op=3 key=f[U2XUiCQMRx1Wy.ctRDKU1BnnhS64BZP] 2024-09-14T11:19:32.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.334+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fdb110 obj=check-bucket:_:U2XUiCQMRx1Wy.ctRDKU1BnnhS64BZP_f state=0x5599a809e1f8 s->prefetch_data=0 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 olh_log_entry: epoch=3 op=3 key=d[VoXDOVSHoWZ5VdPN4uTVGPGXMrfN3yQ] 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d3f5c0 obj=check-bucket:_:VoXDOVSHoWZ5VdPN4uTVGPGXMrfN3yQ_d state=0x5599a80a4e18 s->prefetch_data=0 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 10 manifest: total_size = 22 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16226711401928685719 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fdb110 obj=check-bucket:_:U2XUiCQMRx1Wy.ctRDKU1BnnhS64BZP_f state=0x5599a809e1f8 s->prefetch_data=0 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 prepare_atomic_modification: state is not atomic. state=0x5599a809e1f8 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 10 manifest: total_size = 12 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18176539338945492901 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d3f5c0 obj=check-bucket:_:VoXDOVSHoWZ5VdPN4uTVGPGXMrfN3yQ_d state=0x5599a80a4e18 s->prefetch_data=0 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 prepare_atomic_modification: state is not atomic. state=0x5599a80a4e18 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 olh_log_entry: epoch=3 op=3 key=c[g4IvvAe7HLKq9iqX8qn4ksJumfbiOA4] 2024-09-14T11:19:32.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.335+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fe0750 obj=check-bucket:_:g4IvvAe7HLKq9iqX8qn4ksJumfbiOA4_c state=0x5599a80b0e98 s->prefetch_data=0 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.336+0000 7f74d8c15800 10 manifest: total_size = 11 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.336+0000 7f74d8c15800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1318474361643591428 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.336+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fe0750 obj=check-bucket:_:g4IvvAe7HLKq9iqX8qn4ksJumfbiOA4_c state=0x5599a80b0e98 s->prefetch_data=0 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.336+0000 7f74d8c15800 20 prepare_atomic_modification: state is not atomic. state=0x5599a80b0e98 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.336+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.337+0000 7f74d8c15800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.337+0000 7f74d8c15800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:19:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.337+0000 7f74d8c15800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.337+0000 7f74d8c15800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:xpvvAoO9EpVbQ215plbvCSjV408GtBH_.eQIA5vpYYEPFtdUAj6Pca9BvQr_y5rm_0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:U2XUiCQMRx1Wy.ctRDKU1BnnhS64BZP_.hgzqPeOGWgdOZGgle7q-H1XCbMh4SeP_0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.338+0000 7f74d8c15800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:VoXDOVSHoWZ5VdPN4uTVGPGXMrfN3yQ_.C1GMMjlR-Az72sGa_x-3GBSj8GaY94D_0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.339+0000 7f74d8c15800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.339+0000 7f74d8c15800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.339+0000 7f74d8c15800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:19:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.339+0000 7f74d8c15800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1__shadow:g4IvvAe7HLKq9iqX8qn4ksJumfbiOA4_.sN1ezmS-sSMLgOhLod78_yBHCgLLmyM_0 2024-09-14T11:19:32.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.339+0000 7f73ab7fe640 20 handle_completion(): completion ok for obj=f[U2XUiCQMRx1Wy.ctRDKU1BnnhS64BZP] 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f73aaffd640 20 handle_completion(): completion ok for obj=e[xpvvAoO9EpVbQ215plbvCSjV408GtBH] 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f74d8c15800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f74d8c15800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f74d8c15800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f73aaffd640 20 handle_completion(): completion ok for obj=d[VoXDOVSHoWZ5VdPN4uTVGPGXMrfN3yQ] 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.340+0000 7f74d8c15800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.341+0000 7f73ab7fe640 20 handle_completion(): completion ok for obj=c[g4IvvAe7HLKq9iqX8qn4ksJumfbiOA4] 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.341+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.341+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7fdb110 obj=check-bucket:f state=0x5599a807a688 s->prefetch_data=0 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t64w2wcl9bzm46dx7mdxsveka8inscno 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 get_obj_state: octx=0x5599a7d17380 obj=check-bucket:e state=0x5599a7fdfb48 s->prefetch_data=0 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nultg0zlbstw9bj9aivpmfny8q2yc37y 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.5 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.345+0000 7f74d8c15800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:19:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.346+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.8 2024-09-14T11:19:32.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.346+0000 7f74d8c15800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:19:32.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.351+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.352+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.352+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.10 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.352+0000 7f74d8c15800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.353+0000 7f74d8c15800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1.1 2024-09-14T11:19:32.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.353+0000 7f74d8c15800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:19:32.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.353+0000 7f74d8c15800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:19:32.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.354+0000 7f738afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:32.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.357+0000 7f74d8c15800 20 remove_watcher() i=0 2024-09-14T11:19:32.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.357+0000 7f74d8c15800 2 removed watcher, disabling cache 2024-09-14T11:19:32.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.358+0000 7f74d8c15800 20 remove_watcher() i=1 2024-09-14T11:19:32.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.359+0000 7f74d8c15800 20 remove_watcher() i=2 2024-09-14T11:19:32.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.360+0000 7f74d8c15800 20 remove_watcher() i=3 2024-09-14T11:19:32.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.361+0000 7f74d8c15800 20 remove_watcher() i=4 2024-09-14T11:19:32.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.362+0000 7f74d8c15800 20 remove_watcher() i=5 2024-09-14T11:19:32.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.363+0000 7f74d8c15800 20 remove_watcher() i=6 2024-09-14T11:19:32.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.364+0000 7f74d8c15800 20 remove_watcher() i=7 2024-09-14T11:19:32.582 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:19:32.610 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:32.610 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:32.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.646+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 20 realm 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.648+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.649+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.649+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.649+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.649+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.650+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:32.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.650+0000 7f40eb70c800 20 searching for the correct realm 2024-09-14T11:19:32.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.653+0000 7f40e09fc640 0 -- 172.21.15.116:0/2642047615 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x560e3ed91c20 msgr2=0x560e3ed94010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:32.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.656+0000 7f40e91fd640 0 -- 172.21.15.116:0/2642047615 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f40d407b900 msgr2=0x7f40d40793c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.660+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 zone default found 2024-09-14T11:19:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 4 Realm: () 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 zonegroup default 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.661+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.662+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.662+0000 7f40eb70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.662+0000 7f40eb70c800 20 started sync module instance, tier type = 2024-09-14T11:19:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.662+0000 7f40eb70c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:19:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=0 2024-09-14T11:19:32.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=1 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=2 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=3 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=4 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=5 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.671+0000 7f40eb70c800 20 add_watcher() i=6 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.672+0000 7f40eb70c800 20 add_watcher() i=7 2024-09-14T11:19:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.672+0000 7f40eb70c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:32.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.674+0000 7f3f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:32.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 5 note: GC not initialized 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f3f9e7e4640 20 reqs_thread_entry: start 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 20 Filter name: none 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f3f0ffff640 20 reqs_thread_entry: start 2024-09-14T11:19:32.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.675+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.676+0000 7f40eb70c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.677+0000 7f40eb70c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:19:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.677+0000 7f40eb70c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:32.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.678+0000 7f3f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:32.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.681+0000 7f40eb70c800 20 remove_watcher() i=0 2024-09-14T11:19:32.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.681+0000 7f40eb70c800 2 removed watcher, disabling cache 2024-09-14T11:19:32.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.682+0000 7f40eb70c800 20 remove_watcher() i=1 2024-09-14T11:19:32.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.683+0000 7f40eb70c800 20 remove_watcher() i=2 2024-09-14T11:19:32.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.684+0000 7f40eb70c800 20 remove_watcher() i=3 2024-09-14T11:19:32.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.685+0000 7f40eb70c800 20 remove_watcher() i=4 2024-09-14T11:19:32.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.686+0000 7f40eb70c800 20 remove_watcher() i=5 2024-09-14T11:19:32.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.687+0000 7f40eb70c800 20 remove_watcher() i=6 2024-09-14T11:19:32.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:19:32.688+0000 7f40eb70c800 20 remove_watcher() i=7 2024-09-14T11:19:32.698 INFO:tasks.workunit.client.0.smithi116.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:19:32.698 INFO:tasks.workunit.client.0.smithi116.stderr:Deleting bucket check-bucket 2024-09-14T11:19:32.935 INFO:tasks.workunit.client.0.smithi116.stderr:Completed bucket check tests 2024-09-14T11:19:32.935 INFO:tasks.workunit.client.0.smithi116.stdout:connected to http://localhost:80 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ deactivate 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:19:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ hash -r 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset -f deactivate 2024-09-14T11:19:32.996 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo OK. 2024-09-14T11:19:32.997 INFO:tasks.workunit.client.0.smithi116.stdout:OK. 2024-09-14T11:19:32.997 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:32.997 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:33.076 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:19:33.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:19:33.446 DEBUG:teuthology.parallel:result is None 2024-09-14T11:19:33.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:19:33.484 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:19:33.485 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:19:33.568 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:19:33.568 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:19:33.578 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:19:33.578 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:19:33.579 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:19:33.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:19:33.637 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:19:33.637 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:19:33.705 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:19:33.705 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:19:33.773 INFO:tasks.workunit:timeout=3h 2024-09-14T11:19:33.773 INFO:tasks.workunit:cleanup=True 2024-09-14T11:19:33.773 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:19:33.842 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:20:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:20:29.388 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:20:29.389 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:20:29.459 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:20:29.462 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:20:29.462 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:20:29.511 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:20:29.559 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:20:29.599 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:20:29.601 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:20:29.601 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:20:29.639 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:20:29.643 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:20:29.643 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:20:29.712 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:20:29.713 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:20:29.713 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:20:29.796 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:20:29.796 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:20:29.796 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:29.796 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:20:29.796 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:20:31.491 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:31.491 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: exclusive 2024-09-14T11:20:31.491 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:31.491 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:31.491 INFO:tasks.workunit.client.0.smithi116.stdout: client.5253 expiration=2024-09-14T11:22:31.490066+0000 addr=v1:172.21.15.116:0/1660138739 cookie= 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: shared 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout: client.5253 expiration=2024-09-14T11:22:31.497214+0000 addr=v1:172.21.15.116:0/1660138739 cookie= 2024-09-14T11:20:31.496 INFO:tasks.workunit.client.0.smithi116.stdout: client.5262 expiration=0.000000 addr=v1:172.21.15.116:0/2714897724 cookie= 2024-09-14T11:20:31.497 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:31.497 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: shared 2024-09-14T11:20:31.497 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:31.497 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:31.497 INFO:tasks.workunit.client.0.smithi116.stdout: client.5262 expiration=0.000000 addr=v1:172.21.15.116:0/2714897724 cookie= 2024-09-14T11:20:32.473 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestMultiLocking (2676 ms) 2024-09-14T11:20:32.473 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:20:34.515 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:34.515 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: shared 2024-09-14T11:20:34.515 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:34.515 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:34.515 INFO:tasks.workunit.client.0.smithi116.stdout: client.5277 expiration=0.000000 addr=v1:172.21.15.116:0/2451273776 cookie= 2024-09-14T11:20:34.519 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:34.519 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: exclusive 2024-09-14T11:20:34.519 INFO:tasks.workunit.client.0.smithi116.stdout: tag: new_tag 2024-09-14T11:20:34.519 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:34.519 INFO:tasks.workunit.client.0.smithi116.stdout: client.5271 expiration=0.000000 addr=v1:172.21.15.116:0/3052503147 cookie= 2024-09-14T11:20:35.479 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestMeta (3006 ms) 2024-09-14T11:20:35.479 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:20:37.506 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:37.506 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: exclusive 2024-09-14T11:20:37.506 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:37.506 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout:lock: mylock 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout: lock_type: shared 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout: tag: 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout: lockers: 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout: client.5286 expiration=0.000000 addr=v1:172.21.15.116:0/314800672 cookie= 2024-09-14T11:20:37.508 INFO:tasks.workunit.client.0.smithi116.stdout: client.5286 expiration=0.000000 addr=v1:172.21.15.116:0/314800672 cookie=new cookie 2024-09-14T11:20:38.498 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestCookie (3019 ms) 2024-09-14T11:20:38.498 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:20:41.521 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestMultipleLocks (3022 ms) 2024-09-14T11:20:41.521 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:20:49.552 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestLockDuration (8031 ms) 2024-09-14T11:20:49.552 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:20:52.584 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestAssertLocked (3033 ms) 2024-09-14T11:20:52.584 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:20:55.588 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestSetCookie (3004 ms) 2024-09-14T11:20:55.589 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:21:16.645 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestRenew (21055 ms) 2024-09-14T11:21:16.646 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:21:22.729 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6086 ms) 2024-09-14T11:21:22.729 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:21:29.811 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7081 ms) 2024-09-14T11:21:29.811 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8334 ms) 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from ClsLock (68348 ms total) 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 11 tests from 1 test suite ran. (68348 ms total) 2024-09-14T11:21:38.145 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 11 tests. 2024-09-14T11:21:38.148 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:38.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:38.192 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:21:38.193 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:21:38.193 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:21:38.279 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:21:38.279 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:21:38.279 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:38.279 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from cls_log 2024-09-14T11:21:38.279 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:21:41.156 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_log.test_log_add_same_time (2876 ms) 2024-09-14T11:21:41.156 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:21:44.188 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_log.test_log_add_different_time (3031 ms) 2024-09-14T11:21:44.188 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:21:47.193 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_log.trim_by_time (3005 ms) 2024-09-14T11:21:47.193 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:21:50.221 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_log.trim_by_marker (3028 ms) 2024-09-14T11:21:50.221 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from cls_log (11941 ms total) 2024-09-14T11:21:50.221 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:21:50.221 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:50.222 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 4 tests from 1 test suite ran. (11941 ms total) 2024-09-14T11:21:50.222 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 4 tests. 2024-09-14T11:21:50.224 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:21:50.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:21:50.267 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:21:50.268 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:21:50.268 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:21:50.353 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:21:50.353 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:21:50.353 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:50.353 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:21:50.354 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:21:53.272 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_implicit (2917 ms) 2024-09-14T11:21:53.275 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:21:56.292 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3021 ms) 2024-09-14T11:21:56.292 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:22:04.386 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_put_snap (8095 ms) 2024-09-14T11:22:04.387 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:22:07.406 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_explicit (3016 ms) 2024-09-14T11:22:07.407 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:22:10.439 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.set (3037 ms) 2024-09-14T11:22:10.439 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:22:17.472 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_implicit_ec (7033 ms) 2024-09-14T11:22:17.473 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:22:24.493 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7021 ms) 2024-09-14T11:22:24.493 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:22:37.573 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_put_snap_ec (13079 ms) 2024-09-14T11:22:37.573 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:22:44.596 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.test_explicit_ec (7023 ms) 2024-09-14T11:22:44.596 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:22:51.626 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_refcount.set_ec (7031 ms) 2024-09-14T11:22:51.627 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 10 tests from cls_refcount (61273 ms total) 2024-09-14T11:22:51.627 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:22:51.627 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:51.627 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 10 tests from 1 test suite ran. (61273 ms total) 2024-09-14T11:22:51.627 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 10 tests. 2024-09-14T11:22:51.629 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:51.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:51.672 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:22:51.673 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:22:51.673 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:22:51.757 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:22:51.758 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:22:51.758 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:51.758 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:22:53.643 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:22:53.684 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_basic (42 ms) 2024-09-14T11:22:53.684 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:22:53.717 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-09-14T11:22:53.717 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:22:53.763 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2024-09-14T11:22:53.763 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:22:55.270 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_suggest (1508 ms) 2024-09-14T11:22:55.271 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:22:55.279 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-14T11:22:55.279 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:22:55.307 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_list (28 ms) 2024-09-14T11:22:55.307 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:23:14.519 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_list_delimited (19211 ms) 2024-09-14T11:23:14.520 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:23:14.588 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.bi_list (70 ms) 2024-09-14T11:23:14.588 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:23:14.598 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-14T11:23:14.599 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:23:14.812 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.gc_list (213 ms) 2024-09-14T11:23:14.812 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:23:22.751 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.gc_defer (7939 ms) 2024-09-14T11:23:22.751 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:23:22.829 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.usage_basic (78 ms) 2024-09-14T11:23:22.829 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:23:22.830 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-14T11:23:22.830 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:23:22.948 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.usage_clear (119 ms) 2024-09-14T11:23:22.949 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:23:22.991 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2024-09-14T11:23:22.992 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:23:23.007 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2024-09-14T11:23:23.008 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:23:23.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.reshardlog_list (19 ms) 2024-09-14T11:23:23.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:23:23.037 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw.reshardlog_num (11 ms) 2024-09-14T11:23:23.753 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 18 tests from cls_rgw (29395 ms total) 2024-09-14T11:23:23.753 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:23:23.753 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:23.753 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 18 tests from 1 test suite ran. (31993 ms total) 2024-09-14T11:23:23.753 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 18 tests. 2024-09-14T11:23:23.755 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:23.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:23.797 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:23:23.798 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:23:23.798 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:23:23.881 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:23:23.881 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:23:23.881 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:23.881 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:23:23.881 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:23:25.765 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.init (1884 ms) 2024-09-14T11:23:25.765 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:23:25.781 INFO:tasks.workunit.client.0.smithi116.stderr:[ ] list info tag = chain-0 2024-09-14T11:23:25.782 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (17 ms) 2024-09-14T11:23:25.782 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:23:25.789 INFO:tasks.workunit.client.0.smithi116.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:23:25.790 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-09-14T11:23:25.790 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:23:25.797 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T11:23:25.797 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:23:26.316 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (518 ms) 2024-09-14T11:23:26.316 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:23:26.325 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (9 ms) 2024-09-14T11:23:26.325 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:23:26.333 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-14T11:23:26.333 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:23:26.341 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-14T11:23:26.341 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:23:26.779 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_gc.finalize (437 ms) 2024-09-14T11:23:26.779 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from cls_rgw_gc (2897 ms total) 2024-09-14T11:23:26.780 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:23:26.780 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:26.780 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 9 tests from 1 test suite ran. (2897 ms total) 2024-09-14T11:23:26.780 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 9 tests. 2024-09-14T11:23:26.782 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:26.782 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:26.868 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:23:26.869 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:23:26.869 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:23:26.922 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:26.923 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:26.923 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:23:26.923 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:28.782 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:23:28.782 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:23:28.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.801+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=TPAU8N5WAVPE type=write size=415229 2024-09-14T11:23:28.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.803+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=SDVEJP75P357 type=del size=2510231 2024-09-14T11:23:28.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.805+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=7AA299ZIM8UQ type=del size=263374 2024-09-14T11:23:28.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.806+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=5GJYX6F2P771 type=del size=1868633 2024-09-14T11:23:28.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.807+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=P2UHNH1D93AW type=del size=1073456 2024-09-14T11:23:28.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.808+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=UFSSEMS1LQWZ type=del size=3787425 2024-09-14T11:23:28.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.810+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=3V65E7VSNP1J type=del size=2277465 2024-09-14T11:23:28.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.812+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~MJ65NKFEF0FW.0 size=1048576 2024-09-14T11:23:28.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.813+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~MJ65NKFEF0FW.1 size=477978 2024-09-14T11:23:28.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.813+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=MJ65NKFEF0FW tag=LMQ0LV5HDUCF type=write size=2575130 2024-09-14T11:23:28.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.814+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=BFBYAYBKSWNI type=write size=346057 2024-09-14T11:23:28.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.815+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=5TC9UM7R7YQF type=del size=3449356 2024-09-14T11:23:28.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.817+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=39T6SMOWNSGN type=del size=2019180 2024-09-14T11:23:28.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.819+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.0 size=1048576 2024-09-14T11:23:28.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.820+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.1 size=1048576 2024-09-14T11:23:28.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.821+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.2 size=666584 2024-09-14T11:23:28.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.821+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=50CRQW16FD8D tag=KAX66CG4KZRE type=write size=3812312 2024-09-14T11:23:28.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.822+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=LY4II7E8CP4A type=del size=1896017 2024-09-14T11:23:28.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.824+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~DIDAVBFZULUK.0 size=627521 2024-09-14T11:23:28.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.824+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=DIDAVBFZULUK tag=Z12X7CX6OL1J type=write size=1676097 2024-09-14T11:23:28.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.827+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.0 size=1048576 2024-09-14T11:23:28.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.828+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.1 size=1048576 2024-09-14T11:23:28.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.829+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.2 size=647549 2024-09-14T11:23:28.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.829+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=A6X655LGHX8M tag=XJVS2841LU1W type=write size=3793277 2024-09-14T11:23:28.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.831+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YOKCPK51YNEV.0 size=657433 2024-09-14T11:23:28.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.831+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=YOKCPK51YNEV tag=NFP49KBMCIPR type=write size=1706009 2024-09-14T11:23:28.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.833+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=TPAU8N5WAVPE type=write size=415229 2024-09-14T11:23:28.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.834+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=5KJX5125T2KV type=write size=652092 2024-09-14T11:23:28.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.836+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=SDVEJP75P357 type=del 2024-09-14T11:23:28.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.838+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.0 size=1048576 2024-09-14T11:23:28.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.839+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.1 size=1048576 2024-09-14T11:23:28.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.840+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.2 size=775140 2024-09-14T11:23:28.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.840+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=QZE4ME87WDSB tag=0L0MC7KSLBQC type=write size=3920868 2024-09-14T11:23:28.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.842+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=7AA299ZIM8UQ type=del 2024-09-14T11:23:28.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.843+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=UY8KZ7YSWAPA type=del size=3213001 2024-09-14T11:23:28.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.844+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=5GJYX6F2P771 type=del 2024-09-14T11:23:28.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.845+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=TKUSNDX436AY type=del size=1863752 2024-09-14T11:23:28.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.847+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=P2UHNH1D93AW type=del 2024-09-14T11:23:28.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.849+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~LXT01PAJLVWN.0 size=1048576 2024-09-14T11:23:28.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.850+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~LXT01PAJLVWN.1 size=776204 2024-09-14T11:23:28.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.850+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=LXT01PAJLVWN tag=BITFNADRCZFW type=write size=2873356 2024-09-14T11:23:28.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.851+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=UFSSEMS1LQWZ type=del 2024-09-14T11:23:28.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.853+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=3MAGVT06ZYT9 type=del size=1904382 2024-09-14T11:23:28.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.855+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=3V65E7VSNP1J type=del size=2277465 2024-09-14T11:23:28.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.856+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=QNYB8UGZ9AKD type=del size=3350861 2024-09-14T11:23:28.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.856+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~MJ65NKFEF0FW.0 size=1048576 2024-09-14T11:23:28.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.857+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~MJ65NKFEF0FW.1 size=477978 2024-09-14T11:23:28.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.859+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=MJ65NKFEF0FW tag=LMQ0LV5HDUCF type=write size=2575130 2024-09-14T11:23:28.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.861+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=PAD33012SRFR type=del size=481670 2024-09-14T11:23:28.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.862+0000 7f296241c780 1 < completed write operation key=5XAAGDKVBZ0P tag=BFBYAYBKSWNI type=write size=346057 2024-09-14T11:23:28.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.863+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=BJL2GHE0IBPM type=del size=1690141 2024-09-14T11:23:28.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.864+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=5TC9UM7R7YQF type=del 2024-09-14T11:23:28.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.866+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=GMBM0LT55YLP type=del size=3841409 2024-09-14T11:23:28.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.867+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=39T6SMOWNSGN type=del 2024-09-14T11:23:28.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.868+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=HA1JOB618LBS type=del size=3461177 2024-09-14T11:23:28.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.869+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.0 size=1048576 2024-09-14T11:23:28.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.870+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.1 size=1048576 2024-09-14T11:23:28.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.871+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~50CRQW16FD8D.2 size=666584 2024-09-14T11:23:28.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.874+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=50CRQW16FD8D tag=KAX66CG4KZRE type=write size=3812312 2024-09-14T11:23:28.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.875+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=CTMKK6X70IXU type=write size=961014 2024-09-14T11:23:28.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.876+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=LY4II7E8CP4A type=del 2024-09-14T11:23:28.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.878+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=V19YONJ2EQKU type=del size=612870 2024-09-14T11:23:28.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.878+0000 7f296241c780 1 < canceled part key=_multipart_HZD8WW0H4AAD.2~DIDAVBFZULUK.0 size=627521 2024-09-14T11:23:28.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.880+0000 7f296241c780 1 < canceled multipart upload key=HZD8WW0H4AAD upload=DIDAVBFZULUK tag=Z12X7CX6OL1J type=write size=1676097 2024-09-14T11:23:28.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.882+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~XG6VSF47TOI4.0 size=125680 2024-09-14T11:23:28.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.882+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=XG6VSF47TOI4 tag=IK3XXQMNJU8P type=write size=1174256 2024-09-14T11:23:28.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.883+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.0 size=1048576 2024-09-14T11:23:28.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.884+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.1 size=1048576 2024-09-14T11:23:28.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.884+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~A6X655LGHX8M.2 size=647549 2024-09-14T11:23:28.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.887+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=A6X655LGHX8M tag=XJVS2841LU1W type=write size=3793277 2024-09-14T11:23:28.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.889+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Q3PD36CL2U2B.0 size=1048576 2024-09-14T11:23:28.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.890+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Q3PD36CL2U2B.1 size=1022626 2024-09-14T11:23:28.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.890+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=Q3PD36CL2U2B tag=N3LTV7II3FOI type=write size=3119778 2024-09-14T11:23:28.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.891+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YOKCPK51YNEV.0 size=657433 2024-09-14T11:23:28.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.893+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=YOKCPK51YNEV tag=NFP49KBMCIPR type=write size=1706009 2024-09-14T11:23:28.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.896+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~86GR96W15JZP.0 size=1048576 2024-09-14T11:23:28.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.897+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~86GR96W15JZP.1 size=1017616 2024-09-14T11:23:28.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.897+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=86GR96W15JZP tag=M0TT8ATGB9LX type=write size=3114768 2024-09-14T11:23:28.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.898+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=5KJX5125T2KV type=write size=652092 2024-09-14T11:23:28.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.900+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YNCDZBQQZDJW.0 size=1048576 2024-09-14T11:23:28.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.901+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YNCDZBQQZDJW.1 size=892656 2024-09-14T11:23:28.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.901+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=YNCDZBQQZDJW tag=TOR4XHBQ6650 type=write size=2989808 2024-09-14T11:23:28.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.901+0000 7f296241c780 1 < canceled part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.0 size=1048576 2024-09-14T11:23:28.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.902+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.1 size=1048576 2024-09-14T11:23:28.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.903+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QZE4ME87WDSB.2 size=775140 2024-09-14T11:23:28.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.907+0000 7f296241c780 1 < canceled multipart upload key=6DNKZWENMDM9 upload=QZE4ME87WDSB tag=0L0MC7KSLBQC type=write size=3920868 2024-09-14T11:23:28.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.908+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=7H13SRUYWGFU type=del size=3084105 2024-09-14T11:23:28.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.911+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=UY8KZ7YSWAPA type=del size=3213001 2024-09-14T11:23:28.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.913+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~EIQKOXHKWNMY.0 size=485982 2024-09-14T11:23:28.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.913+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=EIQKOXHKWNMY tag=YILWA6RSK2V2 type=write size=1534558 2024-09-14T11:23:28.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.915+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=TKUSNDX436AY type=del size=1863752 2024-09-14T11:23:28.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.917+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~SW5MP9SSEN9R.0 size=601318 2024-09-14T11:23:28.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.917+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=SW5MP9SSEN9R tag=S1MVVQ3MTYMQ type=write size=1649894 2024-09-14T11:23:28.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.919+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~LXT01PAJLVWN.0 size=1048576 2024-09-14T11:23:28.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.920+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~LXT01PAJLVWN.1 size=776204 2024-09-14T11:23:28.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.921+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=LXT01PAJLVWN tag=BITFNADRCZFW type=write size=2873356 2024-09-14T11:23:28.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.923+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=T5BYF01SG0MT type=write size=227305 2024-09-14T11:23:28.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.924+0000 7f296241c780 1 < canceled operation key=I1XBOS1L5D98 tag=3MAGVT06ZYT9 type=del size=1904382 2024-09-14T11:23:28.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.926+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~Y1UT4ANSMNCP.0 size=1048576 2024-09-14T11:23:28.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.927+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~Y1UT4ANSMNCP.1 size=325837 2024-09-14T11:23:28.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.927+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=Y1UT4ANSMNCP tag=2O517DM6H8ZL type=write size=2422989 2024-09-14T11:23:28.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.929+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=QNYB8UGZ9AKD type=del size=3350861 2024-09-14T11:23:28.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.932+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~XI41N6M923TW.0 size=736808 2024-09-14T11:23:28.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.932+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=XI41N6M923TW tag=SI4HHM0DI5GK type=write size=1785384 2024-09-14T11:23:28.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.935+0000 7f296241c780 1 < suggested remove operation key=R1M982MUIF44 tag=PAD33012SRFR type=del 2024-09-14T11:23:28.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.936+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=L2XMT1EGGTT3 type=del size=3840037 2024-09-14T11:23:28.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.937+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=BJL2GHE0IBPM type=del 2024-09-14T11:23:28.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.939+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.0 size=1048576 2024-09-14T11:23:28.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.940+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.1 size=1048576 2024-09-14T11:23:28.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.941+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.2 size=736511 2024-09-14T11:23:28.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.941+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=S7OZO3YZ4JQC tag=W6DW7DE4SEZH type=write size=3882239 2024-09-14T11:23:28.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.943+0000 7f296241c780 1 < suggested update operation key=OIT1KUT6UEP2 tag=GMBM0LT55YLP type=del size=3841409 2024-09-14T11:23:28.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.944+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=GX4TT1404I9F type=del size=2038103 2024-09-14T11:23:28.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.946+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=HA1JOB618LBS type=del 2024-09-14T11:23:28.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.947+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=JA5IN32NNIRM type=write size=318785 2024-09-14T11:23:28.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.948+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=CTMKK6X70IXU type=write size=961014 2024-09-14T11:23:28.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.949+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=IYOJBV8PXL9J type=write size=524938 2024-09-14T11:23:28.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.950+0000 7f296241c780 -1 < failed to complete operation key=6DNKZWENMDM9 tag=V19YONJ2EQKU type=del size=612870: (22) Invalid argument 2024-09-14T11:23:28.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.951+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=R594VHMNOIZ6 type=del size=154182 2024-09-14T11:23:28.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.952+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~XG6VSF47TOI4.0 size=125680 2024-09-14T11:23:28.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.954+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=XG6VSF47TOI4 tag=IK3XXQMNJU8P type=write size=1174256 2024-09-14T11:23:28.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.956+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=PTYJM4731KAK type=del size=2352700 2024-09-14T11:23:28.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.956+0000 7f296241c780 1 < canceled part key=_multipart_CQU8M12JCE9T.2~Q3PD36CL2U2B.0 size=1048576 2024-09-14T11:23:28.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.957+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~Q3PD36CL2U2B.1 size=1022626 2024-09-14T11:23:28.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.959+0000 7f296241c780 1 < canceled multipart upload key=CQU8M12JCE9T upload=Q3PD36CL2U2B tag=N3LTV7II3FOI type=write size=3119778 2024-09-14T11:23:28.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.960+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=QZ0KTQWXB2L2 type=del size=1005343 2024-09-14T11:23:28.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.961+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~86GR96W15JZP.0 size=1048576 2024-09-14T11:23:28.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.962+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~86GR96W15JZP.1 size=1017616 2024-09-14T11:23:28.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.964+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=86GR96W15JZP tag=M0TT8ATGB9LX type=write size=3114768 2024-09-14T11:23:28.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.965+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=XKBOMZ2BLX7X type=del size=1431332 2024-09-14T11:23:28.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.966+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YNCDZBQQZDJW.0 size=1048576 2024-09-14T11:23:28.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.967+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YNCDZBQQZDJW.1 size=892656 2024-09-14T11:23:28.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.969+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=YNCDZBQQZDJW tag=TOR4XHBQ6650 type=write size=2989808 2024-09-14T11:23:28.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.971+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=123E6J7Y3JP2 type=del size=2225322 2024-09-14T11:23:28.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.972+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=7H13SRUYWGFU type=del 2024-09-14T11:23:28.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.973+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=12T4QJWA2T8H type=del size=2204210 2024-09-14T11:23:28.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.974+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~EIQKOXHKWNMY.0 size=485982 2024-09-14T11:23:28.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.976+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=EIQKOXHKWNMY tag=YILWA6RSK2V2 type=write size=1534558 2024-09-14T11:23:28.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.977+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=LT9N2M93YOQV type=write size=562016 2024-09-14T11:23:28.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.978+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~SW5MP9SSEN9R.0 size=601318 2024-09-14T11:23:28.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.980+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=SW5MP9SSEN9R tag=S1MVVQ3MTYMQ type=write size=1649894 2024-09-14T11:23:28.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.983+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~4YS5CVHIEGCX.0 size=1048576 2024-09-14T11:23:28.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.984+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~4YS5CVHIEGCX.1 size=510322 2024-09-14T11:23:28.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.984+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=4YS5CVHIEGCX tag=IOPF2KQT31IB type=write size=2607474 2024-09-14T11:23:28.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.985+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=T5BYF01SG0MT type=write size=227305 2024-09-14T11:23:28.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.987+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~NPJ6FCRZCBZA.0 size=1048576 2024-09-14T11:23:28.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.988+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~NPJ6FCRZCBZA.1 size=708971 2024-09-14T11:23:28.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.988+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=NPJ6FCRZCBZA tag=PA5BSBS74HQD type=write size=2806123 2024-09-14T11:23:28.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.989+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~Y1UT4ANSMNCP.0 size=1048576 2024-09-14T11:23:28.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.990+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~Y1UT4ANSMNCP.1 size=325837 2024-09-14T11:23:28.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.992+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=Y1UT4ANSMNCP tag=2O517DM6H8ZL type=write size=2422989 2024-09-14T11:23:28.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.993+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=MPDASA8EJSY2 type=del size=1665341 2024-09-14T11:23:28.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.994+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~XI41N6M923TW.0 size=736808 2024-09-14T11:23:28.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.996+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=XI41N6M923TW tag=SI4HHM0DI5GK type=write size=1785384 2024-09-14T11:23:28.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.998+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~JW4XESV3HIW0.0 size=1048576 2024-09-14T11:23:28.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.999+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~JW4XESV3HIW0.1 size=567008 2024-09-14T11:23:28.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:28.999+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=JW4XESV3HIW0 tag=3FSOSBUW6FY8 type=write size=2664160 2024-09-14T11:23:28.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.000+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=L2XMT1EGGTT3 type=del 2024-09-14T11:23:29.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.003+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.0 size=1048576 2024-09-14T11:23:29.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.004+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.1 size=1048576 2024-09-14T11:23:29.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.004+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.2 size=997653 2024-09-14T11:23:29.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.004+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=6G925C7VGC1L tag=812H0V8R513R type=write size=4143381 2024-09-14T11:23:29.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.006+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.0 size=1048576 2024-09-14T11:23:29.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.007+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.1 size=1048576 2024-09-14T11:23:29.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.008+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~S7OZO3YZ4JQC.2 size=736511 2024-09-14T11:23:29.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.010+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=S7OZO3YZ4JQC tag=W6DW7DE4SEZH type=write size=3882239 2024-09-14T11:23:29.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.011+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=KKD91MROP6HY type=write size=1016545 2024-09-14T11:23:29.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.012+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=GX4TT1404I9F type=del 2024-09-14T11:23:29.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.013+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=FQD7JKLXNIAJ type=write size=939979 2024-09-14T11:23:29.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.015+0000 7f296241c780 1 < suggested remove operation key=JH1QJE5V4M9H tag=JA5IN32NNIRM type=write 2024-09-14T11:23:29.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.018+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~3H85YFKG5161.0 size=1048576 2024-09-14T11:23:29.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.018+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~3H85YFKG5161.1 size=359377 2024-09-14T11:23:29.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.018+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=3H85YFKG5161 tag=HDKAZHXE4ZCD type=write size=2456529 2024-09-14T11:23:29.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.020+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=IYOJBV8PXL9J type=write size=524938 2024-09-14T11:23:29.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.021+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=FQT2X636J7VW type=write size=182710 2024-09-14T11:23:29.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.023+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=R594VHMNOIZ6 type=del 2024-09-14T11:23:29.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.025+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~AG1FVI5IJVSV.0 size=1048576 2024-09-14T11:23:29.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.025+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~AG1FVI5IJVSV.1 size=377738 2024-09-14T11:23:29.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.026+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=AG1FVI5IJVSV tag=LSCSH4ENLNHA type=write size=2474890 2024-09-14T11:23:29.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.027+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=PTYJM4731KAK type=del 2024-09-14T11:23:29.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.029+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~40WTJC6KHTEN.0 size=1048576 2024-09-14T11:23:29.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.030+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~40WTJC6KHTEN.1 size=385085 2024-09-14T11:23:29.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.030+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=40WTJC6KHTEN tag=NLZB53EDMQLS type=write size=2482237 2024-09-14T11:23:29.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.032+0000 7f296241c780 1 < suggested update operation key=5XAAGDKVBZ0P tag=QZ0KTQWXB2L2 type=del size=1005343 2024-09-14T11:23:29.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.034+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.0 size=1048576 2024-09-14T11:23:29.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.035+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.1 size=1048576 2024-09-14T11:23:29.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.036+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.2 size=263974 2024-09-14T11:23:29.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.036+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=2IIHK1CB6RQ4 tag=MZPJ659KJ66Y type=write size=3409702 2024-09-14T11:23:29.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.037+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=XKBOMZ2BLX7X type=del 2024-09-14T11:23:29.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.040+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.0 size=1048576 2024-09-14T11:23:29.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.041+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.1 size=1048576 2024-09-14T11:23:29.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.041+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.2 size=169634 2024-09-14T11:23:29.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.041+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=VJ5VSAG5CNSG tag=1QEINA4XX8XE type=write size=3315362 2024-09-14T11:23:29.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.043+0000 7f296241c780 1 < canceled operation key=5N30QR6SN49T tag=123E6J7Y3JP2 type=del size=2225322 2024-09-14T11:23:29.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.044+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=VZER60QHF7BP type=del size=2263164 2024-09-14T11:23:29.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.045+0000 7f296241c780 1 < canceled operation key=7WGFBTAM25J9 tag=12T4QJWA2T8H type=del size=2204210 2024-09-14T11:23:29.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.046+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=JIWFZ8JXYT39 type=del size=3469524 2024-09-14T11:23:29.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.047+0000 7f296241c780 1 < completed write operation key=R1M982MUIF44 tag=LT9N2M93YOQV type=write size=562016 2024-09-14T11:23:29.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.048+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=2KG1B8Z6MTE3 type=write size=230104 2024-09-14T11:23:29.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.049+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~4YS5CVHIEGCX.0 size=1048576 2024-09-14T11:23:29.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.050+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~4YS5CVHIEGCX.1 size=510322 2024-09-14T11:23:29.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.052+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=4YS5CVHIEGCX tag=IOPF2KQT31IB type=write size=2607474 2024-09-14T11:23:29.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.054+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.0 size=1048576 2024-09-14T11:23:29.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.055+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.1 size=1048576 2024-09-14T11:23:29.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.056+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.2 size=374189 2024-09-14T11:23:29.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.056+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=C2239JAQENH0 tag=O1AB7MPSL1S9 type=write size=3519917 2024-09-14T11:23:29.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.057+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~NPJ6FCRZCBZA.0 size=1048576 2024-09-14T11:23:29.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.058+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~NPJ6FCRZCBZA.1 size=708971 2024-09-14T11:23:29.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.060+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=NPJ6FCRZCBZA tag=PA5BSBS74HQD type=write size=2806123 2024-09-14T11:23:29.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.062+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~25WD94E1QB83.0 size=116446 2024-09-14T11:23:29.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.062+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=25WD94E1QB83 tag=4T0IQ4CTHCW0 type=write size=1165022 2024-09-14T11:23:29.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.064+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=MPDASA8EJSY2 type=del 2024-09-14T11:23:29.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.065+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=ZH6PK6L7BPXD type=del size=3604185 2024-09-14T11:23:29.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.066+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~JW4XESV3HIW0.0 size=1048576 2024-09-14T11:23:29.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.067+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~JW4XESV3HIW0.1 size=567008 2024-09-14T11:23:29.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.068+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=JW4XESV3HIW0 tag=3FSOSBUW6FY8 type=write size=2664160 2024-09-14T11:23:29.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.070+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.0 size=1048576 2024-09-14T11:23:29.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.071+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.1 size=1048576 2024-09-14T11:23:29.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.072+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.2 size=713829 2024-09-14T11:23:29.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.072+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=X04UG9KC630X tag=DPBKO7AOW6X9 type=write size=3859557 2024-09-14T11:23:29.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.073+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.0 size=1048576 2024-09-14T11:23:29.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.074+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.1 size=1048576 2024-09-14T11:23:29.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.075+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~6G925C7VGC1L.2 size=997653 2024-09-14T11:23:29.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.077+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=6G925C7VGC1L tag=812H0V8R513R type=write size=4143381 2024-09-14T11:23:29.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.078+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=ZZZ0LF9D02ZU type=del size=3665368 2024-09-14T11:23:29.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.079+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=KKD91MROP6HY type=write size=1016545 2024-09-14T11:23:29.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.080+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=MNDS345YHOMX type=write size=338574 2024-09-14T11:23:29.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.081+0000 7f296241c780 1 < canceled operation key=JW3RIVHUFGPI tag=FQD7JKLXNIAJ type=write size=939979 2024-09-14T11:23:29.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.082+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=47P1DASMCMLD type=del size=1946901 2024-09-14T11:23:29.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.084+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~3H85YFKG5161.0 size=1048576 2024-09-14T11:23:29.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.084+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~3H85YFKG5161.1 size=359377 2024-09-14T11:23:29.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.085+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=3H85YFKG5161 tag=HDKAZHXE4ZCD type=write size=2456529 2024-09-14T11:23:29.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.088+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~WNTTQ2FUGSRP.0 size=472522 2024-09-14T11:23:29.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.088+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=WNTTQ2FUGSRP tag=2UUALIBFFC7M type=write size=1521098 2024-09-14T11:23:29.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.090+0000 7f296241c780 1 < suggested remove operation key=QIVVKYC646IH tag=FQT2X636J7VW type=write 2024-09-14T11:23:29.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.091+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=9LT17WGSU103 type=write size=419769 2024-09-14T11:23:29.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.092+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~AG1FVI5IJVSV.0 size=1048576 2024-09-14T11:23:29.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.093+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~AG1FVI5IJVSV.1 size=377738 2024-09-14T11:23:29.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.095+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=AG1FVI5IJVSV tag=LSCSH4ENLNHA type=write size=2474890 2024-09-14T11:23:29.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.098+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~UL8ESF2DF2LM.0 size=1048576 2024-09-14T11:23:29.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.099+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~UL8ESF2DF2LM.1 size=597923 2024-09-14T11:23:29.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.099+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=UL8ESF2DF2LM tag=C2RFT98V4PU7 type=write size=2695075 2024-09-14T11:23:29.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.100+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~40WTJC6KHTEN.0 size=1048576 2024-09-14T11:23:29.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.101+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~40WTJC6KHTEN.1 size=385085 2024-09-14T11:23:29.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.103+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=40WTJC6KHTEN tag=NLZB53EDMQLS type=write size=2482237 2024-09-14T11:23:29.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.104+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=2K8QH4WCZ8HV type=write size=369978 2024-09-14T11:23:29.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.105+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.0 size=1048576 2024-09-14T11:23:29.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.107+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.1 size=1048576 2024-09-14T11:23:29.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.108+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~2IIHK1CB6RQ4.2 size=263974 2024-09-14T11:23:29.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.110+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=2IIHK1CB6RQ4 tag=MZPJ659KJ66Y type=write size=3409702 2024-09-14T11:23:29.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.111+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=553BPAI8KT93 type=write size=336549 2024-09-14T11:23:29.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.113+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.0 size=1048576 2024-09-14T11:23:29.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.114+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.1 size=1048576 2024-09-14T11:23:29.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.115+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~VJ5VSAG5CNSG.2 size=169634 2024-09-14T11:23:29.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.117+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=VJ5VSAG5CNSG tag=1QEINA4XX8XE type=write size=3315362 2024-09-14T11:23:29.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.118+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=1AZV1GABXZ4F type=del size=1403389 2024-09-14T11:23:29.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.119+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=VZER60QHF7BP type=del 2024-09-14T11:23:29.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.120+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=21VAFDORJN07 type=del size=1005483 2024-09-14T11:23:29.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.123+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=JIWFZ8JXYT39 type=del size=3469524 2024-09-14T11:23:29.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.124+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=MXD443X8DGIO type=del size=2927642 2024-09-14T11:23:29.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.125+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=2KG1B8Z6MTE3 type=write size=230104 2024-09-14T11:23:29.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.127+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~RL5P0PETIC6E.0 size=977001 2024-09-14T11:23:29.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.127+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=RL5P0PETIC6E tag=ZLUHSII6A17D type=write size=2025577 2024-09-14T11:23:29.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.128+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.0 size=1048576 2024-09-14T11:23:29.127 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.129+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.1 size=1048576 2024-09-14T11:23:29.127 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.129+0000 7f296241c780 1 < canceled part key=_multipart_GJ2Y7ICBEZJX.2~C2239JAQENH0.2 size=374189 2024-09-14T11:23:29.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.131+0000 7f296241c780 1 < canceled multipart upload key=GJ2Y7ICBEZJX upload=C2239JAQENH0 tag=O1AB7MPSL1S9 type=write size=3519917 2024-09-14T11:23:29.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.132+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=WZF3XB7YQGKM type=del size=2560718 2024-09-14T11:23:29.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.132+0000 7f296241c780 1 < canceled part key=_multipart_I1XBOS1L5D98.2~25WD94E1QB83.0 size=116446 2024-09-14T11:23:29.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.134+0000 7f296241c780 1 < canceled multipart upload key=I1XBOS1L5D98 upload=25WD94E1QB83 tag=4T0IQ4CTHCW0 type=write size=1165022 2024-09-14T11:23:29.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.136+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=NKZJ1D2L5IA1 type=write size=607327 2024-09-14T11:23:29.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.137+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=ZH6PK6L7BPXD type=del 2024-09-14T11:23:29.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.138+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=40TDWWZ78O13 type=del size=3822314 2024-09-14T11:23:29.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.139+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.0 size=1048576 2024-09-14T11:23:29.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.139+0000 7f296241c780 1 < canceled part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.1 size=1048576 2024-09-14T11:23:29.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.141+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~X04UG9KC630X.2 size=713829 2024-09-14T11:23:29.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.143+0000 7f296241c780 1 < canceled multipart upload key=6DNKZWENMDM9 upload=X04UG9KC630X tag=DPBKO7AOW6X9 type=write size=3859557 2024-09-14T11:23:29.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.144+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=A9Y2COVU1JSD type=write size=652038 2024-09-14T11:23:29.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.145+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=ZZZ0LF9D02ZU type=del 2024-09-14T11:23:29.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.148+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CT09M05KZD9W.0 size=1048576 2024-09-14T11:23:29.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.149+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CT09M05KZD9W.1 size=1035525 2024-09-14T11:23:29.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.149+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=CT09M05KZD9W tag=50YS0ORZ35Y1 type=write size=3132677 2024-09-14T11:23:29.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.151+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=MNDS345YHOMX type=write size=338574 2024-09-14T11:23:29.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.153+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~9LVDMYSANI0H.0 size=1048576 2024-09-14T11:23:29.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.154+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~9LVDMYSANI0H.1 size=911812 2024-09-14T11:23:29.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.154+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=9LVDMYSANI0H tag=V6DD59Z0Z01B type=write size=3008964 2024-09-14T11:23:29.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.155+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=47P1DASMCMLD type=del 2024-09-14T11:23:29.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.156+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=UXZR7VG97OU2 type=del size=3705810 2024-09-14T11:23:29.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.157+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~WNTTQ2FUGSRP.0 size=472522 2024-09-14T11:23:29.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.159+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=WNTTQ2FUGSRP tag=2UUALIBFFC7M type=write size=1521098 2024-09-14T11:23:29.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.161+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~HXO294D4MST4.0 size=649956 2024-09-14T11:23:29.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.161+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=HXO294D4MST4 tag=4AP537JHZVGV type=write size=1698532 2024-09-14T11:23:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.162+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=9LT17WGSU103 type=write size=419769 2024-09-14T11:23:29.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.164+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.0 size=1048576 2024-09-14T11:23:29.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.165+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.1 size=1048576 2024-09-14T11:23:29.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.166+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.2 size=464084 2024-09-14T11:23:29.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.166+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=N507KH3DZ8H6 tag=G4GH3REXXJUB type=write size=3609812 2024-09-14T11:23:29.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.167+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~UL8ESF2DF2LM.0 size=1048576 2024-09-14T11:23:29.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.167+0000 7f296241c780 1 < canceled part key=_multipart_ILOY74OSG5CQ.2~UL8ESF2DF2LM.1 size=597923 2024-09-14T11:23:29.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.169+0000 7f296241c780 1 < canceled multipart upload key=ILOY74OSG5CQ upload=UL8ESF2DF2LM tag=C2RFT98V4PU7 type=write size=2695075 2024-09-14T11:23:29.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.170+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=WJ4UZ72R0YAR type=del size=139307 2024-09-14T11:23:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.172+0000 7f296241c780 1 < suggested update operation key=R1M982MUIF44 tag=2K8QH4WCZ8HV type=write size=369978 2024-09-14T11:23:29.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.174+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.0 size=1048576 2024-09-14T11:23:29.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.175+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.1 size=1048576 2024-09-14T11:23:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.176+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.2 size=33140 2024-09-14T11:23:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.176+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=MXW31JUTZW8V tag=9SOQY0ZPEN37 type=write size=3178868 2024-09-14T11:23:29.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.179+0000 7f296241c780 1 < suggested update operation key=5XAAGDKVBZ0P tag=553BPAI8KT93 type=write size=336549 2024-09-14T11:23:29.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.180+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=VOWOFYYFK0SZ type=del size=540407 2024-09-14T11:23:29.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.182+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=1AZV1GABXZ4F type=del 2024-09-14T11:23:29.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.184+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~PYIBGFYLJF01.0 size=1048576 2024-09-14T11:23:29.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.185+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~PYIBGFYLJF01.1 size=771835 2024-09-14T11:23:29.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.185+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=PYIBGFYLJF01 tag=1JYQW22ZDUYS type=write size=2868987 2024-09-14T11:23:29.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.186+0000 7f296241c780 -1 < failed to complete operation key=5XAAGDKVBZ0P tag=21VAFDORJN07 type=del size=1005483: (22) Invalid argument 2024-09-14T11:23:29.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.188+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~W2V8XMCU0W8B.0 size=233234 2024-09-14T11:23:29.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.188+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=W2V8XMCU0W8B tag=IL9GV1IO9LT0 type=write size=1281810 2024-09-14T11:23:29.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.189+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=MXD443X8DGIO type=del 2024-09-14T11:23:29.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.191+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~0FU2IVLJPCXO.0 size=678729 2024-09-14T11:23:29.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.191+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=0FU2IVLJPCXO tag=DF6KF4YS4RQ7 type=write size=1727305 2024-09-14T11:23:29.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.192+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~RL5P0PETIC6E.0 size=977001 2024-09-14T11:23:29.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.194+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=RL5P0PETIC6E tag=ZLUHSII6A17D type=write size=2025577 2024-09-14T11:23:29.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.196+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=H3BVO0HO3CDX type=write size=329896 2024-09-14T11:23:29.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.197+0000 7f296241c780 -1 < failed to complete operation key=L0GW4TPQCSUY tag=WZF3XB7YQGKM type=del size=2560718: (22) Invalid argument 2024-09-14T11:23:29.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.198+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=XDWMEW307KQ3 type=del size=2755740 2024-09-14T11:23:29.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.199+0000 7f296241c780 1 < completed write operation key=JW3RIVHUFGPI tag=NKZJ1D2L5IA1 type=write size=607327 2024-09-14T11:23:29.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.202+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.0 size=1048576 2024-09-14T11:23:29.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.203+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.1 size=1048576 2024-09-14T11:23:29.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.204+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.2 size=902646 2024-09-14T11:23:29.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.204+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=W33YTIL6W2B8 tag=7Q7X5JWF7S2P type=write size=4048374 2024-09-14T11:23:29.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.205+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=40TDWWZ78O13 type=del 2024-09-14T11:23:29.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.206+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=F696AK9QXV13 type=del size=2172051 2024-09-14T11:23:29.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.207+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=A9Y2COVU1JSD type=write size=652038 2024-09-14T11:23:29.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.210+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~9PECTTYH7Q0M.0 size=1048576 2024-09-14T11:23:29.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.210+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~9PECTTYH7Q0M.1 size=288425 2024-09-14T11:23:29.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.211+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=9PECTTYH7Q0M tag=S9I818FW0QBP type=write size=2385577 2024-09-14T11:23:29.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.212+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CT09M05KZD9W.0 size=1048576 2024-09-14T11:23:29.211 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.213+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CT09M05KZD9W.1 size=1035525 2024-09-14T11:23:29.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.215+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=CT09M05KZD9W tag=50YS0ORZ35Y1 type=write size=3132677 2024-09-14T11:23:29.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.216+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=YFFVWTBGP78F type=del size=1035625 2024-09-14T11:23:29.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.217+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~9LVDMYSANI0H.0 size=1048576 2024-09-14T11:23:29.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.218+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~9LVDMYSANI0H.1 size=911812 2024-09-14T11:23:29.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.220+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=9LVDMYSANI0H tag=V6DD59Z0Z01B type=write size=3008964 2024-09-14T11:23:29.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.222+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=R62U5ABZ9KKO type=del size=619996 2024-09-14T11:23:29.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.223+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=UXZR7VG97OU2 type=del 2024-09-14T11:23:29.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.224+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=57583F925SY9 type=del size=341621 2024-09-14T11:23:29.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.225+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~HXO294D4MST4.0 size=649956 2024-09-14T11:23:29.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.227+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=HXO294D4MST4 tag=4AP537JHZVGV type=write size=1698532 2024-09-14T11:23:29.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.228+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=Z9Q0S972U5TU type=write size=333762 2024-09-14T11:23:29.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.229+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.0 size=1048576 2024-09-14T11:23:29.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.230+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.1 size=1048576 2024-09-14T11:23:29.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.230+0000 7f296241c780 1 < canceled part key=_multipart_GJ2Y7ICBEZJX.2~N507KH3DZ8H6.2 size=464084 2024-09-14T11:23:29.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.232+0000 7f296241c780 1 < canceled multipart upload key=GJ2Y7ICBEZJX upload=N507KH3DZ8H6 tag=G4GH3REXXJUB type=write size=3609812 2024-09-14T11:23:29.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.234+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=B8NNES5H7KZP type=write size=263200 2024-09-14T11:23:29.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.235+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=WJ4UZ72R0YAR type=del 2024-09-14T11:23:29.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.236+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=2BFUOH811XMA type=del size=4153375 2024-09-14T11:23:29.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.237+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.0 size=1048576 2024-09-14T11:23:29.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.238+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.1 size=1048576 2024-09-14T11:23:29.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.239+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~MXW31JUTZW8V.2 size=33140 2024-09-14T11:23:29.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.241+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=MXW31JUTZW8V tag=9SOQY0ZPEN37 type=write size=3178868 2024-09-14T11:23:29.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.242+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=PB58Y5DVTOS8 type=write size=819224 2024-09-14T11:23:29.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.244+0000 7f296241c780 1 < suggested remove operation key=I1XBOS1L5D98 tag=VOWOFYYFK0SZ type=del 2024-09-14T11:23:29.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.246+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CIRAKBDJZZK8.0 size=608661 2024-09-14T11:23:29.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.246+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=CIRAKBDJZZK8 tag=KNBT08OD8DR1 type=write size=1657237 2024-09-14T11:23:29.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.247+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~PYIBGFYLJF01.0 size=1048576 2024-09-14T11:23:29.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.248+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~PYIBGFYLJF01.1 size=771835 2024-09-14T11:23:29.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.249+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=PYIBGFYLJF01 tag=1JYQW22ZDUYS type=write size=2868987 2024-09-14T11:23:29.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.251+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~NMM6YIX8CCX4.0 size=458986 2024-09-14T11:23:29.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.251+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=NMM6YIX8CCX4 tag=342CF3FVLWSH type=write size=1507562 2024-09-14T11:23:29.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.253+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~W2V8XMCU0W8B.0 size=233234 2024-09-14T11:23:29.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.256+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=W2V8XMCU0W8B tag=IL9GV1IO9LT0 type=write size=1281810 2024-09-14T11:23:29.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.258+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.0 size=1048576 2024-09-14T11:23:29.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.259+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.1 size=1048576 2024-09-14T11:23:29.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.260+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.2 size=407591 2024-09-14T11:23:29.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.260+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=YF7G4W90MY0G tag=JX6C83AVBB48 type=write size=3553319 2024-09-14T11:23:29.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.261+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~0FU2IVLJPCXO.0 size=678729 2024-09-14T11:23:29.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.262+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=0FU2IVLJPCXO tag=DF6KF4YS4RQ7 type=write size=1727305 2024-09-14T11:23:29.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.264+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~C6NE6P0JE138.0 size=700503 2024-09-14T11:23:29.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.264+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=C6NE6P0JE138 tag=FII5Z4IS28DJ type=write size=1749079 2024-09-14T11:23:29.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.265+0000 7f296241c780 1 < canceled operation key=FGK7YH1GB4W5 tag=H3BVO0HO3CDX type=write size=329896 2024-09-14T11:23:29.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.266+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=RXOW9JHZVO7J type=write size=115636 2024-09-14T11:23:29.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.268+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=XDWMEW307KQ3 type=del 2024-09-14T11:23:29.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.269+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=GDIBPOIRXVPL type=del size=1834582 2024-09-14T11:23:29.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.270+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.0 size=1048576 2024-09-14T11:23:29.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.271+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.1 size=1048576 2024-09-14T11:23:29.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.271+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~W33YTIL6W2B8.2 size=902646 2024-09-14T11:23:29.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.273+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=W33YTIL6W2B8 tag=7Q7X5JWF7S2P type=write size=4048374 2024-09-14T11:23:29.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.274+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=LISJBK79KZF6 type=del size=1017084 2024-09-14T11:23:29.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.275+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=F696AK9QXV13 type=del 2024-09-14T11:23:29.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.276+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=DQMFP14QGXQU type=del size=2476605 2024-09-14T11:23:29.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.277+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~9PECTTYH7Q0M.0 size=1048576 2024-09-14T11:23:29.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.278+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~9PECTTYH7Q0M.1 size=288425 2024-09-14T11:23:29.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.280+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=9PECTTYH7Q0M tag=S9I818FW0QBP type=write size=2385577 2024-09-14T11:23:29.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.282+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~597MRKIEITU2.0 size=1048576 2024-09-14T11:23:29.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.283+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~597MRKIEITU2.1 size=763383 2024-09-14T11:23:29.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.283+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=597MRKIEITU2 tag=UIZBB43TDZ24 type=write size=2860535 2024-09-14T11:23:29.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.284+0000 7f296241c780 1 < canceled operation key=5N30QR6SN49T tag=YFFVWTBGP78F type=del size=1035625 2024-09-14T11:23:29.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.285+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=67HRS3ODR2CO type=write size=262677 2024-09-14T11:23:29.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.286+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=R62U5ABZ9KKO type=del 2024-09-14T11:23:29.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.288+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~AMRQUN1LD0GV.0 size=1048576 2024-09-14T11:23:29.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.289+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~AMRQUN1LD0GV.1 size=893108 2024-09-14T11:23:29.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.289+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=AMRQUN1LD0GV tag=O8WUR4O30739 type=write size=2990260 2024-09-14T11:23:29.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.290+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=57583F925SY9 type=del 2024-09-14T11:23:29.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.292+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~CSTC19XXZD2F.0 size=931814 2024-09-14T11:23:29.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.292+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=CSTC19XXZD2F tag=1MXOSHUQ5Z5L type=write size=1980390 2024-09-14T11:23:29.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.294+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=Z9Q0S972U5TU type=write size=333762 2024-09-14T11:23:29.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.295+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=QOB2UQNTMGTL type=del size=3871580 2024-09-14T11:23:29.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.296+0000 7f296241c780 1 < completed write operation key=L8NA53KOAT58 tag=B8NNES5H7KZP type=write size=263200 2024-09-14T11:23:29.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.298+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~IXKL4WBV3QQA.0 size=499835 2024-09-14T11:23:29.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.298+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=IXKL4WBV3QQA tag=2WYTPHYY6ZVQ type=write size=1548411 2024-09-14T11:23:29.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.299+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=2BFUOH811XMA type=del 2024-09-14T11:23:29.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.300+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=QG2HM17LMZ96 type=del size=3438235 2024-09-14T11:23:29.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.302+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=PB58Y5DVTOS8 type=write size=819224 2024-09-14T11:23:29.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.303+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~A7RL16QXI59H.0 size=910278 2024-09-14T11:23:29.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.303+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=A7RL16QXI59H tag=PA6P3L5S4LXG type=write size=1958854 2024-09-14T11:23:29.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.305+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CIRAKBDJZZK8.0 size=608661 2024-09-14T11:23:29.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.306+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=CIRAKBDJZZK8 tag=KNBT08OD8DR1 type=write size=1657237 2024-09-14T11:23:29.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.308+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=43PJZ1X0UVRV type=del size=1427527 2024-09-14T11:23:29.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.308+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~NMM6YIX8CCX4.0 size=458986 2024-09-14T11:23:29.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.310+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=NMM6YIX8CCX4 tag=342CF3FVLWSH type=write size=1507562 2024-09-14T11:23:29.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.311+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=8U1ZVIF9R27P type=del size=4103090 2024-09-14T11:23:29.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.312+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.0 size=1048576 2024-09-14T11:23:29.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.312+0000 7f296241c780 1 < canceled part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.1 size=1048576 2024-09-14T11:23:29.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.313+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~YF7G4W90MY0G.2 size=407591 2024-09-14T11:23:29.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.315+0000 7f296241c780 1 < canceled multipart upload key=19TC05N1D5FR upload=YF7G4W90MY0G tag=JX6C83AVBB48 type=write size=3553319 2024-09-14T11:23:29.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.317+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~7X3S0NME7Y74.0 size=1048576 2024-09-14T11:23:29.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.317+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~7X3S0NME7Y74.1 size=71042 2024-09-14T11:23:29.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.317+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=7X3S0NME7Y74 tag=10TT6HNDHOKV type=write size=2168194 2024-09-14T11:23:29.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.319+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~C6NE6P0JE138.0 size=700503 2024-09-14T11:23:29.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.320+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=C6NE6P0JE138 tag=FII5Z4IS28DJ type=write size=1749079 2024-09-14T11:23:29.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.322+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=1YK2QWGK3NO9 type=del size=3127237 2024-09-14T11:23:29.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.323+0000 7f296241c780 1 < completed write operation key=I1XBOS1L5D98 tag=RXOW9JHZVO7J type=write size=115636 2024-09-14T11:23:29.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.325+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=LZMD31B73ZZV type=del size=1437717 2024-09-14T11:23:29.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.327+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=GDIBPOIRXVPL type=del 2024-09-14T11:23:29.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.329+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.0 size=1048576 2024-09-14T11:23:29.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.329+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.1 size=1048576 2024-09-14T11:23:29.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.330+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.2 size=910404 2024-09-14T11:23:29.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.330+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=UWN0H5ZFUQ0P tag=8J75XCD54ANT type=write size=4056132 2024-09-14T11:23:29.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.332+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=LISJBK79KZF6 type=del 2024-09-14T11:23:29.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.334+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~J6BTQIRNGY3U.0 size=1048576 2024-09-14T11:23:29.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.334+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~J6BTQIRNGY3U.1 size=30186 2024-09-14T11:23:29.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.334+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=J6BTQIRNGY3U tag=3Z67VD86RHS3 type=write size=2127338 2024-09-14T11:23:29.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.336+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=DQMFP14QGXQU type=del 2024-09-14T11:23:29.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.337+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=LIIV9FS139RV type=del size=247169 2024-09-14T11:23:29.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.338+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~597MRKIEITU2.0 size=1048576 2024-09-14T11:23:29.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.339+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~597MRKIEITU2.1 size=763383 2024-09-14T11:23:29.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.341+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=597MRKIEITU2 tag=UIZBB43TDZ24 type=write size=2860535 2024-09-14T11:23:29.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.342+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=FS5RX2C24QB8 type=del size=2227865 2024-09-14T11:23:29.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.345+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=67HRS3ODR2CO type=write size=262677 2024-09-14T11:23:29.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.346+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=1ORMWNIQ8N1Z type=write size=138675 2024-09-14T11:23:29.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.347+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~AMRQUN1LD0GV.0 size=1048576 2024-09-14T11:23:29.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.348+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~AMRQUN1LD0GV.1 size=893108 2024-09-14T11:23:29.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.350+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=AMRQUN1LD0GV tag=O8WUR4O30739 type=write size=2990260 2024-09-14T11:23:29.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.352+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.0 size=1048576 2024-09-14T11:23:29.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.353+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.1 size=1048576 2024-09-14T11:23:29.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.354+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.2 size=269528 2024-09-14T11:23:29.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.354+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=DGRSZX0NYGGN tag=X7SH2T6VNIX6 type=write size=3415256 2024-09-14T11:23:29.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.355+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~CSTC19XXZD2F.0 size=931814 2024-09-14T11:23:29.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.357+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=CSTC19XXZD2F tag=1MXOSHUQ5Z5L type=write size=1980390 2024-09-14T11:23:29.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.358+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=PLWX07MTZ4DW type=del size=2904908 2024-09-14T11:23:29.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.359+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=QOB2UQNTMGTL type=del 2024-09-14T11:23:29.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.363+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~PXDFOVNMF0PF.0 size=1048576 2024-09-14T11:23:29.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.363+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~PXDFOVNMF0PF.1 size=448390 2024-09-14T11:23:29.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.363+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=PXDFOVNMF0PF tag=3JV6A2S9EVLW type=write size=2545542 2024-09-14T11:23:29.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.365+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~IXKL4WBV3QQA.0 size=499835 2024-09-14T11:23:29.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.366+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=IXKL4WBV3QQA tag=2WYTPHYY6ZVQ type=write size=1548411 2024-09-14T11:23:29.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.368+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~SJ8MP1Y0GMDB.0 size=69039 2024-09-14T11:23:29.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.368+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=SJ8MP1Y0GMDB tag=BGQ7YX9V4HXE type=write size=1117615 2024-09-14T11:23:29.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.370+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=QG2HM17LMZ96 type=del 2024-09-14T11:23:29.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.371+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~E9QA3CW6RS72.0 size=1048576 2024-09-14T11:23:29.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.372+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~E9QA3CW6RS72.1 size=44813 2024-09-14T11:23:29.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.372+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=E9QA3CW6RS72 tag=6FH5XJQU4V36 type=write size=2141965 2024-09-14T11:23:29.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.373+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~A7RL16QXI59H.0 size=910278 2024-09-14T11:23:29.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.375+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=A7RL16QXI59H tag=PA6P3L5S4LXG type=write size=1958854 2024-09-14T11:23:29.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.376+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=2CBMFD0JBLKG type=del size=3454811 2024-09-14T11:23:29.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.378+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=43PJZ1X0UVRV type=del 2024-09-14T11:23:29.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.379+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=7L5A610536W1 type=del size=2120623 2024-09-14T11:23:29.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.380+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=8U1ZVIF9R27P type=del 2024-09-14T11:23:29.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.382+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.0 size=1048576 2024-09-14T11:23:29.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.383+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.1 size=1048576 2024-09-14T11:23:29.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.384+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.2 size=1038566 2024-09-14T11:23:29.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.384+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=Y2WRNQW3C3UN tag=00B2PK2NQSKM type=write size=4184294 2024-09-14T11:23:29.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.385+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~7X3S0NME7Y74.0 size=1048576 2024-09-14T11:23:29.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.386+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~7X3S0NME7Y74.1 size=71042 2024-09-14T11:23:29.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.388+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=7X3S0NME7Y74 tag=10TT6HNDHOKV type=write size=2168194 2024-09-14T11:23:29.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.389+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=EVH5V2OX1I9A type=del size=2087461 2024-09-14T11:23:29.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.390+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=1YK2QWGK3NO9 type=del 2024-09-14T11:23:29.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.391+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=JTOCMLLWAGDL type=del size=109086 2024-09-14T11:23:29.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.393+0000 7f296241c780 1 < suggested remove operation key=ILOY74OSG5CQ tag=LZMD31B73ZZV type=del 2024-09-14T11:23:29.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.394+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=6WUU0W9JOF23 type=del size=4559 2024-09-14T11:23:29.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.395+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.0 size=1048576 2024-09-14T11:23:29.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.395+0000 7f296241c780 1 < canceled part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.1 size=1048576 2024-09-14T11:23:29.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.396+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~UWN0H5ZFUQ0P.2 size=910404 2024-09-14T11:23:29.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.398+0000 7f296241c780 1 < canceled multipart upload key=OIT1KUT6UEP2 upload=UWN0H5ZFUQ0P tag=8J75XCD54ANT type=write size=4056132 2024-09-14T11:23:29.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.400+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~1SPHDWX7BCBB.0 size=1048576 2024-09-14T11:23:29.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.401+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~1SPHDWX7BCBB.1 size=994699 2024-09-14T11:23:29.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.401+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=1SPHDWX7BCBB tag=GHW4OK03EX37 type=write size=3091851 2024-09-14T11:23:29.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.403+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~J6BTQIRNGY3U.0 size=1048576 2024-09-14T11:23:29.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.403+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~J6BTQIRNGY3U.1 size=30186 2024-09-14T11:23:29.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.405+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=J6BTQIRNGY3U tag=3Z67VD86RHS3 type=write size=2127338 2024-09-14T11:23:29.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.407+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=LXBO94DWFGCX type=del size=3909638 2024-09-14T11:23:29.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.408+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=LIIV9FS139RV type=del 2024-09-14T11:23:29.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.409+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=H5OJVMCEO55O type=del size=2201487 2024-09-14T11:23:29.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.410+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=FS5RX2C24QB8 type=del 2024-09-14T11:23:29.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.412+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~EZUD2WCBRJHY.0 size=1048576 2024-09-14T11:23:29.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.413+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~EZUD2WCBRJHY.1 size=369183 2024-09-14T11:23:29.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.413+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=EZUD2WCBRJHY tag=5F8UIOEC4EF2 type=write size=2466335 2024-09-14T11:23:29.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.414+0000 7f296241c780 1 < completed write operation key=R1M982MUIF44 tag=1ORMWNIQ8N1Z type=write size=138675 2024-09-14T11:23:29.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.416+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~WTLQ5E49WMZT.0 size=267630 2024-09-14T11:23:29.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.416+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=WTLQ5E49WMZT tag=0J1V4L4UNTAL type=write size=1316206 2024-09-14T11:23:29.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.417+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.0 size=1048576 2024-09-14T11:23:29.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.418+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.1 size=1048576 2024-09-14T11:23:29.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.419+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~DGRSZX0NYGGN.2 size=269528 2024-09-14T11:23:29.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.421+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=DGRSZX0NYGGN tag=X7SH2T6VNIX6 type=write size=3415256 2024-09-14T11:23:29.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.422+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=W9A14U4IVP1W type=del size=4159195 2024-09-14T11:23:29.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.424+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=PLWX07MTZ4DW type=del 2024-09-14T11:23:29.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.426+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.0 size=1048576 2024-09-14T11:23:29.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.427+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.1 size=1048576 2024-09-14T11:23:29.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.428+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.2 size=130210 2024-09-14T11:23:29.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.428+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=WV1S12IAT71T tag=CP91XIPQ88JU type=write size=3275938 2024-09-14T11:23:29.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.429+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~PXDFOVNMF0PF.0 size=1048576 2024-09-14T11:23:29.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.429+0000 7f296241c780 1 < canceled part key=_multipart_HZD8WW0H4AAD.2~PXDFOVNMF0PF.1 size=448390 2024-09-14T11:23:29.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.431+0000 7f296241c780 1 < canceled multipart upload key=HZD8WW0H4AAD upload=PXDFOVNMF0PF tag=3JV6A2S9EVLW type=write size=2545542 2024-09-14T11:23:29.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.433+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~OSU1MKF44BW1.0 size=606052 2024-09-14T11:23:29.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.433+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=OSU1MKF44BW1 tag=87IDIQBPV7L5 type=write size=1654628 2024-09-14T11:23:29.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.434+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~SJ8MP1Y0GMDB.0 size=69039 2024-09-14T11:23:29.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.436+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=SJ8MP1Y0GMDB tag=BGQ7YX9V4HXE type=write size=1117615 2024-09-14T11:23:29.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.438+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~PG13EWXEGLC0.0 size=617413 2024-09-14T11:23:29.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.438+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=PG13EWXEGLC0 tag=LYD2PURADH26 type=write size=1665989 2024-09-14T11:23:29.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.439+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~E9QA3CW6RS72.0 size=1048576 2024-09-14T11:23:29.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.440+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~E9QA3CW6RS72.1 size=44813 2024-09-14T11:23:29.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.442+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=E9QA3CW6RS72 tag=6FH5XJQU4V36 type=write size=2141965 2024-09-14T11:23:29.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.444+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~R8LXCY42PSLT.0 size=630671 2024-09-14T11:23:29.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.444+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=R8LXCY42PSLT tag=V97M3JP8OL6X type=write size=1679247 2024-09-14T11:23:29.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.446+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=2CBMFD0JBLKG type=del 2024-09-14T11:23:29.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.447+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=JF9X95XXAOSO type=del size=814514 2024-09-14T11:23:29.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.448+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=7L5A610536W1 type=del 2024-09-14T11:23:29.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.449+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=3JHJ6D5C7G05 type=del size=605944 2024-09-14T11:23:29.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.450+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.0 size=1048576 2024-09-14T11:23:29.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.451+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.1 size=1048576 2024-09-14T11:23:29.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.452+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~Y2WRNQW3C3UN.2 size=1038566 2024-09-14T11:23:29.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.454+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=Y2WRNQW3C3UN tag=00B2PK2NQSKM type=write size=4184294 2024-09-14T11:23:29.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.456+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~MZMEXD1M4CGE.0 size=1048576 2024-09-14T11:23:29.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.457+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~MZMEXD1M4CGE.1 size=1029473 2024-09-14T11:23:29.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.457+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=MZMEXD1M4CGE tag=5GIBJDK7XOF7 type=write size=3126625 2024-09-14T11:23:29.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.459+0000 7f296241c780 1 < suggested remove operation key=QL439L2X13OR tag=EVH5V2OX1I9A type=del 2024-09-14T11:23:29.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.460+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=UKHWA8GTLUWU type=del size=3739260 2024-09-14T11:23:29.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.461+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=JTOCMLLWAGDL type=del 2024-09-14T11:23:29.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.463+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~9ZUS7IVSK2D4.0 size=424696 2024-09-14T11:23:29.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.463+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=9ZUS7IVSK2D4 tag=H88301W2Y7T0 type=write size=1473272 2024-09-14T11:23:29.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.464+0000 7f296241c780 1 < canceled operation key=5N30QR6SN49T tag=6WUU0W9JOF23 type=del size=4559 2024-09-14T11:23:29.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.467+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~7692C24VGPRR.0 size=1048576 2024-09-14T11:23:29.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.467+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~7692C24VGPRR.1 size=745716 2024-09-14T11:23:29.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.467+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=7692C24VGPRR tag=SERS3EWKCYF5 type=write size=2842868 2024-09-14T11:23:29.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.468+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~1SPHDWX7BCBB.0 size=1048576 2024-09-14T11:23:29.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.469+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~1SPHDWX7BCBB.1 size=994699 2024-09-14T11:23:29.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.471+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=1SPHDWX7BCBB tag=GHW4OK03EX37 type=write size=3091851 2024-09-14T11:23:29.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.473+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.0 size=1048576 2024-09-14T11:23:29.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.474+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.1 size=1048576 2024-09-14T11:23:29.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.475+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.2 size=224976 2024-09-14T11:23:29.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.475+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=2I0PKS1HDMPS tag=TL3W9Q46AH4S type=write size=3370704 2024-09-14T11:23:29.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.476+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=LXBO94DWFGCX type=del 2024-09-14T11:23:29.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.477+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=SCHO9ZBPZGRU type=del size=2394204 2024-09-14T11:23:29.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.478+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=H5OJVMCEO55O type=del size=2201487 2024-09-14T11:23:29.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.479+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=RZUW8PIWM1C4 type=del size=1751140 2024-09-14T11:23:29.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.480+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~EZUD2WCBRJHY.0 size=1048576 2024-09-14T11:23:29.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.481+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~EZUD2WCBRJHY.1 size=369183 2024-09-14T11:23:29.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.483+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=EZUD2WCBRJHY tag=5F8UIOEC4EF2 type=write size=2466335 2024-09-14T11:23:29.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.485+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.0 size=1048576 2024-09-14T11:23:29.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.486+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.1 size=1048576 2024-09-14T11:23:29.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.486+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.2 size=284272 2024-09-14T11:23:29.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.486+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=ZNOR9VHJC5U7 tag=COI3EXSDYIRL type=write size=3430000 2024-09-14T11:23:29.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.487+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~WTLQ5E49WMZT.0 size=267630 2024-09-14T11:23:29.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.489+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=WTLQ5E49WMZT tag=0J1V4L4UNTAL type=write size=1316206 2024-09-14T11:23:29.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.491+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~4YY7SC6U93K3.0 size=1048576 2024-09-14T11:23:29.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.492+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~4YY7SC6U93K3.1 size=507326 2024-09-14T11:23:29.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.492+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=4YY7SC6U93K3 tag=TNOGMRYB5RB9 type=write size=2604478 2024-09-14T11:23:29.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.493+0000 7f296241c780 1 < canceled operation key=L0GW4TPQCSUY tag=W9A14U4IVP1W type=del size=4159195 2024-09-14T11:23:29.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.494+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=F6VASNP725RS type=write size=412115 2024-09-14T11:23:29.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.495+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.0 size=1048576 2024-09-14T11:23:29.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.496+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.1 size=1048576 2024-09-14T11:23:29.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.497+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~WV1S12IAT71T.2 size=130210 2024-09-14T11:23:29.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.499+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=WV1S12IAT71T tag=CP91XIPQ88JU type=write size=3275938 2024-09-14T11:23:29.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.500+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=LV38UY3FHDGL type=del size=2809667 2024-09-14T11:23:29.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.501+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~OSU1MKF44BW1.0 size=606052 2024-09-14T11:23:29.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.503+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=OSU1MKF44BW1 tag=87IDIQBPV7L5 type=write size=1654628 2024-09-14T11:23:29.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.505+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~PQYF7WOKP1VR.0 size=343607 2024-09-14T11:23:29.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.505+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=PQYF7WOKP1VR tag=O8RQSBAH5M3E type=write size=1392183 2024-09-14T11:23:29.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.506+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~PG13EWXEGLC0.0 size=617413 2024-09-14T11:23:29.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.508+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=PG13EWXEGLC0 tag=LYD2PURADH26 type=write size=1665989 2024-09-14T11:23:29.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.509+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=70U1DZQEDL7L type=del size=1596875 2024-09-14T11:23:29.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.511+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~R8LXCY42PSLT.0 size=630671 2024-09-14T11:23:29.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.512+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=R8LXCY42PSLT tag=V97M3JP8OL6X type=write size=1679247 2024-09-14T11:23:29.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.514+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=WD0MYX9ETE0S type=del size=1220991 2024-09-14T11:23:29.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.515+0000 7f296241c780 1 < canceled operation key=I1XBOS1L5D98 tag=JF9X95XXAOSO type=del size=814514 2024-09-14T11:23:29.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.516+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=2AJYVNNR7JSF type=del size=3590 2024-09-14T11:23:29.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.517+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=3JHJ6D5C7G05 type=del 2024-09-14T11:23:29.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.518+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=L1EI61XEKADL type=write size=683936 2024-09-14T11:23:29.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.520+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~MZMEXD1M4CGE.0 size=1048576 2024-09-14T11:23:29.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.521+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~MZMEXD1M4CGE.1 size=1029473 2024-09-14T11:23:29.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.523+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=MZMEXD1M4CGE tag=5GIBJDK7XOF7 type=write size=3126625 2024-09-14T11:23:29.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.524+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=T6D0N8UNAUFM type=del size=3187725 2024-09-14T11:23:29.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.525+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=UKHWA8GTLUWU type=del 2024-09-14T11:23:29.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.528+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~VTGSZRI0OHAG.0 size=789889 2024-09-14T11:23:29.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.528+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=VTGSZRI0OHAG tag=AJUUWCJ24H1Q type=write size=1838465 2024-09-14T11:23:29.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.529+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~9ZUS7IVSK2D4.0 size=424696 2024-09-14T11:23:29.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.531+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=9ZUS7IVSK2D4 tag=H88301W2Y7T0 type=write size=1473272 2024-09-14T11:23:29.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.533+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=UB3AG7TVYIUX type=write size=959976 2024-09-14T11:23:29.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.534+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~7692C24VGPRR.0 size=1048576 2024-09-14T11:23:29.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.535+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~7692C24VGPRR.1 size=745716 2024-09-14T11:23:29.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.537+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=7692C24VGPRR tag=SERS3EWKCYF5 type=write size=2842868 2024-09-14T11:23:29.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.540+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.0 size=1048576 2024-09-14T11:23:29.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.541+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.1 size=1048576 2024-09-14T11:23:29.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.542+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.2 size=883566 2024-09-14T11:23:29.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.542+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=K33JDI3H8WN3 tag=FUS432US9DYO type=write size=4029294 2024-09-14T11:23:29.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.543+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.0 size=1048576 2024-09-14T11:23:29.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.544+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.1 size=1048576 2024-09-14T11:23:29.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.545+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~2I0PKS1HDMPS.2 size=224976 2024-09-14T11:23:29.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.547+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=2I0PKS1HDMPS tag=TL3W9Q46AH4S type=write size=3370704 2024-09-14T11:23:29.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.548+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~A2T70A3674QA.0 size=1048576 2024-09-14T11:23:29.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.549+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~A2T70A3674QA.1 size=80118 2024-09-14T11:23:29.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.549+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=A2T70A3674QA tag=8NOPI8WX4YVO type=write size=2177270 2024-09-14T11:23:29.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.550+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=SCHO9ZBPZGRU type=del 2024-09-14T11:23:29.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.552+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=4LR7X1RXOAWE type=del size=3299339 2024-09-14T11:23:29.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.553+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=RZUW8PIWM1C4 type=del 2024-09-14T11:23:29.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.554+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=8RPNEKP2A0W0 type=write size=394502 2024-09-14T11:23:29.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.555+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.0 size=1048576 2024-09-14T11:23:29.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.556+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.1 size=1048576 2024-09-14T11:23:29.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.557+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ZNOR9VHJC5U7.2 size=284272 2024-09-14T11:23:29.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.559+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=ZNOR9VHJC5U7 tag=COI3EXSDYIRL type=write size=3430000 2024-09-14T11:23:29.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.560+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=KM693CY87E33 type=write size=127203 2024-09-14T11:23:29.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.562+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~4YY7SC6U93K3.0 size=1048576 2024-09-14T11:23:29.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.562+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~4YY7SC6U93K3.1 size=507326 2024-09-14T11:23:29.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.564+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=4YY7SC6U93K3 tag=TNOGMRYB5RB9 type=write size=2604478 2024-09-14T11:23:29.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.565+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=6BHB7EX9J1PF type=del size=1274718 2024-09-14T11:23:29.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.566+0000 7f296241c780 1 < completed write operation key=19TC05N1D5FR tag=F6VASNP725RS type=write size=412115 2024-09-14T11:23:29.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.568+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~3QE93MICIJ4R.0 size=1048576 2024-09-14T11:23:29.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.569+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~3QE93MICIJ4R.1 size=122914 2024-09-14T11:23:29.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.569+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=3QE93MICIJ4R tag=B8O8KN2SIP6H type=write size=2220066 2024-09-14T11:23:29.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.571+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=LV38UY3FHDGL type=del 2024-09-14T11:23:29.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.572+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=TMQ43MW7KEG4 type=del size=2147969 2024-09-14T11:23:29.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.573+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~PQYF7WOKP1VR.0 size=343607 2024-09-14T11:23:29.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.575+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=PQYF7WOKP1VR tag=O8RQSBAH5M3E type=write size=1392183 2024-09-14T11:23:29.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.578+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~16OEW52E03D7.0 size=747119 2024-09-14T11:23:29.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.578+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=16OEW52E03D7 tag=E49TOVO10LO8 type=write size=1795695 2024-09-14T11:23:29.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.579+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=70U1DZQEDL7L type=del 2024-09-14T11:23:29.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.581+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~FBGX9AFXX0A6.0 size=1048576 2024-09-14T11:23:29.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.582+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~FBGX9AFXX0A6.1 size=1033584 2024-09-14T11:23:29.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.582+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=FBGX9AFXX0A6 tag=1N403EC4364W type=write size=3130736 2024-09-14T11:23:29.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.583+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=WD0MYX9ETE0S type=del 2024-09-14T11:23:29.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.584+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=8OCJDWWN02PD type=del size=2132972 2024-09-14T11:23:29.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.585+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=2AJYVNNR7JSF type=del 2024-09-14T11:23:29.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.587+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=1VE81L1B3WKT type=del size=2365447 2024-09-14T11:23:29.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.588+0000 7f296241c780 1 < canceled operation key=JH1QJE5V4M9H tag=L1EI61XEKADL type=write size=683936 2024-09-14T11:23:29.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.589+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=A47X9XB2UPKO type=del size=3279475 2024-09-14T11:23:29.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.591+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=T6D0N8UNAUFM type=del 2024-09-14T11:23:29.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.592+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=30MFILVZ3IQD type=del size=2077768 2024-09-14T11:23:29.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.593+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~VTGSZRI0OHAG.0 size=789889 2024-09-14T11:23:29.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.595+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=VTGSZRI0OHAG tag=AJUUWCJ24H1Q type=write size=1838465 2024-09-14T11:23:29.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.596+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=V5I48ENRV69O type=del size=4190616 2024-09-14T11:23:29.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.597+0000 7f296241c780 1 < completed write operation key=XTS8B3LEW0Y3 tag=UB3AG7TVYIUX type=write size=959976 2024-09-14T11:23:29.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.599+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=58WZ5H00KFXE type=write size=499873 2024-09-14T11:23:29.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.600+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.0 size=1048576 2024-09-14T11:23:29.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.601+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.1 size=1048576 2024-09-14T11:23:29.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.602+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~K33JDI3H8WN3.2 size=883566 2024-09-14T11:23:29.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.604+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=K33JDI3H8WN3 tag=FUS432US9DYO type=write size=4029294 2024-09-14T11:23:29.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.605+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=TVR414EXPMU8 type=del size=2417734 2024-09-14T11:23:29.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.606+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~A2T70A3674QA.0 size=1048576 2024-09-14T11:23:29.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.607+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~A2T70A3674QA.1 size=80118 2024-09-14T11:23:29.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.609+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=A2T70A3674QA tag=8NOPI8WX4YVO type=write size=2177270 2024-09-14T11:23:29.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.610+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=Q4VLE0MPH1IX type=write size=1046562 2024-09-14T11:23:29.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.611+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=4LR7X1RXOAWE type=del 2024-09-14T11:23:29.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.613+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~NP6HSNP15M54.0 size=1048576 2024-09-14T11:23:29.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.614+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~NP6HSNP15M54.1 size=275141 2024-09-14T11:23:29.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.614+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=NP6HSNP15M54 tag=1JOC7HYMXU1J type=write size=2372293 2024-09-14T11:23:29.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.615+0000 7f296241c780 1 < completed write operation key=CQU8M12JCE9T tag=8RPNEKP2A0W0 type=write size=394502 2024-09-14T11:23:29.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.617+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.0 size=1048576 2024-09-14T11:23:29.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.618+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.1 size=1048576 2024-09-14T11:23:29.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.619+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.2 size=470668 2024-09-14T11:23:29.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.619+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=EQRNWFXG2GQE tag=G9M113VJ6TB9 type=write size=3616396 2024-09-14T11:23:29.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.620+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=KM693CY87E33 type=write size=127203 2024-09-14T11:23:29.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.621+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=JRER6DKYAXXA type=del size=2096077 2024-09-14T11:23:29.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.622+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=6BHB7EX9J1PF type=del 2024-09-14T11:23:29.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.623+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=1T1EBQC28LRC type=del size=3162929 2024-09-14T11:23:29.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.625+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~3QE93MICIJ4R.0 size=1048576 2024-09-14T11:23:29.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.626+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~3QE93MICIJ4R.1 size=122914 2024-09-14T11:23:29.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.627+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=3QE93MICIJ4R tag=B8O8KN2SIP6H type=write size=2220066 2024-09-14T11:23:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.629+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=R9YZFC2IAK7U type=del size=3373837 2024-09-14T11:23:29.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.630+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=TMQ43MW7KEG4 type=del 2024-09-14T11:23:29.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.632+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~A7KFSQ5X6UQO.0 size=350908 2024-09-14T11:23:29.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.632+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=A7KFSQ5X6UQO tag=8U8VSSIH0Z3I type=write size=1399484 2024-09-14T11:23:29.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.633+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~16OEW52E03D7.0 size=747119 2024-09-14T11:23:29.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.635+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=16OEW52E03D7 tag=E49TOVO10LO8 type=write size=1795695 2024-09-14T11:23:29.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.637+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~N5MRK4RV0IU1.0 size=1048576 2024-09-14T11:23:29.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.638+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~N5MRK4RV0IU1.1 size=426952 2024-09-14T11:23:29.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.638+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=N5MRK4RV0IU1 tag=LHETLUSRJ1IK type=write size=2524104 2024-09-14T11:23:29.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.640+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~FBGX9AFXX0A6.0 size=1048576 2024-09-14T11:23:29.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.641+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~FBGX9AFXX0A6.1 size=1033584 2024-09-14T11:23:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.643+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=FBGX9AFXX0A6 tag=1N403EC4364W type=write size=3130736 2024-09-14T11:23:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.644+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=5UF5Q5KDZD9A type=del size=466052 2024-09-14T11:23:29.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.646+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=8OCJDWWN02PD type=del 2024-09-14T11:23:29.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.648+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.0 size=1048576 2024-09-14T11:23:29.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.649+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.1 size=1048576 2024-09-14T11:23:29.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.650+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.2 size=681832 2024-09-14T11:23:29.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.650+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=7HW31CSWWAGS tag=2JZGNJ81J1X1 type=write size=3827560 2024-09-14T11:23:29.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.651+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=1VE81L1B3WKT type=del 2024-09-14T11:23:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.652+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=RU7ZQ0D6BESM type=del size=3945386 2024-09-14T11:23:29.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.653+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=A47X9XB2UPKO type=del 2024-09-14T11:23:29.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.655+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~H59YUQ2XLNBP.0 size=1048576 2024-09-14T11:23:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.656+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~H59YUQ2XLNBP.1 size=251180 2024-09-14T11:23:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.656+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=H59YUQ2XLNBP tag=0VSNBQ2Z3RKI type=write size=2348332 2024-09-14T11:23:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.657+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=30MFILVZ3IQD type=del 2024-09-14T11:23:29.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.660+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=683QX5W56RHC type=del size=3023382 2024-09-14T11:23:29.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.661+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=V5I48ENRV69O type=del 2024-09-14T11:23:29.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.662+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=G8POJS8Z0Z83 type=del size=2844826 2024-09-14T11:23:29.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.664+0000 7f296241c780 1 < suggested remove operation key=TNT7E4GX5ZR7 tag=58WZ5H00KFXE type=write 2024-09-14T11:23:29.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.665+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=349LP186LJUB type=write size=98539 2024-09-14T11:23:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.666+0000 7f296241c780 1 < canceled operation key=L8NA53KOAT58 tag=TVR414EXPMU8 type=del size=2417734 2024-09-14T11:23:29.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.668+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.0 size=1048576 2024-09-14T11:23:29.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.669+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.1 size=1048576 2024-09-14T11:23:29.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.670+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.2 size=911200 2024-09-14T11:23:29.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.670+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=VY73LOCPO2U5 tag=2WOZPLHVJMKF type=write size=4056928 2024-09-14T11:23:29.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.671+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=Q4VLE0MPH1IX type=write size=1046562 2024-09-14T11:23:29.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.673+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~1O9ERWBQR818.0 size=76417 2024-09-14T11:23:29.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.673+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=1O9ERWBQR818 tag=40Y57VAYM3U5 type=write size=1124993 2024-09-14T11:23:29.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.674+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~NP6HSNP15M54.0 size=1048576 2024-09-14T11:23:29.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.675+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~NP6HSNP15M54.1 size=275141 2024-09-14T11:23:29.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.677+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=NP6HSNP15M54 tag=1JOC7HYMXU1J type=write size=2372293 2024-09-14T11:23:29.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.678+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=2INNBAVOCV99 type=del size=472778 2024-09-14T11:23:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.680+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.0 size=1048576 2024-09-14T11:23:29.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.681+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.1 size=1048576 2024-09-14T11:23:29.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.682+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~EQRNWFXG2GQE.2 size=470668 2024-09-14T11:23:29.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.684+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=EQRNWFXG2GQE tag=G9M113VJ6TB9 type=write size=3616396 2024-09-14T11:23:29.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.685+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=311VMXNR12DV type=del size=3387233 2024-09-14T11:23:29.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.686+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=JRER6DKYAXXA type=del 2024-09-14T11:23:29.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.687+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=VH2WWOKBRJ79 type=del size=3912008 2024-09-14T11:23:29.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.689+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=1T1EBQC28LRC type=del size=3162929 2024-09-14T11:23:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.691+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~2LI4W8ZAYZ9C.0 size=1048576 2024-09-14T11:23:29.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.692+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~2LI4W8ZAYZ9C.1 size=205665 2024-09-14T11:23:29.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.692+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=2LI4W8ZAYZ9C tag=JCQ7ZME128OC type=write size=2302817 2024-09-14T11:23:29.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.693+0000 7f296241c780 -1 < failed to complete operation key=L0GW4TPQCSUY tag=R9YZFC2IAK7U type=del size=3373837: (22) Invalid argument 2024-09-14T11:23:29.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.695+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=MNLJDPY747QI type=del size=2762853 2024-09-14T11:23:29.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.696+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~A7KFSQ5X6UQO.0 size=350908 2024-09-14T11:23:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.697+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=A7KFSQ5X6UQO tag=8U8VSSIH0Z3I type=write size=1399484 2024-09-14T11:23:29.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.699+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=59VWTX9AG08X type=del size=1717484 2024-09-14T11:23:29.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.700+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~N5MRK4RV0IU1.0 size=1048576 2024-09-14T11:23:29.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.701+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~N5MRK4RV0IU1.1 size=426952 2024-09-14T11:23:29.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.703+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=N5MRK4RV0IU1 tag=LHETLUSRJ1IK type=write size=2524104 2024-09-14T11:23:29.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.705+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~B9G3S8UZZHY8.0 size=586381 2024-09-14T11:23:29.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.705+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=B9G3S8UZZHY8 tag=UQCUW6UCFR1G type=write size=1634957 2024-09-14T11:23:29.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.706+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=5UF5Q5KDZD9A type=del 2024-09-14T11:23:29.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.707+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=1FLSCBZF78BX type=del size=3257237 2024-09-14T11:23:29.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.708+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.0 size=1048576 2024-09-14T11:23:29.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.709+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.1 size=1048576 2024-09-14T11:23:29.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.710+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~7HW31CSWWAGS.2 size=681832 2024-09-14T11:23:29.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.712+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=7HW31CSWWAGS tag=2JZGNJ81J1X1 type=write size=3827560 2024-09-14T11:23:29.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.713+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=YU5OFP1R1E7R type=del size=2621375 2024-09-14T11:23:29.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.715+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=RU7ZQ0D6BESM type=del 2024-09-14T11:23:29.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.716+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=I7NK5EIQ2XT5 type=del size=917180 2024-09-14T11:23:29.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.716+0000 7f296241c780 1 < canceled part key=_multipart_C1T4CLU3400T.2~H59YUQ2XLNBP.0 size=1048576 2024-09-14T11:23:29.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.717+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~H59YUQ2XLNBP.1 size=251180 2024-09-14T11:23:29.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.719+0000 7f296241c780 1 < canceled multipart upload key=C1T4CLU3400T upload=H59YUQ2XLNBP tag=0VSNBQ2Z3RKI type=write size=2348332 2024-09-14T11:23:29.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.721+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~MDD0BZI80155.0 size=144415 2024-09-14T11:23:29.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.721+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=MDD0BZI80155 tag=BAS82OYI17EK type=write size=1192991 2024-09-14T11:23:29.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.722+0000 7f296241c780 1 < canceled operation key=HFH3VKZ4T0IR tag=683QX5W56RHC type=del size=3023382 2024-09-14T11:23:29.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.723+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=S8ET4VON31H2 type=del size=1115764 2024-09-14T11:23:29.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.726+0000 7f296241c780 1 < suggested remove operation key=KVQ49I9RAYXA tag=G8POJS8Z0Z83 type=del 2024-09-14T11:23:29.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.728+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~6RIV1PXLD20O.0 size=523636 2024-09-14T11:23:29.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.728+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=6RIV1PXLD20O tag=OQOJD5HGIAOL type=write size=1572212 2024-09-14T11:23:29.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.729+0000 7f296241c780 1 < completed write operation key=XTS8B3LEW0Y3 tag=349LP186LJUB type=write size=98539 2024-09-14T11:23:29.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.731+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HKTJFCL79NAR.0 size=765557 2024-09-14T11:23:29.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.731+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=HKTJFCL79NAR tag=1LAV20FKXS10 type=write size=1814133 2024-09-14T11:23:29.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.733+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.0 size=1048576 2024-09-14T11:23:29.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.734+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.1 size=1048576 2024-09-14T11:23:29.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.735+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~VY73LOCPO2U5.2 size=911200 2024-09-14T11:23:29.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.737+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=VY73LOCPO2U5 tag=2WOZPLHVJMKF type=write size=4056928 2024-09-14T11:23:29.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.739+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~IIV9XMA3NNE1.0 size=197911 2024-09-14T11:23:29.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.739+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=IIV9XMA3NNE1 tag=KS4Q0BVOURNT type=write size=1246487 2024-09-14T11:23:29.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.739+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~1O9ERWBQR818.0 size=76417 2024-09-14T11:23:29.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.741+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=1O9ERWBQR818 tag=40Y57VAYM3U5 type=write size=1124993 2024-09-14T11:23:29.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.742+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=H93RFPEJKNVR type=write size=710455 2024-09-14T11:23:29.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.743+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=2INNBAVOCV99 type=del 2024-09-14T11:23:29.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.745+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~YPF00F5K1OZA.0 size=1001992 2024-09-14T11:23:29.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.745+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=YPF00F5K1OZA tag=N43ICAFTNRAJ type=write size=2050568 2024-09-14T11:23:29.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.747+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=311VMXNR12DV type=del 2024-09-14T11:23:29.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.749+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~RY40NWPVUR8A.0 size=1048576 2024-09-14T11:23:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.750+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~RY40NWPVUR8A.1 size=61454 2024-09-14T11:23:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.750+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=RY40NWPVUR8A tag=BE5FUZ03W1LO type=write size=2158606 2024-09-14T11:23:29.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.751+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=VH2WWOKBRJ79 type=del 2024-09-14T11:23:29.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.753+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~L5PGWX6NN6UK.0 size=254755 2024-09-14T11:23:29.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.753+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=L5PGWX6NN6UK tag=T4UI4H3DSSM8 type=write size=1303331 2024-09-14T11:23:29.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.754+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~2LI4W8ZAYZ9C.0 size=1048576 2024-09-14T11:23:29.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.755+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~2LI4W8ZAYZ9C.1 size=205665 2024-09-14T11:23:29.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.757+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=2LI4W8ZAYZ9C tag=JCQ7ZME128OC type=write size=2302817 2024-09-14T11:23:29.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.759+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~JR5V1WXZ36QH.0 size=1048576 2024-09-14T11:23:29.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.760+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~JR5V1WXZ36QH.1 size=322038 2024-09-14T11:23:29.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.760+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=JR5V1WXZ36QH tag=YHQBIPSV9WY4 type=write size=2419190 2024-09-14T11:23:29.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.761+0000 7f296241c780 1 < canceled operation key=L8NA53KOAT58 tag=MNLJDPY747QI type=del size=2762853 2024-09-14T11:23:29.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.762+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=AAQUMJKTCDN9 type=del size=1167501 2024-09-14T11:23:29.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.764+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=59VWTX9AG08X type=del size=1717484 2024-09-14T11:23:29.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.767+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~FG7P3FWNLLO5.0 size=1048576 2024-09-14T11:23:29.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.767+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~FG7P3FWNLLO5.1 size=320304 2024-09-14T11:23:29.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.767+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=FG7P3FWNLLO5 tag=QOSLZUQIH25V type=write size=2417456 2024-09-14T11:23:29.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.768+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~B9G3S8UZZHY8.0 size=586381 2024-09-14T11:23:29.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.770+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=B9G3S8UZZHY8 tag=UQCUW6UCFR1G type=write size=1634957 2024-09-14T11:23:29.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.771+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=T4BZA16OINAS type=write size=1032640 2024-09-14T11:23:29.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.772+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=1FLSCBZF78BX type=del 2024-09-14T11:23:29.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.775+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.0 size=1048576 2024-09-14T11:23:29.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.776+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.1 size=1048576 2024-09-14T11:23:29.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.777+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.2 size=428883 2024-09-14T11:23:29.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.777+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=34MOKL6UCEE3 tag=MC2NHX46CM1O type=write size=3574611 2024-09-14T11:23:29.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.778+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=YU5OFP1R1E7R type=del 2024-09-14T11:23:29.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.779+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=019ATU7M0HR8 type=del size=1714968 2024-09-14T11:23:29.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.781+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=I7NK5EIQ2XT5 type=del 2024-09-14T11:23:29.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.785+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=JGP2QXG9HKAZ type=del size=225611 2024-09-14T11:23:29.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.787+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~MDD0BZI80155.0 size=144415 2024-09-14T11:23:29.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.790+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=MDD0BZI80155 tag=BAS82OYI17EK type=write size=1192991 2024-09-14T11:23:29.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.792+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.0 size=1048576 2024-09-14T11:23:29.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.793+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.1 size=1048576 2024-09-14T11:23:29.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.794+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.2 size=961021 2024-09-14T11:23:29.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.794+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=19ZJ8I1R9GQE tag=BP9MUCPNOAT6 type=write size=4106749 2024-09-14T11:23:29.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.796+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=S8ET4VON31H2 type=del size=1115764 2024-09-14T11:23:29.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.798+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~PKF2ZWAZK71Z.0 size=1048576 2024-09-14T11:23:29.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.799+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~PKF2ZWAZK71Z.1 size=669800 2024-09-14T11:23:29.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.799+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=PKF2ZWAZK71Z tag=2NYADTOSCNIP type=write size=2766952 2024-09-14T11:23:29.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.800+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~6RIV1PXLD20O.0 size=523636 2024-09-14T11:23:29.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.802+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=6RIV1PXLD20O tag=OQOJD5HGIAOL type=write size=1572212 2024-09-14T11:23:29.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.803+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=743TPXYN30ZS type=del size=1632701 2024-09-14T11:23:29.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.805+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HKTJFCL79NAR.0 size=765557 2024-09-14T11:23:29.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.807+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=HKTJFCL79NAR tag=1LAV20FKXS10 type=write size=1814133 2024-09-14T11:23:29.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.809+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~9LMHR73MD3TK.0 size=1048576 2024-09-14T11:23:29.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.810+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~9LMHR73MD3TK.1 size=465275 2024-09-14T11:23:29.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.810+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=9LMHR73MD3TK tag=65P2U2TT1G3G type=write size=2562427 2024-09-14T11:23:29.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.811+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~IIV9XMA3NNE1.0 size=197911 2024-09-14T11:23:29.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.813+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=IIV9XMA3NNE1 tag=KS4Q0BVOURNT type=write size=1246487 2024-09-14T11:23:29.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.814+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=OSZESFV9NUAT type=write size=457703 2024-09-14T11:23:29.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.815+0000 7f296241c780 1 < completed write operation key=19TC05N1D5FR tag=H93RFPEJKNVR type=write size=710455 2024-09-14T11:23:29.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.816+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=VIUUCT14U2RN type=write size=47143 2024-09-14T11:23:29.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.817+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~YPF00F5K1OZA.0 size=1001992 2024-09-14T11:23:29.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.819+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=YPF00F5K1OZA tag=N43ICAFTNRAJ type=write size=2050568 2024-09-14T11:23:29.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.821+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~X3XJWD6E0MJI.0 size=1048576 2024-09-14T11:23:29.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.822+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~X3XJWD6E0MJI.1 size=752302 2024-09-14T11:23:29.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.822+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=X3XJWD6E0MJI tag=XLZ6VPUOH7R9 type=write size=2849454 2024-09-14T11:23:29.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.823+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~RY40NWPVUR8A.0 size=1048576 2024-09-14T11:23:29.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.824+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~RY40NWPVUR8A.1 size=61454 2024-09-14T11:23:29.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.826+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=RY40NWPVUR8A tag=BE5FUZ03W1LO type=write size=2158606 2024-09-14T11:23:29.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.828+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~R0Q4FZOCX5ZA.0 size=702208 2024-09-14T11:23:29.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.828+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=R0Q4FZOCX5ZA tag=XKZ4ATTKOIOL type=write size=1750784 2024-09-14T11:23:29.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.829+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~L5PGWX6NN6UK.0 size=254755 2024-09-14T11:23:29.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.831+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=L5PGWX6NN6UK tag=T4UI4H3DSSM8 type=write size=1303331 2024-09-14T11:23:29.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.832+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=D83UE1W9FSOQ type=write size=789429 2024-09-14T11:23:29.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.834+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~JR5V1WXZ36QH.0 size=1048576 2024-09-14T11:23:29.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.835+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~JR5V1WXZ36QH.1 size=322038 2024-09-14T11:23:29.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.837+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=JR5V1WXZ36QH tag=YHQBIPSV9WY4 type=write size=2419190 2024-09-14T11:23:29.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.838+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=D13686E2DPTQ type=del size=1285240 2024-09-14T11:23:29.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.839+0000 7f296241c780 1 < canceled operation key=QL439L2X13OR tag=AAQUMJKTCDN9 type=del size=1167501 2024-09-14T11:23:29.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.841+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~6XZYEC2ZEJCX.0 size=1048576 2024-09-14T11:23:29.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.842+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~6XZYEC2ZEJCX.1 size=595668 2024-09-14T11:23:29.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.842+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=6XZYEC2ZEJCX tag=NT930ME5258D type=write size=2692820 2024-09-14T11:23:29.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.843+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~FG7P3FWNLLO5.0 size=1048576 2024-09-14T11:23:29.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.844+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~FG7P3FWNLLO5.1 size=320304 2024-09-14T11:23:29.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.846+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=FG7P3FWNLLO5 tag=QOSLZUQIH25V type=write size=2417456 2024-09-14T11:23:29.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.847+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=M8DJSK9P5EEP type=write size=917617 2024-09-14T11:23:29.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.848+0000 7f296241c780 1 < completed write operation key=FGK7YH1GB4W5 tag=T4BZA16OINAS type=write size=1032640 2024-09-14T11:23:29.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.850+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.0 size=1048576 2024-09-14T11:23:29.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.851+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.1 size=1048576 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.852+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.2 size=243581 2024-09-14T11:23:29.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.852+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=Y5B0OZOU1GJG tag=9QSIO7A33YBF type=write size=3389309 2024-09-14T11:23:29.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.853+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.0 size=1048576 2024-09-14T11:23:29.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.854+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.1 size=1048576 2024-09-14T11:23:29.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.855+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~34MOKL6UCEE3.2 size=428883 2024-09-14T11:23:29.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.857+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=34MOKL6UCEE3 tag=MC2NHX46CM1O type=write size=3574611 2024-09-14T11:23:29.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.858+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=UDMD1L1CSWEH type=del size=421979 2024-09-14T11:23:29.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.859+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=019ATU7M0HR8 type=del 2024-09-14T11:23:29.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.860+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=MG6EBVNC9Q4H type=del size=3169174 2024-09-14T11:23:29.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.861+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=JGP2QXG9HKAZ type=del 2024-09-14T11:23:29.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.863+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~DOJY7XV7R1ZI.0 size=909010 2024-09-14T11:23:29.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.863+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=DOJY7XV7R1ZI tag=K3ET9ALIYENP type=write size=1957586 2024-09-14T11:23:29.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.864+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.0 size=1048576 2024-09-14T11:23:29.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.865+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.1 size=1048576 2024-09-14T11:23:29.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.866+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~19ZJ8I1R9GQE.2 size=961021 2024-09-14T11:23:29.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.868+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=19ZJ8I1R9GQE tag=BP9MUCPNOAT6 type=write size=4106749 2024-09-14T11:23:29.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.869+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=W4M3DND9A83O type=del size=836457 2024-09-14T11:23:29.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.870+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~PKF2ZWAZK71Z.0 size=1048576 2024-09-14T11:23:29.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.871+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~PKF2ZWAZK71Z.1 size=669800 2024-09-14T11:23:29.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.873+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=PKF2ZWAZK71Z tag=2NYADTOSCNIP type=write size=2766952 2024-09-14T11:23:29.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.875+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~QMV6K4M8OH6S.0 size=876213 2024-09-14T11:23:29.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.875+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=QMV6K4M8OH6S tag=3LMSSK6W1GSM type=write size=1924789 2024-09-14T11:23:29.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.876+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=743TPXYN30ZS type=del 2024-09-14T11:23:29.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.878+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~O0KAWXMU9370.0 size=1048576 2024-09-14T11:23:29.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.879+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~O0KAWXMU9370.1 size=637093 2024-09-14T11:23:29.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.879+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=O0KAWXMU9370 tag=W96N7WGEQH6X type=write size=2734245 2024-09-14T11:23:29.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.880+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~9LMHR73MD3TK.0 size=1048576 2024-09-14T11:23:29.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.881+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~9LMHR73MD3TK.1 size=465275 2024-09-14T11:23:29.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.883+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=9LMHR73MD3TK tag=65P2U2TT1G3G type=write size=2562427 2024-09-14T11:23:29.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.884+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=C4DJ4B11Y02K type=del size=2010950 2024-09-14T11:23:29.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.885+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=OSZESFV9NUAT type=write size=457703 2024-09-14T11:23:29.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.887+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.0 size=1048576 2024-09-14T11:23:29.886 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.888+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.1 size=1048576 2024-09-14T11:23:29.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.889+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.2 size=138674 2024-09-14T11:23:29.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.889+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=2ZRA6KIZIUUP tag=30E65Y4RVQ7T type=write size=3284402 2024-09-14T11:23:29.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.891+0000 7f296241c780 1 < suggested remove operation key=JH1QJE5V4M9H tag=VIUUCT14U2RN type=write 2024-09-14T11:23:29.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.893+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~YE4BF0DA1BER.0 size=1048576 2024-09-14T11:23:29.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.894+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~YE4BF0DA1BER.1 size=293826 2024-09-14T11:23:29.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.894+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=YE4BF0DA1BER tag=V5K3VZMV55KR type=write size=2390978 2024-09-14T11:23:29.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.895+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~X3XJWD6E0MJI.0 size=1048576 2024-09-14T11:23:29.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.896+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~X3XJWD6E0MJI.1 size=752302 2024-09-14T11:23:29.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.899+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=X3XJWD6E0MJI tag=XLZ6VPUOH7R9 type=write size=2849454 2024-09-14T11:23:29.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.900+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=F3SU70AFQK9Z type=write size=704522 2024-09-14T11:23:29.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.901+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~R0Q4FZOCX5ZA.0 size=702208 2024-09-14T11:23:29.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.903+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=R0Q4FZOCX5ZA tag=XKZ4ATTKOIOL type=write size=1750784 2024-09-14T11:23:29.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.904+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=146WSL09Z7LA type=del size=3774666 2024-09-14T11:23:29.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.905+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=D83UE1W9FSOQ type=write size=789429 2024-09-14T11:23:29.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.908+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.0 size=1048576 2024-09-14T11:23:29.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.909+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.1 size=1048576 2024-09-14T11:23:29.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.909+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.2 size=792124 2024-09-14T11:23:29.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.909+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=FA2KZAEW513S tag=MYIPGK8A8ZW6 type=write size=3937852 2024-09-14T11:23:29.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.911+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=D13686E2DPTQ type=del 2024-09-14T11:23:29.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.913+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WD828U61SZQT.0 size=1048576 2024-09-14T11:23:29.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.914+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WD828U61SZQT.1 size=537482 2024-09-14T11:23:29.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.914+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=WD828U61SZQT tag=SAJ3P6ZD3O9C type=write size=2634634 2024-09-14T11:23:29.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.915+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~6XZYEC2ZEJCX.0 size=1048576 2024-09-14T11:23:29.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.916+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~6XZYEC2ZEJCX.1 size=595668 2024-09-14T11:23:29.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.918+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=6XZYEC2ZEJCX tag=NT930ME5258D type=write size=2692820 2024-09-14T11:23:29.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.919+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=FQJ84T2OOZBI type=write size=853601 2024-09-14T11:23:29.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.920+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=M8DJSK9P5EEP type=write size=917617 2024-09-14T11:23:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.921+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=MWVMOOA7DXYJ type=write size=371390 2024-09-14T11:23:29.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.922+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.0 size=1048576 2024-09-14T11:23:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.923+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.1 size=1048576 2024-09-14T11:23:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.924+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~Y5B0OZOU1GJG.2 size=243581 2024-09-14T11:23:29.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.926+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=Y5B0OZOU1GJG tag=9QSIO7A33YBF type=write size=3389309 2024-09-14T11:23:29.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.927+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=FXLYJTYATFNS type=write size=1041788 2024-09-14T11:23:29.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.928+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=UDMD1L1CSWEH type=del 2024-09-14T11:23:29.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.929+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=O9GJ5VO8O90C type=del size=2829030 2024-09-14T11:23:29.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.931+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=MG6EBVNC9Q4H type=del size=3169174 2024-09-14T11:23:29.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.932+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=MP0NCSFJXX06 type=del size=3800171 2024-09-14T11:23:29.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.933+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~DOJY7XV7R1ZI.0 size=909010 2024-09-14T11:23:29.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.935+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=DOJY7XV7R1ZI tag=K3ET9ALIYENP type=write size=1957586 2024-09-14T11:23:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.937+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~ZXQRR9CO4V8E.0 size=1048576 2024-09-14T11:23:29.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.938+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~ZXQRR9CO4V8E.1 size=501068 2024-09-14T11:23:29.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.938+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=ZXQRR9CO4V8E tag=FPD5P5TJGL02 type=write size=2598220 2024-09-14T11:23:29.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.939+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=W4M3DND9A83O type=del 2024-09-14T11:23:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.940+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=G8ASKCAEK6TE type=del size=882530 2024-09-14T11:23:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.941+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~QMV6K4M8OH6S.0 size=876213 2024-09-14T11:23:29.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.943+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=QMV6K4M8OH6S tag=3LMSSK6W1GSM type=write size=1924789 2024-09-14T11:23:29.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.945+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=K97HRIGYGR8B type=del size=3553393 2024-09-14T11:23:29.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.946+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~O0KAWXMU9370.0 size=1048576 2024-09-14T11:23:29.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.947+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~O0KAWXMU9370.1 size=637093 2024-09-14T11:23:29.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.949+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=O0KAWXMU9370 tag=W96N7WGEQH6X type=write size=2734245 2024-09-14T11:23:29.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.951+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~HZ3UKXHOL6WZ.0 size=780769 2024-09-14T11:23:29.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.951+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=HZ3UKXHOL6WZ tag=6TGIC3UZ44C0 type=write size=1829345 2024-09-14T11:23:29.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.952+0000 7f296241c780 1 < canceled operation key=OIT1KUT6UEP2 tag=C4DJ4B11Y02K type=del size=2010950 2024-09-14T11:23:29.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.953+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=VTKEW5SOKK0Q type=del size=1216774 2024-09-14T11:23:29.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.954+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.0 size=1048576 2024-09-14T11:23:29.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.955+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.1 size=1048576 2024-09-14T11:23:29.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.956+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~2ZRA6KIZIUUP.2 size=138674 2024-09-14T11:23:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.958+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=2ZRA6KIZIUUP tag=30E65Y4RVQ7T type=write size=3284402 2024-09-14T11:23:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.959+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=4W1V5NBAP8DE type=del size=2674839 2024-09-14T11:23:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.960+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~YE4BF0DA1BER.0 size=1048576 2024-09-14T11:23:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.961+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~YE4BF0DA1BER.1 size=293826 2024-09-14T11:23:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.963+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=YE4BF0DA1BER tag=V5K3VZMV55KR type=write size=2390978 2024-09-14T11:23:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.965+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.0 size=1048576 2024-09-14T11:23:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.966+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.1 size=1048576 2024-09-14T11:23:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.967+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.2 size=169036 2024-09-14T11:23:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.967+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=2ZPOIJX160IV tag=L1U776269KJM type=write size=3314764 2024-09-14T11:23:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.969+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=F3SU70AFQK9Z type=write size=704522 2024-09-14T11:23:29.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.970+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=37WNL8ATSHP8 type=write size=560225 2024-09-14T11:23:29.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.971+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=146WSL09Z7LA type=del 2024-09-14T11:23:29.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.973+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=DLH4YLX68RRT type=del size=494323 2024-09-14T11:23:29.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.974+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.0 size=1048576 2024-09-14T11:23:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.975+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.1 size=1048576 2024-09-14T11:23:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.976+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~FA2KZAEW513S.2 size=792124 2024-09-14T11:23:29.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.978+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=FA2KZAEW513S tag=MYIPGK8A8ZW6 type=write size=3937852 2024-09-14T11:23:29.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.979+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=KOESOM4WPPN5 type=del size=2872389 2024-09-14T11:23:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.980+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WD828U61SZQT.0 size=1048576 2024-09-14T11:23:29.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.981+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WD828U61SZQT.1 size=537482 2024-09-14T11:23:29.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.983+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=WD828U61SZQT tag=SAJ3P6ZD3O9C type=write size=2634634 2024-09-14T11:23:29.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.985+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~WKL63DHUFLD2.0 size=1048576 2024-09-14T11:23:29.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.986+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~WKL63DHUFLD2.1 size=267807 2024-09-14T11:23:29.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.986+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=WKL63DHUFLD2 tag=YTPRH40XQUQV type=write size=2364959 2024-09-14T11:23:29.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.988+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=FQJ84T2OOZBI type=write size=853601 2024-09-14T11:23:29.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.989+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=O15KFW5A9G5K type=del size=2789139 2024-09-14T11:23:29.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.990+0000 7f296241c780 1 < completed write operation key=CQU8M12JCE9T tag=MWVMOOA7DXYJ type=write size=371390 2024-09-14T11:23:29.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.991+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=UC9A1IUQT4PS type=del size=1095135 2024-09-14T11:23:29.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.992+0000 7f296241c780 1 < completed write operation key=3T0SINQVBAGF tag=FXLYJTYATFNS type=write size=1041788 2024-09-14T11:23:29.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.994+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=XYGYVVIL0GBM type=write size=858378 2024-09-14T11:23:29.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.995+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=O9GJ5VO8O90C type=del 2024-09-14T11:23:29.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.996+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=L59WCJQ831FO type=del size=1993524 2024-09-14T11:23:29.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.997+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=MP0NCSFJXX06 type=del 2024-09-14T11:23:29.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.999+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ZWKH82Z656Z8.0 size=227023 2024-09-14T11:23:29.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:29.999+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=ZWKH82Z656Z8 tag=2RWRQXBZ0BRI type=write size=1275599 2024-09-14T11:23:29.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.000+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~ZXQRR9CO4V8E.0 size=1048576 2024-09-14T11:23:29.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.001+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~ZXQRR9CO4V8E.1 size=501068 2024-09-14T11:23:30.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.003+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=ZXQRR9CO4V8E tag=FPD5P5TJGL02 type=write size=2598220 2024-09-14T11:23:30.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.006+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~5VPUM8XX70F6.0 size=1048576 2024-09-14T11:23:30.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.007+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~5VPUM8XX70F6.1 size=262888 2024-09-14T11:23:30.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.007+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=5VPUM8XX70F6 tag=3DZQIQHGYDC3 type=write size=2360040 2024-09-14T11:23:30.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.008+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=G8ASKCAEK6TE type=del 2024-09-14T11:23:30.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.009+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=UNXBMEJQ2J6M type=write size=665402 2024-09-14T11:23:30.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.011+0000 7f296241c780 1 < suggested update operation key=OIT1KUT6UEP2 tag=K97HRIGYGR8B type=del size=3553393 2024-09-14T11:23:30.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.012+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=VS2HILX9BA3A type=del size=3697742 2024-09-14T11:23:30.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.015+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~HZ3UKXHOL6WZ.0 size=780769 2024-09-14T11:23:30.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.016+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=HZ3UKXHOL6WZ tag=6TGIC3UZ44C0 type=write size=1829345 2024-09-14T11:23:30.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.018+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=K6HY3KNYKHBW type=write size=827193 2024-09-14T11:23:30.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.020+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=VTKEW5SOKK0Q type=del size=1216774 2024-09-14T11:23:30.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.022+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~8O8S3D97G5CT.0 size=257995 2024-09-14T11:23:30.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.022+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=8O8S3D97G5CT tag=CKO3AHYTWAQJ type=write size=1306571 2024-09-14T11:23:30.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.023+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=4W1V5NBAP8DE type=del 2024-09-14T11:23:30.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.025+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~JMAJYFZKXRYF.0 size=322963 2024-09-14T11:23:30.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.025+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=JMAJYFZKXRYF tag=E0Q44NVTGHVE type=write size=1371539 2024-09-14T11:23:30.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.026+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.0 size=1048576 2024-09-14T11:23:30.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.028+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.1 size=1048576 2024-09-14T11:23:30.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.029+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~2ZPOIJX160IV.2 size=169036 2024-09-14T11:23:30.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.031+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=2ZPOIJX160IV tag=L1U776269KJM type=write size=3314764 2024-09-14T11:23:30.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.032+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=LDVGM11XEPGZ type=del size=1871051 2024-09-14T11:23:30.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.033+0000 7f296241c780 1 < completed write operation key=QIVVKYC646IH tag=37WNL8ATSHP8 type=write size=560225 2024-09-14T11:23:30.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.034+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=TS077IUNGGPU type=del size=4098496 2024-09-14T11:23:30.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.036+0000 7f296241c780 1 < canceled operation key=R1M982MUIF44 tag=DLH4YLX68RRT type=del size=494323 2024-09-14T11:23:30.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.037+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=M5Y9UXSPV9WJ type=del size=2803609 2024-09-14T11:23:30.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.038+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=KOESOM4WPPN5 type=del 2024-09-14T11:23:30.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.039+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=MERLFSJ60PCE type=del size=2862343 2024-09-14T11:23:30.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.041+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~WKL63DHUFLD2.0 size=1048576 2024-09-14T11:23:30.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.042+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~WKL63DHUFLD2.1 size=267807 2024-09-14T11:23:30.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.044+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=WKL63DHUFLD2 tag=YTPRH40XQUQV type=write size=2364959 2024-09-14T11:23:30.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.046+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.0 size=1048576 2024-09-14T11:23:30.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.047+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.1 size=1048576 2024-09-14T11:23:30.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.048+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.2 size=1022957 2024-09-14T11:23:30.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.048+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=AEJP28WNAKWE tag=N9WM7A6BPD2V type=write size=4168685 2024-09-14T11:23:30.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.049+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=O15KFW5A9G5K type=del 2024-09-14T11:23:30.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.050+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=VKD01H1K1P30 type=del size=2593333 2024-09-14T11:23:30.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.051+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=UC9A1IUQT4PS type=del 2024-09-14T11:23:30.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.052+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=GWJRKWF9RX07 type=del size=1403311 2024-09-14T11:23:30.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.054+0000 7f296241c780 1 < suggested remove operation key=KVQ49I9RAYXA tag=XYGYVVIL0GBM type=write 2024-09-14T11:23:30.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.055+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=IENN88O8IOL4 type=del size=2121803 2024-09-14T11:23:30.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.057+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=L59WCJQ831FO type=del 2024-09-14T11:23:30.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.058+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.0 size=1048576 2024-09-14T11:23:30.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.059+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.1 size=1048576 2024-09-14T11:23:30.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.060+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.2 size=691323 2024-09-14T11:23:30.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.060+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=SU606AHVWLER tag=LBXT96XAJ5WB type=write size=3837051 2024-09-14T11:23:30.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.061+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ZWKH82Z656Z8.0 size=227023 2024-09-14T11:23:30.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.063+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=ZWKH82Z656Z8 tag=2RWRQXBZ0BRI type=write size=1275599 2024-09-14T11:23:30.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.064+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=GX3M3054OMWP type=del size=456350 2024-09-14T11:23:30.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.065+0000 7f296241c780 1 < canceled part key=_multipart_5N30QR6SN49T.2~5VPUM8XX70F6.0 size=1048576 2024-09-14T11:23:30.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.065+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~5VPUM8XX70F6.1 size=262888 2024-09-14T11:23:30.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.067+0000 7f296241c780 1 < canceled multipart upload key=5N30QR6SN49T upload=5VPUM8XX70F6 tag=3DZQIQHGYDC3 type=write size=2360040 2024-09-14T11:23:30.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.069+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=NT8QX1QNX7F8 type=write size=234090 2024-09-14T11:23:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.071+0000 7f296241c780 1 < suggested update operation key=KBMD123LTZA7 tag=UNXBMEJQ2J6M type=write size=665402 2024-09-14T11:23:30.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.072+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=POHHGEXJCGWB type=del size=2174286 2024-09-14T11:23:30.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.073+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=VS2HILX9BA3A type=del 2024-09-14T11:23:30.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.075+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.0 size=1048576 2024-09-14T11:23:30.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.076+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.1 size=1048576 2024-09-14T11:23:30.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.077+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.2 size=718357 2024-09-14T11:23:30.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.077+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=Z4QEFVVY1GW1 tag=23MB02MIWYWZ type=write size=3864085 2024-09-14T11:23:30.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.078+0000 7f296241c780 1 < completed write operation key=R1M982MUIF44 tag=K6HY3KNYKHBW type=write size=827193 2024-09-14T11:23:30.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.080+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~W6TRBVOCQ8SL.0 size=1048576 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.081+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~W6TRBVOCQ8SL.1 size=471765 2024-09-14T11:23:30.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.081+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=W6TRBVOCQ8SL tag=ILLEUOJFK9F1 type=write size=2568917 2024-09-14T11:23:30.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.082+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~8O8S3D97G5CT.0 size=257995 2024-09-14T11:23:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.084+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=8O8S3D97G5CT tag=CKO3AHYTWAQJ type=write size=1306571 2024-09-14T11:23:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.085+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=8ME26RB55XLL type=del size=3695454 2024-09-14T11:23:30.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.086+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~JMAJYFZKXRYF.0 size=322963 2024-09-14T11:23:30.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.088+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=JMAJYFZKXRYF tag=E0Q44NVTGHVE type=write size=1371539 2024-09-14T11:23:30.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.090+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~W0LJA9XTO1HC.0 size=1048576 2024-09-14T11:23:30.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.091+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~W0LJA9XTO1HC.1 size=611772 2024-09-14T11:23:30.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.091+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=W0LJA9XTO1HC tag=0P6S0HGGQ2FW type=write size=2708924 2024-09-14T11:23:30.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.092+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=LDVGM11XEPGZ type=del 2024-09-14T11:23:30.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.094+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~N97E30N9HOS1.0 size=720721 2024-09-14T11:23:30.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.094+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=N97E30N9HOS1 tag=3T82QWW083SK type=write size=1769297 2024-09-14T11:23:30.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.095+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=TS077IUNGGPU type=del 2024-09-14T11:23:30.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.097+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.0 size=1048576 2024-09-14T11:23:30.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.098+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.1 size=1048576 2024-09-14T11:23:30.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.099+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.2 size=239785 2024-09-14T11:23:30.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.099+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=TG3CNHQ5FYDM tag=HUDTE6R44LJW type=write size=3385513 2024-09-14T11:23:30.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.100+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=M5Y9UXSPV9WJ type=del 2024-09-14T11:23:30.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.101+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=57UFBHP280NZ type=del size=2079647 2024-09-14T11:23:30.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.102+0000 7f296241c780 1 < canceled operation key=HZD8WW0H4AAD tag=MERLFSJ60PCE type=del size=2862343 2024-09-14T11:23:30.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.104+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~DEEKN0G6ATU5.0 size=396416 2024-09-14T11:23:30.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.104+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=DEEKN0G6ATU5 tag=INEJPLWLFBSV type=write size=1444992 2024-09-14T11:23:30.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.105+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.0 size=1048576 2024-09-14T11:23:30.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.106+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.1 size=1048576 2024-09-14T11:23:30.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.107+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~AEJP28WNAKWE.2 size=1022957 2024-09-14T11:23:30.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.109+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=AEJP28WNAKWE tag=N9WM7A6BPD2V type=write size=4168685 2024-09-14T11:23:30.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.113+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.0 size=1048576 2024-09-14T11:23:30.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.113+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.1 size=1048576 2024-09-14T11:23:30.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.114+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.2 size=929959 2024-09-14T11:23:30.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.114+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=8Q31P5L78OQ4 tag=RNZNC9PM90X5 type=write size=4075687 2024-09-14T11:23:30.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.115+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=VKD01H1K1P30 type=del 2024-09-14T11:23:30.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.117+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=GQM3YG95BQSJ type=del size=1115815 2024-09-14T11:23:30.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.118+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=GWJRKWF9RX07 type=del 2024-09-14T11:23:30.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.119+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=VB9JOJ0AF4W2 type=del size=61796 2024-09-14T11:23:30.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.122+0000 7f296241c780 1 < suggested update operation key=FGK7YH1GB4W5 tag=IENN88O8IOL4 type=del size=2121803 2024-09-14T11:23:30.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.123+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=LWSPEEJUQPNJ type=del size=2903961 2024-09-14T11:23:30.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.125+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.0 size=1048576 2024-09-14T11:23:30.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.126+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.1 size=1048576 2024-09-14T11:23:30.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.127+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~SU606AHVWLER.2 size=691323 2024-09-14T11:23:30.127 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.129+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=SU606AHVWLER tag=LBXT96XAJ5WB type=write size=3837051 2024-09-14T11:23:30.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.130+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=S69JO1XIL0TS type=del size=1334470 2024-09-14T11:23:30.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.131+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=GX3M3054OMWP type=del 2024-09-14T11:23:30.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.133+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FLINRQ7DHNRV type=write size=94268 2024-09-14T11:23:30.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.134+0000 7f296241c780 1 < canceled operation key=KVQ49I9RAYXA tag=NT8QX1QNX7F8 type=write size=234090 2024-09-14T11:23:30.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.135+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=3K64JDKX1XF6 type=del size=314251 2024-09-14T11:23:30.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.136+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=POHHGEXJCGWB type=del 2024-09-14T11:23:30.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.138+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=4DF18HPEFOVY type=del size=2573545 2024-09-14T11:23:30.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.139+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.0 size=1048576 2024-09-14T11:23:30.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.139+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.1 size=1048576 2024-09-14T11:23:30.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.140+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~Z4QEFVVY1GW1.2 size=718357 2024-09-14T11:23:30.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.142+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=Z4QEFVVY1GW1 tag=23MB02MIWYWZ type=write size=3864085 2024-09-14T11:23:30.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.143+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=ERGK9GQE4SLI type=del size=118537 2024-09-14T11:23:30.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.143+0000 7f296241c780 1 < canceled part key=_multipart_C1T4CLU3400T.2~W6TRBVOCQ8SL.0 size=1048576 2024-09-14T11:23:30.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.144+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~W6TRBVOCQ8SL.1 size=471765 2024-09-14T11:23:30.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.146+0000 7f296241c780 1 < canceled multipart upload key=C1T4CLU3400T upload=W6TRBVOCQ8SL tag=ILLEUOJFK9F1 type=write size=2568917 2024-09-14T11:23:30.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.147+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=7INCZK9H1Z39 type=del size=3193383 2024-09-14T11:23:30.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.150+0000 7f296241c780 1 < suggested remove operation key=R1M982MUIF44 tag=8ME26RB55XLL type=del 2024-09-14T11:23:30.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.152+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~KHJKAHCBAZKT.0 size=969737 2024-09-14T11:23:30.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.152+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=KHJKAHCBAZKT tag=Y63G2YQ6QD5M type=write size=2018313 2024-09-14T11:23:30.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.153+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~W0LJA9XTO1HC.0 size=1048576 2024-09-14T11:23:30.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.154+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~W0LJA9XTO1HC.1 size=611772 2024-09-14T11:23:30.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.156+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=W0LJA9XTO1HC tag=0P6S0HGGQ2FW type=write size=2708924 2024-09-14T11:23:30.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.157+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=L4OVWE7WZEJY type=del size=2396742 2024-09-14T11:23:30.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.158+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~N97E30N9HOS1.0 size=720721 2024-09-14T11:23:30.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.160+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=N97E30N9HOS1 tag=3T82QWW083SK type=write size=1769297 2024-09-14T11:23:30.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.161+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=GLXDTQWMU2LT type=del size=2896142 2024-09-14T11:23:30.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.163+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.0 size=1048576 2024-09-14T11:23:30.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.163+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.1 size=1048576 2024-09-14T11:23:30.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.164+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~TG3CNHQ5FYDM.2 size=239785 2024-09-14T11:23:30.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.167+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=TG3CNHQ5FYDM tag=HUDTE6R44LJW type=write size=3385513 2024-09-14T11:23:30.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.168+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=DCYXSL0FFRXY type=del size=4065441 2024-09-14T11:23:30.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.169+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=57UFBHP280NZ type=del 2024-09-14T11:23:30.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.171+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~WN6S4L11N27K.0 size=896118 2024-09-14T11:23:30.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.171+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=WN6S4L11N27K tag=H2170OTCK3NH type=write size=1944694 2024-09-14T11:23:30.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.172+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~DEEKN0G6ATU5.0 size=396416 2024-09-14T11:23:30.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.174+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=DEEKN0G6ATU5 tag=INEJPLWLFBSV type=write size=1444992 2024-09-14T11:23:30.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.175+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=JFQQHW1XJKZF type=del size=3798185 2024-09-14T11:23:30.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.176+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.0 size=1048576 2024-09-14T11:23:30.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.177+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.1 size=1048576 2024-09-14T11:23:30.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.178+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~8Q31P5L78OQ4.2 size=929959 2024-09-14T11:23:30.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.180+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=8Q31P5L78OQ4 tag=RNZNC9PM90X5 type=write size=4075687 2024-09-14T11:23:30.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.181+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=2F16LAL9ZLZM type=del size=349898 2024-09-14T11:23:30.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.182+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=GQM3YG95BQSJ type=del 2024-09-14T11:23:30.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.184+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~G94URCCUWETQ.0 size=1048576 2024-09-14T11:23:30.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.185+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~G94URCCUWETQ.1 size=372108 2024-09-14T11:23:30.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.185+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=G94URCCUWETQ tag=AJVSA35W1J7Y type=write size=2469260 2024-09-14T11:23:30.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.187+0000 7f296241c780 1 < suggested remove operation key=O35OFLNOZ488 tag=VB9JOJ0AF4W2 type=del 2024-09-14T11:23:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.189+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.0 size=1048576 2024-09-14T11:23:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.190+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.1 size=1048576 2024-09-14T11:23:30.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.191+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.2 size=30043 2024-09-14T11:23:30.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.191+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=7GFNTMM7108L tag=YVORZ60JO7WU type=write size=3175771 2024-09-14T11:23:30.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.192+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=LWSPEEJUQPNJ type=del 2024-09-14T11:23:30.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.193+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=9HBNT3YWN9QO type=del size=1644553 2024-09-14T11:23:30.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.195+0000 7f296241c780 1 < canceled operation key=QIVVKYC646IH tag=S69JO1XIL0TS type=del size=1334470 2024-09-14T11:23:30.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.196+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=XU4D8X3LP0TO type=del size=2643358 2024-09-14T11:23:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.197+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=FLINRQ7DHNRV type=write size=94268 2024-09-14T11:23:30.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.198+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=VD0SA8A1U0TE type=del size=2278743 2024-09-14T11:23:30.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.199+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=3K64JDKX1XF6 type=del 2024-09-14T11:23:30.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.201+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.0 size=1048576 2024-09-14T11:23:30.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.202+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.1 size=1048576 2024-09-14T11:23:30.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.203+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.2 size=514223 2024-09-14T11:23:30.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.203+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=HCD9RNV8ZX3J tag=5IOLWFSDIQM5 type=write size=3659951 2024-09-14T11:23:30.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.205+0000 7f296241c780 1 < suggested update operation key=I6UYPPUMN0FB tag=4DF18HPEFOVY type=del size=2573545 2024-09-14T11:23:30.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.207+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=3LQWVPXQJ807 type=del size=2699344 2024-09-14T11:23:30.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.208+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=ERGK9GQE4SLI type=del 2024-09-14T11:23:30.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.210+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~WZ6A3BU6UYVJ.0 size=879314 2024-09-14T11:23:30.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.210+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=WZ6A3BU6UYVJ tag=YKUCL479N42D type=write size=1927890 2024-09-14T11:23:30.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.212+0000 7f296241c780 1 < suggested update operation key=HZD8WW0H4AAD tag=7INCZK9H1Z39 type=del size=3193383 2024-09-14T11:23:30.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.214+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~AUS9233X0T1J.0 size=515139 2024-09-14T11:23:30.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.214+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=AUS9233X0T1J tag=WJXRS8DB339T type=write size=1563715 2024-09-14T11:23:30.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.215+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~KHJKAHCBAZKT.0 size=969737 2024-09-14T11:23:30.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.217+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=KHJKAHCBAZKT tag=Y63G2YQ6QD5M type=write size=2018313 2024-09-14T11:23:30.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.218+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=R804BJ211NVD type=del size=265328 2024-09-14T11:23:30.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.220+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=L4OVWE7WZEJY type=del size=2396742 2024-09-14T11:23:30.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.222+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=7BUSXOAC7ADD type=write size=160209 2024-09-14T11:23:30.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.223+0000 7f296241c780 -1 < failed to complete operation key=HZD8WW0H4AAD tag=GLXDTQWMU2LT type=del size=2896142: (22) Invalid argument 2024-09-14T11:23:30.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.225+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=8Z9Z3NKNBE0E type=del size=2098882 2024-09-14T11:23:30.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.228+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=DCYXSL0FFRXY type=del size=4065441 2024-09-14T11:23:30.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.229+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=B1QOFR25F283 type=del size=3769144 2024-09-14T11:23:30.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.230+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~WN6S4L11N27K.0 size=896118 2024-09-14T11:23:30.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.232+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=WN6S4L11N27K tag=H2170OTCK3NH type=write size=1944694 2024-09-14T11:23:30.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.233+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=LL4T0SZP020S type=del size=4024666 2024-09-14T11:23:30.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.235+0000 7f296241c780 -1 < failed to complete operation key=HZD8WW0H4AAD tag=JFQQHW1XJKZF type=del size=3798185: (22) Invalid argument 2024-09-14T11:23:30.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.236+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=X46MWBQ2WV05 type=del size=1189766 2024-09-14T11:23:30.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.238+0000 7f296241c780 1 < suggested remove operation key=KVQ49I9RAYXA tag=2F16LAL9ZLZM type=del 2024-09-14T11:23:30.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.239+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=Z2JCN1SDJA22 type=write size=853533 2024-09-14T11:23:30.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.242+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~G94URCCUWETQ.0 size=1048576 2024-09-14T11:23:30.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.243+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~G94URCCUWETQ.1 size=372108 2024-09-14T11:23:30.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.245+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=G94URCCUWETQ tag=AJVSA35W1J7Y type=write size=2469260 2024-09-14T11:23:30.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.246+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=6B7EUG62V809 type=del size=3127485 2024-09-14T11:23:30.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.247+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.0 size=1048576 2024-09-14T11:23:30.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.248+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.1 size=1048576 2024-09-14T11:23:30.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.249+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~7GFNTMM7108L.2 size=30043 2024-09-14T11:23:30.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.251+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=7GFNTMM7108L tag=YVORZ60JO7WU type=write size=3175771 2024-09-14T11:23:30.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.253+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.0 size=1048576 2024-09-14T11:23:30.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.254+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.1 size=1048576 2024-09-14T11:23:30.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.255+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.2 size=836879 2024-09-14T11:23:30.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.255+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=ASVJKL3MCC0Y tag=2VDTQO99XGD2 type=write size=3982607 2024-09-14T11:23:30.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.256+0000 7f296241c780 -1 < failed to complete operation key=K61XH5E6TF3Y tag=9HBNT3YWN9QO type=del size=1644553: (22) Invalid argument 2024-09-14T11:23:30.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.258+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~RPCEPFO36K02.0 size=1048576 2024-09-14T11:23:30.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.259+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~RPCEPFO36K02.1 size=303787 2024-09-14T11:23:30.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.259+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=RPCEPFO36K02 tag=1ZOLVD6RSPTX type=write size=2400939 2024-09-14T11:23:30.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.261+0000 7f296241c780 1 < canceled operation key=3T0SINQVBAGF tag=XU4D8X3LP0TO type=del size=2643358 2024-09-14T11:23:30.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.262+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=34WJ38G566FV type=del size=2066070 2024-09-14T11:23:30.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.263+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=VD0SA8A1U0TE type=del 2024-09-14T11:23:30.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.264+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=6LHIO1NTKJ6M type=del size=942565 2024-09-14T11:23:30.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.265+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.0 size=1048576 2024-09-14T11:23:30.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.266+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.1 size=1048576 2024-09-14T11:23:30.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.266+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~HCD9RNV8ZX3J.2 size=514223 2024-09-14T11:23:30.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.268+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=HCD9RNV8ZX3J tag=5IOLWFSDIQM5 type=write size=3659951 2024-09-14T11:23:30.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.269+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=FA1MWFWOUY9U type=write size=535039 2024-09-14T11:23:30.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.270+0000 7f296241c780 -1 < failed to complete operation key=HZD8WW0H4AAD tag=3LQWVPXQJ807 type=del size=2699344: (22) Invalid argument 2024-09-14T11:23:30.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.272+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.0 size=1048576 2024-09-14T11:23:30.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.273+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.1 size=1048576 2024-09-14T11:23:30.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.274+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.2 size=845465 2024-09-14T11:23:30.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.274+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=UA8ZOJRTU5UC tag=153SJJR4H0TV type=write size=3991193 2024-09-14T11:23:30.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.275+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~WZ6A3BU6UYVJ.0 size=879314 2024-09-14T11:23:30.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.277+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=WZ6A3BU6UYVJ tag=YKUCL479N42D type=write size=1927890 2024-09-14T11:23:30.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.279+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.0 size=1048576 2024-09-14T11:23:30.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.280+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.1 size=1048576 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.281+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.2 size=563134 2024-09-14T11:23:30.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.281+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=YCGMV72RZRXH tag=HK5CJTHOJICE type=write size=3708862 2024-09-14T11:23:30.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.282+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~AUS9233X0T1J.0 size=515139 2024-09-14T11:23:30.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.284+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=AUS9233X0T1J tag=WJXRS8DB339T type=write size=1563715 2024-09-14T11:23:30.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.285+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=LN4XPYY7K55T type=del size=128620 2024-09-14T11:23:30.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.286+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=R804BJ211NVD type=del 2024-09-14T11:23:30.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.287+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=VF1GBJGP8620 type=write size=136071 2024-09-14T11:23:30.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.289+0000 7f296241c780 1 < suggested update operation key=L8NA53KOAT58 tag=7BUSXOAC7ADD type=write size=160209 2024-09-14T11:23:30.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.291+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~T5HFCB1IKWD8.0 size=894799 2024-09-14T11:23:30.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.291+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=T5HFCB1IKWD8 tag=ZPUCJ9DD8ROV type=write size=1943375 2024-09-14T11:23:30.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.293+0000 7f296241c780 1 < canceled operation key=I6UYPPUMN0FB tag=8Z9Z3NKNBE0E type=del size=2098882 2024-09-14T11:23:30.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.295+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~3ZD5LMT78QUO.0 size=1048576 2024-09-14T11:23:30.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.296+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~3ZD5LMT78QUO.1 size=559562 2024-09-14T11:23:30.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.296+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=3ZD5LMT78QUO tag=68R6TZC3O1BY type=write size=2656714 2024-09-14T11:23:30.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.297+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=B1QOFR25F283 type=del 2024-09-14T11:23:30.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.298+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=GWI7F966HC2M type=del size=2724887 2024-09-14T11:23:30.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.300+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=LL4T0SZP020S type=del 2024-09-14T11:23:30.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.301+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=98HBK3A3JLCK type=del size=2832599 2024-09-14T11:23:30.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.303+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=X46MWBQ2WV05 type=del 2024-09-14T11:23:30.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.305+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.0 size=1048576 2024-09-14T11:23:30.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.305+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.1 size=1048576 2024-09-14T11:23:30.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.307+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.2 size=354357 2024-09-14T11:23:30.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.307+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=BUGMWGLLZ2BF tag=RDIX7IACIRUS type=write size=3500085 2024-09-14T11:23:30.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.308+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=Z2JCN1SDJA22 type=write size=853533 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.310+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~JPZF5X22HACA.0 size=429905 2024-09-14T11:23:30.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.310+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=JPZF5X22HACA tag=KDMFYP8GF6SH type=write size=1478481 2024-09-14T11:23:30.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.311+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=6B7EUG62V809 type=del 2024-09-14T11:23:30.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.312+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=TSSNHKYU49PL type=del size=2891015 2024-09-14T11:23:30.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.313+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.0 size=1048576 2024-09-14T11:23:30.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.314+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.1 size=1048576 2024-09-14T11:23:30.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.315+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ASVJKL3MCC0Y.2 size=836879 2024-09-14T11:23:30.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.317+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=ASVJKL3MCC0Y tag=2VDTQO99XGD2 type=write size=3982607 2024-09-14T11:23:30.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.319+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=0ESW7R1KFA18 type=del size=2033844 2024-09-14T11:23:30.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.320+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~RPCEPFO36K02.0 size=1048576 2024-09-14T11:23:30.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.321+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~RPCEPFO36K02.1 size=303787 2024-09-14T11:23:30.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.323+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=RPCEPFO36K02 tag=1ZOLVD6RSPTX type=write size=2400939 2024-09-14T11:23:30.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.324+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=5XI87XQ0T400 type=del size=1805198 2024-09-14T11:23:30.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.325+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=34WJ38G566FV type=del 2024-09-14T11:23:30.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.326+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=LVCKFHGL0VK1 type=write size=834699 2024-09-14T11:23:30.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.328+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=6LHIO1NTKJ6M type=del size=942565 2024-09-14T11:23:30.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.329+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=4DPD9HOEI4ZX type=del size=2080264 2024-09-14T11:23:30.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.331+0000 7f296241c780 1 < completed write operation key=XTS8B3LEW0Y3 tag=FA1MWFWOUY9U type=write size=535039 2024-09-14T11:23:30.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.332+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=C2JZ8MS0U1TT type=write size=794635 2024-09-14T11:23:30.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.333+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.0 size=1048576 2024-09-14T11:23:30.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.335+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.1 size=1048576 2024-09-14T11:23:30.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.336+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~UA8ZOJRTU5UC.2 size=845465 2024-09-14T11:23:30.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.339+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=UA8ZOJRTU5UC tag=153SJJR4H0TV type=write size=3991193 2024-09-14T11:23:30.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.341+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=CKV8AR17P5JJ type=del size=2414783 2024-09-14T11:23:30.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.342+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.0 size=1048576 2024-09-14T11:23:30.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.343+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.1 size=1048576 2024-09-14T11:23:30.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.344+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~YCGMV72RZRXH.2 size=563134 2024-09-14T11:23:30.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.346+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=YCGMV72RZRXH tag=HK5CJTHOJICE type=write size=3708862 2024-09-14T11:23:30.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.347+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=NHKOK04833J7 type=del size=2366640 2024-09-14T11:23:30.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.348+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=LN4XPYY7K55T type=del 2024-09-14T11:23:30.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.350+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=INOL5NCF1U9W type=write size=375948 2024-09-14T11:23:30.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.351+0000 7f296241c780 1 < completed write operation key=3T0SINQVBAGF tag=VF1GBJGP8620 type=write size=136071 2024-09-14T11:23:30.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.352+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=DRU8CG3LLUQF type=del size=3688217 2024-09-14T11:23:30.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.353+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~T5HFCB1IKWD8.0 size=894799 2024-09-14T11:23:30.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.355+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=T5HFCB1IKWD8 tag=ZPUCJ9DD8ROV type=write size=1943375 2024-09-14T11:23:30.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.356+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=DSS2JZNSS547 type=del size=2606704 2024-09-14T11:23:30.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.358+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~3ZD5LMT78QUO.0 size=1048576 2024-09-14T11:23:30.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.359+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~3ZD5LMT78QUO.1 size=559562 2024-09-14T11:23:30.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.361+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=3ZD5LMT78QUO tag=68R6TZC3O1BY type=write size=2656714 2024-09-14T11:23:30.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.362+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=5QVSLMXU1F52 type=del size=2908008 2024-09-14T11:23:30.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.363+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=GWI7F966HC2M type=del 2024-09-14T11:23:30.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.364+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=OK7TQ4FY2WRZ type=del size=1459081 2024-09-14T11:23:30.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.366+0000 7f296241c780 1 < suggested remove operation key=C1T4CLU3400T tag=98HBK3A3JLCK type=del 2024-09-14T11:23:30.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.368+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.0 size=1048576 2024-09-14T11:23:30.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.369+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.1 size=1048576 2024-09-14T11:23:30.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.370+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.2 size=723503 2024-09-14T11:23:30.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.370+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=30JP4G46Z3YQ tag=FRQ390L7MY8D type=write size=3869231 2024-09-14T11:23:30.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.371+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.0 size=1048576 2024-09-14T11:23:30.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.372+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.1 size=1048576 2024-09-14T11:23:30.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.373+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~BUGMWGLLZ2BF.2 size=354357 2024-09-14T11:23:30.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.375+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=BUGMWGLLZ2BF tag=RDIX7IACIRUS type=write size=3500085 2024-09-14T11:23:30.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.376+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=1NVJCKSTU00C type=del size=492734 2024-09-14T11:23:30.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.377+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~JPZF5X22HACA.0 size=429905 2024-09-14T11:23:30.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.379+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=JPZF5X22HACA tag=KDMFYP8GF6SH type=write size=1478481 2024-09-14T11:23:30.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.380+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=9CYHLQQO2FXD type=del size=1386131 2024-09-14T11:23:30.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.381+0000 7f296241c780 -1 < failed to complete operation key=C1T4CLU3400T tag=TSSNHKYU49PL type=del size=2891015: (22) Invalid argument 2024-09-14T11:23:30.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.382+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=S6O1892NXTEA type=del size=367736 2024-09-14T11:23:30.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.383+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=0ESW7R1KFA18 type=del 2024-09-14T11:23:30.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.384+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=49I5852GS7DD type=del size=3310242 2024-09-14T11:23:30.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.386+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=5XI87XQ0T400 type=del 2024-09-14T11:23:30.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.387+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~FP0DSE8Y7HD3.0 size=160667 2024-09-14T11:23:30.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.387+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=FP0DSE8Y7HD3 tag=E075COELRVF9 type=write size=1209243 2024-09-14T11:23:30.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.389+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=LVCKFHGL0VK1 type=write size=834699 2024-09-14T11:23:30.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.390+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=3KGPE345R02E type=del size=1781234 2024-09-14T11:23:30.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.391+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=4DPD9HOEI4ZX type=del 2024-09-14T11:23:30.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.393+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~OL82GUXXW5VN.0 size=56339 2024-09-14T11:23:30.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.393+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=OL82GUXXW5VN tag=WSV8JEAINQ8H type=write size=1104915 2024-09-14T11:23:30.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.394+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=C2JZ8MS0U1TT type=write size=794635 2024-09-14T11:23:30.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.395+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=SCKV6H2ZHXAY type=write size=1034424 2024-09-14T11:23:30.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.396+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=CKV8AR17P5JJ type=del 2024-09-14T11:23:30.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.397+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FXBR2JV68UWK type=write size=797079 2024-09-14T11:23:30.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.398+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=NHKOK04833J7 type=del 2024-09-14T11:23:30.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.399+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=751QC11YBOKO type=del size=373750 2024-09-14T11:23:30.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.401+0000 7f296241c780 1 < completed write operation key=I6UYPPUMN0FB tag=INOL5NCF1U9W type=write size=375948 2024-09-14T11:23:30.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.402+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=UB1LVUQQ4K08 type=del size=2710421 2024-09-14T11:23:30.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.403+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=DRU8CG3LLUQF type=del 2024-09-14T11:23:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.405+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QM6W6CMDQK7A.0 size=1048576 2024-09-14T11:23:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.406+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QM6W6CMDQK7A.1 size=923230 2024-09-14T11:23:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.406+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=QM6W6CMDQK7A tag=TNZNVM4KPB70 type=write size=3020382 2024-09-14T11:23:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.407+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=DSS2JZNSS547 type=del 2024-09-14T11:23:30.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.408+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=6OS27LQYGDR5 type=del size=1112508 2024-09-14T11:23:30.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.410+0000 7f296241c780 1 < suggested remove operation key=19TC05N1D5FR tag=5QVSLMXU1F52 type=del 2024-09-14T11:23:30.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.412+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.0 size=1048576 2024-09-14T11:23:30.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.413+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.1 size=1048576 2024-09-14T11:23:30.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.414+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.2 size=37841 2024-09-14T11:23:30.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.414+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=54QVK4TPXGQ3 tag=QJVKO2Y978O4 type=write size=3183569 2024-09-14T11:23:30.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.415+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=OK7TQ4FY2WRZ type=del 2024-09-14T11:23:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.416+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=RA46043FHK7V type=write size=8864 2024-09-14T11:23:30.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.417+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.0 size=1048576 2024-09-14T11:23:30.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.418+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.1 size=1048576 2024-09-14T11:23:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.419+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~30JP4G46Z3YQ.2 size=723503 2024-09-14T11:23:30.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.420+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=30JP4G46Z3YQ tag=FRQ390L7MY8D type=write size=3869231 2024-09-14T11:23:30.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.422+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=OJUH9F3OAGIX type=del size=3013040 2024-09-14T11:23:30.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.423+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=1NVJCKSTU00C type=del 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.425+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~1PI4YJVCKSM4.0 size=28655 2024-09-14T11:23:30.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.425+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=1PI4YJVCKSM4 tag=143AZZY1U6AV type=write size=1077231 2024-09-14T11:23:30.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.427+0000 7f296241c780 1 < suggested update operation key=R1M982MUIF44 tag=9CYHLQQO2FXD type=del size=1386131 2024-09-14T11:23:30.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.428+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=HL7704ALA06W type=write size=81675 2024-09-14T11:23:30.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.429+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=S6O1892NXTEA type=del 2024-09-14T11:23:30.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.431+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=BR3JUHO7X81E type=write size=293983 2024-09-14T11:23:30.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.432+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=49I5852GS7DD type=del 2024-09-14T11:23:30.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.433+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=4CGKIND43ZLP type=write size=1011693 2024-09-14T11:23:30.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.433+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~FP0DSE8Y7HD3.0 size=160667 2024-09-14T11:23:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.435+0000 7f296241c780 1 < canceled multipart upload key=I6UYPPUMN0FB upload=FP0DSE8Y7HD3 tag=E075COELRVF9 type=write size=1209243 2024-09-14T11:23:30.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.437+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~CEZFL5S1UL1D.0 size=547666 2024-09-14T11:23:30.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.437+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=CEZFL5S1UL1D tag=X8R8IJLVQHFZ type=write size=1596242 2024-09-14T11:23:30.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.438+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=3KGPE345R02E type=del 2024-09-14T11:23:30.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.440+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.0 size=1048576 2024-09-14T11:23:30.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.441+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.1 size=1048576 2024-09-14T11:23:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.443+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.2 size=215687 2024-09-14T11:23:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.443+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=YRHDMM7VMY78 tag=81OZ0XZTOMN4 type=write size=3361415 2024-09-14T11:23:30.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.444+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~OL82GUXXW5VN.0 size=56339 2024-09-14T11:23:30.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.447+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=OL82GUXXW5VN tag=WSV8JEAINQ8H type=write size=1104915 2024-09-14T11:23:30.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.449+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~54P2S6QSKH82.0 size=1048576 2024-09-14T11:23:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.451+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~54P2S6QSKH82.1 size=792718 2024-09-14T11:23:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.451+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=54P2S6QSKH82 tag=GO72BGTUYF24 type=write size=2889870 2024-09-14T11:23:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.452+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=SCKV6H2ZHXAY type=write size=1034424 2024-09-14T11:23:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.453+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=31PPPAM0PNJF type=del size=2429275 2024-09-14T11:23:30.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.455+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=FXBR2JV68UWK type=write size=797079 2024-09-14T11:23:30.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.456+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=8SKSY9IU5R1X type=del size=1181592 2024-09-14T11:23:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.457+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=751QC11YBOKO type=del 2024-09-14T11:23:30.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.459+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=GS6CFGTRVXWM type=write size=918261 2024-09-14T11:23:30.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.460+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=UB1LVUQQ4K08 type=del 2024-09-14T11:23:30.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.462+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=M9MQJEZOBV3M type=del size=1611122 2024-09-14T11:23:30.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.463+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QM6W6CMDQK7A.0 size=1048576 2024-09-14T11:23:30.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.464+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QM6W6CMDQK7A.1 size=923230 2024-09-14T11:23:30.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.466+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=QM6W6CMDQK7A tag=TNZNVM4KPB70 type=write size=3020382 2024-09-14T11:23:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.468+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=NR8VUG934CSY type=del size=1566479 2024-09-14T11:23:30.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.469+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=6OS27LQYGDR5 type=del 2024-09-14T11:23:30.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.470+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=4BJL1694RYEB type=del size=2832194 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.471+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.0 size=1048576 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.471+0000 7f296241c780 1 < canceled part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.1 size=1048576 2024-09-14T11:23:30.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.472+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~54QVK4TPXGQ3.2 size=37841 2024-09-14T11:23:30.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.474+0000 7f296241c780 1 < canceled multipart upload key=KBMD123LTZA7 upload=54QVK4TPXGQ3 tag=QJVKO2Y978O4 type=write size=3183569 2024-09-14T11:23:30.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.475+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=VBRAR8ON9ID5 type=del size=638971 2024-09-14T11:23:30.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.476+0000 7f296241c780 1 < completed write operation key=JH1QJE5V4M9H tag=RA46043FHK7V type=write size=8864 2024-09-14T11:23:30.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.478+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~HRHWDTBAJU2Z.0 size=601077 2024-09-14T11:23:30.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.478+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=HRHWDTBAJU2Z tag=1T036SW2LIZE type=write size=1649653 2024-09-14T11:23:30.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.479+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=OJUH9F3OAGIX type=del 2024-09-14T11:23:30.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.481+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.0 size=1048576 2024-09-14T11:23:30.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.482+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.1 size=1048576 2024-09-14T11:23:30.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.483+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.2 size=717815 2024-09-14T11:23:30.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.483+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=6OCNC0WHW0HQ tag=RMNQFQ9SE3IF type=write size=3863543 2024-09-14T11:23:30.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.484+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~1PI4YJVCKSM4.0 size=28655 2024-09-14T11:23:30.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.486+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=1PI4YJVCKSM4 tag=143AZZY1U6AV type=write size=1077231 2024-09-14T11:23:30.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.488+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~CETGQ5COOKD0.0 size=333741 2024-09-14T11:23:30.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.488+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=CETGQ5COOKD0 tag=SAH6TTWF31PB type=write size=1382317 2024-09-14T11:23:30.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.491+0000 7f296241c780 1 < suggested remove operation key=HZD8WW0H4AAD tag=HL7704ALA06W type=write 2024-09-14T11:23:30.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.492+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=1QJV45HR3FBG type=del size=3770568 2024-09-14T11:23:30.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.493+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=BR3JUHO7X81E type=write size=293983 2024-09-14T11:23:30.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.494+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=1PURTULW6RXU type=del size=2198869 2024-09-14T11:23:30.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.495+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=4CGKIND43ZLP type=write size=1011693 2024-09-14T11:23:30.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.497+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~8TOM5ERAGINL.0 size=1048576 2024-09-14T11:23:30.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.498+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~8TOM5ERAGINL.1 size=991853 2024-09-14T11:23:30.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.498+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=8TOM5ERAGINL tag=TXS32S7TP9M4 type=write size=3089005 2024-09-14T11:23:30.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.500+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~CEZFL5S1UL1D.0 size=547666 2024-09-14T11:23:30.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.502+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=CEZFL5S1UL1D tag=X8R8IJLVQHFZ type=write size=1596242 2024-09-14T11:23:30.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.503+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=LH6K402P8VGO type=del size=1497415 2024-09-14T11:23:30.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.504+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.0 size=1048576 2024-09-14T11:23:30.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.505+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.1 size=1048576 2024-09-14T11:23:30.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.506+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~YRHDMM7VMY78.2 size=215687 2024-09-14T11:23:30.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.508+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=YRHDMM7VMY78 tag=81OZ0XZTOMN4 type=write size=3361415 2024-09-14T11:23:30.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.510+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ZXW86QGAXB1N.0 size=579315 2024-09-14T11:23:30.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.510+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=ZXW86QGAXB1N tag=LJDIHUQ2LOGG type=write size=1627891 2024-09-14T11:23:30.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.511+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~54P2S6QSKH82.0 size=1048576 2024-09-14T11:23:30.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.512+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~54P2S6QSKH82.1 size=792718 2024-09-14T11:23:30.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.514+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=54P2S6QSKH82 tag=GO72BGTUYF24 type=write size=2889870 2024-09-14T11:23:30.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.516+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.0 size=1048576 2024-09-14T11:23:30.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.517+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.1 size=1048576 2024-09-14T11:23:30.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.517+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.2 size=277010 2024-09-14T11:23:30.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.517+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=EMXBHNFSXVUO tag=DDMBL4BWF6BW type=write size=3422738 2024-09-14T11:23:30.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.519+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=31PPPAM0PNJF type=del 2024-09-14T11:23:30.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.520+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=MZ850LL02XLN type=del size=1628361 2024-09-14T11:23:30.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.522+0000 7f296241c780 1 < suggested remove operation key=KVQ49I9RAYXA tag=8SKSY9IU5R1X type=del 2024-09-14T11:23:30.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.523+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=5760ZHP1OFHC type=del size=3863736 2024-09-14T11:23:30.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.525+0000 7f296241c780 1 < suggested update operation key=19TC05N1D5FR tag=GS6CFGTRVXWM type=write size=918261 2024-09-14T11:23:30.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.527+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~8V3VAD07KWS9.0 size=1048576 2024-09-14T11:23:30.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.528+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~8V3VAD07KWS9.1 size=932845 2024-09-14T11:23:30.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.528+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=8V3VAD07KWS9 tag=RFB5MKN8NVIQ type=write size=3029997 2024-09-14T11:23:30.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.529+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=M9MQJEZOBV3M type=del 2024-09-14T11:23:30.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.531+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.0 size=1048576 2024-09-14T11:23:30.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.532+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.1 size=1048576 2024-09-14T11:23:30.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.533+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.2 size=250652 2024-09-14T11:23:30.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.533+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=GJZJYLZA9O35 tag=BO0IZYMBJTUB type=write size=3396380 2024-09-14T11:23:30.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.534+0000 7f296241c780 1 < canceled operation key=0A90ZOC79OWP tag=NR8VUG934CSY type=del size=1566479 2024-09-14T11:23:30.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.537+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~E3PK4EAK0UYS.0 size=468116 2024-09-14T11:23:30.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.537+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=E3PK4EAK0UYS tag=KW8FAUGXWCMC type=write size=1516692 2024-09-14T11:23:30.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.538+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=4BJL1694RYEB type=del 2024-09-14T11:23:30.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.539+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=QNAGZG1AOK1H type=del size=2332476 2024-09-14T11:23:30.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.541+0000 7f296241c780 1 < suggested remove operation key=I6UYPPUMN0FB tag=VBRAR8ON9ID5 type=del 2024-09-14T11:23:30.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.542+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=K1UI86B9LLKK type=del size=2036666 2024-09-14T11:23:30.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.543+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~HRHWDTBAJU2Z.0 size=601077 2024-09-14T11:23:30.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.545+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=HRHWDTBAJU2Z tag=1T036SW2LIZE type=write size=1649653 2024-09-14T11:23:30.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.547+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~CYT2XODTW6UP.0 size=112919 2024-09-14T11:23:30.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.547+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=CYT2XODTW6UP tag=83P8VA3K26I7 type=write size=1161495 2024-09-14T11:23:30.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.548+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.0 size=1048576 2024-09-14T11:23:30.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.549+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.1 size=1048576 2024-09-14T11:23:30.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.549+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~6OCNC0WHW0HQ.2 size=717815 2024-09-14T11:23:30.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.551+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=6OCNC0WHW0HQ tag=RMNQFQ9SE3IF type=write size=3863543 2024-09-14T11:23:30.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.553+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=ITJYX00Z5YGT type=del size=2791194 2024-09-14T11:23:30.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.555+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~CETGQ5COOKD0.0 size=333741 2024-09-14T11:23:30.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.557+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=CETGQ5COOKD0 tag=SAH6TTWF31PB type=write size=1382317 2024-09-14T11:23:30.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.558+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=E1Z7I1FV3ADD type=del size=2260526 2024-09-14T11:23:30.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.559+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=1QJV45HR3FBG type=del 2024-09-14T11:23:30.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.560+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=WK0M3RE4OVTJ type=del size=1751902 2024-09-14T11:23:30.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.561+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=1PURTULW6RXU type=del 2024-09-14T11:23:30.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.563+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.0 size=1048576 2024-09-14T11:23:30.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.564+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.1 size=1048576 2024-09-14T11:23:30.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.565+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.2 size=873535 2024-09-14T11:23:30.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.565+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=F2IE2PBEFT7P tag=AJGAKH7H50G8 type=write size=4019263 2024-09-14T11:23:30.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.566+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~8TOM5ERAGINL.0 size=1048576 2024-09-14T11:23:30.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.567+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~8TOM5ERAGINL.1 size=991853 2024-09-14T11:23:30.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.569+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=8TOM5ERAGINL tag=TXS32S7TP9M4 type=write size=3089005 2024-09-14T11:23:30.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.570+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=DIDVUQ1MNWZ1 type=del size=1092447 2024-09-14T11:23:30.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.571+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=LH6K402P8VGO type=del 2024-09-14T11:23:30.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.572+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=UBNTRFKTZUT2 type=del size=403413 2024-09-14T11:23:30.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.573+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~ZXW86QGAXB1N.0 size=579315 2024-09-14T11:23:30.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.575+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=ZXW86QGAXB1N tag=LJDIHUQ2LOGG type=write size=1627891 2024-09-14T11:23:30.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.577+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.0 size=1048576 2024-09-14T11:23:30.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.578+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.1 size=1048576 2024-09-14T11:23:30.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.579+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.2 size=765474 2024-09-14T11:23:30.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.579+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=4P6ES7VVLFYP tag=BTS78FBVVZTK type=write size=3911202 2024-09-14T11:23:30.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.580+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.0 size=1048576 2024-09-14T11:23:30.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.581+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.1 size=1048576 2024-09-14T11:23:30.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.582+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~EMXBHNFSXVUO.2 size=277010 2024-09-14T11:23:30.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.584+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=EMXBHNFSXVUO tag=DDMBL4BWF6BW type=write size=3422738 2024-09-14T11:23:30.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.585+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=NGSMNZPUTNE1 type=del size=780371 2024-09-14T11:23:30.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.586+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=MZ850LL02XLN type=del 2024-09-14T11:23:30.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.587+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=PUFRPJOWQ9O0 type=del size=1233239 2024-09-14T11:23:30.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.588+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=5760ZHP1OFHC type=del size=3863736 2024-09-14T11:23:30.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.590+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=CCVOW91ZG88C type=del size=640257 2024-09-14T11:23:30.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.591+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~8V3VAD07KWS9.0 size=1048576 2024-09-14T11:23:30.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.592+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~8V3VAD07KWS9.1 size=932845 2024-09-14T11:23:30.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.594+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=8V3VAD07KWS9 tag=RFB5MKN8NVIQ type=write size=3029997 2024-09-14T11:23:30.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.595+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=TYVXPLRPQAX9 type=del size=2106751 2024-09-14T11:23:30.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.596+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.0 size=1048576 2024-09-14T11:23:30.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.597+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.1 size=1048576 2024-09-14T11:23:30.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.598+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GJZJYLZA9O35.2 size=250652 2024-09-14T11:23:30.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.599+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=GJZJYLZA9O35 tag=BO0IZYMBJTUB type=write size=3396380 2024-09-14T11:23:30.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.601+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=J8W32ZRRFCLN type=write size=616372 2024-09-14T11:23:30.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.601+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~E3PK4EAK0UYS.0 size=468116 2024-09-14T11:23:30.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.603+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=E3PK4EAK0UYS tag=KW8FAUGXWCMC type=write size=1516692 2024-09-14T11:23:30.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.604+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=I1SKEF06NSC6 type=del size=2466268 2024-09-14T11:23:30.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.606+0000 7f296241c780 1 < suggested remove operation key=ILOY74OSG5CQ tag=QNAGZG1AOK1H type=del 2024-09-14T11:23:30.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.608+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.0 size=1048576 2024-09-14T11:23:30.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.609+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.1 size=1048576 2024-09-14T11:23:30.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.610+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.2 size=282188 2024-09-14T11:23:30.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.610+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=8KEWE18YQKJH tag=VA808R2BNYN0 type=write size=3427916 2024-09-14T11:23:30.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.612+0000 7f296241c780 1 < suggested update operation key=0A90ZOC79OWP tag=K1UI86B9LLKK type=del size=2036666 2024-09-14T11:23:30.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.613+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=CSFKNRS6R5K7 type=del size=779548 2024-09-14T11:23:30.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.614+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~CYT2XODTW6UP.0 size=112919 2024-09-14T11:23:30.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.616+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=CYT2XODTW6UP tag=83P8VA3K26I7 type=write size=1161495 2024-09-14T11:23:30.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.619+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~TPWFXYQ05JD8.0 size=1048576 2024-09-14T11:23:30.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.619+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~TPWFXYQ05JD8.1 size=315549 2024-09-14T11:23:30.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.619+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=TPWFXYQ05JD8 tag=6SA91MYG1YLP type=write size=2412701 2024-09-14T11:23:30.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.621+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=ITJYX00Z5YGT type=del size=2791194 2024-09-14T11:23:30.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.622+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=JHT42JQCADI0 type=del size=1630848 2024-09-14T11:23:30.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.624+0000 7f296241c780 1 < suggested remove operation key=5N30QR6SN49T tag=E1Z7I1FV3ADD type=del 2024-09-14T11:23:30.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.625+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=D9S1EDQTDZXT type=del size=2953726 2024-09-14T11:23:30.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.627+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=WK0M3RE4OVTJ type=del 2024-09-14T11:23:30.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.628+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=WY2KCOD7J52Q type=del size=1927890 2024-09-14T11:23:30.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.629+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.0 size=1048576 2024-09-14T11:23:30.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.630+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.1 size=1048576 2024-09-14T11:23:30.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.631+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~F2IE2PBEFT7P.2 size=873535 2024-09-14T11:23:30.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.633+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=F2IE2PBEFT7P tag=AJGAKH7H50G8 type=write size=4019263 2024-09-14T11:23:30.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.637+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~KTP9S3L9WU2L.0 size=1048576 2024-09-14T11:23:30.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.638+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~KTP9S3L9WU2L.1 size=385586 2024-09-14T11:23:30.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.638+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=KTP9S3L9WU2L tag=0ESW7V9A0KMX type=write size=2482738 2024-09-14T11:23:30.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.640+0000 7f296241c780 1 < suggested update operation key=KVQ49I9RAYXA tag=DIDVUQ1MNWZ1 type=del size=1092447 2024-09-14T11:23:30.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.641+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=4TNCYC01NDPL type=write size=335030 2024-09-14T11:23:30.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.642+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=UBNTRFKTZUT2 type=del 2024-09-14T11:23:30.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.644+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=C3Z8GEL2QZCL type=del size=3664075 2024-09-14T11:23:30.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.645+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.0 size=1048576 2024-09-14T11:23:30.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.646+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.1 size=1048576 2024-09-14T11:23:30.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.647+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~4P6ES7VVLFYP.2 size=765474 2024-09-14T11:23:30.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.649+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=4P6ES7VVLFYP tag=BTS78FBVVZTK type=write size=3911202 2024-09-14T11:23:30.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.651+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~SAVT06IEUPYW.0 size=1048576 2024-09-14T11:23:30.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.652+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~SAVT06IEUPYW.1 size=652195 2024-09-14T11:23:30.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.652+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=SAVT06IEUPYW tag=L4E5SX4R4FLS type=write size=2749347 2024-09-14T11:23:30.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.653+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=NGSMNZPUTNE1 type=del 2024-09-14T11:23:30.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.654+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=JYHVAID2T4AI type=del size=3620938 2024-09-14T11:23:30.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.656+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=PUFRPJOWQ9O0 type=del size=1233239 2024-09-14T11:23:30.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.658+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~24WZ79YG5TM7.0 size=551743 2024-09-14T11:23:30.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.658+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=24WZ79YG5TM7 tag=1PFXL56205MD type=write size=1600319 2024-09-14T11:23:30.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.661+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=CCVOW91ZG88C type=del size=640257 2024-09-14T11:23:30.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.663+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=UGB54NZVVKQD type=del size=4156188 2024-09-14T11:23:30.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.664+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=TYVXPLRPQAX9 type=del 2024-09-14T11:23:30.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.665+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=KR9U8G6QN0IQ type=del size=3673670 2024-09-14T11:23:30.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.666+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=J8W32ZRRFCLN type=write size=616372 2024-09-14T11:23:30.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.667+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=041DPW3J4ZX1 type=del size=4046992 2024-09-14T11:23:30.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.668+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=I1SKEF06NSC6 type=del size=2466268 2024-09-14T11:23:30.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.670+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~W2XPR7AIO5TA.0 size=928646 2024-09-14T11:23:30.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.670+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=W2XPR7AIO5TA tag=I731ZL2WBKO5 type=write size=1977222 2024-09-14T11:23:30.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.671+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.0 size=1048576 2024-09-14T11:23:30.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.672+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.1 size=1048576 2024-09-14T11:23:30.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.672+0000 7f296241c780 1 < canceled part key=_multipart_QIVVKYC646IH.2~8KEWE18YQKJH.2 size=282188 2024-09-14T11:23:30.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.674+0000 7f296241c780 1 < canceled multipart upload key=QIVVKYC646IH upload=8KEWE18YQKJH tag=VA808R2BNYN0 type=write size=3427916 2024-09-14T11:23:30.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.676+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~VDQTE2VD8WD9.0 size=1048576 2024-09-14T11:23:30.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.677+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~VDQTE2VD8WD9.1 size=705415 2024-09-14T11:23:30.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.677+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=VDQTE2VD8WD9 tag=LCDVYZAGAY9I type=write size=2802567 2024-09-14T11:23:30.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.679+0000 7f296241c780 1 < suggested remove operation key=ILOY74OSG5CQ tag=CSFKNRS6R5K7 type=del 2024-09-14T11:23:30.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.680+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=5G5LSZR1A7HA type=write size=118253 2024-09-14T11:23:30.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.682+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~TPWFXYQ05JD8.0 size=1048576 2024-09-14T11:23:30.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.682+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~TPWFXYQ05JD8.1 size=315549 2024-09-14T11:23:30.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.684+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=TPWFXYQ05JD8 tag=6SA91MYG1YLP type=write size=2412701 2024-09-14T11:23:30.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.686+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=83AEX6JH23V5 type=del size=2813121 2024-09-14T11:23:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.687+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=JHT42JQCADI0 type=del 2024-09-14T11:23:30.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.690+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.0 size=1048576 2024-09-14T11:23:30.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.690+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.1 size=1048576 2024-09-14T11:23:30.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.691+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.2 size=115854 2024-09-14T11:23:30.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.691+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=3D3L1KJPY28F tag=CF5WHLSUSK4M type=write size=3261582 2024-09-14T11:23:30.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.693+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=D9S1EDQTDZXT type=del 2024-09-14T11:23:30.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.694+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=OMG6JAX5G2D4 type=del size=594603 2024-09-14T11:23:30.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.695+0000 7f296241c780 -1 < failed to complete operation key=GJ2Y7ICBEZJX tag=WY2KCOD7J52Q type=del size=1927890: (22) Invalid argument 2024-09-14T11:23:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.696+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=KYL99TJDH95M type=del size=3602703 2024-09-14T11:23:30.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.697+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~KTP9S3L9WU2L.0 size=1048576 2024-09-14T11:23:30.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.698+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~KTP9S3L9WU2L.1 size=385586 2024-09-14T11:23:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.700+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=KTP9S3L9WU2L tag=0ESW7V9A0KMX type=write size=2482738 2024-09-14T11:23:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.702+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~5FV919L8LTFU.0 size=974135 2024-09-14T11:23:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.702+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=5FV919L8LTFU tag=N71LT6AHAKUK type=write size=2022711 2024-09-14T11:23:30.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.703+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=4TNCYC01NDPL type=write size=335030 2024-09-14T11:23:30.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.704+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=HPWZXHCGIK4C type=del size=3750256 2024-09-14T11:23:30.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.705+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=C3Z8GEL2QZCL type=del 2024-09-14T11:23:30.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.707+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=VEIP2GESEE5Y type=del size=3279007 2024-09-14T11:23:30.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.708+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~SAVT06IEUPYW.0 size=1048576 2024-09-14T11:23:30.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.709+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~SAVT06IEUPYW.1 size=652195 2024-09-14T11:23:30.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.711+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=SAVT06IEUPYW tag=L4E5SX4R4FLS type=write size=2749347 2024-09-14T11:23:30.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.713+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.0 size=1048576 2024-09-14T11:23:30.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.714+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.1 size=1048576 2024-09-14T11:23:30.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.715+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.2 size=132778 2024-09-14T11:23:30.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.715+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=JKD1VOLU2XSU tag=CJRKA49PF4IP type=write size=3278506 2024-09-14T11:23:30.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.716+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=JYHVAID2T4AI type=del 2024-09-14T11:23:30.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.718+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~19OT7LGHHMWP.0 size=537115 2024-09-14T11:23:30.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.718+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=19OT7LGHHMWP tag=Z1BNTOMB4DHR type=write size=1585691 2024-09-14T11:23:30.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.719+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~24WZ79YG5TM7.0 size=551743 2024-09-14T11:23:30.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.721+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=24WZ79YG5TM7 tag=1PFXL56205MD type=write size=1600319 2024-09-14T11:23:30.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.722+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=GRON2T8K2642 type=del size=2930109 2024-09-14T11:23:30.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.723+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=UGB54NZVVKQD type=del 2024-09-14T11:23:30.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.725+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.0 size=1048576 2024-09-14T11:23:30.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.726+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.1 size=1048576 2024-09-14T11:23:30.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.727+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.2 size=161408 2024-09-14T11:23:30.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.727+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=I4RXOA0OUIVY tag=X4G8B2IM94TM type=write size=3307136 2024-09-14T11:23:30.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.729+0000 7f296241c780 1 < suggested update operation key=HZD8WW0H4AAD tag=KR9U8G6QN0IQ type=del size=3673670 2024-09-14T11:23:30.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.730+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=5GS0OYOV50AJ type=del size=1403517 2024-09-14T11:23:30.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.732+0000 7f296241c780 1 < canceled operation key=I1XBOS1L5D98 tag=041DPW3J4ZX1 type=del size=4046992 2024-09-14T11:23:30.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.734+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~T5FX8E4VJWJN.0 size=1048576 2024-09-14T11:23:30.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.735+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~T5FX8E4VJWJN.1 size=128699 2024-09-14T11:23:30.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.735+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=T5FX8E4VJWJN tag=YF92L5A8FY7V type=write size=2225851 2024-09-14T11:23:30.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.736+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~W2XPR7AIO5TA.0 size=928646 2024-09-14T11:23:30.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.738+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=W2XPR7AIO5TA tag=I731ZL2WBKO5 type=write size=1977222 2024-09-14T11:23:30.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.740+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.0 size=1048576 2024-09-14T11:23:30.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.741+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.1 size=1048576 2024-09-14T11:23:30.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.742+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.2 size=809980 2024-09-14T11:23:30.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.742+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=QOSH6VC7JN8Y tag=GAIXV722UQE3 type=write size=3955708 2024-09-14T11:23:30.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.743+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~VDQTE2VD8WD9.0 size=1048576 2024-09-14T11:23:30.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.743+0000 7f296241c780 1 < canceled part key=_multipart_3T0SINQVBAGF.2~VDQTE2VD8WD9.1 size=705415 2024-09-14T11:23:30.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.745+0000 7f296241c780 1 < canceled multipart upload key=3T0SINQVBAGF upload=VDQTE2VD8WD9 tag=LCDVYZAGAY9I type=write size=2802567 2024-09-14T11:23:30.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.746+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=ZNYG6EI8PB6J type=del size=3840650 2024-09-14T11:23:30.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.747+0000 7f296241c780 -1 < failed to complete operation key=HZD8WW0H4AAD tag=5G5LSZR1A7HA type=write size=118253: (22) Invalid argument 2024-09-14T11:23:30.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.749+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~6ZVZIRQTSVSB.0 size=1048576 2024-09-14T11:23:30.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.750+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~6ZVZIRQTSVSB.1 size=693805 2024-09-14T11:23:30.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.750+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=6ZVZIRQTSVSB tag=Y2WB2S3MLJVT type=write size=2790957 2024-09-14T11:23:30.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.751+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=83AEX6JH23V5 type=del 2024-09-14T11:23:30.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.754+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~TR84RF4O7K9D.0 size=1048576 2024-09-14T11:23:30.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.755+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~TR84RF4O7K9D.1 size=618422 2024-09-14T11:23:30.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.755+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=TR84RF4O7K9D tag=IIBBYVS9Q789 type=write size=2715574 2024-09-14T11:23:30.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.756+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.0 size=1048576 2024-09-14T11:23:30.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.757+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.1 size=1048576 2024-09-14T11:23:30.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.757+0000 7f296241c780 1 < canceled part key=_multipart_QIVVKYC646IH.2~3D3L1KJPY28F.2 size=115854 2024-09-14T11:23:30.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.759+0000 7f296241c780 1 < canceled multipart upload key=QIVVKYC646IH upload=3D3L1KJPY28F tag=CF5WHLSUSK4M type=write size=3261582 2024-09-14T11:23:30.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.761+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~P8P1KQJS74K3.0 size=1048576 2024-09-14T11:23:30.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.762+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~P8P1KQJS74K3.1 size=936255 2024-09-14T11:23:30.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.762+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=P8P1KQJS74K3 tag=0VSF4VXISNV6 type=write size=3033407 2024-09-14T11:23:30.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.763+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=OMG6JAX5G2D4 type=del 2024-09-14T11:23:30.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.764+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=9C8FP3KGA8D6 type=del size=2622805 2024-09-14T11:23:30.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.765+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=KYL99TJDH95M type=del 2024-09-14T11:23:30.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.766+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=4PGB44HW0901 type=write size=370929 2024-09-14T11:23:30.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.768+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~5FV919L8LTFU.0 size=974135 2024-09-14T11:23:30.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.770+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=5FV919L8LTFU tag=N71LT6AHAKUK type=write size=2022711 2024-09-14T11:23:30.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.771+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=UBU82N8QYQY0 type=write size=372461 2024-09-14T11:23:30.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.773+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=HPWZXHCGIK4C type=del 2024-09-14T11:23:30.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.775+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~C1E491XSN26J.0 size=1048576 2024-09-14T11:23:30.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.775+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~C1E491XSN26J.1 size=454792 2024-09-14T11:23:30.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.775+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=C1E491XSN26J tag=G8B5DHUUO3PB type=write size=2551944 2024-09-14T11:23:30.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.777+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=VEIP2GESEE5Y type=del 2024-09-14T11:23:30.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.778+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=308VN4JXSIYH type=del size=311631 2024-09-14T11:23:30.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.779+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.0 size=1048576 2024-09-14T11:23:30.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.779+0000 7f296241c780 1 < canceled part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.1 size=1048576 2024-09-14T11:23:30.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.780+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~JKD1VOLU2XSU.2 size=132778 2024-09-14T11:23:30.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.782+0000 7f296241c780 1 < canceled multipart upload key=ILOY74OSG5CQ upload=JKD1VOLU2XSU tag=CJRKA49PF4IP type=write size=3278506 2024-09-14T11:23:30.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.783+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=5XO5BTDE86SJ type=del size=2793025 2024-09-14T11:23:30.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.783+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~19OT7LGHHMWP.0 size=537115 2024-09-14T11:23:30.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.785+0000 7f296241c780 1 < canceled multipart upload key=I6UYPPUMN0FB upload=19OT7LGHHMWP tag=Z1BNTOMB4DHR type=write size=1585691 2024-09-14T11:23:30.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.787+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~5C7AO7HRYNYO.0 size=1007078 2024-09-14T11:23:30.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.787+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=5C7AO7HRYNYO tag=F7F0BQH16GGY type=write size=2055654 2024-09-14T11:23:30.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.789+0000 7f296241c780 1 < suggested update operation key=R1M982MUIF44 tag=GRON2T8K2642 type=del size=2930109 2024-09-14T11:23:30.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.790+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=4I75IEJOJ623 type=write size=44982 2024-09-14T11:23:30.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.791+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.0 size=1048576 2024-09-14T11:23:30.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.792+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.1 size=1048576 2024-09-14T11:23:30.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.793+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~I4RXOA0OUIVY.2 size=161408 2024-09-14T11:23:30.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.795+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=I4RXOA0OUIVY tag=X4G8B2IM94TM type=write size=3307136 2024-09-14T11:23:30.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.796+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~3T0WS6O0XGV1.0 size=480956 2024-09-14T11:23:30.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.796+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=3T0WS6O0XGV1 tag=AAZH7OA7JRS4 type=write size=1529532 2024-09-14T11:23:30.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.797+0000 7f296241c780 1 < canceled operation key=JW3RIVHUFGPI tag=5GS0OYOV50AJ type=del size=1403517 2024-09-14T11:23:30.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.801+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~YCXG3H6XHYNW.0 size=1048576 2024-09-14T11:23:30.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.802+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~YCXG3H6XHYNW.1 size=1009776 2024-09-14T11:23:30.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.802+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=YCXG3H6XHYNW tag=ZOTWNH3NPDAT type=write size=3106928 2024-09-14T11:23:30.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.804+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~T5FX8E4VJWJN.0 size=1048576 2024-09-14T11:23:30.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.805+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~T5FX8E4VJWJN.1 size=128699 2024-09-14T11:23:30.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.807+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=T5FX8E4VJWJN tag=YF92L5A8FY7V type=write size=2225851 2024-09-14T11:23:30.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.809+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.0 size=1048576 2024-09-14T11:23:30.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.810+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.1 size=1048576 2024-09-14T11:23:30.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.811+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.2 size=1018001 2024-09-14T11:23:30.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.811+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=WN8236MV3T8W tag=WU4Q0G3TIDBE type=write size=4163729 2024-09-14T11:23:30.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.812+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.0 size=1048576 2024-09-14T11:23:30.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.813+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.1 size=1048576 2024-09-14T11:23:30.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.814+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~QOSH6VC7JN8Y.2 size=809980 2024-09-14T11:23:30.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.816+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=QOSH6VC7JN8Y tag=GAIXV722UQE3 type=write size=3955708 2024-09-14T11:23:30.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.817+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=089DJ1L19K94 type=del size=616919 2024-09-14T11:23:30.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.820+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=ZNYG6EI8PB6J type=del 2024-09-14T11:23:30.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.821+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=61J3UNWSIP76 type=del size=3812115 2024-09-14T11:23:30.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.823+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~6ZVZIRQTSVSB.0 size=1048576 2024-09-14T11:23:30.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.823+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~6ZVZIRQTSVSB.1 size=693805 2024-09-14T11:23:30.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.825+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=6ZVZIRQTSVSB tag=Y2WB2S3MLJVT type=write size=2790957 2024-09-14T11:23:30.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.827+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=S2WXKL9JYFZY type=del size=2237453 2024-09-14T11:23:30.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.828+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~TR84RF4O7K9D.0 size=1048576 2024-09-14T11:23:30.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.829+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~TR84RF4O7K9D.1 size=618422 2024-09-14T11:23:30.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.831+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=TR84RF4O7K9D tag=IIBBYVS9Q789 type=write size=2715574 2024-09-14T11:23:30.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.832+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=5F27RK14EI0L type=del size=205487 2024-09-14T11:23:30.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.833+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~P8P1KQJS74K3.0 size=1048576 2024-09-14T11:23:30.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.834+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~P8P1KQJS74K3.1 size=936255 2024-09-14T11:23:30.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.836+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=P8P1KQJS74K3 tag=0VSF4VXISNV6 type=write size=3033407 2024-09-14T11:23:30.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.838+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~UXLWDMN7245A.0 size=1048576 2024-09-14T11:23:30.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.839+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~UXLWDMN7245A.1 size=568455 2024-09-14T11:23:30.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.839+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=UXLWDMN7245A tag=TV1VFYASNB9E type=write size=2665607 2024-09-14T11:23:30.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.840+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=9C8FP3KGA8D6 type=del 2024-09-14T11:23:30.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.842+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~7LUFAM4OWTWH.0 size=339302 2024-09-14T11:23:30.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.842+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=7LUFAM4OWTWH tag=UF7PAOSENLEK type=write size=1387878 2024-09-14T11:23:30.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.843+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=4PGB44HW0901 type=write size=370929 2024-09-14T11:23:30.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.844+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=DHWP4LD2MIGG type=write size=347185 2024-09-14T11:23:30.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.846+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=UBU82N8QYQY0 type=write size=372461 2024-09-14T11:23:30.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.847+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=8MIRARJSOFHM type=del size=3822951 2024-09-14T11:23:30.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.847+0000 7f296241c780 1 < canceled part key=_multipart_KBMD123LTZA7.2~C1E491XSN26J.0 size=1048576 2024-09-14T11:23:30.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.848+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~C1E491XSN26J.1 size=454792 2024-09-14T11:23:30.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.852+0000 7f296241c780 1 < canceled multipart upload key=KBMD123LTZA7 upload=C1E491XSN26J tag=G8B5DHUUO3PB type=write size=2551944 2024-09-14T11:23:30.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.853+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=8N0ANIBS3O2V type=del size=714911 2024-09-14T11:23:30.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.855+0000 7f296241c780 1 < suggested update operation key=CQU8M12JCE9T tag=308VN4JXSIYH type=del size=311631 2024-09-14T11:23:30.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.858+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.0 size=1048576 2024-09-14T11:23:30.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.859+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.1 size=1048576 2024-09-14T11:23:30.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.860+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.2 size=31776 2024-09-14T11:23:30.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.860+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=A3CXW7TJ4EQ2 tag=H987OQV082YM type=write size=3177504 2024-09-14T11:23:30.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.861+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=5XO5BTDE86SJ type=del 2024-09-14T11:23:30.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.862+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=7W8XPHQRL7JG type=write size=507212 2024-09-14T11:23:30.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.863+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~5C7AO7HRYNYO.0 size=1007078 2024-09-14T11:23:30.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.866+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=5C7AO7HRYNYO tag=F7F0BQH16GGY type=write size=2055654 2024-09-14T11:23:30.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.868+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~Y53CKJFK599F.0 size=1048576 2024-09-14T11:23:30.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.869+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~Y53CKJFK599F.1 size=48400 2024-09-14T11:23:30.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.869+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=Y53CKJFK599F tag=G5OYMQL0DU6S type=write size=2145552 2024-09-14T11:23:30.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.870+0000 7f296241c780 1 < completed write operation key=I1XBOS1L5D98 tag=4I75IEJOJ623 type=write size=44982 2024-09-14T11:23:30.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.872+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=KG1AJLSZOKH5 type=del size=4149085 2024-09-14T11:23:30.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.873+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~3T0WS6O0XGV1.0 size=480956 2024-09-14T11:23:30.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.875+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=3T0WS6O0XGV1 tag=AAZH7OA7JRS4 type=write size=1529532 2024-09-14T11:23:30.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.876+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=FLGVKQV9XO1O type=del size=2126437 2024-09-14T11:23:30.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.877+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~YCXG3H6XHYNW.0 size=1048576 2024-09-14T11:23:30.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.878+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~YCXG3H6XHYNW.1 size=1009776 2024-09-14T11:23:30.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.881+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=YCXG3H6XHYNW tag=ZOTWNH3NPDAT type=write size=3106928 2024-09-14T11:23:30.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.882+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=UYO68FJSHVT9 type=del size=3435381 2024-09-14T11:23:30.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.882+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.0 size=1048576 2024-09-14T11:23:30.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.883+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.1 size=1048576 2024-09-14T11:23:30.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.884+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~WN8236MV3T8W.2 size=1018001 2024-09-14T11:23:30.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.886+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=WN8236MV3T8W tag=WU4Q0G3TIDBE type=write size=4163729 2024-09-14T11:23:30.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.887+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=H73ZJX9VGOW0 type=write size=268577 2024-09-14T11:23:30.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.890+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=089DJ1L19K94 type=del size=616919 2024-09-14T11:23:30.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.891+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=CJHGK4256B3Q type=del size=3547273 2024-09-14T11:23:30.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.893+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=61J3UNWSIP76 type=del 2024-09-14T11:23:30.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.894+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=G61AWME34BCI type=write size=29800 2024-09-14T11:23:30.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.896+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=S2WXKL9JYFZY type=del size=2237453 2024-09-14T11:23:30.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.898+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=V53YGJ7U1DMO type=del size=1475304 2024-09-14T11:23:30.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.900+0000 7f296241c780 1 < suggested update operation key=KBMD123LTZA7 tag=5F27RK14EI0L type=del size=205487 2024-09-14T11:23:30.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.901+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=SDV7E8HLHO1Q type=del size=108194 2024-09-14T11:23:30.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.903+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~UXLWDMN7245A.0 size=1048576 2024-09-14T11:23:30.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.903+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~UXLWDMN7245A.1 size=568455 2024-09-14T11:23:30.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.905+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=UXLWDMN7245A tag=TV1VFYASNB9E type=write size=2665607 2024-09-14T11:23:30.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.906+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=KSO3BAZ67V77 type=del size=2600690 2024-09-14T11:23:30.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.907+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~7LUFAM4OWTWH.0 size=339302 2024-09-14T11:23:30.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.909+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=7LUFAM4OWTWH tag=UF7PAOSENLEK type=write size=1387878 2024-09-14T11:23:30.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.910+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=VMC5117200HB type=del size=2313513 2024-09-14T11:23:30.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.911+0000 7f296241c780 1 < completed write operation key=HZD8WW0H4AAD tag=DHWP4LD2MIGG type=write size=347185 2024-09-14T11:23:30.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.912+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=RKPUJ029TP4X type=del size=691208 2024-09-14T11:23:30.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.914+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=8MIRARJSOFHM type=del 2024-09-14T11:23:30.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.916+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~PK4LM4NF02H3.0 size=1048576 2024-09-14T11:23:30.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.917+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~PK4LM4NF02H3.1 size=255349 2024-09-14T11:23:30.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.917+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=PK4LM4NF02H3 tag=DVC2SN23VMDI type=write size=2352501 2024-09-14T11:23:30.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.919+0000 7f296241c780 1 < suggested remove operation key=L8NA53KOAT58 tag=8N0ANIBS3O2V type=del 2024-09-14T11:23:30.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.921+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OTG1MB0UP7VN.0 size=53580 2024-09-14T11:23:30.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.921+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=OTG1MB0UP7VN tag=32FCD236GUIO type=write size=1102156 2024-09-14T11:23:30.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.923+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.0 size=1048576 2024-09-14T11:23:30.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.924+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.1 size=1048576 2024-09-14T11:23:30.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.925+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~A3CXW7TJ4EQ2.2 size=31776 2024-09-14T11:23:30.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.927+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=A3CXW7TJ4EQ2 tag=H987OQV082YM type=write size=3177504 2024-09-14T11:23:30.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.928+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=G2YF8T3698EM type=del size=409123 2024-09-14T11:23:30.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.930+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=7W8XPHQRL7JG type=write size=507212 2024-09-14T11:23:30.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.931+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=LDNJVYDI67I9 type=del size=756868 2024-09-14T11:23:30.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.932+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~Y53CKJFK599F.0 size=1048576 2024-09-14T11:23:30.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.933+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~Y53CKJFK599F.1 size=48400 2024-09-14T11:23:30.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.935+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=Y53CKJFK599F tag=G5OYMQL0DU6S type=write size=2145552 2024-09-14T11:23:30.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.936+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=QYE6O0TA97NG type=del size=856328 2024-09-14T11:23:30.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.937+0000 7f296241c780 -1 < failed to complete operation key=K61XH5E6TF3Y tag=KG1AJLSZOKH5 type=del size=4149085: (22) Invalid argument 2024-09-14T11:23:30.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.939+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~OBHH1ZM4QA75.0 size=2710 2024-09-14T11:23:30.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.939+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=OBHH1ZM4QA75 tag=80JQKPMZ0690 type=write size=1051286 2024-09-14T11:23:30.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.940+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=FLGVKQV9XO1O type=del 2024-09-14T11:23:30.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.942+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~SGUN2CZKL4UU.0 size=933129 2024-09-14T11:23:30.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.942+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=SGUN2CZKL4UU tag=25NOPTORSSJI type=write size=1981705 2024-09-14T11:23:30.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.943+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=UYO68FJSHVT9 type=del 2024-09-14T11:23:30.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.945+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.0 size=1048576 2024-09-14T11:23:30.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.946+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.1 size=1048576 2024-09-14T11:23:30.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.947+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.2 size=417675 2024-09-14T11:23:30.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.947+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=X8X6BAZISN7S tag=YZAQEP6FYQ36 type=write size=3563403 2024-09-14T11:23:30.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.948+0000 7f296241c780 1 < canceled operation key=C1T4CLU3400T tag=H73ZJX9VGOW0 type=write size=268577 2024-09-14T11:23:30.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.949+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=LKIES0VOZ1RE type=del size=3874507 2024-09-14T11:23:30.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.952+0000 7f296241c780 1 < suggested remove operation key=GJ2Y7ICBEZJX tag=CJHGK4256B3Q type=del 2024-09-14T11:23:30.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.954+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.0 size=1048576 2024-09-14T11:23:30.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.955+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.1 size=1048576 2024-09-14T11:23:30.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.956+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.2 size=847215 2024-09-14T11:23:30.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.956+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=VIS9PWSYKMTF tag=H6I9R4K1N713 type=write size=3992943 2024-09-14T11:23:30.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.957+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=G61AWME34BCI type=write size=29800 2024-09-14T11:23:30.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.958+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=C0XA08X7TST0 type=del size=2353656 2024-09-14T11:23:30.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.959+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=V53YGJ7U1DMO type=del 2024-09-14T11:23:30.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.960+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=AH1G6GYAUVSR type=del size=1447199 2024-09-14T11:23:30.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.961+0000 7f296241c780 -1 < failed to complete operation key=GJ2Y7ICBEZJX tag=SDV7E8HLHO1Q type=del size=108194: (22) Invalid argument 2024-09-14T11:23:30.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.962+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=93RZAJNBH2LA type=del size=4005745 2024-09-14T11:23:30.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.963+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=KSO3BAZ67V77 type=del size=2600690 2024-09-14T11:23:30.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.965+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.0 size=1048576 2024-09-14T11:23:30.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.966+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.1 size=1048576 2024-09-14T11:23:30.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.967+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.2 size=490390 2024-09-14T11:23:30.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.967+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=3G7KR5URTXC2 tag=Y4SI39N2QA1G type=write size=3636118 2024-09-14T11:23:30.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.969+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=VMC5117200HB type=del 2024-09-14T11:23:30.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.971+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~NN5VWP6LMPCP.0 size=797974 2024-09-14T11:23:30.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.971+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=NN5VWP6LMPCP tag=YYN260AZQLCQ type=write size=1846550 2024-09-14T11:23:30.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.972+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=RKPUJ029TP4X type=del 2024-09-14T11:23:30.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.974+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~6XN1ON2OPGVW.0 size=217328 2024-09-14T11:23:30.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.974+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=6XN1ON2OPGVW tag=4B6MHE9NRYGO type=write size=1265904 2024-09-14T11:23:30.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.975+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~PK4LM4NF02H3.0 size=1048576 2024-09-14T11:23:30.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.976+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~PK4LM4NF02H3.1 size=255349 2024-09-14T11:23:30.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.978+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=PK4LM4NF02H3 tag=DVC2SN23VMDI type=write size=2352501 2024-09-14T11:23:30.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.979+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=BHAE0PGWI3AW type=del size=3508553 2024-09-14T11:23:30.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.980+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OTG1MB0UP7VN.0 size=53580 2024-09-14T11:23:30.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.982+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=OTG1MB0UP7VN tag=32FCD236GUIO type=write size=1102156 2024-09-14T11:23:30.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.984+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.0 size=1048576 2024-09-14T11:23:30.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.985+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.1 size=1048576 2024-09-14T11:23:30.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.986+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.2 size=422455 2024-09-14T11:23:30.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.986+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=YCXZF4YQMSXQ tag=7L643AO4H11F type=write size=3568183 2024-09-14T11:23:30.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.990+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=G2YF8T3698EM type=del size=409123 2024-09-14T11:23:30.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.992+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~8FE92FSPMBBE.0 size=1048576 2024-09-14T11:23:30.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.993+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~8FE92FSPMBBE.1 size=606812 2024-09-14T11:23:30.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.993+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=8FE92FSPMBBE tag=HK1GJQON3Y2D type=write size=2703964 2024-09-14T11:23:30.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.994+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=LDNJVYDI67I9 type=del 2024-09-14T11:23:30.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.996+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~IHABO29WWNJ6.0 size=1048576 2024-09-14T11:23:30.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.997+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~IHABO29WWNJ6.1 size=775365 2024-09-14T11:23:30.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.997+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=IHABO29WWNJ6 tag=OGB7G64UTZHD type=write size=2872517 2024-09-14T11:23:30.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.998+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=QYE6O0TA97NG type=del 2024-09-14T11:23:30.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.999+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=ST9KVFJCX2AP type=del size=2021135 2024-09-14T11:23:30.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:30.999+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~OBHH1ZM4QA75.0 size=2710 2024-09-14T11:23:31.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.204+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=OBHH1ZM4QA75 tag=80JQKPMZ0690 type=write size=1051286 2024-09-14T11:23:31.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.206+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.0 size=1048576 2024-09-14T11:23:31.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.207+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.1 size=1048576 2024-09-14T11:23:31.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.208+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.2 size=775534 2024-09-14T11:23:31.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.208+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=4WLNLPUVEH6Z tag=C73BE7N494O0 type=write size=3921262 2024-09-14T11:23:31.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.210+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~SGUN2CZKL4UU.0 size=933129 2024-09-14T11:23:31.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.212+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=SGUN2CZKL4UU tag=25NOPTORSSJI type=write size=1981705 2024-09-14T11:23:31.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.214+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~7A27AGOIZ27N.0 size=808912 2024-09-14T11:23:31.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.214+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=7A27AGOIZ27N tag=ET9NZ8S6AU07 type=write size=1857488 2024-09-14T11:23:31.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.215+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.0 size=1048576 2024-09-14T11:23:31.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.215+0000 7f296241c780 1 < canceled part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.1 size=1048576 2024-09-14T11:23:31.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.215+0000 7f296241c780 1 < canceled part key=_multipart_0A90ZOC79OWP.2~X8X6BAZISN7S.2 size=417675 2024-09-14T11:23:31.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.217+0000 7f296241c780 1 < canceled multipart upload key=0A90ZOC79OWP upload=X8X6BAZISN7S tag=YZAQEP6FYQ36 type=write size=3563403 2024-09-14T11:23:31.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.219+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=L6P8SGBIFVVF type=del size=1245783 2024-09-14T11:23:31.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.221+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=LKIES0VOZ1RE type=del 2024-09-14T11:23:31.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.223+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=BBXMVPVANII4 type=write size=229191 2024-09-14T11:23:31.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.224+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.0 size=1048576 2024-09-14T11:23:31.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.224+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.1 size=1048576 2024-09-14T11:23:31.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.225+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~VIS9PWSYKMTF.2 size=847215 2024-09-14T11:23:31.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.227+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=VIS9PWSYKMTF tag=H6I9R4K1N713 type=write size=3992943 2024-09-14T11:23:31.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.229+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.0 size=1048576 2024-09-14T11:23:31.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.230+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.1 size=1048576 2024-09-14T11:23:31.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.231+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.2 size=498369 2024-09-14T11:23:31.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.231+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=6XA6EI0E96SC tag=3SIXSRBWVWFB type=write size=3644097 2024-09-14T11:23:31.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.233+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=C0XA08X7TST0 type=del 2024-09-14T11:23:31.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.235+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.0 size=1048576 2024-09-14T11:23:31.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.236+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.1 size=1048576 2024-09-14T11:23:31.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.236+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.2 size=1043467 2024-09-14T11:23:31.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.236+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=EEG1SEZHD3FV tag=78C8HHQHPMG6 type=write size=4189195 2024-09-14T11:23:31.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.238+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=AH1G6GYAUVSR type=del 2024-09-14T11:23:31.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.240+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~HWF1K786VHN5.0 size=1048576 2024-09-14T11:23:31.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.241+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~HWF1K786VHN5.1 size=344023 2024-09-14T11:23:31.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.241+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=HWF1K786VHN5 tag=6OBDNMCR5FT3 type=write size=2441175 2024-09-14T11:23:31.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.242+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=93RZAJNBH2LA type=del 2024-09-14T11:23:31.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.244+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~EHP7C8YHE8DS.0 size=1048576 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.245+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~EHP7C8YHE8DS.1 size=36180 2024-09-14T11:23:31.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.245+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=EHP7C8YHE8DS tag=ZKQA94NY554G type=write size=2133332 2024-09-14T11:23:31.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.246+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.0 size=1048576 2024-09-14T11:23:31.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.247+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.1 size=1048576 2024-09-14T11:23:31.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.247+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~3G7KR5URTXC2.2 size=490390 2024-09-14T11:23:31.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.250+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=3G7KR5URTXC2 tag=Y4SI39N2QA1G type=write size=3636118 2024-09-14T11:23:31.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.252+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.0 size=1048576 2024-09-14T11:23:31.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.253+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.1 size=1048576 2024-09-14T11:23:31.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.254+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.2 size=670198 2024-09-14T11:23:31.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.254+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=U9EFICBJTB6P tag=9IRAT1T3W2WV type=write size=3815926 2024-09-14T11:23:31.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.255+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~NN5VWP6LMPCP.0 size=797974 2024-09-14T11:23:31.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.257+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=NN5VWP6LMPCP tag=YYN260AZQLCQ type=write size=1846550 2024-09-14T11:23:31.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.258+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=9TPLOD106QAY type=del size=1306537 2024-09-14T11:23:31.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.259+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~6XN1ON2OPGVW.0 size=217328 2024-09-14T11:23:31.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.261+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=6XN1ON2OPGVW tag=4B6MHE9NRYGO type=write size=1265904 2024-09-14T11:23:31.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.262+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=ZV1CIVLFOG2M type=del size=103454 2024-09-14T11:23:31.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.264+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=BHAE0PGWI3AW type=del 2024-09-14T11:23:31.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.265+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=YJZ6SJ01IOF3 type=del size=3402772 2024-09-14T11:23:31.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.266+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.0 size=1048576 2024-09-14T11:23:31.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.267+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.1 size=1048576 2024-09-14T11:23:31.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.268+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~YCXZF4YQMSXQ.2 size=422455 2024-09-14T11:23:31.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.270+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=YCXZF4YQMSXQ tag=7L643AO4H11F type=write size=3568183 2024-09-14T11:23:31.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.271+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=JYVXIOQSNOLS type=del size=2784293 2024-09-14T11:23:31.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.272+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~8FE92FSPMBBE.0 size=1048576 2024-09-14T11:23:31.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.273+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~8FE92FSPMBBE.1 size=606812 2024-09-14T11:23:31.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.275+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=8FE92FSPMBBE tag=HK1GJQON3Y2D type=write size=2703964 2024-09-14T11:23:31.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.276+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=DTOVIAFSVX7U type=del size=2733526 2024-09-14T11:23:31.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.278+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~IHABO29WWNJ6.0 size=1048576 2024-09-14T11:23:31.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.279+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~IHABO29WWNJ6.1 size=775365 2024-09-14T11:23:31.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.280+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=IHABO29WWNJ6 tag=OGB7G64UTZHD type=write size=2872517 2024-09-14T11:23:31.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.283+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.0 size=1048576 2024-09-14T11:23:31.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.283+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.1 size=1048576 2024-09-14T11:23:31.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.284+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.2 size=110404 2024-09-14T11:23:31.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.284+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=90H58DA1J9KB tag=AHXDEJUBFCIU type=write size=3256132 2024-09-14T11:23:31.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.287+0000 7f296241c780 1 < suggested update operation key=HZD8WW0H4AAD tag=ST9KVFJCX2AP type=del size=2021135 2024-09-14T11:23:31.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.288+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=RP5Z0DSFLH5X type=write size=428840 2024-09-14T11:23:31.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.288+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.0 size=1048576 2024-09-14T11:23:31.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.289+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.1 size=1048576 2024-09-14T11:23:31.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.290+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~4WLNLPUVEH6Z.2 size=775534 2024-09-14T11:23:31.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.292+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=4WLNLPUVEH6Z tag=C73BE7N494O0 type=write size=3921262 2024-09-14T11:23:31.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.294+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=PBZXFRTYXEJN type=del size=1136872 2024-09-14T11:23:31.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.295+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~7A27AGOIZ27N.0 size=808912 2024-09-14T11:23:31.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.297+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=7A27AGOIZ27N tag=ET9NZ8S6AU07 type=write size=1857488 2024-09-14T11:23:31.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.299+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~GMGSEC0JT7F5.0 size=490551 2024-09-14T11:23:31.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.299+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=GMGSEC0JT7F5 tag=Q6M6BKPZEKCX type=write size=1539127 2024-09-14T11:23:31.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.300+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=L6P8SGBIFVVF type=del 2024-09-14T11:23:31.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.302+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=COWPNA5ZKWW0 type=del size=2936453 2024-09-14T11:23:31.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.303+0000 7f296241c780 1 < completed write operation key=O35OFLNOZ488 tag=BBXMVPVANII4 type=write size=229191 2024-09-14T11:23:31.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.306+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~Y7RT9KT3ELNL.0 size=413211 2024-09-14T11:23:31.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.306+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=Y7RT9KT3ELNL tag=80U5MH8231VB type=write size=1461787 2024-09-14T11:23:31.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.306+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.0 size=1048576 2024-09-14T11:23:31.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.307+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.1 size=1048576 2024-09-14T11:23:31.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.308+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~6XA6EI0E96SC.2 size=498369 2024-09-14T11:23:31.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.309+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=6XA6EI0E96SC tag=3SIXSRBWVWFB type=write size=3644097 2024-09-14T11:23:31.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.311+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=GLW67F3WTDAI type=del size=3644056 2024-09-14T11:23:31.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.312+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.0 size=1048576 2024-09-14T11:23:31.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.313+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.1 size=1048576 2024-09-14T11:23:31.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.313+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~EEG1SEZHD3FV.2 size=1043467 2024-09-14T11:23:31.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.315+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=EEG1SEZHD3FV tag=78C8HHQHPMG6 type=write size=4189195 2024-09-14T11:23:31.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.316+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=7F8IS102KWU6 type=del size=3095102 2024-09-14T11:23:31.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.318+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~HWF1K786VHN5.0 size=1048576 2024-09-14T11:23:31.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.319+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~HWF1K786VHN5.1 size=344023 2024-09-14T11:23:31.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.321+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=HWF1K786VHN5 tag=6OBDNMCR5FT3 type=write size=2441175 2024-09-14T11:23:31.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.322+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=ECCO81CMDLPT type=del size=2253077 2024-09-14T11:23:31.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.323+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~EHP7C8YHE8DS.0 size=1048576 2024-09-14T11:23:31.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.324+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~EHP7C8YHE8DS.1 size=36180 2024-09-14T11:23:31.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.326+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=EHP7C8YHE8DS tag=ZKQA94NY554G type=write size=2133332 2024-09-14T11:23:31.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.328+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.0 size=1048576 2024-09-14T11:23:31.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.329+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.1 size=1048576 2024-09-14T11:23:31.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.330+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.2 size=57021 2024-09-14T11:23:31.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.330+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=V6O8PA7C07ZS tag=ZMBST2FPOIHD type=write size=3202749 2024-09-14T11:23:31.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.331+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.0 size=1048576 2024-09-14T11:23:31.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.332+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.1 size=1048576 2024-09-14T11:23:31.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.333+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~U9EFICBJTB6P.2 size=670198 2024-09-14T11:23:31.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.335+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=U9EFICBJTB6P tag=9IRAT1T3W2WV type=write size=3815926 2024-09-14T11:23:31.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.337+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.0 size=1048576 2024-09-14T11:23:31.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.338+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.1 size=1048576 2024-09-14T11:23:31.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.339+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.2 size=978367 2024-09-14T11:23:31.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.339+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=QWVXT99XY9VA tag=L4BPJN3HCULZ type=write size=4124095 2024-09-14T11:23:31.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.340+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=9TPLOD106QAY type=del 2024-09-14T11:23:31.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.341+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=FV15FDCOTT1J type=write size=559440 2024-09-14T11:23:31.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.343+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=ZV1CIVLFOG2M type=del 2024-09-14T11:23:31.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.345+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.0 size=1048576 2024-09-14T11:23:31.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.346+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.1 size=1048576 2024-09-14T11:23:31.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.347+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.2 size=962148 2024-09-14T11:23:31.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.347+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=BJ5081A2T8GZ tag=1H8CRNPWLUQM type=write size=4107876 2024-09-14T11:23:31.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.348+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=YJZ6SJ01IOF3 type=del 2024-09-14T11:23:31.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.349+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=WTAF8COAA3J0 type=del size=2048863 2024-09-14T11:23:31.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.350+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=JYVXIOQSNOLS type=del 2024-09-14T11:23:31.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.353+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~IIQ0W7Q03O21.0 size=1048576 2024-09-14T11:23:31.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.354+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~IIQ0W7Q03O21.1 size=524193 2024-09-14T11:23:31.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.354+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=IIQ0W7Q03O21 tag=T5EV1FQV3T87 type=write size=2621345 2024-09-14T11:23:31.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.355+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=DTOVIAFSVX7U type=del 2024-09-14T11:23:31.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.356+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=7FIEA1MLV4PY type=del size=2522846 2024-09-14T11:23:31.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.357+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.0 size=1048576 2024-09-14T11:23:31.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.358+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.1 size=1048576 2024-09-14T11:23:31.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.360+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~90H58DA1J9KB.2 size=110404 2024-09-14T11:23:31.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.362+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=90H58DA1J9KB tag=AHXDEJUBFCIU type=write size=3256132 2024-09-14T11:23:31.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.364+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~6981DXT6ECXB.0 size=1048576 2024-09-14T11:23:31.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.365+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~6981DXT6ECXB.1 size=440919 2024-09-14T11:23:31.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.365+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=6981DXT6ECXB tag=8ILHTWKF2T8N type=write size=2538071 2024-09-14T11:23:31.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.366+0000 7f296241c780 1 < completed write operation key=5XAAGDKVBZ0P tag=RP5Z0DSFLH5X type=write size=428840 2024-09-14T11:23:31.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.367+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=MZ4ARMZZI9VM type=del size=47789 2024-09-14T11:23:31.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.370+0000 7f296241c780 1 < suggested update operation key=O35OFLNOZ488 tag=PBZXFRTYXEJN type=del size=1136872 2024-09-14T11:23:31.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.372+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~7FOQ2I84T7DE.0 size=701551 2024-09-14T11:23:31.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.372+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=7FOQ2I84T7DE tag=OX1NLRLPPOYL type=write size=1750127 2024-09-14T11:23:31.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.373+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~GMGSEC0JT7F5.0 size=490551 2024-09-14T11:23:31.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.375+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=GMGSEC0JT7F5 tag=Q6M6BKPZEKCX type=write size=1539127 2024-09-14T11:23:31.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.377+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~Y4YTUWNXXMUU.0 size=58634 2024-09-14T11:23:31.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.377+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=Y4YTUWNXXMUU tag=Y4W4D47FOVUA type=write size=1107210 2024-09-14T11:23:31.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.378+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=COWPNA5ZKWW0 type=del size=2936453 2024-09-14T11:23:31.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.380+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~SOSUS0DKYNA4.0 size=747791 2024-09-14T11:23:31.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.380+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=SOSUS0DKYNA4 tag=OF0LWBL7Q7H2 type=write size=1796367 2024-09-14T11:23:31.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.381+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~Y7RT9KT3ELNL.0 size=413211 2024-09-14T11:23:31.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.383+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=Y7RT9KT3ELNL tag=80U5MH8231VB type=write size=1461787 2024-09-14T11:23:31.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.384+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=JH2B8HLJPZB0 type=del size=2325717 2024-09-14T11:23:31.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.386+0000 7f296241c780 1 < suggested update operation key=XTS8B3LEW0Y3 tag=GLW67F3WTDAI type=del size=3644056 2024-09-14T11:23:31.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.389+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.0 size=1048576 2024-09-14T11:23:31.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.390+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.1 size=1048576 2024-09-14T11:23:31.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.390+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.2 size=256853 2024-09-14T11:23:31.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.390+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=OVU0VRQOTLRY tag=GKSJ8DW21M9A type=write size=3402581 2024-09-14T11:23:31.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.392+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=7F8IS102KWU6 type=del 2024-09-14T11:23:31.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.394+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~6X2GDJE1GJIB.0 size=234465 2024-09-14T11:23:31.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.394+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=6X2GDJE1GJIB tag=Q3S3L3BN7RHK type=write size=1283041 2024-09-14T11:23:31.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.396+0000 7f296241c780 1 < suggested remove operation key=K61XH5E6TF3Y tag=ECCO81CMDLPT type=del 2024-09-14T11:23:31.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.397+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=T6FE5SL74Y41 type=del size=1165940 2024-09-14T11:23:31.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.399+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.0 size=1048576 2024-09-14T11:23:31.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.399+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.1 size=1048576 2024-09-14T11:23:31.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.400+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~V6O8PA7C07ZS.2 size=57021 2024-09-14T11:23:31.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.402+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=V6O8PA7C07ZS tag=ZMBST2FPOIHD type=write size=3202749 2024-09-14T11:23:31.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.403+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=SPJBBZBNOZOL type=write size=697263 2024-09-14T11:23:31.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.405+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.0 size=1048576 2024-09-14T11:23:31.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.406+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.1 size=1048576 2024-09-14T11:23:31.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.407+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~QWVXT99XY9VA.2 size=978367 2024-09-14T11:23:31.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.409+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=QWVXT99XY9VA tag=L4BPJN3HCULZ type=write size=4124095 2024-09-14T11:23:31.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.410+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=OEXY3V2Q3CBX type=del size=3236738 2024-09-14T11:23:31.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.412+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=FV15FDCOTT1J type=write size=559440 2024-09-14T11:23:31.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.414+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~7LJKTCVSH042.0 size=659292 2024-09-14T11:23:31.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.414+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=7LJKTCVSH042 tag=X2G9GOA7LOG4 type=write size=1707868 2024-09-14T11:23:31.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.415+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.0 size=1048576 2024-09-14T11:23:31.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.416+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.1 size=1048576 2024-09-14T11:23:31.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.417+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~BJ5081A2T8GZ.2 size=962148 2024-09-14T11:23:31.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.418+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=BJ5081A2T8GZ tag=1H8CRNPWLUQM type=write size=4107876 2024-09-14T11:23:31.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.419+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=6NH4W6XGUVC6 type=del size=2481227 2024-09-14T11:23:31.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.422+0000 7f296241c780 1 < suggested update operation key=L8NA53KOAT58 tag=WTAF8COAA3J0 type=del size=2048863 2024-09-14T11:23:31.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.423+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=8ZNQ1970BQ70 type=write size=867478 2024-09-14T11:23:31.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.424+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~IIQ0W7Q03O21.0 size=1048576 2024-09-14T11:23:31.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.425+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~IIQ0W7Q03O21.1 size=524193 2024-09-14T11:23:31.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.427+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=IIQ0W7Q03O21 tag=T5EV1FQV3T87 type=write size=2621345 2024-09-14T11:23:31.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.429+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ORC2EJM9Y6FS.0 size=1048576 2024-09-14T11:23:31.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.430+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ORC2EJM9Y6FS.1 size=592171 2024-09-14T11:23:31.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.430+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=ORC2EJM9Y6FS tag=7MTZK6RR83DO type=write size=2689323 2024-09-14T11:23:31.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.431+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=7FIEA1MLV4PY type=del 2024-09-14T11:23:31.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.433+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.0 size=1048576 2024-09-14T11:23:31.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.434+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.1 size=1048576 2024-09-14T11:23:31.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.435+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.2 size=709449 2024-09-14T11:23:31.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.435+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=RO8KJJ6UO0NF tag=XCV6II8ED7YO type=write size=3855177 2024-09-14T11:23:31.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.436+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~6981DXT6ECXB.0 size=1048576 2024-09-14T11:23:31.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.437+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~6981DXT6ECXB.1 size=440919 2024-09-14T11:23:31.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.439+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=6981DXT6ECXB tag=8ILHTWKF2T8N type=write size=2538071 2024-09-14T11:23:31.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.440+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=UPK9HB958D9B type=del size=2124154 2024-09-14T11:23:31.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.441+0000 7f296241c780 1 < canceled operation key=ILOY74OSG5CQ tag=MZ4ARMZZI9VM type=del size=47789 2024-09-14T11:23:31.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.443+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~32NK2YEVO363.0 size=691078 2024-09-14T11:23:31.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.443+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=32NK2YEVO363 tag=H6U1TS59B66E type=write size=1739654 2024-09-14T11:23:31.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.445+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~7FOQ2I84T7DE.0 size=701551 2024-09-14T11:23:31.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.447+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=7FOQ2I84T7DE tag=OX1NLRLPPOYL type=write size=1750127 2024-09-14T11:23:31.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.448+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=GG7VV82JH4IA type=write size=973863 2024-09-14T11:23:31.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.449+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~Y4YTUWNXXMUU.0 size=58634 2024-09-14T11:23:31.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.451+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=Y4YTUWNXXMUU tag=Y4W4D47FOVUA type=write size=1107210 2024-09-14T11:23:31.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.453+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=WXDY323DD7C7 type=del size=67871 2024-09-14T11:23:31.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.454+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~SOSUS0DKYNA4.0 size=747791 2024-09-14T11:23:31.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.456+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=SOSUS0DKYNA4 tag=OF0LWBL7Q7H2 type=write size=1796367 2024-09-14T11:23:31.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.457+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=4MA6C0QTYFRX type=del size=2789977 2024-09-14T11:23:31.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.458+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=JH2B8HLJPZB0 type=del 2024-09-14T11:23:31.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.459+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=X8EG4WYYGUWJ type=del size=3279470 2024-09-14T11:23:31.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.460+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.0 size=1048576 2024-09-14T11:23:31.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.461+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.1 size=1048576 2024-09-14T11:23:31.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.462+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~OVU0VRQOTLRY.2 size=256853 2024-09-14T11:23:31.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.464+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=OVU0VRQOTLRY tag=GKSJ8DW21M9A type=write size=3402581 2024-09-14T11:23:31.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.466+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7LOJHO9GJ4QT.0 size=1048576 2024-09-14T11:23:31.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.467+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7LOJHO9GJ4QT.1 size=437 2024-09-14T11:23:31.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.467+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=7LOJHO9GJ4QT tag=7855ZJS229BJ type=write size=2097589 2024-09-14T11:23:31.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.468+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~6X2GDJE1GJIB.0 size=234465 2024-09-14T11:23:31.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.470+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=6X2GDJE1GJIB tag=Q3S3L3BN7RHK type=write size=1283041 2024-09-14T11:23:31.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.471+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=NSGCU4LCNKBY type=del size=1649781 2024-09-14T11:23:31.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.472+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=T6FE5SL74Y41 type=del 2024-09-14T11:23:31.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.473+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=8XTFGQ5EKD7F type=del size=3030584 2024-09-14T11:23:31.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.476+0000 7f296241c780 1 < suggested update operation key=ILOY74OSG5CQ tag=SPJBBZBNOZOL type=write size=697263 2024-09-14T11:23:31.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.477+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=60AWM1H6FY71 type=write size=53319 2024-09-14T11:23:31.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.480+0000 7f296241c780 1 < suggested remove operation key=TNT7E4GX5ZR7 tag=OEXY3V2Q3CBX type=del 2024-09-14T11:23:31.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.482+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.0 size=1048576 2024-09-14T11:23:31.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.482+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.1 size=1048576 2024-09-14T11:23:31.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.483+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.2 size=96492 2024-09-14T11:23:31.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.483+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=7SK40VND0KIG tag=S704T6EGQA03 type=write size=3242220 2024-09-14T11:23:31.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.484+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~7LJKTCVSH042.0 size=659292 2024-09-14T11:23:31.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.486+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=7LJKTCVSH042 tag=X2G9GOA7LOG4 type=write size=1707868 2024-09-14T11:23:31.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.488+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~7KH57AR4LTZA.0 size=239901 2024-09-14T11:23:31.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.488+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=7KH57AR4LTZA tag=4G1K1PLSXKG9 type=write size=1288477 2024-09-14T11:23:31.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.490+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=6NH4W6XGUVC6 type=del 2024-09-14T11:23:31.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.492+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.0 size=1048576 2024-09-14T11:23:31.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.493+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.1 size=1048576 2024-09-14T11:23:31.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.494+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.2 size=946277 2024-09-14T11:23:31.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.494+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=T2OQEGQ419TH tag=LF5YD6VSGCJC type=write size=4092005 2024-09-14T11:23:31.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.495+0000 7f296241c780 1 < canceled operation key=QL439L2X13OR tag=8ZNQ1970BQ70 type=write size=867478 2024-09-14T11:23:31.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.497+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.0 size=1048576 2024-09-14T11:23:31.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.498+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.1 size=1048576 2024-09-14T11:23:31.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.499+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.2 size=175308 2024-09-14T11:23:31.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.499+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=ZZCDFXZT7TDA tag=E2NP902KHSRN type=write size=3321036 2024-09-14T11:23:31.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.500+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ORC2EJM9Y6FS.0 size=1048576 2024-09-14T11:23:31.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.501+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ORC2EJM9Y6FS.1 size=592171 2024-09-14T11:23:31.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.504+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=ORC2EJM9Y6FS tag=7MTZK6RR83DO type=write size=2689323 2024-09-14T11:23:31.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.505+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=LHQS8J4N539A type=del size=3601181 2024-09-14T11:23:31.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.506+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.0 size=1048576 2024-09-14T11:23:31.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.507+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.1 size=1048576 2024-09-14T11:23:31.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.508+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~RO8KJJ6UO0NF.2 size=709449 2024-09-14T11:23:31.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.511+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=RO8KJJ6UO0NF tag=XCV6II8ED7YO type=write size=3855177 2024-09-14T11:23:31.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.512+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=FEFUJFV4593O type=del size=4187506 2024-09-14T11:23:31.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.513+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=UPK9HB958D9B type=del 2024-09-14T11:23:31.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.514+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=757FV75HMNWH type=write size=245363 2024-09-14T11:23:31.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.516+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~32NK2YEVO363.0 size=691078 2024-09-14T11:23:31.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.519+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=32NK2YEVO363 tag=H6U1TS59B66E type=write size=1739654 2024-09-14T11:23:31.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.521+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~66TF8QQT0YE3.0 size=1048576 2024-09-14T11:23:31.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.522+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~66TF8QQT0YE3.1 size=332364 2024-09-14T11:23:31.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.522+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=66TF8QQT0YE3 tag=WVNKSM0XN20Z type=write size=2429516 2024-09-14T11:23:31.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.523+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=GG7VV82JH4IA type=write size=973863 2024-09-14T11:23:31.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.526+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~QGSJ9TW83KCT.0 size=530344 2024-09-14T11:23:31.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.526+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=QGSJ9TW83KCT tag=PDHIO79JCWUU type=write size=1578920 2024-09-14T11:23:31.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.527+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=WXDY323DD7C7 type=del 2024-09-14T11:23:31.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.529+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.0 size=1048576 2024-09-14T11:23:31.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.530+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.1 size=1048576 2024-09-14T11:23:31.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.531+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.2 size=962091 2024-09-14T11:23:31.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.531+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=LJTNH7U18T7J tag=LB36TNC3LLKK type=write size=4107819 2024-09-14T11:23:31.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.533+0000 7f296241c780 1 < suggested remove operation key=7WGFBTAM25J9 tag=4MA6C0QTYFRX type=del 2024-09-14T11:23:31.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.535+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~2AFV4WIH4XKW.0 size=440207 2024-09-14T11:23:31.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.535+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=2AFV4WIH4XKW tag=EIPXG7VQEMLP type=write size=1488783 2024-09-14T11:23:31.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.536+0000 7f296241c780 1 < canceled operation key=GJ2Y7ICBEZJX tag=X8EG4WYYGUWJ type=del size=3279470 2024-09-14T11:23:31.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.538+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.0 size=1048576 2024-09-14T11:23:31.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.539+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.1 size=1048576 2024-09-14T11:23:31.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.540+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.2 size=515199 2024-09-14T11:23:31.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.540+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=15296J3WES1S tag=YYJGRPPAI6ZM type=write size=3660927 2024-09-14T11:23:31.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.540+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~7LOJHO9GJ4QT.0 size=1048576 2024-09-14T11:23:31.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.541+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~7LOJHO9GJ4QT.1 size=437 2024-09-14T11:23:31.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.543+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=7LOJHO9GJ4QT tag=7855ZJS229BJ type=write size=2097589 2024-09-14T11:23:31.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.544+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=1B3JQAS93A0G type=del size=3075379 2024-09-14T11:23:31.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.547+0000 7f296241c780 1 < suggested remove operation key=KBMD123LTZA7 tag=NSGCU4LCNKBY type=del 2024-09-14T11:23:31.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.548+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=2C39941S6H8Q type=del size=4009131 2024-09-14T11:23:31.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.549+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=8XTFGQ5EKD7F type=del 2024-09-14T11:23:31.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.551+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.0 size=1048576 2024-09-14T11:23:31.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.552+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.1 size=1048576 2024-09-14T11:23:31.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.553+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.2 size=778262 2024-09-14T11:23:31.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.553+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=1A3V30O7LS2S tag=NE37KYGT30ZD type=write size=3923990 2024-09-14T11:23:31.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.555+0000 7f296241c780 1 < suggested update operation key=ILOY74OSG5CQ tag=60AWM1H6FY71 type=write size=53319 2024-09-14T11:23:31.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.557+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~932DQ01VQZ2M.0 size=705716 2024-09-14T11:23:31.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.557+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=932DQ01VQZ2M tag=O0NBK1BYKGUA type=write size=1754292 2024-09-14T11:23:31.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.558+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.0 size=1048576 2024-09-14T11:23:31.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.559+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.1 size=1048576 2024-09-14T11:23:31.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.560+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~7SK40VND0KIG.2 size=96492 2024-09-14T11:23:31.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.562+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=7SK40VND0KIG tag=S704T6EGQA03 type=write size=3242220 2024-09-14T11:23:31.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.565+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~9FOMCRSPXV7H.0 size=1048576 2024-09-14T11:23:31.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.565+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~9FOMCRSPXV7H.1 size=654047 2024-09-14T11:23:31.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.565+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=9FOMCRSPXV7H tag=DUN886BM0BFN type=write size=2751199 2024-09-14T11:23:31.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.567+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~7KH57AR4LTZA.0 size=239901 2024-09-14T11:23:31.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.569+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=7KH57AR4LTZA tag=4G1K1PLSXKG9 type=write size=1288477 2024-09-14T11:23:31.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.571+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~LD71U9NL7SQ2.0 size=1048576 2024-09-14T11:23:31.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.572+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~LD71U9NL7SQ2.1 size=1030736 2024-09-14T11:23:31.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.572+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=LD71U9NL7SQ2 tag=POCP23JMN08J type=write size=3127888 2024-09-14T11:23:31.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.573+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.0 size=1048576 2024-09-14T11:23:31.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.573+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.1 size=1048576 2024-09-14T11:23:31.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.574+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~T2OQEGQ419TH.2 size=946277 2024-09-14T11:23:31.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.576+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=T2OQEGQ419TH tag=LF5YD6VSGCJC type=write size=4092005 2024-09-14T11:23:31.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.578+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~KCQBR7GRSDSR.0 size=647498 2024-09-14T11:23:31.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.578+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=KCQBR7GRSDSR tag=GBC063P2V1FN type=write size=1696074 2024-09-14T11:23:31.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.578+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.0 size=1048576 2024-09-14T11:23:31.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.579+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.1 size=1048576 2024-09-14T11:23:31.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.580+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~ZZCDFXZT7TDA.2 size=175308 2024-09-14T11:23:31.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.582+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=ZZCDFXZT7TDA tag=E2NP902KHSRN type=write size=3321036 2024-09-14T11:23:31.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.583+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=N7HCY3HD1LR5 type=del size=4052886 2024-09-14T11:23:31.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.584+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=LHQS8J4N539A type=del 2024-09-14T11:23:31.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.585+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=XB5RL00PDO92 type=del size=2898530 2024-09-14T11:23:31.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.587+0000 7f296241c780 1 < canceled operation key=5XAAGDKVBZ0P tag=FEFUJFV4593O type=del size=4187506 2024-09-14T11:23:31.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.588+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.0 size=1048576 2024-09-14T11:23:31.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.589+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.1 size=1048576 2024-09-14T11:23:31.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.590+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.2 size=450470 2024-09-14T11:23:31.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.590+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=GEWV2N0N3389 tag=I7M6O35PK1G0 type=write size=3596198 2024-09-14T11:23:31.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.592+0000 7f296241c780 1 < suggested update operation key=0A90ZOC79OWP tag=757FV75HMNWH type=write size=245363 2024-09-14T11:23:31.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.593+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=83H61UU8LLYC type=write size=149909 2024-09-14T11:23:31.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.594+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~66TF8QQT0YE3.0 size=1048576 2024-09-14T11:23:31.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.596+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~66TF8QQT0YE3.1 size=332364 2024-09-14T11:23:31.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.598+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=66TF8QQT0YE3 tag=WVNKSM0XN20Z type=write size=2429516 2024-09-14T11:23:31.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.600+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~PWEOA1XFI91K.0 size=1029896 2024-09-14T11:23:31.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.600+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=PWEOA1XFI91K tag=84Y38LVJZV2K type=write size=2078472 2024-09-14T11:23:31.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.601+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~QGSJ9TW83KCT.0 size=530344 2024-09-14T11:23:31.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.603+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=QGSJ9TW83KCT tag=PDHIO79JCWUU type=write size=1578920 2024-09-14T11:23:31.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.604+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=ENI5N6HXSP7Y type=write size=249632 2024-09-14T11:23:31.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.606+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.0 size=1048576 2024-09-14T11:23:31.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.607+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.1 size=1048576 2024-09-14T11:23:31.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.608+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~LJTNH7U18T7J.2 size=962091 2024-09-14T11:23:31.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.610+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=LJTNH7U18T7J tag=LB36TNC3LLKK type=write size=4107819 2024-09-14T11:23:31.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.612+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~6KRZ61EY7RJ7.0 size=1048576 2024-09-14T11:23:31.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.613+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~6KRZ61EY7RJ7.1 size=219527 2024-09-14T11:23:31.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.613+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=6KRZ61EY7RJ7 tag=BK8FSLCSC7KH type=write size=2316679 2024-09-14T11:23:31.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.613+0000 7f296241c780 1 < canceled part key=_multipart_CQU8M12JCE9T.2~2AFV4WIH4XKW.0 size=440207 2024-09-14T11:23:31.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.615+0000 7f296241c780 1 < canceled multipart upload key=CQU8M12JCE9T upload=2AFV4WIH4XKW tag=EIPXG7VQEMLP type=write size=1488783 2024-09-14T11:23:31.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.616+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=GRZ3U18IH18K type=del size=2506662 2024-09-14T11:23:31.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.617+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.0 size=1048576 2024-09-14T11:23:31.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.618+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.1 size=1048576 2024-09-14T11:23:31.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.619+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~15296J3WES1S.2 size=515199 2024-09-14T11:23:31.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.621+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=15296J3WES1S tag=YYJGRPPAI6ZM type=write size=3660927 2024-09-14T11:23:31.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.622+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=EWX7MI3H9UQY type=write size=37171 2024-09-14T11:23:31.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.624+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=1B3JQAS93A0G type=del 2024-09-14T11:23:31.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.626+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~CT2YTOWUV41D.0 size=1048576 2024-09-14T11:23:31.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.627+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~CT2YTOWUV41D.1 size=7098 2024-09-14T11:23:31.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.627+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=CT2YTOWUV41D tag=TYH9IE1T46N0 type=write size=2104250 2024-09-14T11:23:31.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.628+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=2C39941S6H8Q type=del 2024-09-14T11:23:31.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.629+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=IR4KBRHL5778 type=write size=843335 2024-09-14T11:23:31.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.630+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.0 size=1048576 2024-09-14T11:23:31.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.631+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.1 size=1048576 2024-09-14T11:23:31.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.632+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~1A3V30O7LS2S.2 size=778262 2024-09-14T11:23:31.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.635+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=1A3V30O7LS2S tag=NE37KYGT30ZD type=write size=3923990 2024-09-14T11:23:31.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.637+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.0 size=1048576 2024-09-14T11:23:31.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.638+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.1 size=1048576 2024-09-14T11:23:31.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.639+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.2 size=407083 2024-09-14T11:23:31.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.639+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=BZAZPEUY7O3N tag=A7329XIAHQ0F type=write size=3552811 2024-09-14T11:23:31.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.640+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~932DQ01VQZ2M.0 size=705716 2024-09-14T11:23:31.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.642+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=932DQ01VQZ2M tag=O0NBK1BYKGUA type=write size=1754292 2024-09-14T11:23:31.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.643+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=T7H3PFRL83QF type=del size=3504392 2024-09-14T11:23:31.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.643+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~9FOMCRSPXV7H.0 size=1048576 2024-09-14T11:23:31.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.644+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~9FOMCRSPXV7H.1 size=654047 2024-09-14T11:23:31.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.646+0000 7f296241c780 1 < canceled multipart upload key=I6UYPPUMN0FB upload=9FOMCRSPXV7H tag=DUN886BM0BFN type=write size=2751199 2024-09-14T11:23:31.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.648+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~WHZUKYI5YEH8.0 size=884375 2024-09-14T11:23:31.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.648+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=WHZUKYI5YEH8 tag=0T4VKDHMGPPP type=write size=1932951 2024-09-14T11:23:31.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.649+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~LD71U9NL7SQ2.0 size=1048576 2024-09-14T11:23:31.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.650+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~LD71U9NL7SQ2.1 size=1030736 2024-09-14T11:23:31.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.652+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=LD71U9NL7SQ2 tag=POCP23JMN08J type=write size=3127888 2024-09-14T11:23:31.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.653+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=ZH1OXCJRNQQ4 type=del size=4062985 2024-09-14T11:23:31.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.654+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~KCQBR7GRSDSR.0 size=647498 2024-09-14T11:23:31.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.656+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=KCQBR7GRSDSR tag=GBC063P2V1FN type=write size=1696074 2024-09-14T11:23:31.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.658+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~LMCHF79MOFQU.0 size=1048576 2024-09-14T11:23:31.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.659+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~LMCHF79MOFQU.1 size=358218 2024-09-14T11:23:31.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.659+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=LMCHF79MOFQU tag=WLSL7K4W6YC7 type=write size=2455370 2024-09-14T11:23:31.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.660+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=N7HCY3HD1LR5 type=del 2024-09-14T11:23:31.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.661+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=VRKVJH2REQ07 type=del size=2394888 2024-09-14T11:23:31.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.663+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=XB5RL00PDO92 type=del 2024-09-14T11:23:31.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.664+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=1JWEVBPT29DW type=del size=3059844 2024-09-14T11:23:31.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.665+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.0 size=1048576 2024-09-14T11:23:31.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.665+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.1 size=1048576 2024-09-14T11:23:31.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.666+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GEWV2N0N3389.2 size=450470 2024-09-14T11:23:31.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.668+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=GEWV2N0N3389 tag=I7M6O35PK1G0 type=write size=3596198 2024-09-14T11:23:31.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.669+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=B8TR4J8WZO66 type=del size=1008340 2024-09-14T11:23:31.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.670+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=83H61UU8LLYC type=write size=149909 2024-09-14T11:23:31.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.672+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~MQYTAMGY79GK.0 size=1048576 2024-09-14T11:23:31.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.673+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~MQYTAMGY79GK.1 size=982682 2024-09-14T11:23:31.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.673+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=MQYTAMGY79GK tag=LUIISL8GAMBV type=write size=3079834 2024-09-14T11:23:31.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.674+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~PWEOA1XFI91K.0 size=1029896 2024-09-14T11:23:31.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.676+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=PWEOA1XFI91K tag=84Y38LVJZV2K type=write size=2078472 2024-09-14T11:23:31.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.677+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=FFDYHYMOQY1I type=del size=3546306 2024-09-14T11:23:31.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.678+0000 7f296241c780 1 < completed write operation key=HFH3VKZ4T0IR tag=ENI5N6HXSP7Y type=write size=249632 2024-09-14T11:23:31.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.679+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=2F5PZ37QENJX type=del size=248536 2024-09-14T11:23:31.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.680+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~6KRZ61EY7RJ7.0 size=1048576 2024-09-14T11:23:31.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.681+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~6KRZ61EY7RJ7.1 size=219527 2024-09-14T11:23:31.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.683+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=6KRZ61EY7RJ7 tag=BK8FSLCSC7KH type=write size=2316679 2024-09-14T11:23:31.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.684+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=NXC25I2WSGHN type=del size=352260 2024-09-14T11:23:31.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.685+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=GRZ3U18IH18K type=del 2024-09-14T11:23:31.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.687+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~E7B895SCYRFD.0 size=1048576 2024-09-14T11:23:31.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.688+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~E7B895SCYRFD.1 size=160838 2024-09-14T11:23:31.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.688+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=E7B895SCYRFD tag=0W11UN3TFMWJ type=write size=2257990 2024-09-14T11:23:31.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.689+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=EWX7MI3H9UQY type=write size=37171 2024-09-14T11:23:31.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.690+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=5QOK0T44PT50 type=del size=432869 2024-09-14T11:23:31.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.691+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~CT2YTOWUV41D.0 size=1048576 2024-09-14T11:23:31.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.692+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~CT2YTOWUV41D.1 size=7098 2024-09-14T11:23:31.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.694+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=CT2YTOWUV41D tag=TYH9IE1T46N0 type=write size=2104250 2024-09-14T11:23:31.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.696+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~X224478WTJRC.0 size=40753 2024-09-14T11:23:31.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.696+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=X224478WTJRC tag=EIWYFI1G6FJS type=write size=1089329 2024-09-14T11:23:31.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.697+0000 7f296241c780 1 < completed write operation key=QL439L2X13OR tag=IR4KBRHL5778 type=write size=843335 2024-09-14T11:23:31.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.698+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=DDKOEZNC43P9 type=del size=2874260 2024-09-14T11:23:31.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.700+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.0 size=1048576 2024-09-14T11:23:31.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.701+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.1 size=1048576 2024-09-14T11:23:31.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.701+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~BZAZPEUY7O3N.2 size=407083 2024-09-14T11:23:31.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.703+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=BZAZPEUY7O3N tag=A7329XIAHQ0F type=write size=3552811 2024-09-14T11:23:31.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.705+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=NY6323TMH7EC type=del size=1431712 2024-09-14T11:23:31.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.706+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=T7H3PFRL83QF type=del 2024-09-14T11:23:31.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.707+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=SM7ZEMQ1PBXC type=del size=2547515 2024-09-14T11:23:31.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.709+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~WHZUKYI5YEH8.0 size=884375 2024-09-14T11:23:31.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.711+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=WHZUKYI5YEH8 tag=0T4VKDHMGPPP type=write size=1932951 2024-09-14T11:23:31.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.712+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=G6OO354MDPKD type=del size=153935 2024-09-14T11:23:31.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.713+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=ZH1OXCJRNQQ4 type=del 2024-09-14T11:23:31.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.714+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=XAFUR50WRM7Q type=write size=424136 2024-09-14T11:23:31.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.715+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~LMCHF79MOFQU.0 size=1048576 2024-09-14T11:23:31.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.716+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~LMCHF79MOFQU.1 size=358218 2024-09-14T11:23:31.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.718+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=LMCHF79MOFQU tag=WLSL7K4W6YC7 type=write size=2455370 2024-09-14T11:23:31.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.719+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=788ROBS476SP type=del size=3692081 2024-09-14T11:23:31.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.720+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=VRKVJH2REQ07 type=del 2024-09-14T11:23:31.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.722+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.0 size=1048576 2024-09-14T11:23:31.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.723+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.1 size=1048576 2024-09-14T11:23:31.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.724+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.2 size=763755 2024-09-14T11:23:31.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.724+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=94W0TPXC5QDL tag=9SN8Q8MR9GDE type=write size=3909483 2024-09-14T11:23:31.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.725+0000 7f296241c780 1 < canceled operation key=R1M982MUIF44 tag=1JWEVBPT29DW type=del size=3059844 2024-09-14T11:23:31.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.726+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=W8XXU4NCQPDC type=del size=1943291 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.727+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=B8TR4J8WZO66 type=del 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.729+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=R4JULUIMFVOG type=del size=3384226 2024-09-14T11:23:31.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.731+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~MQYTAMGY79GK.0 size=1048576 2024-09-14T11:23:31.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.731+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~MQYTAMGY79GK.1 size=982682 2024-09-14T11:23:31.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.733+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=MQYTAMGY79GK tag=LUIISL8GAMBV type=write size=3079834 2024-09-14T11:23:31.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.735+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~3U5GH5CF40G5.0 size=1048576 2024-09-14T11:23:31.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.736+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~3U5GH5CF40G5.1 size=546124 2024-09-14T11:23:31.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.736+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=3U5GH5CF40G5 tag=5GRI0O2AAF5V type=write size=2643276 2024-09-14T11:23:31.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.738+0000 7f296241c780 1 < suggested update operation key=HFH3VKZ4T0IR tag=FFDYHYMOQY1I type=del size=3546306 2024-09-14T11:23:31.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.739+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=ZXHIKJRQJ9EJ type=del size=1444003 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.740+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=2F5PZ37QENJX type=del 2024-09-14T11:23:31.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.742+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.0 size=1048576 2024-09-14T11:23:31.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.743+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.1 size=1048576 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.744+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.2 size=806061 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.744+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=ENXFQFUVTOVV tag=7LVISNB97YLD type=write size=3951789 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.746+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=NXC25I2WSGHN type=del 2024-09-14T11:23:31.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.747+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=0Q3WB5VRXKVU type=del size=3197979 2024-09-14T11:23:31.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.748+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~E7B895SCYRFD.0 size=1048576 2024-09-14T11:23:31.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.749+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~E7B895SCYRFD.1 size=160838 2024-09-14T11:23:31.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.751+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=E7B895SCYRFD tag=0W11UN3TFMWJ type=write size=2257990 2024-09-14T11:23:31.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.753+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~NU73E7S1106V.0 size=1048576 2024-09-14T11:23:31.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.754+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~NU73E7S1106V.1 size=654387 2024-09-14T11:23:31.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.754+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=NU73E7S1106V tag=68BELIQFSJP7 type=write size=2751539 2024-09-14T11:23:31.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.756+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=5QOK0T44PT50 type=del size=432869 2024-09-14T11:23:31.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.757+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=GVGWYQE51OKG type=write size=486699 2024-09-14T11:23:31.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.758+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~X224478WTJRC.0 size=40753 2024-09-14T11:23:31.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.760+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=X224478WTJRC tag=EIWYFI1G6FJS type=write size=1089329 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.762+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.0 size=1048576 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.763+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.1 size=1048576 2024-09-14T11:23:31.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.764+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.2 size=898089 2024-09-14T11:23:31.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.764+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=W8682C20HJ1O tag=7LSA9B2B1K34 type=write size=4043817 2024-09-14T11:23:31.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.765+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=DDKOEZNC43P9 type=del 2024-09-14T11:23:31.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.767+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.0 size=1048576 2024-09-14T11:23:31.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.768+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.1 size=1048576 2024-09-14T11:23:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.769+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.2 size=424701 2024-09-14T11:23:31.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.769+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=L4BH9KMJN9GL tag=XM9G0T428I3I type=write size=3570429 2024-09-14T11:23:31.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.771+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=NY6323TMH7EC type=del size=1431712 2024-09-14T11:23:31.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.772+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=IFEXI6HS1JUK type=del size=294011 2024-09-14T11:23:31.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.773+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=SM7ZEMQ1PBXC type=del 2024-09-14T11:23:31.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.775+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~EH8WVL4GT87D.0 size=1048576 2024-09-14T11:23:31.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.776+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~EH8WVL4GT87D.1 size=962302 2024-09-14T11:23:31.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.776+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=EH8WVL4GT87D tag=64VNJ3AI97U0 type=write size=3059454 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.777+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=G6OO354MDPKD type=del 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.779+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.0 size=1048576 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.780+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.1 size=1048576 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.781+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.2 size=935933 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.781+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=K3W5YHTNYODQ tag=ZN7BKFMZA5UR type=write size=4081661 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.782+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=XAFUR50WRM7Q type=write size=424136 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.783+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=8KW10LI9PFMW type=del size=4130311 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.786+0000 7f296241c780 1 < suggested remove operation key=O35OFLNOZ488 tag=788ROBS476SP type=del 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.788+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~R6WPDQ5B05Z2.0 size=1048576 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.788+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~R6WPDQ5B05Z2.1 size=393962 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.788+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=R6WPDQ5B05Z2 tag=DHKZ4Y6PV0V7 type=write size=2491114 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.790+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.0 size=1048576 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.790+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.1 size=1048576 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.791+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~94W0TPXC5QDL.2 size=763755 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.793+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=94W0TPXC5QDL tag=9SN8Q8MR9GDE type=write size=3909483 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.794+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=6YIZQD2YCMEH type=del size=3500518 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.795+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=W8XXU4NCQPDC type=del 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.797+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=F9MD0K33NI0R type=del size=2630787 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.797+0000 7f296241c780 -1 < no bi entry to suggest for operation key=O35OFLNOZ488 tag=R4JULUIMFVOG type=del size=3384226: (2) No such file or directory 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.798+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=28U0MLJ7RXPC type=del size=1890157 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.799+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~3U5GH5CF40G5.0 size=1048576 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.800+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~3U5GH5CF40G5.1 size=546124 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.802+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=3U5GH5CF40G5 tag=5GRI0O2AAF5V type=write size=2643276 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.804+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~B7MODOVDC0VX.0 size=1048576 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.805+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~B7MODOVDC0VX.1 size=217341 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.805+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=B7MODOVDC0VX tag=VSLETDVIK6MV type=write size=2314493 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.807+0000 7f296241c780 1 < suggested remove operation key=QL439L2X13OR tag=ZXHIKJRQJ9EJ type=del 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.809+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.0 size=1048576 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.810+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.1 size=1048576 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.811+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.2 size=81481 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.811+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=3Q62FWV7L488 tag=BUEB871PTJGA type=write size=3227209 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.812+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.0 size=1048576 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.813+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.1 size=1048576 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.814+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ENXFQFUVTOVV.2 size=806061 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.816+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=ENXFQFUVTOVV tag=7LVISNB97YLD type=write size=3951789 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.819+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~1JR7BIKLCQSL.0 size=1048576 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.820+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~1JR7BIKLCQSL.1 size=969351 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.820+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=1JR7BIKLCQSL tag=O4D2ARK558NF type=write size=3066503 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.821+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=0Q3WB5VRXKVU type=del 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.823+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=IMMRAYU9E0TQ type=del size=1367202 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.824+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~NU73E7S1106V.0 size=1048576 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.825+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~NU73E7S1106V.1 size=654387 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.827+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=NU73E7S1106V tag=68BELIQFSJP7 type=write size=2751539 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.829+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~CRWLQKIJZE0K.0 size=585335 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.829+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=CRWLQKIJZE0K tag=DGGDCBWT68VY type=write size=1633911 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.830+0000 7f296241c780 1 < completed write operation key=HZD8WW0H4AAD tag=GVGWYQE51OKG type=write size=486699 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.831+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=69JTEQ3FLJ4Z type=write size=799268 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.833+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.0 size=1048576 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.833+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.1 size=1048576 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.834+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~W8682C20HJ1O.2 size=898089 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.836+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=W8682C20HJ1O tag=7LSA9B2B1K34 type=write size=4043817 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.837+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=KAW2RREKBX32 type=del size=1411834 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.838+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.0 size=1048576 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.839+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.1 size=1048576 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.839+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~L4BH9KMJN9GL.2 size=424701 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.842+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=L4BH9KMJN9GL tag=XM9G0T428I3I type=write size=3570429 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.843+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=0CZZGZTM2RKQ type=del size=852788 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.844+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=IFEXI6HS1JUK type=del 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.845+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=4RCA0XLBN5T5 type=write size=960412 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.846+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~EH8WVL4GT87D.0 size=1048576 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.847+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~EH8WVL4GT87D.1 size=962302 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.849+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=EH8WVL4GT87D tag=64VNJ3AI97U0 type=write size=3059454 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.850+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=73V8HE9H7BJ5 type=del size=3663768 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.853+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.0 size=1048576 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.854+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.1 size=1048576 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.855+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~K3W5YHTNYODQ.2 size=935933 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.857+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=K3W5YHTNYODQ tag=ZN7BKFMZA5UR type=write size=4081661 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.859+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=TQX3K2BV576C type=write size=277635 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.860+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=8KW10LI9PFMW type=del 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.861+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=S8IY0MHOLDX3 type=del size=168309 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.862+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~R6WPDQ5B05Z2.0 size=1048576 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.863+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~R6WPDQ5B05Z2.1 size=393962 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.865+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=R6WPDQ5B05Z2 tag=DHKZ4Y6PV0V7 type=write size=2491114 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.867+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~ZNXFR8IVRGIM.0 size=1048576 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.868+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~ZNXFR8IVRGIM.1 size=723651 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.868+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=ZNXFR8IVRGIM tag=5DBTLBY1UOOP type=write size=2820803 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.870+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=6YIZQD2YCMEH type=del size=3500518 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.871+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=RRG4C52N00UA type=del size=1153155 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.873+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=F9MD0K33NI0R type=del 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.874+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=L7XJWYTJVK2Z type=del size=912560 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.875+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=28U0MLJ7RXPC type=del 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.876+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=NL37ATHFM13G type=write size=350037 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.877+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~B7MODOVDC0VX.0 size=1048576 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.878+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~B7MODOVDC0VX.1 size=217341 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.880+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=B7MODOVDC0VX tag=VSLETDVIK6MV type=write size=2314493 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.881+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=X8W4EGS7AMVS type=del size=1288314 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.882+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.0 size=1048576 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.883+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.1 size=1048576 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.884+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~3Q62FWV7L488.2 size=81481 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.886+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=3Q62FWV7L488 tag=BUEB871PTJGA type=write size=3227209 2024-09-14T11:23:31.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.887+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=7J0NRJ4WGI1Z type=del size=322990 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.888+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~1JR7BIKLCQSL.0 size=1048576 2024-09-14T11:23:31.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.889+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~1JR7BIKLCQSL.1 size=969351 2024-09-14T11:23:31.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.891+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=1JR7BIKLCQSL tag=O4D2ARK558NF type=write size=3066503 2024-09-14T11:23:31.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.892+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=WRYUZKG51YW1 type=del size=837999 2024-09-14T11:23:31.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.893+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=IMMRAYU9E0TQ type=del 2024-09-14T11:23:31.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.895+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~ZHXT6Z20C3KB.0 size=599390 2024-09-14T11:23:31.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.895+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=ZHXT6Z20C3KB tag=153F97R9XZ4J type=write size=1647966 2024-09-14T11:23:31.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.896+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~CRWLQKIJZE0K.0 size=585335 2024-09-14T11:23:31.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.898+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=CRWLQKIJZE0K tag=DGGDCBWT68VY type=write size=1633911 2024-09-14T11:23:31.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.899+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=4SDSDZMWU4MY type=write size=223463 2024-09-14T11:23:31.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.901+0000 7f296241c780 1 < completed write operation key=O35OFLNOZ488 tag=69JTEQ3FLJ4Z type=write size=799268 2024-09-14T11:23:31.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.903+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~DNRHAPD90EH0.0 size=1048576 2024-09-14T11:23:31.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.904+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~DNRHAPD90EH0.1 size=801960 2024-09-14T11:23:31.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.904+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=DNRHAPD90EH0 tag=EKIF4TMN09K2 type=write size=2899112 2024-09-14T11:23:31.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.905+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=KAW2RREKBX32 type=del 2024-09-14T11:23:31.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.906+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=PZ2R5DEPWOIL type=del size=2874263 2024-09-14T11:23:31.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.907+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=0CZZGZTM2RKQ type=del 2024-09-14T11:23:31.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.908+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=GRRDXS31FXXN type=del size=3317042 2024-09-14T11:23:31.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.910+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=4RCA0XLBN5T5 type=write size=960412 2024-09-14T11:23:31.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.912+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~FZPD6EIDMX1H.0 size=1048576 2024-09-14T11:23:31.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.913+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~FZPD6EIDMX1H.1 size=397524 2024-09-14T11:23:31.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.913+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=FZPD6EIDMX1H tag=9GVHU2S80BJI type=write size=2494676 2024-09-14T11:23:31.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.914+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=73V8HE9H7BJ5 type=del 2024-09-14T11:23:31.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.915+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=5Y3V47R2EE4H type=del size=1066332 2024-09-14T11:23:31.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.916+0000 7f296241c780 1 < completed write operation key=5XAAGDKVBZ0P tag=TQX3K2BV576C type=write size=277635 2024-09-14T11:23:31.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.918+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.0 size=1048576 2024-09-14T11:23:31.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.919+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.1 size=1048576 2024-09-14T11:23:31.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.920+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.2 size=916545 2024-09-14T11:23:31.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.920+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=DSWD8T71EZDM tag=GTOGUU8Y9EV4 type=write size=4062273 2024-09-14T11:23:31.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.922+0000 7f296241c780 1 < suggested update operation key=JW3RIVHUFGPI tag=S8IY0MHOLDX3 type=del size=168309 2024-09-14T11:23:31.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.924+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=T0161Y0CYF23 type=del size=1403921 2024-09-14T11:23:31.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.925+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~ZNXFR8IVRGIM.0 size=1048576 2024-09-14T11:23:31.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.926+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~ZNXFR8IVRGIM.1 size=723651 2024-09-14T11:23:31.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.928+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=ZNXFR8IVRGIM tag=5DBTLBY1UOOP type=write size=2820803 2024-09-14T11:23:31.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.929+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=MJZFJ1PU9ADX type=write size=745307 2024-09-14T11:23:31.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.930+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=RRG4C52N00UA type=del 2024-09-14T11:23:31.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.931+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=0UOFUCIOMOLW type=del size=236090 2024-09-14T11:23:31.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.933+0000 7f296241c780 1 < suggested update operation key=0A90ZOC79OWP tag=L7XJWYTJVK2Z type=del size=912560 2024-09-14T11:23:31.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.936+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~MGIIQYG2Z6MH.0 size=166802 2024-09-14T11:23:31.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.936+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=MGIIQYG2Z6MH tag=RQW6U52S39XT type=write size=1215378 2024-09-14T11:23:31.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.937+0000 7f296241c780 1 < completed write operation key=TNT7E4GX5ZR7 tag=NL37ATHFM13G type=write size=350037 2024-09-14T11:23:31.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.938+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=D3ZC3WXIV4F2 type=del size=2752323 2024-09-14T11:23:31.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.940+0000 7f296241c780 1 < suggested remove operation key=LK9LRQM3TZRR tag=X8W4EGS7AMVS type=del 2024-09-14T11:23:31.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.942+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=FBIPOUNY420V type=del size=870190 2024-09-14T11:23:31.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.944+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=7J0NRJ4WGI1Z type=del size=322990 2024-09-14T11:23:31.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.945+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=GEF4U6SCCNM3 type=del size=2528898 2024-09-14T11:23:31.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.947+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=WRYUZKG51YW1 type=del 2024-09-14T11:23:31.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.948+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=3YGMEROPMT28 type=del size=3407243 2024-09-14T11:23:31.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.949+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~ZHXT6Z20C3KB.0 size=599390 2024-09-14T11:23:31.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.951+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=ZHXT6Z20C3KB tag=153F97R9XZ4J type=write size=1647966 2024-09-14T11:23:31.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.952+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=L0NLRFPTGONA type=del size=678469 2024-09-14T11:23:31.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.953+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=4SDSDZMWU4MY type=write size=223463 2024-09-14T11:23:31.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.955+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~HN1CNXPKLAYH.0 size=1048576 2024-09-14T11:23:31.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.956+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~HN1CNXPKLAYH.1 size=147408 2024-09-14T11:23:31.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.956+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=HN1CNXPKLAYH tag=PFJD4K7Z6Z72 type=write size=2244560 2024-09-14T11:23:31.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.957+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~DNRHAPD90EH0.0 size=1048576 2024-09-14T11:23:31.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.958+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~DNRHAPD90EH0.1 size=801960 2024-09-14T11:23:31.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.960+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=DNRHAPD90EH0 tag=EKIF4TMN09K2 type=write size=2899112 2024-09-14T11:23:31.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.961+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=IBHDKL9C3WSG type=del size=2181569 2024-09-14T11:23:31.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.962+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=PZ2R5DEPWOIL type=del 2024-09-14T11:23:31.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.964+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=2DXKTN9JJV3M type=write size=990523 2024-09-14T11:23:31.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.965+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=GRRDXS31FXXN type=del 2024-09-14T11:23:31.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.966+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=DQ63IK7S1JMX type=del size=1029949 2024-09-14T11:23:31.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.966+0000 7f296241c780 1 < canceled part key=_multipart_XTS8B3LEW0Y3.2~FZPD6EIDMX1H.0 size=1048576 2024-09-14T11:23:31.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.967+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~FZPD6EIDMX1H.1 size=397524 2024-09-14T11:23:31.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.969+0000 7f296241c780 1 < canceled multipart upload key=XTS8B3LEW0Y3 upload=FZPD6EIDMX1H tag=9GVHU2S80BJI type=write size=2494676 2024-09-14T11:23:31.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.972+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~QLI2XSBR8502.0 size=629033 2024-09-14T11:23:31.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.972+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=QLI2XSBR8502 tag=OBB5INADW049 type=write size=1677609 2024-09-14T11:23:31.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.976+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=5Y3V47R2EE4H type=del 2024-09-14T11:23:31.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.977+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=XQD1O2Z9K21Y type=del size=1368807 2024-09-14T11:23:31.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.979+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.0 size=1048576 2024-09-14T11:23:31.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.980+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.1 size=1048576 2024-09-14T11:23:31.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.980+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~DSWD8T71EZDM.2 size=916545 2024-09-14T11:23:31.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.982+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=DSWD8T71EZDM tag=GTOGUU8Y9EV4 type=write size=4062273 2024-09-14T11:23:31.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.984+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=SO43YFEEXNJ1 type=del size=3811530 2024-09-14T11:23:31.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.985+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=T0161Y0CYF23 type=del 2024-09-14T11:23:31.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.987+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.0 size=1048576 2024-09-14T11:23:31.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.988+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.1 size=1048576 2024-09-14T11:23:31.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.989+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.2 size=485903 2024-09-14T11:23:31.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.989+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=DFT1QODTXQ76 tag=9RZU9981COU1 type=write size=3631631 2024-09-14T11:23:31.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.990+0000 7f296241c780 1 < completed write operation key=TNT7E4GX5ZR7 tag=MJZFJ1PU9ADX type=write size=745307 2024-09-14T11:23:31.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.991+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=TLJT8RCZMAHU type=del size=2095719 2024-09-14T11:23:31.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.992+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=0UOFUCIOMOLW type=del 2024-09-14T11:23:31.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.993+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=XWGAG43D55SD type=del size=1439973 2024-09-14T11:23:31.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.995+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~MGIIQYG2Z6MH.0 size=166802 2024-09-14T11:23:31.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.998+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=MGIIQYG2Z6MH tag=RQW6U52S39XT type=write size=1215378 2024-09-14T11:23:31.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:31.999+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=U5GTZLC8ZDET type=del size=3199028 2024-09-14T11:23:31.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.000+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=D3ZC3WXIV4F2 type=del 2024-09-14T11:23:32.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.002+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=1WITEX2W57UH type=del size=3464047 2024-09-14T11:23:32.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.003+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=FBIPOUNY420V type=del 2024-09-14T11:23:32.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.004+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=ZWHG2839ZYD3 type=del size=2490431 2024-09-14T11:23:32.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.005+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=GEF4U6SCCNM3 type=del 2024-09-14T11:23:32.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.007+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.0 size=1048576 2024-09-14T11:23:32.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.008+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.1 size=1048576 2024-09-14T11:23:32.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.009+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.2 size=438538 2024-09-14T11:23:32.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.009+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=1NTY0PWK3WDH tag=CT47TGDGO0XS type=write size=3584266 2024-09-14T11:23:32.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.010+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=3YGMEROPMT28 type=del 2024-09-14T11:23:32.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.011+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=VQ3EVTSSYGJL type=del size=68930 2024-09-14T11:23:32.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.013+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=L0NLRFPTGONA type=del 2024-09-14T11:23:32.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.014+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=7BL8VFYCFF4A type=write size=674216 2024-09-14T11:23:32.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.015+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~HN1CNXPKLAYH.0 size=1048576 2024-09-14T11:23:32.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.016+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~HN1CNXPKLAYH.1 size=147408 2024-09-14T11:23:32.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.018+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=HN1CNXPKLAYH tag=PFJD4K7Z6Z72 type=write size=2244560 2024-09-14T11:23:32.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.019+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=NQ94PFAZZN7W type=del size=783373 2024-09-14T11:23:32.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.020+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=IBHDKL9C3WSG type=del 2024-09-14T11:23:32.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.021+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=UHKI1VL696ZI type=del size=3640487 2024-09-14T11:23:32.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.022+0000 7f296241c780 1 < completed write operation key=K61XH5E6TF3Y tag=2DXKTN9JJV3M type=write size=990523 2024-09-14T11:23:32.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.024+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=XPHOB13RMQV4 type=write size=605544 2024-09-14T11:23:32.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.025+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=DQ63IK7S1JMX type=del 2024-09-14T11:23:32.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.026+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=EVV9ZANICM84 type=del size=2497120 2024-09-14T11:23:32.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.027+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~QLI2XSBR8502.0 size=629033 2024-09-14T11:23:32.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.029+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=QLI2XSBR8502 tag=OBB5INADW049 type=write size=1677609 2024-09-14T11:23:32.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.030+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=Q1XQ6RIHXKAI type=del size=3874869 2024-09-14T11:23:32.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.031+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=XQD1O2Z9K21Y type=del 2024-09-14T11:23:32.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.033+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VXX9EMZ602HS.0 size=1048576 2024-09-14T11:23:32.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.034+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VXX9EMZ602HS.1 size=232730 2024-09-14T11:23:32.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.034+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=VXX9EMZ602HS tag=7ZKYVAT7BAAE type=write size=2329882 2024-09-14T11:23:32.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.035+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=SO43YFEEXNJ1 type=del 2024-09-14T11:23:32.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.037+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~TSQQS962K4QK.0 size=1048576 2024-09-14T11:23:32.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.038+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~TSQQS962K4QK.1 size=103903 2024-09-14T11:23:32.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.038+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=TSQQS962K4QK tag=174YKUFLP12O type=write size=2201055 2024-09-14T11:23:32.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.039+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.0 size=1048576 2024-09-14T11:23:32.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.040+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.1 size=1048576 2024-09-14T11:23:32.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.041+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~DFT1QODTXQ76.2 size=485903 2024-09-14T11:23:32.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.043+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=DFT1QODTXQ76 tag=9RZU9981COU1 type=write size=3631631 2024-09-14T11:23:32.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.044+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=E36SFNVO8SFO type=del size=1623632 2024-09-14T11:23:32.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.046+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=TLJT8RCZMAHU type=del 2024-09-14T11:23:32.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.047+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=TO62N6F4T3A0 type=del size=2065842 2024-09-14T11:23:32.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.048+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=XWGAG43D55SD type=del 2024-09-14T11:23:32.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.050+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~X2Y2AUGEP0ON.0 size=1048576 2024-09-14T11:23:32.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.051+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~X2Y2AUGEP0ON.1 size=64325 2024-09-14T11:23:32.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.051+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=X2Y2AUGEP0ON tag=1HWAXTBI9RT2 type=write size=2161477 2024-09-14T11:23:32.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.052+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=U5GTZLC8ZDET type=del 2024-09-14T11:23:32.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.053+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=LKNT2ELTJ4F6 type=del size=161615 2024-09-14T11:23:32.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.055+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=1WITEX2W57UH type=del 2024-09-14T11:23:32.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.056+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=WSSS4X8VTU7A type=del size=385270 2024-09-14T11:23:32.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.057+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=ZWHG2839ZYD3 type=del 2024-09-14T11:23:32.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.059+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=VF9NAD9O8BQP type=del size=2493341 2024-09-14T11:23:32.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.060+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.0 size=1048576 2024-09-14T11:23:32.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.061+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.1 size=1048576 2024-09-14T11:23:32.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.062+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~1NTY0PWK3WDH.2 size=438538 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.064+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=1NTY0PWK3WDH tag=CT47TGDGO0XS type=write size=3584266 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.065+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=6WY8DUW39JZ8 type=del size=3949504 2024-09-14T11:23:32.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.068+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=VQ3EVTSSYGJL type=del size=68930 2024-09-14T11:23:32.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.070+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~99Z3RS7E3OC5.0 size=695267 2024-09-14T11:23:32.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.070+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=99Z3RS7E3OC5 tag=4QJ2SL7TFM28 type=write size=1743843 2024-09-14T11:23:32.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.072+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=7BL8VFYCFF4A type=write size=674216 2024-09-14T11:23:32.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.073+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=G9EIQ1VQ1FJ3 type=write size=304581 2024-09-14T11:23:32.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.076+0000 7f296241c780 1 < suggested update operation key=XTS8B3LEW0Y3 tag=NQ94PFAZZN7W type=del size=783373 2024-09-14T11:23:32.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.078+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~EIQZR9YDXK2X.0 size=1048576 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.079+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~EIQZR9YDXK2X.1 size=310548 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.079+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=EIQZR9YDXK2X tag=0I4091QEIDHB type=write size=2407700 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.080+0000 7f296241c780 1 < canceled operation key=K61XH5E6TF3Y tag=UHKI1VL696ZI type=del size=3640487 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.081+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=FFKAOZAV8ND5 type=del size=1858300 2024-09-14T11:23:32.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.082+0000 7f296241c780 1 < completed write operation key=I1XBOS1L5D98 tag=XPHOB13RMQV4 type=write size=605544 2024-09-14T11:23:32.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.085+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.0 size=1048576 2024-09-14T11:23:32.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.085+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.1 size=1048576 2024-09-14T11:23:32.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.086+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.2 size=596645 2024-09-14T11:23:32.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.086+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=4F4D5LUXBPL6 tag=WZFBI34VB4SC type=write size=3742373 2024-09-14T11:23:32.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.088+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=EVV9ZANICM84 type=del 2024-09-14T11:23:32.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.089+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=8BKWGQ2DS2K8 type=del size=3804688 2024-09-14T11:23:32.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.090+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=Q1XQ6RIHXKAI type=del 2024-09-14T11:23:32.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.091+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=RVGVFV1OBNU0 type=del size=1338691 2024-09-14T11:23:32.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.092+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VXX9EMZ602HS.0 size=1048576 2024-09-14T11:23:32.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.092+0000 7f296241c780 1 < canceled part key=_multipart_5XAAGDKVBZ0P.2~VXX9EMZ602HS.1 size=232730 2024-09-14T11:23:32.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.094+0000 7f296241c780 1 < canceled multipart upload key=5XAAGDKVBZ0P upload=VXX9EMZ602HS tag=7ZKYVAT7BAAE type=write size=2329882 2024-09-14T11:23:32.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.095+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=OQZGLFF4R2S3 type=write size=335207 2024-09-14T11:23:32.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.097+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~TSQQS962K4QK.0 size=1048576 2024-09-14T11:23:32.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.098+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~TSQQS962K4QK.1 size=103903 2024-09-14T11:23:32.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.099+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=TSQQS962K4QK tag=174YKUFLP12O type=write size=2201055 2024-09-14T11:23:32.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.101+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~US0LR5RSMKHQ.0 size=1048576 2024-09-14T11:23:32.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.102+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~US0LR5RSMKHQ.1 size=230935 2024-09-14T11:23:32.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.102+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=US0LR5RSMKHQ tag=1ALL73QTAIIW type=write size=2328087 2024-09-14T11:23:32.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.104+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=E36SFNVO8SFO type=del 2024-09-14T11:23:32.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.105+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=QPCFF3TNIGN7 type=del size=727468 2024-09-14T11:23:32.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.106+0000 7f296241c780 -1 < failed to complete operation key=L0GW4TPQCSUY tag=TO62N6F4T3A0 type=del size=2065842: (22) Invalid argument 2024-09-14T11:23:32.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.108+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.0 size=1048576 2024-09-14T11:23:32.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.109+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.1 size=1048576 2024-09-14T11:23:32.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.110+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.2 size=282306 2024-09-14T11:23:32.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.110+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=1DY0NNAI2SIA tag=262O9K8OH23O type=write size=3428034 2024-09-14T11:23:32.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.111+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~X2Y2AUGEP0ON.0 size=1048576 2024-09-14T11:23:32.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.112+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~X2Y2AUGEP0ON.1 size=64325 2024-09-14T11:23:32.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.114+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=X2Y2AUGEP0ON tag=1HWAXTBI9RT2 type=write size=2161477 2024-09-14T11:23:32.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.115+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=5R3JFJHCBWLZ type=del size=273685 2024-09-14T11:23:32.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.116+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=LKNT2ELTJ4F6 type=del 2024-09-14T11:23:32.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.117+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=187WCQRN5ZC2 type=del size=1506770 2024-09-14T11:23:32.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.119+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=WSSS4X8VTU7A type=del 2024-09-14T11:23:32.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.120+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=7M7JDCN3CEJW type=del size=3895938 2024-09-14T11:23:32.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.121+0000 7f296241c780 -1 < failed to complete operation key=XTS8B3LEW0Y3 tag=VF9NAD9O8BQP type=del size=2493341: (22) Invalid argument 2024-09-14T11:23:32.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.123+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~O4XVP0BQXETE.0 size=641826 2024-09-14T11:23:32.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.123+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=O4XVP0BQXETE tag=CFHTQ66NQX13 type=write size=1690402 2024-09-14T11:23:32.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.124+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=6WY8DUW39JZ8 type=del 2024-09-14T11:23:32.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.126+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~P3BK79XUU2RB.0 size=1048576 2024-09-14T11:23:32.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.127+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~P3BK79XUU2RB.1 size=710978 2024-09-14T11:23:32.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.127+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=P3BK79XUU2RB tag=V60U85NTEHOT type=write size=2808130 2024-09-14T11:23:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.128+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~99Z3RS7E3OC5.0 size=695267 2024-09-14T11:23:32.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.130+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=99Z3RS7E3OC5 tag=4QJ2SL7TFM28 type=write size=1743843 2024-09-14T11:23:32.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.132+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~48V2PK5LZ7Q0.0 size=1048576 2024-09-14T11:23:32.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.133+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~48V2PK5LZ7Q0.1 size=48338 2024-09-14T11:23:32.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.133+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=48V2PK5LZ7Q0 tag=DQ32VHTE0SEL type=write size=2145490 2024-09-14T11:23:32.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.134+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=G9EIQ1VQ1FJ3 type=write size=304581 2024-09-14T11:23:32.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.136+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=RA4GXB4PB0V0 type=write size=116018 2024-09-14T11:23:32.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.137+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~EIQZR9YDXK2X.0 size=1048576 2024-09-14T11:23:32.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.138+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~EIQZR9YDXK2X.1 size=310548 2024-09-14T11:23:32.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.140+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=EIQZR9YDXK2X tag=0I4091QEIDHB type=write size=2407700 2024-09-14T11:23:32.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.142+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~PNJ6ANQFEONQ.0 size=925259 2024-09-14T11:23:32.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.142+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=PNJ6ANQFEONQ tag=KJNTR75B0ID2 type=write size=1973835 2024-09-14T11:23:32.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.143+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=FFKAOZAV8ND5 type=del 2024-09-14T11:23:32.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.145+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.0 size=1048576 2024-09-14T11:23:32.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.146+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.1 size=1048576 2024-09-14T11:23:32.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.147+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.2 size=154792 2024-09-14T11:23:32.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.147+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=9IADMVHNJ3TT tag=34WQDHALWTBX type=write size=3300520 2024-09-14T11:23:32.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.148+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.0 size=1048576 2024-09-14T11:23:32.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.149+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.1 size=1048576 2024-09-14T11:23:32.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.150+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~4F4D5LUXBPL6.2 size=596645 2024-09-14T11:23:32.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.153+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=4F4D5LUXBPL6 tag=WZFBI34VB4SC type=write size=3742373 2024-09-14T11:23:32.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.155+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~M84FCV6PYJV7.0 size=927153 2024-09-14T11:23:32.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.155+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=M84FCV6PYJV7 tag=BAA16FDOA7S7 type=write size=1975729 2024-09-14T11:23:32.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.156+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=8BKWGQ2DS2K8 type=del 2024-09-14T11:23:32.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.158+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.0 size=1048576 2024-09-14T11:23:32.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.159+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.1 size=1048576 2024-09-14T11:23:32.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.160+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.2 size=15932 2024-09-14T11:23:32.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.160+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=913F061YEUWC tag=HH4C00H0RLTI type=write size=3161660 2024-09-14T11:23:32.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.161+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=RVGVFV1OBNU0 type=del 2024-09-14T11:23:32.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.162+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=QK3T1IRPAKWV type=del size=3623642 2024-09-14T11:23:32.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.164+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=OQZGLFF4R2S3 type=write size=335207 2024-09-14T11:23:32.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.166+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=R6K2KRTR802Q type=del size=3936967 2024-09-14T11:23:32.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.166+0000 7f296241c780 1 < canceled part key=_multipart_XTS8B3LEW0Y3.2~US0LR5RSMKHQ.0 size=1048576 2024-09-14T11:23:32.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.167+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~US0LR5RSMKHQ.1 size=230935 2024-09-14T11:23:32.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.169+0000 7f296241c780 1 < canceled multipart upload key=XTS8B3LEW0Y3 upload=US0LR5RSMKHQ tag=1ALL73QTAIIW type=write size=2328087 2024-09-14T11:23:32.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.170+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=BH7PRTH9PBNY type=del size=2799771 2024-09-14T11:23:32.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.171+0000 7f296241c780 1 < canceled operation key=HFH3VKZ4T0IR tag=QPCFF3TNIGN7 type=del size=727468 2024-09-14T11:23:32.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.172+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=WESRRJLQ8BKC type=del size=4038940 2024-09-14T11:23:32.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.173+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.0 size=1048576 2024-09-14T11:23:32.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.174+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.1 size=1048576 2024-09-14T11:23:32.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.175+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~1DY0NNAI2SIA.2 size=282306 2024-09-14T11:23:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.177+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=1DY0NNAI2SIA tag=262O9K8OH23O type=write size=3428034 2024-09-14T11:23:32.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.179+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.0 size=1048576 2024-09-14T11:23:32.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.180+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.1 size=1048576 2024-09-14T11:23:32.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.181+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.2 size=295655 2024-09-14T11:23:32.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.181+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=K24FDT9EOX3B tag=JV30SF1FZ5Q0 type=write size=3441383 2024-09-14T11:23:32.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.183+0000 7f296241c780 1 < canceled operation key=19TC05N1D5FR tag=5R3JFJHCBWLZ type=del size=273685 2024-09-14T11:23:32.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.184+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=39YHD0DUJ39N type=del size=2056831 2024-09-14T11:23:32.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.185+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=187WCQRN5ZC2 type=del 2024-09-14T11:23:32.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.187+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~XCOZ1DZEZ13I.0 size=1048576 2024-09-14T11:23:32.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.188+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~XCOZ1DZEZ13I.1 size=539272 2024-09-14T11:23:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.188+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=XCOZ1DZEZ13I tag=HE4F8DMNK2PK type=write size=2636424 2024-09-14T11:23:32.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.190+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=7M7JDCN3CEJW type=del 2024-09-14T11:23:32.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.192+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~OERC1MJJ5U00.0 size=734466 2024-09-14T11:23:32.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.192+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=OERC1MJJ5U00 tag=MK3Z8XPERQ55 type=write size=1783042 2024-09-14T11:23:32.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.193+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~O4XVP0BQXETE.0 size=641826 2024-09-14T11:23:32.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.195+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=O4XVP0BQXETE tag=CFHTQ66NQX13 type=write size=1690402 2024-09-14T11:23:32.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.197+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=QSK8H9Q7WSS3 type=del size=2698221 2024-09-14T11:23:32.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.198+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~P3BK79XUU2RB.0 size=1048576 2024-09-14T11:23:32.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.199+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~P3BK79XUU2RB.1 size=710978 2024-09-14T11:23:32.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.201+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=P3BK79XUU2RB tag=V60U85NTEHOT type=write size=2808130 2024-09-14T11:23:32.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.202+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=6EMDXKDJSW4O type=del size=3967407 2024-09-14T11:23:32.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.203+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~48V2PK5LZ7Q0.0 size=1048576 2024-09-14T11:23:32.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.204+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~48V2PK5LZ7Q0.1 size=48338 2024-09-14T11:23:32.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.206+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=48V2PK5LZ7Q0 tag=DQ32VHTE0SEL type=write size=2145490 2024-09-14T11:23:32.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.208+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.0 size=1048576 2024-09-14T11:23:32.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.209+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.1 size=1048576 2024-09-14T11:23:32.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.210+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.2 size=360306 2024-09-14T11:23:32.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.210+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=HN5KJFVR15K0 tag=RTNSPTG0UQM3 type=write size=3506034 2024-09-14T11:23:32.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.211+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=RA4GXB4PB0V0 type=write size=116018 2024-09-14T11:23:32.211 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.213+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=FTNZVFOPOTQ6 type=del size=1747643 2024-09-14T11:23:32.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.214+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~PNJ6ANQFEONQ.0 size=925259 2024-09-14T11:23:32.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.216+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=PNJ6ANQFEONQ tag=KJNTR75B0ID2 type=write size=1973835 2024-09-14T11:23:32.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.217+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=GLWCGXQTV0P2 type=del size=1817131 2024-09-14T11:23:32.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.218+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.0 size=1048576 2024-09-14T11:23:32.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.218+0000 7f296241c780 1 < canceled part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.1 size=1048576 2024-09-14T11:23:32.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.219+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~9IADMVHNJ3TT.2 size=154792 2024-09-14T11:23:32.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.221+0000 7f296241c780 1 < canceled multipart upload key=3T0SINQVBAGF upload=9IADMVHNJ3TT tag=34WQDHALWTBX type=write size=3300520 2024-09-14T11:23:32.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.223+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=GXA9VZJ2RKT1 type=del size=3954904 2024-09-14T11:23:32.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.224+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~M84FCV6PYJV7.0 size=927153 2024-09-14T11:23:32.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.225+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=M84FCV6PYJV7 tag=BAA16FDOA7S7 type=write size=1975729 2024-09-14T11:23:32.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.227+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=X9S3J0D87MFK type=del size=1336707 2024-09-14T11:23:32.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.228+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.0 size=1048576 2024-09-14T11:23:32.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.229+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.1 size=1048576 2024-09-14T11:23:32.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.230+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~913F061YEUWC.2 size=15932 2024-09-14T11:23:32.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.231+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=913F061YEUWC tag=HH4C00H0RLTI type=write size=3161660 2024-09-14T11:23:32.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.233+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=508I92RH3HJC type=del size=2063829 2024-09-14T11:23:32.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.234+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=QK3T1IRPAKWV type=del 2024-09-14T11:23:32.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.235+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=EG14AK1F17CW type=del size=2702617 2024-09-14T11:23:32.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.236+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=R6K2KRTR802Q type=del 2024-09-14T11:23:32.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.238+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.0 size=1048576 2024-09-14T11:23:32.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.239+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.1 size=1048576 2024-09-14T11:23:32.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.240+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.2 size=742035 2024-09-14T11:23:32.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.240+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=WA6HMHALKML6 tag=2J27M2ALQ9XS type=write size=3887763 2024-09-14T11:23:32.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.242+0000 7f296241c780 1 < suggested remove operation key=XTS8B3LEW0Y3 tag=BH7PRTH9PBNY type=del 2024-09-14T11:23:32.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.244+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~R03LL6WS1FVT.0 size=1048576 2024-09-14T11:23:32.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.245+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~R03LL6WS1FVT.1 size=916425 2024-09-14T11:23:32.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.245+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=R03LL6WS1FVT tag=0APXVBBBQQR2 type=write size=3013577 2024-09-14T11:23:32.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.248+0000 7f296241c780 1 < suggested update operation key=O35OFLNOZ488 tag=WESRRJLQ8BKC type=del size=4038940 2024-09-14T11:23:32.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.249+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=TEXKZ40ZL8TQ type=write size=994109 2024-09-14T11:23:32.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.250+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.0 size=1048576 2024-09-14T11:23:32.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.251+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.1 size=1048576 2024-09-14T11:23:32.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.252+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~K24FDT9EOX3B.2 size=295655 2024-09-14T11:23:32.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.254+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=K24FDT9EOX3B tag=JV30SF1FZ5Q0 type=write size=3441383 2024-09-14T11:23:32.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.256+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~5CHGOR5LEPU9.0 size=622865 2024-09-14T11:23:32.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.256+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=5CHGOR5LEPU9 tag=0497WVZTAROV type=write size=1671441 2024-09-14T11:23:32.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.257+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=39YHD0DUJ39N type=del 2024-09-14T11:23:32.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.259+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=KCMKNBMTQQPL type=del size=2011758 2024-09-14T11:23:32.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.260+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~XCOZ1DZEZ13I.0 size=1048576 2024-09-14T11:23:32.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.261+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~XCOZ1DZEZ13I.1 size=539272 2024-09-14T11:23:32.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.263+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=XCOZ1DZEZ13I tag=HE4F8DMNK2PK type=write size=2636424 2024-09-14T11:23:32.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.264+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=5454IPAR8N1T type=del size=3176473 2024-09-14T11:23:32.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.265+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~OERC1MJJ5U00.0 size=734466 2024-09-14T11:23:32.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.267+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=OERC1MJJ5U00 tag=MK3Z8XPERQ55 type=write size=1783042 2024-09-14T11:23:32.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.268+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=JFIVZREQ7RIP type=del size=2867131 2024-09-14T11:23:32.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.269+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=QSK8H9Q7WSS3 type=del 2024-09-14T11:23:32.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.270+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=H5FO7ARVAN3O type=del size=4050404 2024-09-14T11:23:32.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.271+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=6EMDXKDJSW4O type=del 2024-09-14T11:23:32.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.274+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~EAYV6ML2DKZ3.0 size=1035470 2024-09-14T11:23:32.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.274+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=EAYV6ML2DKZ3 tag=P2S0ZVII2NYE type=write size=2084046 2024-09-14T11:23:32.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.275+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.0 size=1048576 2024-09-14T11:23:32.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.276+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.1 size=1048576 2024-09-14T11:23:32.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.277+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~HN5KJFVR15K0.2 size=360306 2024-09-14T11:23:32.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.279+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=HN5KJFVR15K0 tag=RTNSPTG0UQM3 type=write size=3506034 2024-09-14T11:23:32.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.281+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.0 size=1048576 2024-09-14T11:23:32.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.282+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.1 size=1048576 2024-09-14T11:23:32.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.283+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.2 size=27131 2024-09-14T11:23:32.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.283+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=4O4XQ0MNN7AP tag=WS80KPJMPEJZ type=write size=3172859 2024-09-14T11:23:32.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.285+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=FTNZVFOPOTQ6 type=del size=1747643 2024-09-14T11:23:32.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.286+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=H1Y1J10QJZB0 type=del size=1560989 2024-09-14T11:23:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.287+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=GLWCGXQTV0P2 type=del 2024-09-14T11:23:32.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.288+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=I3M1L9LSCS9D type=del size=1075407 2024-09-14T11:23:32.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.290+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=GXA9VZJ2RKT1 type=del 2024-09-14T11:23:32.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.291+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=BTAOCXWVT3YE type=del size=2610697 2024-09-14T11:23:32.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.292+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=X9S3J0D87MFK type=del 2024-09-14T11:23:32.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.293+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=EQN9FA8EWXFP type=del size=94303 2024-09-14T11:23:32.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.295+0000 7f296241c780 1 < suggested update operation key=QL439L2X13OR tag=508I92RH3HJC type=del size=2063829 2024-09-14T11:23:32.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.298+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~3WB66KSE4ZQA.0 size=983059 2024-09-14T11:23:32.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.298+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=3WB66KSE4ZQA tag=7WLSOJVOZF6M type=write size=2031635 2024-09-14T11:23:32.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.299+0000 7f296241c780 1 < canceled operation key=MO1WWGC42DD4 tag=EG14AK1F17CW type=del size=2702617 2024-09-14T11:23:32.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.300+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=7AR5CFFD2J91 type=del size=2075853 2024-09-14T11:23:32.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.301+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.0 size=1048576 2024-09-14T11:23:32.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.302+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.1 size=1048576 2024-09-14T11:23:32.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.302+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~WA6HMHALKML6.2 size=742035 2024-09-14T11:23:32.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.304+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=WA6HMHALKML6 tag=2J27M2ALQ9XS type=write size=3887763 2024-09-14T11:23:32.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.306+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~K1USKJT69UQQ.0 size=1048576 2024-09-14T11:23:32.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.307+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~K1USKJT69UQQ.1 size=236269 2024-09-14T11:23:32.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.307+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=K1USKJT69UQQ tag=FKV2HZTKVHKS type=write size=2333421 2024-09-14T11:23:32.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.308+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~R03LL6WS1FVT.0 size=1048576 2024-09-14T11:23:32.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.308+0000 7f296241c780 1 < canceled part key=_multipart_C1T4CLU3400T.2~R03LL6WS1FVT.1 size=916425 2024-09-14T11:23:32.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.310+0000 7f296241c780 1 < canceled multipart upload key=C1T4CLU3400T upload=R03LL6WS1FVT tag=0APXVBBBQQR2 type=write size=3013577 2024-09-14T11:23:32.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.312+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~L81O9B4MNECM.0 size=339214 2024-09-14T11:23:32.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.312+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=L81O9B4MNECM tag=HPNW0D9U2VMH type=write size=1387790 2024-09-14T11:23:32.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.314+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=TEXKZ40ZL8TQ type=write size=994109 2024-09-14T11:23:32.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.316+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.0 size=1048576 2024-09-14T11:23:32.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.317+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.1 size=1048576 2024-09-14T11:23:32.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.318+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.2 size=136679 2024-09-14T11:23:32.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.318+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=2TQHUL328OX6 tag=482MLA7O66N4 type=write size=3282407 2024-09-14T11:23:32.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.319+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~5CHGOR5LEPU9.0 size=622865 2024-09-14T11:23:32.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.321+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=5CHGOR5LEPU9 tag=0497WVZTAROV type=write size=1671441 2024-09-14T11:23:32.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.322+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=OAC0LVCLY8G4 type=del size=1012402 2024-09-14T11:23:32.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.323+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=KCMKNBMTQQPL type=del 2024-09-14T11:23:32.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.325+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=C250AFSY28JI type=write size=277318 2024-09-14T11:23:32.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.326+0000 7f296241c780 1 < canceled operation key=FGK7YH1GB4W5 tag=5454IPAR8N1T type=del size=3176473 2024-09-14T11:23:32.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.328+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~4CEL7LW53P59.0 size=1048576 2024-09-14T11:23:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.329+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~4CEL7LW53P59.1 size=799221 2024-09-14T11:23:32.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.329+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=4CEL7LW53P59 tag=Z18Q5YSA8XYK type=write size=2896373 2024-09-14T11:23:32.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.330+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=JFIVZREQ7RIP type=del 2024-09-14T11:23:32.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.331+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=NRKQQUQEXBTG type=del size=3046836 2024-09-14T11:23:32.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.333+0000 7f296241c780 1 < suggested update operation key=FGK7YH1GB4W5 tag=H5FO7ARVAN3O type=del size=4050404 2024-09-14T11:23:32.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.335+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=8LM3WD9KUREH type=del size=2198937 2024-09-14T11:23:32.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.336+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~EAYV6ML2DKZ3.0 size=1035470 2024-09-14T11:23:32.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.338+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=EAYV6ML2DKZ3 tag=P2S0ZVII2NYE type=write size=2084046 2024-09-14T11:23:32.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.339+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=NTZSWFNWHMT3 type=write size=1011212 2024-09-14T11:23:32.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.340+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.0 size=1048576 2024-09-14T11:23:32.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.341+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.1 size=1048576 2024-09-14T11:23:32.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.342+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~4O4XQ0MNN7AP.2 size=27131 2024-09-14T11:23:32.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.344+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=4O4XQ0MNN7AP tag=WS80KPJMPEJZ type=write size=3172859 2024-09-14T11:23:32.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.346+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~J2QN2BH9F6SP.0 size=902442 2024-09-14T11:23:32.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.346+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=J2QN2BH9F6SP tag=SK030MUAD3WV type=write size=1951018 2024-09-14T11:23:32.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.347+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=H1Y1J10QJZB0 type=del 2024-09-14T11:23:32.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.348+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=2SPT3DLPWWB8 type=del size=1775483 2024-09-14T11:23:32.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.349+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=I3M1L9LSCS9D type=del 2024-09-14T11:23:32.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.351+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=RS93IL3QXGGR type=del size=2904196 2024-09-14T11:23:32.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.352+0000 7f296241c780 -1 < failed to complete operation key=QL439L2X13OR tag=BTAOCXWVT3YE type=del size=2610697: (22) Invalid argument 2024-09-14T11:23:32.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.353+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=EIWWUGAFU6GU type=del size=1751677 2024-09-14T11:23:32.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.354+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=EQN9FA8EWXFP type=del 2024-09-14T11:23:32.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.358+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~K9D80MU2IUU8.0 size=955483 2024-09-14T11:23:32.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.358+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=K9D80MU2IUU8 tag=OA1GJUE0FCX8 type=write size=2004059 2024-09-14T11:23:32.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.359+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~3WB66KSE4ZQA.0 size=983059 2024-09-14T11:23:32.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.361+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=3WB66KSE4ZQA tag=7WLSOJVOZF6M type=write size=2031635 2024-09-14T11:23:32.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.363+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~JA6OCEFGJ30I.0 size=1048576 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.364+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~JA6OCEFGJ30I.1 size=222836 2024-09-14T11:23:32.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.364+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=JA6OCEFGJ30I tag=VLHTV528PKEG type=write size=2319988 2024-09-14T11:23:32.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.366+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=7AR5CFFD2J91 type=del 2024-09-14T11:23:32.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.367+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=CMTHKKIEFLUA type=del size=3914784 2024-09-14T11:23:32.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.368+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~K1USKJT69UQQ.0 size=1048576 2024-09-14T11:23:32.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.369+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~K1USKJT69UQQ.1 size=236269 2024-09-14T11:23:32.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.371+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=K1USKJT69UQQ tag=FKV2HZTKVHKS type=write size=2333421 2024-09-14T11:23:32.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.372+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=133L4263NFXO type=del size=2238818 2024-09-14T11:23:32.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.373+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~L81O9B4MNECM.0 size=339214 2024-09-14T11:23:32.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.375+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=L81O9B4MNECM tag=HPNW0D9U2VMH type=write size=1387790 2024-09-14T11:23:32.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.376+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=DI19E9XAJXJL type=del size=3324024 2024-09-14T11:23:32.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.377+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.0 size=1048576 2024-09-14T11:23:32.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.377+0000 7f296241c780 1 < canceled part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.1 size=1048576 2024-09-14T11:23:32.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.378+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~2TQHUL328OX6.2 size=136679 2024-09-14T11:23:32.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.381+0000 7f296241c780 1 < canceled multipart upload key=QL439L2X13OR upload=2TQHUL328OX6 tag=482MLA7O66N4 type=write size=3282407 2024-09-14T11:23:32.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.382+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=HLQ8CLPH2NIK type=del size=4008054 2024-09-14T11:23:32.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.383+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=OAC0LVCLY8G4 type=del 2024-09-14T11:23:32.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.384+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=7070KNRPLNL3 type=del size=1284317 2024-09-14T11:23:32.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.385+0000 7f296241c780 -1 < failed to complete operation key=FGK7YH1GB4W5 tag=C250AFSY28JI type=write size=277318: (22) Invalid argument 2024-09-14T11:23:32.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.387+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~TYHFXPPQEMRB.0 size=333430 2024-09-14T11:23:32.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.387+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=TYHFXPPQEMRB tag=2Y50I99EX600 type=write size=1382006 2024-09-14T11:23:32.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.388+0000 7f296241c780 1 < canceled part key=_multipart_OIT1KUT6UEP2.2~4CEL7LW53P59.0 size=1048576 2024-09-14T11:23:32.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.389+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~4CEL7LW53P59.1 size=799221 2024-09-14T11:23:32.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.391+0000 7f296241c780 1 < canceled multipart upload key=OIT1KUT6UEP2 upload=4CEL7LW53P59 tag=Z18Q5YSA8XYK type=write size=2896373 2024-09-14T11:23:32.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.392+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=L2VRI049YVHK type=del size=4109544 2024-09-14T11:23:32.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.394+0000 7f296241c780 1 < suggested update operation key=JW3RIVHUFGPI tag=NRKQQUQEXBTG type=del size=3046836 2024-09-14T11:23:32.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.396+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.0 size=1048576 2024-09-14T11:23:32.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.397+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.1 size=1048576 2024-09-14T11:23:32.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.398+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.2 size=344488 2024-09-14T11:23:32.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.398+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=83VDFW67NRR9 tag=W07SZRVCWZ2P type=write size=3490216 2024-09-14T11:23:32.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.399+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=8LM3WD9KUREH type=del 2024-09-14T11:23:32.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.401+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~GHUGX53TVWV1.0 size=276968 2024-09-14T11:23:32.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.401+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=GHUGX53TVWV1 tag=ZLEIQB325EHE type=write size=1325544 2024-09-14T11:23:32.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.403+0000 7f296241c780 1 < suggested remove operation key=JH1QJE5V4M9H tag=NTZSWFNWHMT3 type=write 2024-09-14T11:23:32.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.405+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~FWS3UQYY05LR.0 size=702411 2024-09-14T11:23:32.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.405+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=FWS3UQYY05LR tag=LMPXCXK2T8Q4 type=write size=1750987 2024-09-14T11:23:32.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.407+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~J2QN2BH9F6SP.0 size=902442 2024-09-14T11:23:32.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.408+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=J2QN2BH9F6SP tag=SK030MUAD3WV type=write size=1951018 2024-09-14T11:23:32.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.410+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~NLTMZ0FCRFZN.0 size=484464 2024-09-14T11:23:32.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.410+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=NLTMZ0FCRFZN tag=LDCUGL0L1ZQ4 type=write size=1533040 2024-09-14T11:23:32.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.412+0000 7f296241c780 1 < canceled operation key=ILOY74OSG5CQ tag=2SPT3DLPWWB8 type=del size=1775483 2024-09-14T11:23:32.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.413+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=P5GTFRCJF268 type=write size=900831 2024-09-14T11:23:32.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.414+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=RS93IL3QXGGR type=del 2024-09-14T11:23:32.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.415+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=7V5VP8J0FVCI type=del size=593358 2024-09-14T11:23:32.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.416+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=EIWWUGAFU6GU type=del 2024-09-14T11:23:32.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.417+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=81B6ORMZKKXA type=del size=3870181 2024-09-14T11:23:32.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.418+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~K9D80MU2IUU8.0 size=955483 2024-09-14T11:23:32.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.421+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=K9D80MU2IUU8 tag=OA1GJUE0FCX8 type=write size=2004059 2024-09-14T11:23:32.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.422+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=KMBIA1VTHJJW type=write size=273188 2024-09-14T11:23:32.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.424+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~JA6OCEFGJ30I.0 size=1048576 2024-09-14T11:23:32.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.425+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~JA6OCEFGJ30I.1 size=222836 2024-09-14T11:23:32.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.426+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=JA6OCEFGJ30I tag=VLHTV528PKEG type=write size=2319988 2024-09-14T11:23:32.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.428+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=T5UXM184VKSY type=del size=2056234 2024-09-14T11:23:32.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.429+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=CMTHKKIEFLUA type=del 2024-09-14T11:23:32.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.431+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~H3R1PS1K4301.0 size=715671 2024-09-14T11:23:32.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.431+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=H3R1PS1K4301 tag=5FJQ6M8WQNH8 type=write size=1764247 2024-09-14T11:23:32.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.432+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=133L4263NFXO type=del 2024-09-14T11:23:32.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.433+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=CTM4OM0D2I01 type=del size=1378028 2024-09-14T11:23:32.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.435+0000 7f296241c780 1 < suggested update operation key=FGK7YH1GB4W5 tag=DI19E9XAJXJL type=del size=3324024 2024-09-14T11:23:32.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.437+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=4LEVPUMOUY7K type=del size=4062875 2024-09-14T11:23:32.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.438+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=HLQ8CLPH2NIK type=del 2024-09-14T11:23:32.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.440+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~CO6AAJH6U8P8.0 size=1048576 2024-09-14T11:23:32.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.441+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~CO6AAJH6U8P8.1 size=565789 2024-09-14T11:23:32.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.441+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=CO6AAJH6U8P8 tag=VVEA2NCRTE2X type=write size=2662941 2024-09-14T11:23:32.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.442+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=7070KNRPLNL3 type=del 2024-09-14T11:23:32.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.444+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~LJLL0SV2AHWB.0 size=1048576 2024-09-14T11:23:32.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.445+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~LJLL0SV2AHWB.1 size=712485 2024-09-14T11:23:32.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.445+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=LJLL0SV2AHWB tag=D3GAQJRX9DRB type=write size=2809637 2024-09-14T11:23:32.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.446+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~TYHFXPPQEMRB.0 size=333430 2024-09-14T11:23:32.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.448+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=TYHFXPPQEMRB tag=2Y50I99EX600 type=write size=1382006 2024-09-14T11:23:32.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.449+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=VZDZR8HDUJSG type=del size=2526422 2024-09-14T11:23:32.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.450+0000 7f296241c780 -1 < failed to complete operation key=JW3RIVHUFGPI tag=L2VRI049YVHK type=del size=4109544: (22) Invalid argument 2024-09-14T11:23:32.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.451+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=6WRAHWTWWQPE type=del size=2981568 2024-09-14T11:23:32.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.453+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.0 size=1048576 2024-09-14T11:23:32.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.453+0000 7f296241c780 1 < canceled part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.1 size=1048576 2024-09-14T11:23:32.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.453+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~83VDFW67NRR9.2 size=344488 2024-09-14T11:23:32.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.455+0000 7f296241c780 1 < canceled multipart upload key=L0GW4TPQCSUY upload=83VDFW67NRR9 tag=W07SZRVCWZ2P type=write size=3490216 2024-09-14T11:23:32.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.458+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.0 size=1048576 2024-09-14T11:23:32.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.459+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.1 size=1048576 2024-09-14T11:23:32.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.460+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.2 size=151786 2024-09-14T11:23:32.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.460+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=87Y4FNZEKGRD tag=GRF2K88YN864 type=write size=3297514 2024-09-14T11:23:32.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.461+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~GHUGX53TVWV1.0 size=276968 2024-09-14T11:23:32.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.463+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=GHUGX53TVWV1 tag=ZLEIQB325EHE type=write size=1325544 2024-09-14T11:23:32.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.465+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=DHAACXJ9PRED type=del size=139222 2024-09-14T11:23:32.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.466+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~FWS3UQYY05LR.0 size=702411 2024-09-14T11:23:32.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.468+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=FWS3UQYY05LR tag=LMPXCXK2T8Q4 type=write size=1750987 2024-09-14T11:23:32.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.469+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=RV1EAISV4WND type=del size=225445 2024-09-14T11:23:32.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.470+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~NLTMZ0FCRFZN.0 size=484464 2024-09-14T11:23:32.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.472+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=NLTMZ0FCRFZN tag=LDCUGL0L1ZQ4 type=write size=1533040 2024-09-14T11:23:32.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.474+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~1HZSJVNHRH8W.0 size=763913 2024-09-14T11:23:32.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.474+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=1HZSJVNHRH8W tag=YRV4D7VP8ZEN type=write size=1812489 2024-09-14T11:23:32.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.475+0000 7f296241c780 1 < completed write operation key=I1XBOS1L5D98 tag=P5GTFRCJF268 type=write size=900831 2024-09-14T11:23:32.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.477+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=H4MP89TLOIP2 type=del size=2664034 2024-09-14T11:23:32.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.479+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=7V5VP8J0FVCI type=del 2024-09-14T11:23:32.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.480+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=XEG4VQY0DR11 type=del size=128371 2024-09-14T11:23:32.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.481+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=81B6ORMZKKXA type=del 2024-09-14T11:23:32.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.482+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=3UGRL7SW9USS type=write size=243152 2024-09-14T11:23:32.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.483+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=KMBIA1VTHJJW type=write size=273188 2024-09-14T11:23:32.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.485+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=2RWECAY5W50R type=del size=2390223 2024-09-14T11:23:32.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.487+0000 7f296241c780 1 < suggested update operation key=KBMD123LTZA7 tag=T5UXM184VKSY type=del size=2056234 2024-09-14T11:23:32.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.488+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=33GIPTXF95LG type=write size=351191 2024-09-14T11:23:32.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.489+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~H3R1PS1K4301.0 size=715671 2024-09-14T11:23:32.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.492+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=H3R1PS1K4301 tag=5FJQ6M8WQNH8 type=write size=1764247 2024-09-14T11:23:32.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.494+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.0 size=1048576 2024-09-14T11:23:32.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.495+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.1 size=1048576 2024-09-14T11:23:32.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.496+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.2 size=775825 2024-09-14T11:23:32.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.496+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=LJ0CDULR7MLZ tag=98CH8PJKKT7C type=write size=3921553 2024-09-14T11:23:32.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.497+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=CTM4OM0D2I01 type=del 2024-09-14T11:23:32.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.498+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=CAXBCTXJ411P type=del size=1775250 2024-09-14T11:23:32.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.500+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=4LEVPUMOUY7K type=del 2024-09-14T11:23:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.501+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=997S9UOANRDC type=del size=170834 2024-09-14T11:23:32.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.502+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~CO6AAJH6U8P8.0 size=1048576 2024-09-14T11:23:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.503+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~CO6AAJH6U8P8.1 size=565789 2024-09-14T11:23:32.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.505+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=CO6AAJH6U8P8 tag=VVEA2NCRTE2X type=write size=2662941 2024-09-14T11:23:32.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.506+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=BQZ1XG14074T type=del size=3207472 2024-09-14T11:23:32.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.507+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~LJLL0SV2AHWB.0 size=1048576 2024-09-14T11:23:32.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.508+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~LJLL0SV2AHWB.1 size=712485 2024-09-14T11:23:32.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.510+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=LJLL0SV2AHWB tag=D3GAQJRX9DRB type=write size=2809637 2024-09-14T11:23:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.511+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=2SUNVBQ740DK type=del size=236141 2024-09-14T11:23:32.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.512+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=VZDZR8HDUJSG type=del 2024-09-14T11:23:32.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.514+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=G4514L9D2QQ5 type=del size=2772907 2024-09-14T11:23:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.515+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=6WRAHWTWWQPE type=del 2024-09-14T11:23:32.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.517+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~3CJZCIL5EQ3X.0 size=1048576 2024-09-14T11:23:32.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.517+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~3CJZCIL5EQ3X.1 size=790791 2024-09-14T11:23:32.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.517+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=3CJZCIL5EQ3X tag=Z42K5PP3R84J type=write size=2887943 2024-09-14T11:23:32.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.519+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.0 size=1048576 2024-09-14T11:23:32.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.520+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.1 size=1048576 2024-09-14T11:23:32.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.520+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~87Y4FNZEKGRD.2 size=151786 2024-09-14T11:23:32.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.522+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=87Y4FNZEKGRD tag=GRF2K88YN864 type=write size=3297514 2024-09-14T11:23:32.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.524+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.0 size=1048576 2024-09-14T11:23:32.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.525+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.1 size=1048576 2024-09-14T11:23:32.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.526+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.2 size=218236 2024-09-14T11:23:32.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.526+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=ST1VSBC8CK16 tag=N56599H19RSK type=write size=3363964 2024-09-14T11:23:32.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.527+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=DHAACXJ9PRED type=del 2024-09-14T11:23:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.528+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=LS3RSLBLCRPL type=del size=2950877 2024-09-14T11:23:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.529+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=RV1EAISV4WND type=del 2024-09-14T11:23:32.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.530+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=Y5GQ538RSJ1W type=del size=2637383 2024-09-14T11:23:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.531+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~1HZSJVNHRH8W.0 size=763913 2024-09-14T11:23:32.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.533+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=1HZSJVNHRH8W tag=YRV4D7VP8ZEN type=write size=1812489 2024-09-14T11:23:32.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.534+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=DLSW2MZUZEO3 type=del size=526625 2024-09-14T11:23:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.537+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=H4MP89TLOIP2 type=del size=2664034 2024-09-14T11:23:32.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.538+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=2XDAYNO8GMEW type=del size=2903525 2024-09-14T11:23:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.539+0000 7f296241c780 -1 < failed to complete operation key=L0GW4TPQCSUY tag=XEG4VQY0DR11 type=del size=128371: (22) Invalid argument 2024-09-14T11:23:32.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.540+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=AMJ7R0YSKUG2 type=del size=2436746 2024-09-14T11:23:32.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.542+0000 7f296241c780 1 < suggested remove operation key=L8NA53KOAT58 tag=3UGRL7SW9USS type=write 2024-09-14T11:23:32.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.543+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=N4PW9YLCX6Q1 type=del size=671482 2024-09-14T11:23:32.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.544+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=2RWECAY5W50R type=del 2024-09-14T11:23:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.546+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~TG9Y8IN8TJDL.0 size=107735 2024-09-14T11:23:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.546+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=TG9Y8IN8TJDL tag=XJIFWXVTEYNX type=write size=1156311 2024-09-14T11:23:32.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.547+0000 7f296241c780 1 < completed write operation key=3T0SINQVBAGF tag=33GIPTXF95LG type=write size=351191 2024-09-14T11:23:32.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.549+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~91V2XJY435DV.0 size=564098 2024-09-14T11:23:32.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.549+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=91V2XJY435DV tag=TJI7YZLWE3CA type=write size=1612674 2024-09-14T11:23:32.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.551+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.0 size=1048576 2024-09-14T11:23:32.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.552+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.1 size=1048576 2024-09-14T11:23:32.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.554+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~LJ0CDULR7MLZ.2 size=775825 2024-09-14T11:23:32.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.556+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=LJ0CDULR7MLZ tag=98CH8PJKKT7C type=write size=3921553 2024-09-14T11:23:32.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.558+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~J277YGGGBCHF.0 size=1048576 2024-09-14T11:23:32.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.559+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~J277YGGGBCHF.1 size=439184 2024-09-14T11:23:32.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.559+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=J277YGGGBCHF tag=6TFDZPYP6NVT type=write size=2536336 2024-09-14T11:23:32.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.560+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=CAXBCTXJ411P type=del 2024-09-14T11:23:32.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.563+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~T3DKJRFCVB6T.0 size=1048576 2024-09-14T11:23:32.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.564+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~T3DKJRFCVB6T.1 size=204861 2024-09-14T11:23:32.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.564+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=T3DKJRFCVB6T tag=GBCUPTGPP3RI type=write size=2302013 2024-09-14T11:23:32.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.565+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=997S9UOANRDC type=del 2024-09-14T11:23:32.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.566+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=PLDFVRQKI4YI type=write size=676154 2024-09-14T11:23:32.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.568+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=BQZ1XG14074T type=del size=3207472 2024-09-14T11:23:32.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.569+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=1I09L0PM2YWV type=write size=814189 2024-09-14T11:23:32.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.571+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=2SUNVBQ740DK type=del size=236141 2024-09-14T11:23:32.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.572+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=DD9KAB087RII type=del size=3366989 2024-09-14T11:23:32.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.575+0000 7f296241c780 -1 < failed to complete operation key=L8NA53KOAT58 tag=G4514L9D2QQ5 type=del size=2772907: (22) Invalid argument 2024-09-14T11:23:32.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.576+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=RGXTVOHSA930 type=del size=1018822 2024-09-14T11:23:32.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.577+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~3CJZCIL5EQ3X.0 size=1048576 2024-09-14T11:23:32.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.578+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~3CJZCIL5EQ3X.1 size=790791 2024-09-14T11:23:32.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.580+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=3CJZCIL5EQ3X tag=Z42K5PP3R84J type=write size=2887943 2024-09-14T11:23:32.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.581+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=1HT28C1VW0CX type=del size=4106604 2024-09-14T11:23:32.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.582+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.0 size=1048576 2024-09-14T11:23:32.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.583+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.1 size=1048576 2024-09-14T11:23:32.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.583+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~ST1VSBC8CK16.2 size=218236 2024-09-14T11:23:32.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.585+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=ST1VSBC8CK16 tag=N56599H19RSK type=write size=3363964 2024-09-14T11:23:32.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.587+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~K1EONKBDS8AC.0 size=1048576 2024-09-14T11:23:32.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.588+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~K1EONKBDS8AC.1 size=638602 2024-09-14T11:23:32.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.588+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=K1EONKBDS8AC tag=W5TNPXD3S9LS type=write size=2735754 2024-09-14T11:23:32.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.589+0000 7f296241c780 -1 < failed to complete operation key=C1T4CLU3400T tag=LS3RSLBLCRPL type=del size=2950877: (22) Invalid argument 2024-09-14T11:23:32.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.590+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=8CAMR306BK4G type=del size=162236 2024-09-14T11:23:32.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.591+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=Y5GQ538RSJ1W type=del 2024-09-14T11:23:32.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.593+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=U3XG5SNIRWYQ type=del size=1440179 2024-09-14T11:23:32.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.594+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=DLSW2MZUZEO3 type=del 2024-09-14T11:23:32.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.596+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~1W7WZXD92B7U.0 size=1048576 2024-09-14T11:23:32.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.597+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~1W7WZXD92B7U.1 size=287164 2024-09-14T11:23:32.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.597+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=1W7WZXD92B7U tag=ODEPJQORIS42 type=write size=2384316 2024-09-14T11:23:32.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.598+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=2XDAYNO8GMEW type=del 2024-09-14T11:23:32.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.601+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~Z42Y0NF9OA4V.0 size=1048576 2024-09-14T11:23:32.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.602+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~Z42Y0NF9OA4V.1 size=82696 2024-09-14T11:23:32.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.602+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=Z42Y0NF9OA4V tag=PTW0SM6G6JJP type=write size=2179848 2024-09-14T11:23:32.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.603+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=AMJ7R0YSKUG2 type=del 2024-09-14T11:23:32.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.605+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.0 size=1048576 2024-09-14T11:23:32.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.606+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.1 size=1048576 2024-09-14T11:23:32.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.607+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.2 size=876122 2024-09-14T11:23:32.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.607+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=OI8HY1BAEV8L tag=AD37B0RMKKBQ type=write size=4021850 2024-09-14T11:23:32.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.608+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=N4PW9YLCX6Q1 type=del 2024-09-14T11:23:32.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.610+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~PCEXIJW0M68M.0 size=1048576 2024-09-14T11:23:32.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.611+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~PCEXIJW0M68M.1 size=1028416 2024-09-14T11:23:32.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.611+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=PCEXIJW0M68M tag=76N7W3K78ATB type=write size=3125568 2024-09-14T11:23:32.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.611+0000 7f296241c780 1 < canceled part key=_multipart_CQU8M12JCE9T.2~TG9Y8IN8TJDL.0 size=107735 2024-09-14T11:23:32.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.613+0000 7f296241c780 1 < canceled multipart upload key=CQU8M12JCE9T upload=TG9Y8IN8TJDL tag=XJIFWXVTEYNX type=write size=1156311 2024-09-14T11:23:32.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.614+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=II4HE47NTELX type=write size=691458 2024-09-14T11:23:32.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.615+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~91V2XJY435DV.0 size=564098 2024-09-14T11:23:32.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.617+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=91V2XJY435DV tag=TJI7YZLWE3CA type=write size=1612674 2024-09-14T11:23:32.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.619+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~MUCXGJIEBCBL.0 size=1048576 2024-09-14T11:23:32.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.620+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~MUCXGJIEBCBL.1 size=248056 2024-09-14T11:23:32.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.620+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=MUCXGJIEBCBL tag=C5XNHG9Y7P8T type=write size=2345208 2024-09-14T11:23:32.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.621+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~J277YGGGBCHF.0 size=1048576 2024-09-14T11:23:32.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.621+0000 7f296241c780 1 < canceled part key=_multipart_3T0SINQVBAGF.2~J277YGGGBCHF.1 size=439184 2024-09-14T11:23:32.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.623+0000 7f296241c780 1 < canceled multipart upload key=3T0SINQVBAGF upload=J277YGGGBCHF tag=6TFDZPYP6NVT type=write size=2536336 2024-09-14T11:23:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.624+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=5D71GERHZAN9 type=del size=1507462 2024-09-14T11:23:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.625+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~T3DKJRFCVB6T.0 size=1048576 2024-09-14T11:23:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.626+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~T3DKJRFCVB6T.1 size=204861 2024-09-14T11:23:32.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.628+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=T3DKJRFCVB6T tag=GBCUPTGPP3RI type=write size=2302013 2024-09-14T11:23:32.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.629+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=PHCSY5TCR4S1 type=del size=2763881 2024-09-14T11:23:32.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.630+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=PLDFVRQKI4YI type=write size=676154 2024-09-14T11:23:32.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.631+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=9A30TEFPBGCR type=del size=1199529 2024-09-14T11:23:32.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.634+0000 7f296241c780 1 < suggested remove operation key=LK9LRQM3TZRR tag=1I09L0PM2YWV type=write 2024-09-14T11:23:32.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.636+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.0 size=1048576 2024-09-14T11:23:32.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.637+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.1 size=1048576 2024-09-14T11:23:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.638+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.2 size=314805 2024-09-14T11:23:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.638+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=TIALJ82Q2RFW tag=Q8R6MO78WP76 type=write size=3460533 2024-09-14T11:23:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.639+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=DD9KAB087RII type=del 2024-09-14T11:23:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.641+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.0 size=1048576 2024-09-14T11:23:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.642+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.1 size=1048576 2024-09-14T11:23:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.642+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.2 size=816409 2024-09-14T11:23:32.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.642+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=BSMVTLZRGYDU tag=C2T3EZPVAL9M type=write size=3962137 2024-09-14T11:23:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.644+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=RGXTVOHSA930 type=del 2024-09-14T11:23:32.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.646+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~79RU39E09HGS.0 size=1048576 2024-09-14T11:23:32.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.646+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~79RU39E09HGS.1 size=764429 2024-09-14T11:23:32.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.647+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=79RU39E09HGS tag=FLSQKO6A4KTU type=write size=2861581 2024-09-14T11:23:32.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.649+0000 7f296241c780 1 < suggested remove operation key=ILOY74OSG5CQ tag=1HT28C1VW0CX type=del 2024-09-14T11:23:32.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.650+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=LZUU1PTH6K5P type=del size=2908431 2024-09-14T11:23:32.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.651+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~K1EONKBDS8AC.0 size=1048576 2024-09-14T11:23:32.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.652+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~K1EONKBDS8AC.1 size=638602 2024-09-14T11:23:32.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.654+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=K1EONKBDS8AC tag=W5TNPXD3S9LS type=write size=2735754 2024-09-14T11:23:32.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.656+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=7QYPATIAPCXF type=write size=744548 2024-09-14T11:23:32.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.657+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=8CAMR306BK4G type=del 2024-09-14T11:23:32.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.659+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.0 size=1048576 2024-09-14T11:23:32.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.660+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.1 size=1048576 2024-09-14T11:23:32.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.661+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.2 size=910225 2024-09-14T11:23:32.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.661+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=APOIQL3DSIN8 tag=VOT79RZ5TTO1 type=write size=4055953 2024-09-14T11:23:32.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.662+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=U3XG5SNIRWYQ type=del 2024-09-14T11:23:32.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.663+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=8ZD107O60QRY type=del size=907249 2024-09-14T11:23:32.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.664+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~1W7WZXD92B7U.0 size=1048576 2024-09-14T11:23:32.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.665+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~1W7WZXD92B7U.1 size=287164 2024-09-14T11:23:32.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.667+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=1W7WZXD92B7U tag=ODEPJQORIS42 type=write size=2384316 2024-09-14T11:23:32.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.668+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=YYN3EZ5I4O32 type=del size=263086 2024-09-14T11:23:32.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.669+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~Z42Y0NF9OA4V.0 size=1048576 2024-09-14T11:23:32.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.670+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~Z42Y0NF9OA4V.1 size=82696 2024-09-14T11:23:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.672+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=Z42Y0NF9OA4V tag=PTW0SM6G6JJP type=write size=2179848 2024-09-14T11:23:32.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.673+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=6E3084IJUS1E type=del size=3667120 2024-09-14T11:23:32.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.674+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.0 size=1048576 2024-09-14T11:23:32.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.675+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.1 size=1048576 2024-09-14T11:23:32.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.676+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OI8HY1BAEV8L.2 size=876122 2024-09-14T11:23:32.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.678+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=OI8HY1BAEV8L tag=AD37B0RMKKBQ type=write size=4021850 2024-09-14T11:23:32.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.679+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=ACOOCK2L0LWY type=write size=583545 2024-09-14T11:23:32.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.680+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~PCEXIJW0M68M.0 size=1048576 2024-09-14T11:23:32.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.681+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~PCEXIJW0M68M.1 size=1028416 2024-09-14T11:23:32.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.683+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=PCEXIJW0M68M tag=76N7W3K78ATB type=write size=3125568 2024-09-14T11:23:32.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.685+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~M5D64RWR8GYS.0 size=1048576 2024-09-14T11:23:32.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.686+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~M5D64RWR8GYS.1 size=529162 2024-09-14T11:23:32.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.686+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=M5D64RWR8GYS tag=45PBGZVMP9AR type=write size=2626314 2024-09-14T11:23:32.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.687+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=II4HE47NTELX type=write size=691458 2024-09-14T11:23:32.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.689+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=CM12MBQYPJ0Z type=write size=128197 2024-09-14T11:23:32.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.690+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~MUCXGJIEBCBL.0 size=1048576 2024-09-14T11:23:32.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.691+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~MUCXGJIEBCBL.1 size=248056 2024-09-14T11:23:32.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.693+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=MUCXGJIEBCBL tag=C5XNHG9Y7P8T type=write size=2345208 2024-09-14T11:23:32.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.694+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=1PZMT4L96WPS type=del size=1072613 2024-09-14T11:23:32.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.695+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=5D71GERHZAN9 type=del 2024-09-14T11:23:32.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.696+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=1P24M60NATFQ type=del size=3131612 2024-09-14T11:23:32.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.698+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=PHCSY5TCR4S1 type=del size=2763881 2024-09-14T11:23:32.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.699+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=0VOV2IMO2U24 type=write size=940926 2024-09-14T11:23:32.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.701+0000 7f296241c780 1 < canceled operation key=5XAAGDKVBZ0P tag=9A30TEFPBGCR type=del size=1199529 2024-09-14T11:23:32.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.703+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.0 size=1048576 2024-09-14T11:23:32.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.705+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.1 size=1048576 2024-09-14T11:23:32.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.706+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.2 size=81233 2024-09-14T11:23:32.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.706+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=M8L9R5IS7RET tag=TYEUP43MHLFI type=write size=3226961 2024-09-14T11:23:32.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.707+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.0 size=1048576 2024-09-14T11:23:32.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.708+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.1 size=1048576 2024-09-14T11:23:32.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.709+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~TIALJ82Q2RFW.2 size=314805 2024-09-14T11:23:32.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.711+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=TIALJ82Q2RFW tag=Q8R6MO78WP76 type=write size=3460533 2024-09-14T11:23:32.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.713+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.0 size=1048576 2024-09-14T11:23:32.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.714+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.1 size=1048576 2024-09-14T11:23:32.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.715+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.2 size=338239 2024-09-14T11:23:32.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.715+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=IAMQ2UQ1ID3X tag=5QVD8FUAVTR6 type=write size=3483967 2024-09-14T11:23:32.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.716+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.0 size=1048576 2024-09-14T11:23:32.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.717+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.1 size=1048576 2024-09-14T11:23:32.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.717+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~BSMVTLZRGYDU.2 size=816409 2024-09-14T11:23:32.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.720+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=BSMVTLZRGYDU tag=C2T3EZPVAL9M type=write size=3962137 2024-09-14T11:23:32.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.722+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~5RJLWUSXRQ8Y.0 size=1048576 2024-09-14T11:23:32.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.723+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~5RJLWUSXRQ8Y.1 size=913390 2024-09-14T11:23:32.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.723+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=5RJLWUSXRQ8Y tag=CQ09XUU5ENY9 type=write size=3010542 2024-09-14T11:23:32.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.724+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~79RU39E09HGS.0 size=1048576 2024-09-14T11:23:32.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.725+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~79RU39E09HGS.1 size=764429 2024-09-14T11:23:32.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.727+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=79RU39E09HGS tag=FLSQKO6A4KTU type=write size=2861581 2024-09-14T11:23:32.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.728+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=ZR1ZVELHRUSD type=write size=499824 2024-09-14T11:23:32.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.730+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=LZUU1PTH6K5P type=del 2024-09-14T11:23:32.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.731+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=ENBEBGBMQYXC type=del size=532069 2024-09-14T11:23:32.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.732+0000 7f296241c780 1 < completed write operation key=QIVVKYC646IH tag=7QYPATIAPCXF type=write size=744548 2024-09-14T11:23:32.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.733+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=7W4BBHLL4VK5 type=del size=4158663 2024-09-14T11:23:32.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.734+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.0 size=1048576 2024-09-14T11:23:32.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.735+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.1 size=1048576 2024-09-14T11:23:32.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.736+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~APOIQL3DSIN8.2 size=910225 2024-09-14T11:23:32.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.738+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=APOIQL3DSIN8 tag=VOT79RZ5TTO1 type=write size=4055953 2024-09-14T11:23:32.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.740+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.0 size=1048576 2024-09-14T11:23:32.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.741+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.1 size=1048576 2024-09-14T11:23:32.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.742+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.2 size=553886 2024-09-14T11:23:32.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.742+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=SJQDSDWPWMRU tag=17OXXAPG7WS0 type=write size=3699614 2024-09-14T11:23:32.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.743+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=8ZD107O60QRY type=del 2024-09-14T11:23:32.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.744+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=ZR90QYLPITKY type=write size=425462 2024-09-14T11:23:32.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.746+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=YYN3EZ5I4O32 type=del 2024-09-14T11:23:32.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.748+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~4WR3RESV3WEC.0 size=892393 2024-09-14T11:23:32.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.748+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=4WR3RESV3WEC tag=8BXV3OQC2004 type=write size=1940969 2024-09-14T11:23:32.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.749+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=6E3084IJUS1E type=del 2024-09-14T11:23:32.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.752+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~HH9YLXBUDE1S.0 size=414719 2024-09-14T11:23:32.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.752+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=HH9YLXBUDE1S tag=7UUDY6A8KUL7 type=write size=1463295 2024-09-14T11:23:32.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.754+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=ACOOCK2L0LWY type=write size=583545 2024-09-14T11:23:32.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.756+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~ASICW4HC6RY4.0 size=1048576 2024-09-14T11:23:32.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.757+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~ASICW4HC6RY4.1 size=122941 2024-09-14T11:23:32.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.757+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=ASICW4HC6RY4 tag=2Q4RPUO3TQDS type=write size=2220093 2024-09-14T11:23:32.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.759+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~M5D64RWR8GYS.0 size=1048576 2024-09-14T11:23:32.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.759+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~M5D64RWR8GYS.1 size=529162 2024-09-14T11:23:32.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.761+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=M5D64RWR8GYS tag=45PBGZVMP9AR type=write size=2626314 2024-09-14T11:23:32.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.762+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=330HHGVRD2NP type=del size=198150 2024-09-14T11:23:32.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.763+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=CM12MBQYPJ0Z type=write size=128197 2024-09-14T11:23:32.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.765+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~2WE58FQ0YMB4.0 size=561608 2024-09-14T11:23:32.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.765+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=2WE58FQ0YMB4 tag=HHMKNMORR6X3 type=write size=1610184 2024-09-14T11:23:32.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.766+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=1PZMT4L96WPS type=del 2024-09-14T11:23:32.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.768+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.0 size=1048576 2024-09-14T11:23:32.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.769+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.1 size=1048576 2024-09-14T11:23:32.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.770+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.2 size=978091 2024-09-14T11:23:32.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.770+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=6NR0WHXB7G04 tag=VW6VUE5ZBPZB type=write size=4123819 2024-09-14T11:23:32.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.772+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=1P24M60NATFQ type=del 2024-09-14T11:23:32.772 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.774+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.0 size=1048576 2024-09-14T11:23:32.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.775+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.1 size=1048576 2024-09-14T11:23:32.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.776+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.2 size=739797 2024-09-14T11:23:32.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.776+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=OH8KO4M5WRVT tag=N6AE61FCZA9T type=write size=3885525 2024-09-14T11:23:32.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.778+0000 7f296241c780 1 < suggested remove operation key=TNT7E4GX5ZR7 tag=0VOV2IMO2U24 type=write 2024-09-14T11:23:32.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.779+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=WP86YK2PXTM5 type=del size=2514318 2024-09-14T11:23:32.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.780+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.0 size=1048576 2024-09-14T11:23:32.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.781+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.1 size=1048576 2024-09-14T11:23:32.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.782+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~M8L9R5IS7RET.2 size=81233 2024-09-14T11:23:32.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.784+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=M8L9R5IS7RET tag=TYEUP43MHLFI type=write size=3226961 2024-09-14T11:23:32.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.786+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~X4X8Q48NSY9U.0 size=692151 2024-09-14T11:23:32.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.786+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=X4X8Q48NSY9U tag=E7YYU3WL7CNU type=write size=1740727 2024-09-14T11:23:32.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.787+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.0 size=1048576 2024-09-14T11:23:32.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.788+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.1 size=1048576 2024-09-14T11:23:32.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.788+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~IAMQ2UQ1ID3X.2 size=338239 2024-09-14T11:23:32.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.790+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=IAMQ2UQ1ID3X tag=5QVD8FUAVTR6 type=write size=3483967 2024-09-14T11:23:32.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.792+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=1PDYGOSBWPUC type=del size=2444699 2024-09-14T11:23:32.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.792+0000 7f296241c780 1 < canceled part key=_multipart_ILOY74OSG5CQ.2~5RJLWUSXRQ8Y.0 size=1048576 2024-09-14T11:23:32.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.793+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~5RJLWUSXRQ8Y.1 size=913390 2024-09-14T11:23:32.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.795+0000 7f296241c780 1 < canceled multipart upload key=ILOY74OSG5CQ upload=5RJLWUSXRQ8Y tag=CQ09XUU5ENY9 type=write size=3010542 2024-09-14T11:23:32.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.796+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=GJJ25GNYMCR6 type=write size=632470 2024-09-14T11:23:32.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.797+0000 7f296241c780 1 < completed write operation key=HFH3VKZ4T0IR tag=ZR1ZVELHRUSD type=write size=499824 2024-09-14T11:23:32.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.798+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=GQW6YB493E01 type=del size=598512 2024-09-14T11:23:32.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.799+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=ENBEBGBMQYXC type=del 2024-09-14T11:23:32.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.800+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=ACT1X03NR9UH type=del size=2528936 2024-09-14T11:23:32.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.801+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=7W4BBHLL4VK5 type=del 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.803+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~CDDSD88WO0WV.0 size=462436 2024-09-14T11:23:32.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.803+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=CDDSD88WO0WV tag=WIR53RG6MF78 type=write size=1511012 2024-09-14T11:23:32.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.804+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.0 size=1048576 2024-09-14T11:23:32.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.805+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.1 size=1048576 2024-09-14T11:23:32.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.806+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~SJQDSDWPWMRU.2 size=553886 2024-09-14T11:23:32.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.808+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=SJQDSDWPWMRU tag=17OXXAPG7WS0 type=write size=3699614 2024-09-14T11:23:32.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.810+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=PZ5N0DTPXYML type=del size=469609 2024-09-14T11:23:32.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.811+0000 7f296241c780 1 < canceled operation key=R1M982MUIF44 tag=ZR90QYLPITKY type=write size=425462 2024-09-14T11:23:32.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.812+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=X3KDSHY3T1VU type=del size=1419644 2024-09-14T11:23:32.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.814+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~4WR3RESV3WEC.0 size=892393 2024-09-14T11:23:32.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.815+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=4WR3RESV3WEC tag=8BXV3OQC2004 type=write size=1940969 2024-09-14T11:23:32.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.817+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~OZDOF2H7BDOE.0 size=1048576 2024-09-14T11:23:32.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.818+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~OZDOF2H7BDOE.1 size=793886 2024-09-14T11:23:32.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.818+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=OZDOF2H7BDOE tag=RDADKROGSU82 type=write size=2891038 2024-09-14T11:23:32.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.819+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~HH9YLXBUDE1S.0 size=414719 2024-09-14T11:23:32.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.820+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=HH9YLXBUDE1S tag=7UUDY6A8KUL7 type=write size=1463295 2024-09-14T11:23:32.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.822+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~JKTAL4K9RE92.0 size=1048576 2024-09-14T11:23:32.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.823+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~JKTAL4K9RE92.1 size=328076 2024-09-14T11:23:32.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.823+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=JKTAL4K9RE92 tag=3KWUY6DT3FH0 type=write size=2425228 2024-09-14T11:23:32.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.824+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~ASICW4HC6RY4.0 size=1048576 2024-09-14T11:23:32.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.825+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~ASICW4HC6RY4.1 size=122941 2024-09-14T11:23:32.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.827+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=ASICW4HC6RY4 tag=2Q4RPUO3TQDS type=write size=2220093 2024-09-14T11:23:32.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.829+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.0 size=1048576 2024-09-14T11:23:32.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.830+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.1 size=1048576 2024-09-14T11:23:32.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.831+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.2 size=908523 2024-09-14T11:23:32.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.831+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=ET7GD0EAV1M2 tag=VDH59F5XQESS type=write size=4054251 2024-09-14T11:23:32.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.832+0000 7f296241c780 -1 < failed to complete operation key=6DNKZWENMDM9 tag=330HHGVRD2NP type=del size=198150: (22) Invalid argument 2024-09-14T11:23:32.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.833+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=QE53HO3QYLL3 type=del size=564769 2024-09-14T11:23:32.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.835+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~2WE58FQ0YMB4.0 size=561608 2024-09-14T11:23:32.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.836+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=2WE58FQ0YMB4 tag=HHMKNMORR6X3 type=write size=1610184 2024-09-14T11:23:32.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.838+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=3G16IW17H05W type=del size=1708275 2024-09-14T11:23:32.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.839+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.0 size=1048576 2024-09-14T11:23:32.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.840+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.1 size=1048576 2024-09-14T11:23:32.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.841+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~6NR0WHXB7G04.2 size=978091 2024-09-14T11:23:32.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.843+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=6NR0WHXB7G04 tag=VW6VUE5ZBPZB type=write size=4123819 2024-09-14T11:23:32.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.844+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=CS94RBI7UH96 type=del size=2832701 2024-09-14T11:23:32.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.845+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.0 size=1048576 2024-09-14T11:23:32.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.846+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.1 size=1048576 2024-09-14T11:23:32.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.847+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~OH8KO4M5WRVT.2 size=739797 2024-09-14T11:23:32.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.851+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=OH8KO4M5WRVT tag=N6AE61FCZA9T type=write size=3885525 2024-09-14T11:23:32.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.853+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.0 size=1048576 2024-09-14T11:23:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.854+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.1 size=1048576 2024-09-14T11:23:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.855+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.2 size=347154 2024-09-14T11:23:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.855+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=BP6U1VFEPVXQ tag=5Z8LFXM48QW8 type=write size=3492882 2024-09-14T11:23:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.856+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=WP86YK2PXTM5 type=del 2024-09-14T11:23:32.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.859+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~RXR2B6ITDLKE.0 size=594906 2024-09-14T11:23:32.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.859+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=RXR2B6ITDLKE tag=NBWRM3IW9WBR type=write size=1643482 2024-09-14T11:23:32.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.860+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~X4X8Q48NSY9U.0 size=692151 2024-09-14T11:23:32.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.862+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=X4X8Q48NSY9U tag=E7YYU3WL7CNU type=write size=1740727 2024-09-14T11:23:32.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.863+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=0M4G1NZUB1RL type=del size=1674520 2024-09-14T11:23:32.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.864+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=1PDYGOSBWPUC type=del 2024-09-14T11:23:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.865+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=HUPNAMQWXHS3 type=del size=1904639 2024-09-14T11:23:32.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.868+0000 7f296241c780 1 < suggested update operation key=KVQ49I9RAYXA tag=GJJ25GNYMCR6 type=write size=632470 2024-09-14T11:23:32.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.871+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VS5D7168F8O2.0 size=1048576 2024-09-14T11:23:32.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.872+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VS5D7168F8O2.1 size=794123 2024-09-14T11:23:32.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.872+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=VS5D7168F8O2 tag=GCB8WGY2XU15 type=write size=2891275 2024-09-14T11:23:32.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.873+0000 7f296241c780 1 < canceled operation key=JW3RIVHUFGPI tag=GQW6YB493E01 type=del size=598512 2024-09-14T11:23:32.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.875+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=QZFV4WG2EQRF type=write size=426126 2024-09-14T11:23:32.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.877+0000 7f296241c780 1 < suggested update operation key=3T0SINQVBAGF tag=ACT1X03NR9UH type=del size=2528936 2024-09-14T11:23:32.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.878+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=FHBGXOW5E3GZ type=write size=226079 2024-09-14T11:23:32.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.879+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~CDDSD88WO0WV.0 size=462436 2024-09-14T11:23:32.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.881+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=CDDSD88WO0WV tag=WIR53RG6MF78 type=write size=1511012 2024-09-14T11:23:32.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.883+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.0 size=1048576 2024-09-14T11:23:32.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.884+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.1 size=1048576 2024-09-14T11:23:32.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.885+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.2 size=257422 2024-09-14T11:23:32.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.885+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=J0X1VI75EHGN tag=I2RRDKLU66IU type=write size=3403150 2024-09-14T11:23:32.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.887+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=PZ5N0DTPXYML type=del size=469609 2024-09-14T11:23:32.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.889+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=ZZJJ8P12DVLL type=del size=2991547 2024-09-14T11:23:32.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.890+0000 7f296241c780 -1 < failed to complete operation key=6DNKZWENMDM9 tag=X3KDSHY3T1VU type=del size=1419644: (22) Invalid argument 2024-09-14T11:23:32.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.892+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.0 size=1048576 2024-09-14T11:23:32.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.893+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.1 size=1048576 2024-09-14T11:23:32.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.894+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.2 size=867056 2024-09-14T11:23:32.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.894+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=U040AA5L1I2Z tag=1286CGLC0AEH type=write size=4012784 2024-09-14T11:23:32.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.895+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~OZDOF2H7BDOE.0 size=1048576 2024-09-14T11:23:32.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.896+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~OZDOF2H7BDOE.1 size=793886 2024-09-14T11:23:32.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.898+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=OZDOF2H7BDOE tag=RDADKROGSU82 type=write size=2891038 2024-09-14T11:23:32.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.899+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=XT2LRT8GVP0S type=del size=479518 2024-09-14T11:23:32.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.900+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~JKTAL4K9RE92.0 size=1048576 2024-09-14T11:23:32.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.901+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~JKTAL4K9RE92.1 size=328076 2024-09-14T11:23:32.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.903+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=JKTAL4K9RE92 tag=3KWUY6DT3FH0 type=write size=2425228 2024-09-14T11:23:32.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.905+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.0 size=1048576 2024-09-14T11:23:32.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.906+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.1 size=1048576 2024-09-14T11:23:32.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.906+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.2 size=478268 2024-09-14T11:23:32.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.906+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=JMPZWI0U8YWU tag=2F73BVR0QA1H type=write size=3623996 2024-09-14T11:23:32.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.908+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.0 size=1048576 2024-09-14T11:23:32.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.908+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.1 size=1048576 2024-09-14T11:23:32.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.909+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~ET7GD0EAV1M2.2 size=908523 2024-09-14T11:23:32.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.911+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=ET7GD0EAV1M2 tag=VDH59F5XQESS type=write size=4054251 2024-09-14T11:23:32.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.912+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=GM0PJUY7IJYZ type=del size=1134213 2024-09-14T11:23:32.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.913+0000 7f296241c780 1 < canceled operation key=QL439L2X13OR tag=QE53HO3QYLL3 type=del size=564769 2024-09-14T11:23:32.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.914+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=BUUB4ZFNKI8D type=del size=3489295 2024-09-14T11:23:32.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.916+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=3G16IW17H05W type=del 2024-09-14T11:23:32.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.917+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=W56OLI9NRABS type=del size=3503950 2024-09-14T11:23:32.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.920+0000 7f296241c780 1 < suggested remove operation key=5XAAGDKVBZ0P tag=CS94RBI7UH96 type=del 2024-09-14T11:23:32.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.921+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=CWEPCLLYRB6Y type=del size=827719 2024-09-14T11:23:32.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.922+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.0 size=1048576 2024-09-14T11:23:32.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.923+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.1 size=1048576 2024-09-14T11:23:32.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.924+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~BP6U1VFEPVXQ.2 size=347154 2024-09-14T11:23:32.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.925+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=BP6U1VFEPVXQ tag=5Z8LFXM48QW8 type=write size=3492882 2024-09-14T11:23:32.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.927+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.0 size=1048576 2024-09-14T11:23:32.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.928+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.1 size=1048576 2024-09-14T11:23:32.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.929+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.2 size=615579 2024-09-14T11:23:32.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.929+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=ZJ4SOE4LHWPP tag=NDV26TF6V71P type=write size=3761307 2024-09-14T11:23:32.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.930+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~RXR2B6ITDLKE.0 size=594906 2024-09-14T11:23:32.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.932+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=RXR2B6ITDLKE tag=NBWRM3IW9WBR type=write size=1643482 2024-09-14T11:23:32.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.933+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=5Y1QNFUPCQ0K type=del size=2271623 2024-09-14T11:23:32.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.934+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=0M4G1NZUB1RL type=del 2024-09-14T11:23:32.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.936+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.0 size=1048576 2024-09-14T11:23:32.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.937+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.1 size=1048576 2024-09-14T11:23:32.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.938+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.2 size=351375 2024-09-14T11:23:32.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.938+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=9S27U41DTY4E tag=0S56MVY6XEGL type=write size=3497103 2024-09-14T11:23:32.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.939+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=HUPNAMQWXHS3 type=del 2024-09-14T11:23:32.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.941+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~C3PPNVL4E3BN.0 size=387041 2024-09-14T11:23:32.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.941+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=C3PPNVL4E3BN tag=PA7CIM388TAN type=write size=1435617 2024-09-14T11:23:32.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.942+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VS5D7168F8O2.0 size=1048576 2024-09-14T11:23:32.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.943+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VS5D7168F8O2.1 size=794123 2024-09-14T11:23:32.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.945+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=VS5D7168F8O2 tag=GCB8WGY2XU15 type=write size=2891275 2024-09-14T11:23:32.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.946+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=8OPPU1AE27GX type=del size=2194177 2024-09-14T11:23:32.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.948+0000 7f296241c780 1 < suggested update operation key=KVQ49I9RAYXA tag=QZFV4WG2EQRF type=write size=426126 2024-09-14T11:23:32.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.950+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~0WNSXPCCHQ85.0 size=929068 2024-09-14T11:23:32.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.950+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=0WNSXPCCHQ85 tag=KY8OQYHEH9J8 type=write size=1977644 2024-09-14T11:23:32.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.953+0000 7f296241c780 1 < suggested update operation key=HFH3VKZ4T0IR tag=FHBGXOW5E3GZ type=write size=226079 2024-09-14T11:23:32.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.955+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.0 size=1048576 2024-09-14T11:23:32.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.956+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.1 size=1048576 2024-09-14T11:23:32.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.957+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.2 size=377878 2024-09-14T11:23:32.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.957+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=6BCBY54L6H83 tag=VCR5CMJMTAHN type=write size=3523606 2024-09-14T11:23:32.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.958+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.0 size=1048576 2024-09-14T11:23:32.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.959+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.1 size=1048576 2024-09-14T11:23:32.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.960+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~J0X1VI75EHGN.2 size=257422 2024-09-14T11:23:32.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.962+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=J0X1VI75EHGN tag=I2RRDKLU66IU type=write size=3403150 2024-09-14T11:23:32.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.964+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~9ZRHCP6J7DUW.0 size=1048576 2024-09-14T11:23:32.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.965+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~9ZRHCP6J7DUW.1 size=734288 2024-09-14T11:23:32.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.965+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=9ZRHCP6J7DUW tag=RN4XI4UITPR2 type=write size=2831440 2024-09-14T11:23:32.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.966+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=ZZJJ8P12DVLL type=del 2024-09-14T11:23:32.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.968+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=P4Z8SAB6M1EB type=del size=217386 2024-09-14T11:23:32.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.969+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.0 size=1048576 2024-09-14T11:23:32.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.970+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.1 size=1048576 2024-09-14T11:23:32.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.971+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~U040AA5L1I2Z.2 size=867056 2024-09-14T11:23:32.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.973+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=U040AA5L1I2Z tag=1286CGLC0AEH type=write size=4012784 2024-09-14T11:23:32.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.974+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=GBG58Q3U0892 type=del size=545933 2024-09-14T11:23:32.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.975+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=XT2LRT8GVP0S type=del 2024-09-14T11:23:32.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.976+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=RRLSEXQ7A2O0 type=del size=1645126 2024-09-14T11:23:32.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.978+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.0 size=1048576 2024-09-14T11:23:32.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.979+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.1 size=1048576 2024-09-14T11:23:32.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.980+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~JMPZWI0U8YWU.2 size=478268 2024-09-14T11:23:32.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.982+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=JMPZWI0U8YWU tag=2F73BVR0QA1H type=write size=3623996 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.984+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~DVNAPFBVBP64.0 size=612442 2024-09-14T11:23:32.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.984+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=DVNAPFBVBP64 tag=OXZRE4Z19379 type=write size=1661018 2024-09-14T11:23:32.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.985+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=GM0PJUY7IJYZ type=del 2024-09-14T11:23:32.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.986+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=V4C0H8HLQA9O type=del size=1596454 2024-09-14T11:23:32.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.987+0000 7f296241c780 -1 < failed to complete operation key=HFH3VKZ4T0IR tag=BUUB4ZFNKI8D type=del size=3489295: (22) Invalid argument 2024-09-14T11:23:32.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.988+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=8EBQQIY4BK2L type=del size=1269543 2024-09-14T11:23:32.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.991+0000 7f296241c780 1 < suggested remove operation key=FGK7YH1GB4W5 tag=W56OLI9NRABS type=del 2024-09-14T11:23:32.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.993+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~5IX4W774UGBB.0 size=1048576 2024-09-14T11:23:32.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.994+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~5IX4W774UGBB.1 size=523879 2024-09-14T11:23:32.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.994+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=5IX4W774UGBB tag=UA6TX1F5WGLJ type=write size=2621031 2024-09-14T11:23:32.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.996+0000 7f296241c780 1 < suggested remove operation key=I1XBOS1L5D98 tag=CWEPCLLYRB6Y type=del 2024-09-14T11:23:32.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.997+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=S1OPID0MH9DR type=del size=374918 2024-09-14T11:23:32.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.999+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.0 size=1048576 2024-09-14T11:23:32.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.999+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.1 size=1048576 2024-09-14T11:23:32.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:32.999+0000 7f296241c780 1 < canceled part key=_multipart_HFH3VKZ4T0IR.2~ZJ4SOE4LHWPP.2 size=615579 2024-09-14T11:23:32.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.001+0000 7f296241c780 1 < canceled multipart upload key=HFH3VKZ4T0IR upload=ZJ4SOE4LHWPP tag=NDV26TF6V71P type=write size=3761307 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.004+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~OGUO0408XNVZ.0 size=830240 2024-09-14T11:23:33.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.004+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=OGUO0408XNVZ tag=7OEMGCUXIG1E type=write size=1878816 2024-09-14T11:23:33.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.005+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=5Y1QNFUPCQ0K type=del 2024-09-14T11:23:33.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.006+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=OLVGC3NHJX8S type=del size=3883167 2024-09-14T11:23:33.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.007+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.0 size=1048576 2024-09-14T11:23:33.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.008+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.1 size=1048576 2024-09-14T11:23:33.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.009+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~9S27U41DTY4E.2 size=351375 2024-09-14T11:23:33.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.011+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=9S27U41DTY4E tag=0S56MVY6XEGL type=write size=3497103 2024-09-14T11:23:33.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.012+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=GHO1ZP3UHMST type=del size=880420 2024-09-14T11:23:33.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.012+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~C3PPNVL4E3BN.0 size=387041 2024-09-14T11:23:33.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.015+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=C3PPNVL4E3BN tag=PA7CIM388TAN type=write size=1435617 2024-09-14T11:23:33.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.016+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=6FNV5W29UF7B type=del size=1238511 2024-09-14T11:23:33.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.018+0000 7f296241c780 1 < suggested update operation key=OIT1KUT6UEP2 tag=8OPPU1AE27GX type=del size=2194177 2024-09-14T11:23:33.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.020+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~RSY2SXIWE0ZV.0 size=1048576 2024-09-14T11:23:33.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.021+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~RSY2SXIWE0ZV.1 size=75473 2024-09-14T11:23:33.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.021+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=RSY2SXIWE0ZV tag=TZAK9PA7OI6V type=write size=2172625 2024-09-14T11:23:33.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.022+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~0WNSXPCCHQ85.0 size=929068 2024-09-14T11:23:33.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.026+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=0WNSXPCCHQ85 tag=KY8OQYHEH9J8 type=write size=1977644 2024-09-14T11:23:33.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.027+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=YT94B6FB5LBK type=write size=14935 2024-09-14T11:23:33.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.028+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.0 size=1048576 2024-09-14T11:23:33.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.029+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.1 size=1048576 2024-09-14T11:23:33.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.030+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~6BCBY54L6H83.2 size=377878 2024-09-14T11:23:33.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.031+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=6BCBY54L6H83 tag=VCR5CMJMTAHN type=write size=3523606 2024-09-14T11:23:33.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.033+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=PBBHA8LM02GC type=write size=212415 2024-09-14T11:23:33.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.034+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~9ZRHCP6J7DUW.0 size=1048576 2024-09-14T11:23:33.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.035+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~9ZRHCP6J7DUW.1 size=734288 2024-09-14T11:23:33.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.037+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=9ZRHCP6J7DUW tag=RN4XI4UITPR2 type=write size=2831440 2024-09-14T11:23:33.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.038+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=HCLQ5PXQYDUS type=del size=3868679 2024-09-14T11:23:33.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.039+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=P4Z8SAB6M1EB type=del 2024-09-14T11:23:33.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.041+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~K57WDAAT3OIX.0 size=1048576 2024-09-14T11:23:33.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.042+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~K57WDAAT3OIX.1 size=425025 2024-09-14T11:23:33.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.042+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=K57WDAAT3OIX tag=L4WZ4JF6SR10 type=write size=2522177 2024-09-14T11:23:33.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.043+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=GBG58Q3U0892 type=del 2024-09-14T11:23:33.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.045+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~Z7JUMQWKNO4W.0 size=408177 2024-09-14T11:23:33.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.045+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=Z7JUMQWKNO4W tag=XAVNOM6OH4TC type=write size=1456753 2024-09-14T11:23:33.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.046+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=RRLSEXQ7A2O0 type=del 2024-09-14T11:23:33.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.048+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=0ECGHO5Z9XS7 type=del size=3327212 2024-09-14T11:23:33.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.049+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~DVNAPFBVBP64.0 size=612442 2024-09-14T11:23:33.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.051+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=DVNAPFBVBP64 tag=OXZRE4Z19379 type=write size=1661018 2024-09-14T11:23:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.052+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=VPEFBK8F9PQQ type=del size=3750515 2024-09-14T11:23:33.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.053+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=V4C0H8HLQA9O type=del 2024-09-14T11:23:33.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.055+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.0 size=1048576 2024-09-14T11:23:33.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.056+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.1 size=1048576 2024-09-14T11:23:33.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.057+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.2 size=252766 2024-09-14T11:23:33.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.057+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=RI7JGNULBGUT tag=ARBAUYK230OK type=write size=3398494 2024-09-14T11:23:33.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.059+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=8EBQQIY4BK2L type=del 2024-09-14T11:23:33.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.060+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=LHTFOLWYCR2V type=del size=2378934 2024-09-14T11:23:33.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.060+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~5IX4W774UGBB.0 size=1048576 2024-09-14T11:23:33.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.061+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~5IX4W774UGBB.1 size=523879 2024-09-14T11:23:33.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.065+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=5IX4W774UGBB tag=UA6TX1F5WGLJ type=write size=2621031 2024-09-14T11:23:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.066+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=2APL0K3SHYSW type=del size=580599 2024-09-14T11:23:33.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.068+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=S1OPID0MH9DR type=del 2024-09-14T11:23:33.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.070+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~N3O0MPONO2XV.0 size=535099 2024-09-14T11:23:33.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.070+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=N3O0MPONO2XV tag=GY5Z48EF91GC type=write size=1583675 2024-09-14T11:23:33.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.071+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~OGUO0408XNVZ.0 size=830240 2024-09-14T11:23:33.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.073+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=OGUO0408XNVZ tag=7OEMGCUXIG1E type=write size=1878816 2024-09-14T11:23:33.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.075+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=8EJTN721GB8K type=del size=1612116 2024-09-14T11:23:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.077+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=OLVGC3NHJX8S type=del 2024-09-14T11:23:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.079+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.0 size=1048576 2024-09-14T11:23:33.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.080+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.1 size=1048576 2024-09-14T11:23:33.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.081+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.2 size=329257 2024-09-14T11:23:33.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.081+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=BLAVHJKN8JYC tag=BW9CZ55IBCJB type=write size=3474985 2024-09-14T11:23:33.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.082+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=GHO1ZP3UHMST type=del 2024-09-14T11:23:33.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.086+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~JO3RHIZ721VF.0 size=1048576 2024-09-14T11:23:33.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.087+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~JO3RHIZ721VF.1 size=780149 2024-09-14T11:23:33.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.087+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=JO3RHIZ721VF tag=98BEESB54546 type=write size=2877301 2024-09-14T11:23:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.089+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=6FNV5W29UF7B type=del size=1238511 2024-09-14T11:23:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.091+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=PMXHHC5NI6JG type=del size=2016596 2024-09-14T11:23:33.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.092+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~RSY2SXIWE0ZV.0 size=1048576 2024-09-14T11:23:33.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.093+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~RSY2SXIWE0ZV.1 size=75473 2024-09-14T11:23:33.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.094+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=RSY2SXIWE0ZV tag=TZAK9PA7OI6V type=write size=2172625 2024-09-14T11:23:33.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.096+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=MER0YF3ZGY2Z type=del size=4183632 2024-09-14T11:23:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.097+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=YT94B6FB5LBK type=write size=14935 2024-09-14T11:23:33.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.098+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=L620J8D5MJYB type=del size=3609692 2024-09-14T11:23:33.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.100+0000 7f296241c780 1 < suggested update operation key=ILOY74OSG5CQ tag=PBBHA8LM02GC type=write size=212415 2024-09-14T11:23:33.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.101+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=CKSQKDD37R2N type=del size=1507658 2024-09-14T11:23:33.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.102+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=HCLQ5PXQYDUS type=del 2024-09-14T11:23:33.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.103+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=VZCTVE2N3RXB type=del size=3579332 2024-09-14T11:23:33.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.105+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~K57WDAAT3OIX.0 size=1048576 2024-09-14T11:23:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.106+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~K57WDAAT3OIX.1 size=425025 2024-09-14T11:23:33.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.108+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=K57WDAAT3OIX tag=L4WZ4JF6SR10 type=write size=2522177 2024-09-14T11:23:33.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.110+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.0 size=1048576 2024-09-14T11:23:33.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.111+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.1 size=1048576 2024-09-14T11:23:33.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.112+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.2 size=632179 2024-09-14T11:23:33.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.112+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=DHYNEHC6ZRN8 tag=L7EL0XYA0G6U type=write size=3777907 2024-09-14T11:23:33.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.113+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~Z7JUMQWKNO4W.0 size=408177 2024-09-14T11:23:33.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.115+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=Z7JUMQWKNO4W tag=XAVNOM6OH4TC type=write size=1456753 2024-09-14T11:23:33.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.117+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=JBT9WLUDPD3O type=write size=125288 2024-09-14T11:23:33.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.118+0000 7f296241c780 1 < canceled operation key=QIVVKYC646IH tag=0ECGHO5Z9XS7 type=del size=3327212 2024-09-14T11:23:33.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.119+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=V9BDSUORYG5G type=del size=636391 2024-09-14T11:23:33.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.122+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=VPEFBK8F9PQQ type=del size=3750515 2024-09-14T11:23:33.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.123+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=8I9NUF39RZLY type=del size=2239670 2024-09-14T11:23:33.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.123+0000 7f296241c780 1 < canceled part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.0 size=1048576 2024-09-14T11:23:33.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.124+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.1 size=1048576 2024-09-14T11:23:33.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.125+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~RI7JGNULBGUT.2 size=252766 2024-09-14T11:23:33.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.127+0000 7f296241c780 1 < canceled multipart upload key=3T0SINQVBAGF upload=RI7JGNULBGUT tag=ARBAUYK230OK type=write size=3398494 2024-09-14T11:23:33.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.128+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=BX3JMZ9D9YGZ type=del size=3726144 2024-09-14T11:23:33.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.129+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=LHTFOLWYCR2V type=del 2024-09-14T11:23:33.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.131+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=CNUCGOKL4AFB type=del size=4168947 2024-09-14T11:23:33.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.132+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=2APL0K3SHYSW type=del 2024-09-14T11:23:33.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.134+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.0 size=1048576 2024-09-14T11:23:33.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.135+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.1 size=1048576 2024-09-14T11:23:33.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.136+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.2 size=635276 2024-09-14T11:23:33.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.136+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=CNRBZAGUZT3B tag=W1TO77B5E8DK type=write size=3781004 2024-09-14T11:23:33.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.137+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~N3O0MPONO2XV.0 size=535099 2024-09-14T11:23:33.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.140+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=N3O0MPONO2XV tag=GY5Z48EF91GC type=write size=1583675 2024-09-14T11:23:33.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.141+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=W6EIDSL81P06 type=write size=846874 2024-09-14T11:23:33.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.142+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=8EJTN721GB8K type=del 2024-09-14T11:23:33.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.144+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=FMZWPTSOCOUU type=write size=582903 2024-09-14T11:23:33.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.145+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.0 size=1048576 2024-09-14T11:23:33.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.146+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.1 size=1048576 2024-09-14T11:23:33.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.147+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~BLAVHJKN8JYC.2 size=329257 2024-09-14T11:23:33.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.149+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=BLAVHJKN8JYC tag=BW9CZ55IBCJB type=write size=3474985 2024-09-14T11:23:33.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.151+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.0 size=1048576 2024-09-14T11:23:33.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.152+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.1 size=1048576 2024-09-14T11:23:33.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.153+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.2 size=259076 2024-09-14T11:23:33.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.153+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=249VJAINQ1MY tag=L4MG36CYAGVK type=write size=3404804 2024-09-14T11:23:33.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.154+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~JO3RHIZ721VF.0 size=1048576 2024-09-14T11:23:33.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.155+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~JO3RHIZ721VF.1 size=780149 2024-09-14T11:23:33.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.157+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=JO3RHIZ721VF tag=98BEESB54546 type=write size=2877301 2024-09-14T11:23:33.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.159+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~JXZG4Z3XLY92.0 size=121471 2024-09-14T11:23:33.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.159+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=JXZG4Z3XLY92 tag=XUUE5OF6VNNV type=write size=1170047 2024-09-14T11:23:33.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.161+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=PMXHHC5NI6JG type=del 2024-09-14T11:23:33.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.163+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~EGRT6MM75QJ8.0 size=587336 2024-09-14T11:23:33.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.163+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=EGRT6MM75QJ8 tag=ZCMBEXKPXN5X type=write size=1635912 2024-09-14T11:23:33.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.164+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=MER0YF3ZGY2Z type=del 2024-09-14T11:23:33.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.166+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.0 size=1048576 2024-09-14T11:23:33.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.167+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.1 size=1048576 2024-09-14T11:23:33.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.168+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.2 size=845029 2024-09-14T11:23:33.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.168+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=O32X0K3I41V3 tag=JT7QVK831R12 type=write size=3990757 2024-09-14T11:23:33.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.171+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=L620J8D5MJYB type=del size=3609692 2024-09-14T11:23:33.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.172+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=3J1NH5XDM2NU type=write size=355770 2024-09-14T11:23:33.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.173+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=CKSQKDD37R2N type=del 2024-09-14T11:23:33.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.176+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~BZI3VKC8ST4U.0 size=1048576 2024-09-14T11:23:33.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.176+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~BZI3VKC8ST4U.1 size=621059 2024-09-14T11:23:33.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.176+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=BZI3VKC8ST4U tag=YVREV04K2NM4 type=write size=2718211 2024-09-14T11:23:33.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.178+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=VZCTVE2N3RXB type=del 2024-09-14T11:23:33.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.179+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=GCEP4EK4KHIA type=write size=842531 2024-09-14T11:23:33.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.180+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.0 size=1048576 2024-09-14T11:23:33.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.181+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.1 size=1048576 2024-09-14T11:23:33.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.182+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~DHYNEHC6ZRN8.2 size=632179 2024-09-14T11:23:33.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.184+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=DHYNEHC6ZRN8 tag=L7EL0XYA0G6U type=write size=3777907 2024-09-14T11:23:33.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.185+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=DZ4W7HA2UE9F type=del size=820710 2024-09-14T11:23:33.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.188+0000 7f296241c780 1 < suggested remove operation key=GJ2Y7ICBEZJX tag=JBT9WLUDPD3O type=write 2024-09-14T11:23:33.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.189+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=BJCEBDCX62EY type=del size=19366 2024-09-14T11:23:33.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.190+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=V9BDSUORYG5G type=del 2024-09-14T11:23:33.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.191+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=51ZIFPSUPBRU type=del size=719892 2024-09-14T11:23:33.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.192+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=8I9NUF39RZLY type=del size=2239670 2024-09-14T11:23:33.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.194+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.0 size=1048576 2024-09-14T11:23:33.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.195+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.1 size=1048576 2024-09-14T11:23:33.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.196+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.2 size=723691 2024-09-14T11:23:33.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.196+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=OZOO513X0DPH tag=5ASMUST1UVHB type=write size=3869419 2024-09-14T11:23:33.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.198+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=BX3JMZ9D9YGZ type=del 2024-09-14T11:23:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.200+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~LWWM44SFQCV9.0 size=300499 2024-09-14T11:23:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.200+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=LWWM44SFQCV9 tag=FUVQFB4PLF72 type=write size=1349075 2024-09-14T11:23:33.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.201+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=CNUCGOKL4AFB type=del 2024-09-14T11:23:33.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.203+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=BWVKUG7VIKFX type=del size=3805896 2024-09-14T11:23:33.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.204+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.0 size=1048576 2024-09-14T11:23:33.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.205+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.1 size=1048576 2024-09-14T11:23:33.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.206+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~CNRBZAGUZT3B.2 size=635276 2024-09-14T11:23:33.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.208+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=CNRBZAGUZT3B tag=W1TO77B5E8DK type=write size=3781004 2024-09-14T11:23:33.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.210+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~YGE3FB1MDHDA.0 size=1048576 2024-09-14T11:23:33.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.211+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~YGE3FB1MDHDA.1 size=382610 2024-09-14T11:23:33.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.211+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=YGE3FB1MDHDA tag=P3TY4LVCISBN type=write size=2479762 2024-09-14T11:23:33.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.214+0000 7f296241c780 1 < suggested remove operation key=K61XH5E6TF3Y tag=W6EIDSL81P06 type=write 2024-09-14T11:23:33.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.216+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~4OMHXCRJX5ZL.0 size=105790 2024-09-14T11:23:33.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.216+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=4OMHXCRJX5ZL tag=CRKOYLJ0POAH type=write size=1154366 2024-09-14T11:23:33.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.218+0000 7f296241c780 1 < completed write operation key=XTS8B3LEW0Y3 tag=FMZWPTSOCOUU type=write size=582903 2024-09-14T11:23:33.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.219+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=CZQA03XT7FGP type=del size=1655957 2024-09-14T11:23:33.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.220+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.0 size=1048576 2024-09-14T11:23:33.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.221+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.1 size=1048576 2024-09-14T11:23:33.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.222+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~249VJAINQ1MY.2 size=259076 2024-09-14T11:23:33.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.224+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=249VJAINQ1MY tag=L4MG36CYAGVK type=write size=3404804 2024-09-14T11:23:33.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.226+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=EH2Q03J1C4GO type=del size=1901581 2024-09-14T11:23:33.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.227+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~JXZG4Z3XLY92.0 size=121471 2024-09-14T11:23:33.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.229+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=JXZG4Z3XLY92 tag=XUUE5OF6VNNV type=write size=1170047 2024-09-14T11:23:33.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.230+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=6HDPPBDH6V5M type=del size=121555 2024-09-14T11:23:33.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.231+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~EGRT6MM75QJ8.0 size=587336 2024-09-14T11:23:33.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.233+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=EGRT6MM75QJ8 tag=ZCMBEXKPXN5X type=write size=1635912 2024-09-14T11:23:33.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.235+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.0 size=1048576 2024-09-14T11:23:33.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.236+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.1 size=1048576 2024-09-14T11:23:33.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.237+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.2 size=975133 2024-09-14T11:23:33.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.237+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=9M2GQ38R0ZXK tag=AWLN1K9YRHHU type=write size=4120861 2024-09-14T11:23:33.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.238+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.0 size=1048576 2024-09-14T11:23:33.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.239+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.1 size=1048576 2024-09-14T11:23:33.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.239+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~O32X0K3I41V3.2 size=845029 2024-09-14T11:23:33.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.241+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=O32X0K3I41V3 tag=JT7QVK831R12 type=write size=3990757 2024-09-14T11:23:33.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.242+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=ATIA59K3NCG3 type=write size=579491 2024-09-14T11:23:33.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.244+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=3J1NH5XDM2NU type=write size=355770 2024-09-14T11:23:33.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.246+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~R5LRPPKZTIYP.0 size=639589 2024-09-14T11:23:33.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.246+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=R5LRPPKZTIYP tag=LQVIVK7Q80BN type=write size=1688165 2024-09-14T11:23:33.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.247+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~BZI3VKC8ST4U.0 size=1048576 2024-09-14T11:23:33.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.248+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~BZI3VKC8ST4U.1 size=621059 2024-09-14T11:23:33.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.251+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=BZI3VKC8ST4U tag=YVREV04K2NM4 type=write size=2718211 2024-09-14T11:23:33.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.253+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=IVE4XIUWBTOL type=del size=753898 2024-09-14T11:23:33.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.254+0000 7f296241c780 1 < canceled operation key=HFH3VKZ4T0IR tag=GCEP4EK4KHIA type=write size=842531 2024-09-14T11:23:33.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.256+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~VMMAWM313L4V.0 size=1048576 2024-09-14T11:23:33.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.257+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~VMMAWM313L4V.1 size=57372 2024-09-14T11:23:33.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.257+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=VMMAWM313L4V tag=21I75RD11ISU type=write size=2154524 2024-09-14T11:23:33.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.258+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=DZ4W7HA2UE9F type=del 2024-09-14T11:23:33.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.259+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=WYJ9MB62Z74Y type=del size=1260211 2024-09-14T11:23:33.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.260+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=BJCEBDCX62EY type=del 2024-09-14T11:23:33.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.261+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=LMTQZZZ3PT93 type=del size=1402307 2024-09-14T11:23:33.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.264+0000 7f296241c780 1 < suggested remove operation key=GJ2Y7ICBEZJX tag=51ZIFPSUPBRU type=del 2024-09-14T11:23:33.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.265+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=GAVLP0UDAZTO type=del size=4182690 2024-09-14T11:23:33.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.266+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.0 size=1048576 2024-09-14T11:23:33.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.267+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.1 size=1048576 2024-09-14T11:23:33.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.268+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~OZOO513X0DPH.2 size=723691 2024-09-14T11:23:33.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.270+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=OZOO513X0DPH tag=5ASMUST1UVHB type=write size=3869419 2024-09-14T11:23:33.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.272+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~D18IIRQEYGP3.0 size=1048576 2024-09-14T11:23:33.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.273+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~D18IIRQEYGP3.1 size=420359 2024-09-14T11:23:33.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.273+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=D18IIRQEYGP3 tag=G7TBBK82FYDM type=write size=2517511 2024-09-14T11:23:33.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.274+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~LWWM44SFQCV9.0 size=300499 2024-09-14T11:23:33.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.276+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=LWWM44SFQCV9 tag=FUVQFB4PLF72 type=write size=1349075 2024-09-14T11:23:33.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.278+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.0 size=1048576 2024-09-14T11:23:33.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.279+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.1 size=1048576 2024-09-14T11:23:33.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.280+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.2 size=406085 2024-09-14T11:23:33.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.280+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=66Q1QPSD56LM tag=Y0XRD6V0YIRE type=write size=3551813 2024-09-14T11:23:33.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.281+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=BWVKUG7VIKFX type=del 2024-09-14T11:23:33.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.282+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=6PVTO67CYEBE type=del size=962590 2024-09-14T11:23:33.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.283+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~YGE3FB1MDHDA.0 size=1048576 2024-09-14T11:23:33.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.284+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~YGE3FB1MDHDA.1 size=382610 2024-09-14T11:23:33.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.286+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=YGE3FB1MDHDA tag=P3TY4LVCISBN type=write size=2479762 2024-09-14T11:23:33.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.289+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=LHF0C96OF4BQ type=del size=520388 2024-09-14T11:23:33.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.290+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~4OMHXCRJX5ZL.0 size=105790 2024-09-14T11:23:33.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.292+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=4OMHXCRJX5ZL tag=CRKOYLJ0POAH type=write size=1154366 2024-09-14T11:23:33.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.293+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=NRNPCF879EE5 type=del size=1701469 2024-09-14T11:23:33.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.294+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=CZQA03XT7FGP type=del 2024-09-14T11:23:33.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.296+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~TUSRQFYUAXUW.0 size=1048576 2024-09-14T11:23:33.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.297+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~TUSRQFYUAXUW.1 size=1027817 2024-09-14T11:23:33.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.297+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=TUSRQFYUAXUW tag=F34CHKBS503X type=write size=3124969 2024-09-14T11:23:33.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.298+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=EH2Q03J1C4GO type=del 2024-09-14T11:23:33.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.301+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~FK2EWV23FKMD.0 size=83233 2024-09-14T11:23:33.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.301+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=FK2EWV23FKMD tag=F2BPW1QMHV4P type=write size=1131809 2024-09-14T11:23:33.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.302+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=6HDPPBDH6V5M type=del 2024-09-14T11:23:33.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.303+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=FL1JAH1Q6PGU type=del size=1774298 2024-09-14T11:23:33.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.304+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.0 size=1048576 2024-09-14T11:23:33.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.305+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.1 size=1048576 2024-09-14T11:23:33.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.306+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~9M2GQ38R0ZXK.2 size=975133 2024-09-14T11:23:33.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.308+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=9M2GQ38R0ZXK tag=AWLN1K9YRHHU type=write size=4120861 2024-09-14T11:23:33.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.309+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=A0OMAAXVJ3TI type=write size=273837 2024-09-14T11:23:33.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.312+0000 7f296241c780 1 < suggested update operation key=L8NA53KOAT58 tag=ATIA59K3NCG3 type=write size=579491 2024-09-14T11:23:33.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.313+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=GPG44G77YEFS type=del size=409211 2024-09-14T11:23:33.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.314+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~R5LRPPKZTIYP.0 size=639589 2024-09-14T11:23:33.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.316+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=R5LRPPKZTIYP tag=LQVIVK7Q80BN type=write size=1688165 2024-09-14T11:23:33.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.317+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=KO2MONE1H9Q2 type=del size=1638765 2024-09-14T11:23:33.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.318+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=IVE4XIUWBTOL type=del 2024-09-14T11:23:33.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.320+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~XO5AIM2HCLT7.0 size=690084 2024-09-14T11:23:33.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.320+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=XO5AIM2HCLT7 tag=BZVVL9SDGCBP type=write size=1738660 2024-09-14T11:23:33.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.322+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~VMMAWM313L4V.0 size=1048576 2024-09-14T11:23:33.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.322+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~VMMAWM313L4V.1 size=57372 2024-09-14T11:23:33.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.324+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=VMMAWM313L4V tag=21I75RD11ISU type=write size=2154524 2024-09-14T11:23:33.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.327+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~SHDA272E45IZ.0 size=1048576 2024-09-14T11:23:33.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.327+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~SHDA272E45IZ.1 size=60126 2024-09-14T11:23:33.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.327+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=SHDA272E45IZ tag=0OM6BCK11U3M type=write size=2157278 2024-09-14T11:23:33.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.329+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=WYJ9MB62Z74Y type=del 2024-09-14T11:23:33.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.331+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~M2GFYUKKWSLM.0 size=151059 2024-09-14T11:23:33.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.331+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=M2GFYUKKWSLM tag=EJYZSD0CTKGI type=write size=1199635 2024-09-14T11:23:33.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.332+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=LMTQZZZ3PT93 type=del 2024-09-14T11:23:33.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.333+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=RPXRTRIQIVI7 type=write size=307447 2024-09-14T11:23:33.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.334+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=GAVLP0UDAZTO type=del 2024-09-14T11:23:33.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.335+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=R2UZ9XM8XYUX type=del size=184047 2024-09-14T11:23:33.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.336+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~D18IIRQEYGP3.0 size=1048576 2024-09-14T11:23:33.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.337+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~D18IIRQEYGP3.1 size=420359 2024-09-14T11:23:33.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.339+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=D18IIRQEYGP3 tag=G7TBBK82FYDM type=write size=2517511 2024-09-14T11:23:33.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.340+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=IXE9K3PDWDO0 type=del size=926918 2024-09-14T11:23:33.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.341+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.0 size=1048576 2024-09-14T11:23:33.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.342+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.1 size=1048576 2024-09-14T11:23:33.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.343+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~66Q1QPSD56LM.2 size=406085 2024-09-14T11:23:33.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.345+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=66Q1QPSD56LM tag=Y0XRD6V0YIRE type=write size=3551813 2024-09-14T11:23:33.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.347+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~MV1RCI3ILRCQ.0 size=1048576 2024-09-14T11:23:33.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.348+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~MV1RCI3ILRCQ.1 size=470524 2024-09-14T11:23:33.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.348+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=MV1RCI3ILRCQ tag=W5J0GUAO8Y0K type=write size=2567676 2024-09-14T11:23:33.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.349+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=6PVTO67CYEBE type=del 2024-09-14T11:23:33.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.351+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~KPMN7IR2SH2L.0 size=1048576 2024-09-14T11:23:33.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.352+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~KPMN7IR2SH2L.1 size=572901 2024-09-14T11:23:33.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.352+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=KPMN7IR2SH2L tag=D80BWKR5TZVZ type=write size=2670053 2024-09-14T11:23:33.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.354+0000 7f296241c780 1 < suggested remove operation key=CQU8M12JCE9T tag=LHF0C96OF4BQ type=del 2024-09-14T11:23:33.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.355+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=M5UA1BS1577L type=del size=1517458 2024-09-14T11:23:33.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.356+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=NRNPCF879EE5 type=del 2024-09-14T11:23:33.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.358+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.0 size=1048576 2024-09-14T11:23:33.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.361+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.1 size=1048576 2024-09-14T11:23:33.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.362+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.2 size=197591 2024-09-14T11:23:33.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.362+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=P9OMVK8ILVYC tag=M6PXGXUSLS2Q type=write size=3343319 2024-09-14T11:23:33.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.363+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~TUSRQFYUAXUW.0 size=1048576 2024-09-14T11:23:33.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.364+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~TUSRQFYUAXUW.1 size=1027817 2024-09-14T11:23:33.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.366+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=TUSRQFYUAXUW tag=F34CHKBS503X type=write size=3124969 2024-09-14T11:23:33.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.367+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=R3XE0N0DN6LV type=del size=1207058 2024-09-14T11:23:33.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.369+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~FK2EWV23FKMD.0 size=83233 2024-09-14T11:23:33.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.371+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=FK2EWV23FKMD tag=F2BPW1QMHV4P type=write size=1131809 2024-09-14T11:23:33.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.372+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=HKKNWOQHEQXO type=del size=1427189 2024-09-14T11:23:33.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.373+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=FL1JAH1Q6PGU type=del 2024-09-14T11:23:33.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.374+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=7S6736ZOTJ8X type=del size=787800 2024-09-14T11:23:33.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.375+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=A0OMAAXVJ3TI type=write size=273837 2024-09-14T11:23:33.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.377+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.0 size=1048576 2024-09-14T11:23:33.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.378+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.1 size=1048576 2024-09-14T11:23:33.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.379+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.2 size=988213 2024-09-14T11:23:33.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.379+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=RQF22ZAVAT31 tag=EVUIFCC9VZXO type=write size=4133941 2024-09-14T11:23:33.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.380+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=GPG44G77YEFS type=del 2024-09-14T11:23:33.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.382+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=X70406U6Y264 type=del size=3637401 2024-09-14T11:23:33.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.383+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=KO2MONE1H9Q2 type=del 2024-09-14T11:23:33.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.384+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=SMYAL9QF6WCM type=del size=2491237 2024-09-14T11:23:33.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.385+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~XO5AIM2HCLT7.0 size=690084 2024-09-14T11:23:33.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.387+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=XO5AIM2HCLT7 tag=BZVVL9SDGCBP type=write size=1738660 2024-09-14T11:23:33.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.389+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~SRJ0ZT0D001A.0 size=1048576 2024-09-14T11:23:33.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.390+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~SRJ0ZT0D001A.1 size=177971 2024-09-14T11:23:33.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.390+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=SRJ0ZT0D001A tag=GHB417WSECW7 type=write size=2275123 2024-09-14T11:23:33.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.391+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~SHDA272E45IZ.0 size=1048576 2024-09-14T11:23:33.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.392+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~SHDA272E45IZ.1 size=60126 2024-09-14T11:23:33.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.394+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=SHDA272E45IZ tag=0OM6BCK11U3M type=write size=2157278 2024-09-14T11:23:33.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.395+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=MWW0JS6L66PT type=del size=662684 2024-09-14T11:23:33.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.397+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~M2GFYUKKWSLM.0 size=151059 2024-09-14T11:23:33.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.398+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=M2GFYUKKWSLM tag=EJYZSD0CTKGI type=write size=1199635 2024-09-14T11:23:33.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.400+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=P5Y3GQC4ZDAC type=del size=3781710 2024-09-14T11:23:33.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.401+0000 7f296241c780 1 < canceled operation key=R1M982MUIF44 tag=RPXRTRIQIVI7 type=write size=307447 2024-09-14T11:23:33.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.402+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=70QZY126TK84 type=del size=648764 2024-09-14T11:23:33.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.403+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=R2UZ9XM8XYUX type=del 2024-09-14T11:23:33.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.404+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=PH001V1QAPDV type=write size=975195 2024-09-14T11:23:33.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.406+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=IXE9K3PDWDO0 type=del size=926918 2024-09-14T11:23:33.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.407+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=2YWAZD1RR06K type=del size=3141175 2024-09-14T11:23:33.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.408+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~MV1RCI3ILRCQ.0 size=1048576 2024-09-14T11:23:33.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.409+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~MV1RCI3ILRCQ.1 size=470524 2024-09-14T11:23:33.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.411+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=MV1RCI3ILRCQ tag=W5J0GUAO8Y0K type=write size=2567676 2024-09-14T11:23:33.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.412+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=ZHFIIIPMV83S type=del size=3105195 2024-09-14T11:23:33.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.413+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~KPMN7IR2SH2L.0 size=1048576 2024-09-14T11:23:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.414+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~KPMN7IR2SH2L.1 size=572901 2024-09-14T11:23:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.416+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=KPMN7IR2SH2L tag=D80BWKR5TZVZ type=write size=2670053 2024-09-14T11:23:33.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.417+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=191HZTVZYK3J type=del size=1795382 2024-09-14T11:23:33.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.420+0000 7f296241c780 1 < suggested remove operation key=7WGFBTAM25J9 tag=M5UA1BS1577L type=del 2024-09-14T11:23:33.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.422+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~366UUXCCRIQH.0 size=1048576 2024-09-14T11:23:33.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.423+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~366UUXCCRIQH.1 size=976831 2024-09-14T11:23:33.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.423+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=366UUXCCRIQH tag=4734X9UXPVTU type=write size=3073983 2024-09-14T11:23:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.424+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.0 size=1048576 2024-09-14T11:23:33.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.425+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.1 size=1048576 2024-09-14T11:23:33.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.426+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~P9OMVK8ILVYC.2 size=197591 2024-09-14T11:23:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.428+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=P9OMVK8ILVYC tag=M6PXGXUSLS2Q type=write size=3343319 2024-09-14T11:23:33.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.430+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~GXBYUT08E1UI.0 size=1048576 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.431+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~GXBYUT08E1UI.1 size=676566 2024-09-14T11:23:33.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.431+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=GXBYUT08E1UI tag=ZRMIZHJPSL10 type=write size=2773718 2024-09-14T11:23:33.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.432+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=R3XE0N0DN6LV type=del 2024-09-14T11:23:33.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.433+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=63OS92GBHRCB type=del size=2848521 2024-09-14T11:23:33.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.434+0000 7f296241c780 1 < canceled operation key=L0GW4TPQCSUY tag=HKKNWOQHEQXO type=del size=1427189 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.435+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=ZA33QTZ9BOT1 type=del size=3186204 2024-09-14T11:23:33.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.436+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=7S6736ZOTJ8X type=del 2024-09-14T11:23:33.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.438+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=NWOR5ZJG0DGK type=del size=2741617 2024-09-14T11:23:33.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.439+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.0 size=1048576 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.440+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.1 size=1048576 2024-09-14T11:23:33.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.440+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~RQF22ZAVAT31.2 size=988213 2024-09-14T11:23:33.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.441+0000 7f296241c780 1 < canceled multipart upload key=I6UYPPUMN0FB upload=RQF22ZAVAT31 tag=EVUIFCC9VZXO type=write size=4133941 2024-09-14T11:23:33.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.443+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=GIEK82SMVOJI type=del size=3273897 2024-09-14T11:23:33.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.443+0000 7f296241c780 -1 < no bi entry to suggest for operation key=7WGFBTAM25J9 tag=X70406U6Y264 type=del size=3637401: (2) No such file or directory 2024-09-14T11:23:33.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.445+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.0 size=1048576 2024-09-14T11:23:33.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.446+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.1 size=1048576 2024-09-14T11:23:33.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.447+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.2 size=206331 2024-09-14T11:23:33.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.447+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=PHLEMADZEEIZ tag=5NOPG0YFUKME type=write size=3352059 2024-09-14T11:23:33.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.448+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=SMYAL9QF6WCM type=del 2024-09-14T11:23:33.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.449+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=TG3J7HPUE9CW type=del size=2341304 2024-09-14T11:23:33.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.450+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~SRJ0ZT0D001A.0 size=1048576 2024-09-14T11:23:33.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.451+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~SRJ0ZT0D001A.1 size=177971 2024-09-14T11:23:33.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.453+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=SRJ0ZT0D001A tag=GHB417WSECW7 type=write size=2275123 2024-09-14T11:23:33.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.455+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.0 size=1048576 2024-09-14T11:23:33.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.456+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.1 size=1048576 2024-09-14T11:23:33.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.457+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.2 size=625149 2024-09-14T11:23:33.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.457+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=X25C7G5X4W5I tag=WW4R2G0AM3RZ type=write size=3770877 2024-09-14T11:23:33.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.458+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=MWW0JS6L66PT type=del 2024-09-14T11:23:33.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.459+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=4YF79G253AZ3 type=del size=4117750 2024-09-14T11:23:33.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.460+0000 7f296241c780 1 < canceled operation key=FGK7YH1GB4W5 tag=P5Y3GQC4ZDAC type=del size=3781710 2024-09-14T11:23:33.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.462+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~S58MNW2ECIUA.0 size=85977 2024-09-14T11:23:33.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.462+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=S58MNW2ECIUA tag=NI3AU8PIJT28 type=write size=1134553 2024-09-14T11:23:33.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.464+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=70QZY126TK84 type=del 2024-09-14T11:23:33.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.465+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=7MMKD372YXEP type=write size=684414 2024-09-14T11:23:33.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.465+0000 7f296241c780 -1 < no bi entry to suggest for operation key=7WGFBTAM25J9 tag=PH001V1QAPDV type=write size=975195: (2) No such file or directory 2024-09-14T11:23:33.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.467+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~JOCIEU3GVZ1U.0 size=920504 2024-09-14T11:23:33.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.467+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=JOCIEU3GVZ1U tag=4RQY44C5JIEX type=write size=1969080 2024-09-14T11:23:33.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.470+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=2YWAZD1RR06K type=del 2024-09-14T11:23:33.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.471+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=5ET5TN2JN2CK type=del size=491096 2024-09-14T11:23:33.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.472+0000 7f296241c780 1 < canceled operation key=HFH3VKZ4T0IR tag=ZHFIIIPMV83S type=del size=3105195 2024-09-14T11:23:33.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.473+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=QC8QZPTWRDEZ type=del size=3616217 2024-09-14T11:23:33.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.476+0000 7f296241c780 1 < suggested remove operation key=HZD8WW0H4AAD tag=191HZTVZYK3J type=del 2024-09-14T11:23:33.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.477+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=CRYUMDSF2ADK type=del size=212847 2024-09-14T11:23:33.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.478+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~366UUXCCRIQH.0 size=1048576 2024-09-14T11:23:33.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.479+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~366UUXCCRIQH.1 size=976831 2024-09-14T11:23:33.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.482+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=366UUXCCRIQH tag=4734X9UXPVTU type=write size=3073983 2024-09-14T11:23:33.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.483+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=D43DWM3L9WN4 type=del size=38249 2024-09-14T11:23:33.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.484+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~GXBYUT08E1UI.0 size=1048576 2024-09-14T11:23:33.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.485+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~GXBYUT08E1UI.1 size=676566 2024-09-14T11:23:33.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.487+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=GXBYUT08E1UI tag=ZRMIZHJPSL10 type=write size=2773718 2024-09-14T11:23:33.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.490+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.0 size=1048576 2024-09-14T11:23:33.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.491+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.1 size=1048576 2024-09-14T11:23:33.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.492+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.2 size=622575 2024-09-14T11:23:33.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.492+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=21LTIV0R43NN tag=BQYU9P310Z79 type=write size=3768303 2024-09-14T11:23:33.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.493+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=63OS92GBHRCB type=del 2024-09-14T11:23:33.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.495+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~9Q4IELW2YT97.0 size=1048576 2024-09-14T11:23:33.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.496+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~9Q4IELW2YT97.1 size=31266 2024-09-14T11:23:33.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.496+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=9Q4IELW2YT97 tag=S6RUPTJ0N5FI type=write size=2128418 2024-09-14T11:23:33.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.498+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=ZA33QTZ9BOT1 type=del size=3186204 2024-09-14T11:23:33.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.499+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=00OV2LVKN0F8 type=del size=4099068 2024-09-14T11:23:33.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.502+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=NWOR5ZJG0DGK type=del 2024-09-14T11:23:33.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.504+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~N8R41DX4HDMC.0 size=1048576 2024-09-14T11:23:33.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.505+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~N8R41DX4HDMC.1 size=97641 2024-09-14T11:23:33.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.505+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=N8R41DX4HDMC tag=DA7ND1P8N60I type=write size=2194793 2024-09-14T11:23:33.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.506+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=GIEK82SMVOJI type=del 2024-09-14T11:23:33.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.507+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=ETU1GLEPEN2A type=del size=2651604 2024-09-14T11:23:33.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.508+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.0 size=1048576 2024-09-14T11:23:33.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.509+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.1 size=1048576 2024-09-14T11:23:33.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.510+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~PHLEMADZEEIZ.2 size=206331 2024-09-14T11:23:33.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.512+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=PHLEMADZEEIZ tag=5NOPG0YFUKME type=write size=3352059 2024-09-14T11:23:33.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.513+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=60RBGE8J3MNI type=write size=943727 2024-09-14T11:23:33.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.515+0000 7f296241c780 1 < suggested remove operation key=OIT1KUT6UEP2 tag=TG3J7HPUE9CW type=del 2024-09-14T11:23:33.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.517+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.0 size=1048576 2024-09-14T11:23:33.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.518+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.1 size=1048576 2024-09-14T11:23:33.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.519+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.2 size=50879 2024-09-14T11:23:33.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.519+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=KIYZ94IUBJ73 tag=01AFVJKW8W8L type=write size=3196607 2024-09-14T11:23:33.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.520+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.0 size=1048576 2024-09-14T11:23:33.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.521+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.1 size=1048576 2024-09-14T11:23:33.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.522+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~X25C7G5X4W5I.2 size=625149 2024-09-14T11:23:33.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.524+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=X25C7G5X4W5I tag=WW4R2G0AM3RZ type=write size=3770877 2024-09-14T11:23:33.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.526+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.0 size=1048576 2024-09-14T11:23:33.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.527+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.1 size=1048576 2024-09-14T11:23:33.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.528+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.2 size=953384 2024-09-14T11:23:33.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.528+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=ZX3RWIOAH39R tag=3Q2KI1WF8ZL7 type=write size=4099112 2024-09-14T11:23:33.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.529+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=4YF79G253AZ3 type=del 2024-09-14T11:23:33.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.530+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=X96YR190CYBB type=del size=3507556 2024-09-14T11:23:33.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.531+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~S58MNW2ECIUA.0 size=85977 2024-09-14T11:23:33.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.533+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=S58MNW2ECIUA tag=NI3AU8PIJT28 type=write size=1134553 2024-09-14T11:23:33.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.534+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=4TRBMS5LIGRQ type=del size=435004 2024-09-14T11:23:33.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.535+0000 7f296241c780 1 < completed write operation key=GJ2Y7ICBEZJX tag=7MMKD372YXEP type=write size=684414 2024-09-14T11:23:33.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.536+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=XHG863BB9957 type=del size=894305 2024-09-14T11:23:33.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.538+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~JOCIEU3GVZ1U.0 size=920504 2024-09-14T11:23:33.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.539+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=JOCIEU3GVZ1U tag=4RQY44C5JIEX type=write size=1969080 2024-09-14T11:23:33.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.542+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.0 size=1048576 2024-09-14T11:23:33.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.543+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.1 size=1048576 2024-09-14T11:23:33.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.543+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.2 size=600123 2024-09-14T11:23:33.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.543+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=R7IGOFAVPUB4 tag=1YT6LC8FKQJ6 type=write size=3745851 2024-09-14T11:23:33.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.545+0000 7f296241c780 -1 < failed to complete operation key=6DNKZWENMDM9 tag=5ET5TN2JN2CK type=del size=491096: (22) Invalid argument 2024-09-14T11:23:33.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.547+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~XDYKUCN7VQOR.0 size=322090 2024-09-14T11:23:33.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.547+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=XDYKUCN7VQOR tag=G01H20L5D1VL type=write size=1370666 2024-09-14T11:23:33.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.548+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=QC8QZPTWRDEZ type=del 2024-09-14T11:23:33.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.550+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.0 size=1048576 2024-09-14T11:23:33.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.551+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.1 size=1048576 2024-09-14T11:23:33.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.552+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.2 size=640613 2024-09-14T11:23:33.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.552+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=QKWGEHAWO1LC tag=WPXZPIX3K6LJ type=write size=3786341 2024-09-14T11:23:33.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.553+0000 7f296241c780 -1 < failed to complete operation key=OIT1KUT6UEP2 tag=CRYUMDSF2ADK type=del size=212847: (22) Invalid argument 2024-09-14T11:23:33.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.554+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=8XJ6AVEAM77D type=del size=2650721 2024-09-14T11:23:33.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.555+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=D43DWM3L9WN4 type=del 2024-09-14T11:23:33.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.556+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=6XFI72CE356W type=write size=1019083 2024-09-14T11:23:33.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.557+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.0 size=1048576 2024-09-14T11:23:33.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.558+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.1 size=1048576 2024-09-14T11:23:33.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.559+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~21LTIV0R43NN.2 size=622575 2024-09-14T11:23:33.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.561+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=21LTIV0R43NN tag=BQYU9P310Z79 type=write size=3768303 2024-09-14T11:23:33.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.563+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~07H21EDR4Y9K.0 size=1048576 2024-09-14T11:23:33.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.564+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~07H21EDR4Y9K.1 size=542062 2024-09-14T11:23:33.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.564+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=07H21EDR4Y9K tag=IQN2KH7HIC0D type=write size=2639214 2024-09-14T11:23:33.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.565+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~9Q4IELW2YT97.0 size=1048576 2024-09-14T11:23:33.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.566+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~9Q4IELW2YT97.1 size=31266 2024-09-14T11:23:33.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.568+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=9Q4IELW2YT97 tag=S6RUPTJ0N5FI type=write size=2128418 2024-09-14T11:23:33.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.569+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=GGFVAGLF16O5 type=del size=3182333 2024-09-14T11:23:33.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.570+0000 7f296241c780 1 < canceled operation key=I1XBOS1L5D98 tag=00OV2LVKN0F8 type=del size=4099068 2024-09-14T11:23:33.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.572+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~TPCVC86KOY6K.0 size=493043 2024-09-14T11:23:33.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.572+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=TPCVC86KOY6K tag=X8W9NHI0R9M9 type=write size=1541619 2024-09-14T11:23:33.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.573+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~N8R41DX4HDMC.0 size=1048576 2024-09-14T11:23:33.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.574+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~N8R41DX4HDMC.1 size=97641 2024-09-14T11:23:33.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.578+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=N8R41DX4HDMC tag=DA7ND1P8N60I type=write size=2194793 2024-09-14T11:23:33.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.579+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=R75B7E53DC86 type=del size=1464316 2024-09-14T11:23:33.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.581+0000 7f296241c780 1 < suggested update operation key=7WGFBTAM25J9 tag=ETU1GLEPEN2A type=del size=2651604 2024-09-14T11:23:33.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.582+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=L4R5T15566AL type=del size=4113865 2024-09-14T11:23:33.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.583+0000 7f296241c780 1 < completed write operation key=I6UYPPUMN0FB tag=60RBGE8J3MNI type=write size=943727 2024-09-14T11:23:33.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.585+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.0 size=1048576 2024-09-14T11:23:33.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.586+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.1 size=1048576 2024-09-14T11:23:33.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.587+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.2 size=859179 2024-09-14T11:23:33.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.587+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=XKY9Q8982OQ2 tag=MCG71W7Z4T63 type=write size=4004907 2024-09-14T11:23:33.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.588+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.0 size=1048576 2024-09-14T11:23:33.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.589+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.1 size=1048576 2024-09-14T11:23:33.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.590+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~KIYZ94IUBJ73.2 size=50879 2024-09-14T11:23:33.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.592+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=KIYZ94IUBJ73 tag=01AFVJKW8W8L type=write size=3196607 2024-09-14T11:23:33.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.593+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=P6TUZIV76KK7 type=del size=3964198 2024-09-14T11:23:33.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.594+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.0 size=1048576 2024-09-14T11:23:33.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.595+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.1 size=1048576 2024-09-14T11:23:33.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.595+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~ZX3RWIOAH39R.2 size=953384 2024-09-14T11:23:33.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.597+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=ZX3RWIOAH39R tag=3Q2KI1WF8ZL7 type=write size=4099112 2024-09-14T11:23:33.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.598+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=9TWMSY7057JH type=write size=274229 2024-09-14T11:23:33.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.599+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=X96YR190CYBB type=del 2024-09-14T11:23:33.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.600+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=PCSRJ30K20V2 type=del size=1632532 2024-09-14T11:23:33.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.601+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=4TRBMS5LIGRQ type=del 2024-09-14T11:23:33.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.603+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~TAW9I7GO2XGW.0 size=1048576 2024-09-14T11:23:33.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.604+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~TAW9I7GO2XGW.1 size=897822 2024-09-14T11:23:33.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.604+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=TAW9I7GO2XGW tag=JQWJSEA8VJEF type=write size=2994974 2024-09-14T11:23:33.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.605+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=XHG863BB9957 type=del 2024-09-14T11:23:33.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.606+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=4QEFGZJUEUKE type=del size=3155048 2024-09-14T11:23:33.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.607+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.0 size=1048576 2024-09-14T11:23:33.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.608+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.1 size=1048576 2024-09-14T11:23:33.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.609+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~R7IGOFAVPUB4.2 size=600123 2024-09-14T11:23:33.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.611+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=R7IGOFAVPUB4 tag=1YT6LC8FKQJ6 type=write size=3745851 2024-09-14T11:23:33.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.613+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~2KRHI742DEP6.0 size=1048576 2024-09-14T11:23:33.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.614+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~2KRHI742DEP6.1 size=332503 2024-09-14T11:23:33.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.614+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=2KRHI742DEP6 tag=F0AJS2CPHK6C type=write size=2429655 2024-09-14T11:23:33.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.615+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~XDYKUCN7VQOR.0 size=322090 2024-09-14T11:23:33.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.617+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=XDYKUCN7VQOR tag=G01H20L5D1VL type=write size=1370666 2024-09-14T11:23:33.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.618+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=2J8E88JFBIFY type=del size=321177 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.620+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.0 size=1048576 2024-09-14T11:23:33.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.620+0000 7f296241c780 1 < canceled part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.1 size=1048576 2024-09-14T11:23:33.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.621+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~QKWGEHAWO1LC.2 size=640613 2024-09-14T11:23:33.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.623+0000 7f296241c780 1 < canceled multipart upload key=HZD8WW0H4AAD upload=QKWGEHAWO1LC tag=WPXZPIX3K6LJ type=write size=3786341 2024-09-14T11:23:33.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.624+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=241D6E02PODH type=del size=123616 2024-09-14T11:23:33.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.625+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=8XJ6AVEAM77D type=del 2024-09-14T11:23:33.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.626+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=EY0341ZYCA1W type=del size=304063 2024-09-14T11:23:33.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.627+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=6XFI72CE356W type=write size=1019083 2024-09-14T11:23:33.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.629+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=S0KEMKEELAXN type=del size=1307976 2024-09-14T11:23:33.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.630+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~07H21EDR4Y9K.0 size=1048576 2024-09-14T11:23:33.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.631+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~07H21EDR4Y9K.1 size=542062 2024-09-14T11:23:33.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.633+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=07H21EDR4Y9K tag=IQN2KH7HIC0D type=write size=2639214 2024-09-14T11:23:33.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.635+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~MPR7V1GFT7CZ.0 size=1048576 2024-09-14T11:23:33.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.636+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~MPR7V1GFT7CZ.1 size=257539 2024-09-14T11:23:33.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.636+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=MPR7V1GFT7CZ tag=POTQ819SFPND type=write size=2354691 2024-09-14T11:23:33.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.637+0000 7f296241c780 1 < canceled operation key=K61XH5E6TF3Y tag=GGFVAGLF16O5 type=del size=3182333 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.639+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~UUPER1ZEDG17.0 size=245384 2024-09-14T11:23:33.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.639+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=UUPER1ZEDG17 tag=ON0NA5IYTRFH type=write size=1293960 2024-09-14T11:23:33.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.640+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~TPCVC86KOY6K.0 size=493043 2024-09-14T11:23:33.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.642+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=TPCVC86KOY6K tag=X8W9NHI0R9M9 type=write size=1541619 2024-09-14T11:23:33.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.643+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=GZFK87K325FM type=del size=4155830 2024-09-14T11:23:33.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.644+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=R75B7E53DC86 type=del 2024-09-14T11:23:33.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.645+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=NVR4EWPZ49Q3 type=del size=2489974 2024-09-14T11:23:33.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.646+0000 7f296241c780 1 < canceled operation key=L0GW4TPQCSUY tag=L4R5T15566AL type=del size=4113865 2024-09-14T11:23:33.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.647+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=H8ITD0KDTJON type=del size=1336362 2024-09-14T11:23:33.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.649+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.0 size=1048576 2024-09-14T11:23:33.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.649+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.1 size=1048576 2024-09-14T11:23:33.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.650+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~XKY9Q8982OQ2.2 size=859179 2024-09-14T11:23:33.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.652+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=XKY9Q8982OQ2 tag=MCG71W7Z4T63 type=write size=4004907 2024-09-14T11:23:33.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.653+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=SPLHAAMDHA2U type=del size=1071443 2024-09-14T11:23:33.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.655+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=P6TUZIV76KK7 type=del 2024-09-14T11:23:33.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.656+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=S370E2W2OT9N type=del size=2263120 2024-09-14T11:23:33.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.657+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=9TWMSY7057JH type=write size=274229 2024-09-14T11:23:33.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.659+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.0 size=1048576 2024-09-14T11:23:33.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.660+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.1 size=1048576 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.661+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.2 size=654874 2024-09-14T11:23:33.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.661+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=O8MEZ1P795AC tag=ZCU18E9J0TYH type=write size=3800602 2024-09-14T11:23:33.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.662+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=PCSRJ30K20V2 type=del 2024-09-14T11:23:33.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.663+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=SL1VRNB0VXZK type=write size=858577 2024-09-14T11:23:33.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.664+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~TAW9I7GO2XGW.0 size=1048576 2024-09-14T11:23:33.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.665+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~TAW9I7GO2XGW.1 size=897822 2024-09-14T11:23:33.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.667+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=TAW9I7GO2XGW tag=JQWJSEA8VJEF type=write size=2994974 2024-09-14T11:23:33.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.668+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=2BY050JTBA1V type=del size=4044751 2024-09-14T11:23:33.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.669+0000 7f296241c780 1 < canceled operation key=FGK7YH1GB4W5 tag=4QEFGZJUEUKE type=del size=3155048 2024-09-14T11:23:33.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.671+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=9M3B50462X8U type=del size=3958976 2024-09-14T11:23:33.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.671+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~2KRHI742DEP6.0 size=1048576 2024-09-14T11:23:33.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.672+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~2KRHI742DEP6.1 size=332503 2024-09-14T11:23:33.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.674+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=2KRHI742DEP6 tag=F0AJS2CPHK6C type=write size=2429655 2024-09-14T11:23:33.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.675+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=NWZN7XLKWOVB type=write size=158580 2024-09-14T11:23:33.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.677+0000 7f296241c780 1 < suggested remove operation key=JH1QJE5V4M9H tag=2J8E88JFBIFY type=del 2024-09-14T11:23:33.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.679+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.0 size=1048576 2024-09-14T11:23:33.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.680+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.1 size=1048576 2024-09-14T11:23:33.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.682+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.2 size=335216 2024-09-14T11:23:33.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.682+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=GAYK971Y2AWT tag=FAF599GVXZ1F type=write size=3480944 2024-09-14T11:23:33.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.684+0000 7f296241c780 1 < suggested remove operation key=HZD8WW0H4AAD tag=241D6E02PODH type=del 2024-09-14T11:23:33.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.686+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.0 size=1048576 2024-09-14T11:23:33.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.687+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.1 size=1048576 2024-09-14T11:23:33.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.688+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.2 size=764598 2024-09-14T11:23:33.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.688+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=WK7J1B342R7V tag=5CVB7KHJ2KPB type=write size=3910326 2024-09-14T11:23:33.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.689+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=EY0341ZYCA1W type=del 2024-09-14T11:23:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.691+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~GKPIUNJS9OYD.0 size=1048576 2024-09-14T11:23:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.692+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~GKPIUNJS9OYD.1 size=525717 2024-09-14T11:23:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.692+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=GKPIUNJS9OYD tag=IMNJ7869OE97 type=write size=2622869 2024-09-14T11:23:33.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.693+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=S0KEMKEELAXN type=del 2024-09-14T11:23:33.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.694+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=YDCG26QCRM7O type=del size=129206 2024-09-14T11:23:33.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.696+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~MPR7V1GFT7CZ.0 size=1048576 2024-09-14T11:23:33.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.697+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~MPR7V1GFT7CZ.1 size=257539 2024-09-14T11:23:33.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.699+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=MPR7V1GFT7CZ tag=POTQ819SFPND type=write size=2354691 2024-09-14T11:23:33.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.700+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=AY93ZGWPFJJZ type=del size=2322018 2024-09-14T11:23:33.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.701+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~UUPER1ZEDG17.0 size=245384 2024-09-14T11:23:33.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.703+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=UUPER1ZEDG17 tag=ON0NA5IYTRFH type=write size=1293960 2024-09-14T11:23:33.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.704+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=ZWW08B18YR5L type=del size=1451962 2024-09-14T11:23:33.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.705+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=GZFK87K325FM type=del 2024-09-14T11:23:33.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.706+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=F0AC6L46GURT type=del size=3374556 2024-09-14T11:23:33.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.707+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=NVR4EWPZ49Q3 type=del 2024-09-14T11:23:33.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.709+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~2HODORGH41O5.0 size=560741 2024-09-14T11:23:33.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.709+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=2HODORGH41O5 tag=FLVO03UOX4N3 type=write size=1609317 2024-09-14T11:23:33.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.710+0000 7f296241c780 -1 < failed to complete operation key=JH1QJE5V4M9H tag=H8ITD0KDTJON type=del size=1336362: (22) Invalid argument 2024-09-14T11:23:33.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.712+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=CLK481ZTBOCI type=del size=2634250 2024-09-14T11:23:33.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.713+0000 7f296241c780 1 < canceled operation key=0A90ZOC79OWP tag=SPLHAAMDHA2U type=del size=1071443 2024-09-14T11:23:33.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.714+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=O0M3V39JWN07 type=del size=2943484 2024-09-14T11:23:33.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.715+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=S370E2W2OT9N type=del 2024-09-14T11:23:33.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.717+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~V6OGEBZX17K4.0 size=501346 2024-09-14T11:23:33.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.717+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=V6OGEBZX17K4 tag=12ODO2EQBBYQ type=write size=1549922 2024-09-14T11:23:33.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.718+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.0 size=1048576 2024-09-14T11:23:33.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.719+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.1 size=1048576 2024-09-14T11:23:33.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.720+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~O8MEZ1P795AC.2 size=654874 2024-09-14T11:23:33.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.722+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=O8MEZ1P795AC tag=ZCU18E9J0TYH type=write size=3800602 2024-09-14T11:23:33.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.724+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.0 size=1048576 2024-09-14T11:23:33.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.725+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.1 size=1048576 2024-09-14T11:23:33.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.726+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.2 size=257433 2024-09-14T11:23:33.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.726+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=VM6WKN2TVOQV tag=XZK8U3U45QIW type=write size=3403161 2024-09-14T11:23:33.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.728+0000 7f296241c780 1 < suggested update operation key=R1M982MUIF44 tag=SL1VRNB0VXZK type=write size=858577 2024-09-14T11:23:33.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.729+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=E0ICWYLHGGNI type=del size=1869704 2024-09-14T11:23:33.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.730+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=2BY050JTBA1V type=del 2024-09-14T11:23:33.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.732+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~THSU42DKC90B.0 size=689486 2024-09-14T11:23:33.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.732+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=THSU42DKC90B tag=PEDEPBICT0V1 type=write size=1738062 2024-09-14T11:23:33.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.733+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=9M3B50462X8U type=del 2024-09-14T11:23:33.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.734+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=S9QGSPJLBLRQ type=del size=3937124 2024-09-14T11:23:33.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.735+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=NWZN7XLKWOVB type=write size=158580 2024-09-14T11:23:33.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.737+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=6OWLIXNFF088 type=del size=3932036 2024-09-14T11:23:33.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.738+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.0 size=1048576 2024-09-14T11:23:33.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.739+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.1 size=1048576 2024-09-14T11:23:33.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.740+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~GAYK971Y2AWT.2 size=335216 2024-09-14T11:23:33.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.741+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=GAYK971Y2AWT tag=FAF599GVXZ1F type=write size=3480944 2024-09-14T11:23:33.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.743+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=BQ3PWZ97Q1NM type=del size=3590464 2024-09-14T11:23:33.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.744+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.0 size=1048576 2024-09-14T11:23:33.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.745+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.1 size=1048576 2024-09-14T11:23:33.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.745+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~WK7J1B342R7V.2 size=764598 2024-09-14T11:23:33.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.747+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=WK7J1B342R7V tag=5CVB7KHJ2KPB type=write size=3910326 2024-09-14T11:23:33.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.749+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=EI5LJHN77GOR type=del size=435496 2024-09-14T11:23:33.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.750+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~GKPIUNJS9OYD.0 size=1048576 2024-09-14T11:23:33.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.751+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~GKPIUNJS9OYD.1 size=525717 2024-09-14T11:23:33.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.753+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=GKPIUNJS9OYD tag=IMNJ7869OE97 type=write size=2622869 2024-09-14T11:23:33.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.755+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~X5QEN7EOI9P2.0 size=1016615 2024-09-14T11:23:33.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.755+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=X5QEN7EOI9P2 tag=FJ5QKVGEY3NE type=write size=2065191 2024-09-14T11:23:33.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.757+0000 7f296241c780 1 < suggested remove operation key=O35OFLNOZ488 tag=YDCG26QCRM7O type=del 2024-09-14T11:23:33.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.758+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=TQ5QO2ZSNUAS type=del size=3914636 2024-09-14T11:23:33.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.759+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=AY93ZGWPFJJZ type=del 2024-09-14T11:23:33.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.760+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=WJ3JBOYCANZR type=del size=82948 2024-09-14T11:23:33.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.761+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=ZWW08B18YR5L type=del 2024-09-14T11:23:33.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.762+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=CVQJ2FWLJ4TD type=del size=1091601 2024-09-14T11:23:33.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.763+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=F0AC6L46GURT type=del 2024-09-14T11:23:33.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.765+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=7OBVS3TI9FNK type=write size=529055 2024-09-14T11:23:33.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.766+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~2HODORGH41O5.0 size=560741 2024-09-14T11:23:33.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.768+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=2HODORGH41O5 tag=FLVO03UOX4N3 type=write size=1609317 2024-09-14T11:23:33.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.769+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=W8FWELKFKCUN type=del size=2352194 2024-09-14T11:23:33.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.770+0000 7f296241c780 1 < canceled operation key=CQU8M12JCE9T tag=CLK481ZTBOCI type=del size=2634250 2024-09-14T11:23:33.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.771+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=UNOEVXPF7UHH type=del size=3777076 2024-09-14T11:23:33.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.772+0000 7f296241c780 -1 < failed to complete operation key=R1M982MUIF44 tag=O0M3V39JWN07 type=del size=2943484: (22) Invalid argument 2024-09-14T11:23:33.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.775+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~XVX20RY44A26.0 size=922309 2024-09-14T11:23:33.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.775+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=XVX20RY44A26 tag=W447F1G2V8LA type=write size=1970885 2024-09-14T11:23:33.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.776+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~V6OGEBZX17K4.0 size=501346 2024-09-14T11:23:33.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.778+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=V6OGEBZX17K4 tag=12ODO2EQBBYQ type=write size=1549922 2024-09-14T11:23:33.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.779+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=503G14HEFPLN type=write size=21903 2024-09-14T11:23:33.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.780+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.0 size=1048576 2024-09-14T11:23:33.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.781+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.1 size=1048576 2024-09-14T11:23:33.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.782+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~VM6WKN2TVOQV.2 size=257433 2024-09-14T11:23:33.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.784+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=VM6WKN2TVOQV tag=XZK8U3U45QIW type=write size=3403161 2024-09-14T11:23:33.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.785+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=OV1GWYK5MF9K type=del size=3854205 2024-09-14T11:23:33.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.786+0000 7f296241c780 1 < canceled operation key=JH1QJE5V4M9H tag=E0ICWYLHGGNI type=del size=1869704 2024-09-14T11:23:33.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.789+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=J2AM6WCXHCZS type=del size=280128 2024-09-14T11:23:33.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.790+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~THSU42DKC90B.0 size=689486 2024-09-14T11:23:33.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.792+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=THSU42DKC90B tag=PEDEPBICT0V1 type=write size=1738062 2024-09-14T11:23:33.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.793+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=TDHRMLZ8RYW1 type=del size=3819632 2024-09-14T11:23:33.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.794+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=S9QGSPJLBLRQ type=del 2024-09-14T11:23:33.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.796+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.0 size=1048576 2024-09-14T11:23:33.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.797+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.1 size=1048576 2024-09-14T11:23:33.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.798+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.2 size=416168 2024-09-14T11:23:33.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.798+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=88U3U9F2I726 tag=GNA5Y8H2H5XB type=write size=3561896 2024-09-14T11:23:33.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.799+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=6OWLIXNFF088 type=del 2024-09-14T11:23:33.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.801+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=9WFOBFRI0JQC type=del size=395643 2024-09-14T11:23:33.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.803+0000 7f296241c780 1 < suggested remove operation key=FGK7YH1GB4W5 tag=BQ3PWZ97Q1NM type=del 2024-09-14T11:23:33.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.804+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=Z1PZZA6GX6ZI type=del size=2065858 2024-09-14T11:23:33.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.806+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=EI5LJHN77GOR type=del 2024-09-14T11:23:33.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.808+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~EAZ2YPFAZJ6G.0 size=226000 2024-09-14T11:23:33.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.808+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=EAZ2YPFAZJ6G tag=P8GBJKJP039H type=write size=1274576 2024-09-14T11:23:33.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.810+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~X5QEN7EOI9P2.0 size=1016615 2024-09-14T11:23:33.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.812+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=X5QEN7EOI9P2 tag=FJ5QKVGEY3NE type=write size=2065191 2024-09-14T11:23:33.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.814+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~VLIL90MR1M0L.0 size=1048576 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.815+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~VLIL90MR1M0L.1 size=474200 2024-09-14T11:23:33.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.815+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=VLIL90MR1M0L tag=VKZ8MME16SLY type=write size=2571352 2024-09-14T11:23:33.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.816+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=TQ5QO2ZSNUAS type=del 2024-09-14T11:23:33.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.818+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.0 size=1048576 2024-09-14T11:23:33.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.819+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.1 size=1048576 2024-09-14T11:23:33.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.820+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.2 size=485027 2024-09-14T11:23:33.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.820+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=FOGKCWVAXP6T tag=O46O4SU529M6 type=write size=3630755 2024-09-14T11:23:33.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.821+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=WJ3JBOYCANZR type=del 2024-09-14T11:23:33.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.823+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.0 size=1048576 2024-09-14T11:23:33.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.824+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.1 size=1048576 2024-09-14T11:23:33.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.825+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.2 size=393727 2024-09-14T11:23:33.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.825+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=IT55GZFPHJN4 tag=S04RIBCNYY9W type=write size=3539455 2024-09-14T11:23:33.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.827+0000 7f296241c780 1 < suggested remove operation key=CQU8M12JCE9T tag=CVQJ2FWLJ4TD type=del 2024-09-14T11:23:33.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.829+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=QTQUBS6ERELA type=del size=3789224 2024-09-14T11:23:33.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.831+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=7OBVS3TI9FNK type=write size=529055 2024-09-14T11:23:33.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.832+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=M43NEBRLVBSW type=del size=2174532 2024-09-14T11:23:33.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.833+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=W8FWELKFKCUN type=del 2024-09-14T11:23:33.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.835+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.0 size=1048576 2024-09-14T11:23:33.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.836+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.1 size=1048576 2024-09-14T11:23:33.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.837+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.2 size=50402 2024-09-14T11:23:33.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.837+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=YYSQK4QEBHIC tag=A1ZUPMXENEH3 type=write size=3196130 2024-09-14T11:23:33.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.839+0000 7f296241c780 1 < suggested remove operation key=O35OFLNOZ488 tag=UNOEVXPF7UHH type=del 2024-09-14T11:23:33.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.841+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=F1S9BX7TAIXM type=del size=3896073 2024-09-14T11:23:33.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.842+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~XVX20RY44A26.0 size=922309 2024-09-14T11:23:33.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.844+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=XVX20RY44A26 tag=W447F1G2V8LA type=write size=1970885 2024-09-14T11:23:33.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.845+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=88A6LE3AHX21 type=del size=3213547 2024-09-14T11:23:33.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.846+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=503G14HEFPLN type=write size=21903 2024-09-14T11:23:33.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.847+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=1317ZREBGRBS type=write size=802831 2024-09-14T11:23:33.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.848+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=OV1GWYK5MF9K type=del 2024-09-14T11:23:33.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.849+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=ELRIJRUO3LZW type=del size=1642415 2024-09-14T11:23:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.851+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=J2AM6WCXHCZS type=del 2024-09-14T11:23:33.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.852+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=D1YA3TZGCHSN type=write size=1038960 2024-09-14T11:23:33.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.853+0000 7f296241c780 1 < canceled operation key=C1T4CLU3400T tag=TDHRMLZ8RYW1 type=del size=3819632 2024-09-14T11:23:33.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.855+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~QRHF3CFOPVKT.0 size=274286 2024-09-14T11:23:33.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.855+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=QRHF3CFOPVKT tag=9POCIBJOD98E type=write size=1322862 2024-09-14T11:23:33.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.857+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.0 size=1048576 2024-09-14T11:23:33.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.857+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.1 size=1048576 2024-09-14T11:23:33.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.858+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~88U3U9F2I726.2 size=416168 2024-09-14T11:23:33.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.860+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=88U3U9F2I726 tag=GNA5Y8H2H5XB type=write size=3561896 2024-09-14T11:23:33.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.861+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=7KGZO7PFSSKY type=del size=43256 2024-09-14T11:23:33.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.863+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=9WFOBFRI0JQC type=del 2024-09-14T11:23:33.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.864+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=CIZKWCOHNT0L type=del size=3173441 2024-09-14T11:23:33.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.865+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=Z1PZZA6GX6ZI type=del 2024-09-14T11:23:33.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.867+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~YYVPMX5LW457.0 size=921116 2024-09-14T11:23:33.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.867+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=YYVPMX5LW457 tag=P07MHIIRXGQA type=write size=1969692 2024-09-14T11:23:33.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.868+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~EAZ2YPFAZJ6G.0 size=226000 2024-09-14T11:23:33.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.870+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=EAZ2YPFAZJ6G tag=P8GBJKJP039H type=write size=1274576 2024-09-14T11:23:33.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.873+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~SFYJT7DVLW4L.0 size=1048576 2024-09-14T11:23:33.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.874+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~SFYJT7DVLW4L.1 size=670482 2024-09-14T11:23:33.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.874+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=SFYJT7DVLW4L tag=LKYVENYJZYEU type=write size=2767634 2024-09-14T11:23:33.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.875+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~VLIL90MR1M0L.0 size=1048576 2024-09-14T11:23:33.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.875+0000 7f296241c780 1 < canceled part key=_multipart_KBMD123LTZA7.2~VLIL90MR1M0L.1 size=474200 2024-09-14T11:23:33.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.877+0000 7f296241c780 1 < canceled multipart upload key=KBMD123LTZA7 upload=VLIL90MR1M0L tag=VKZ8MME16SLY type=write size=2571352 2024-09-14T11:23:33.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.878+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=XTV2715TE5HV type=del size=262900 2024-09-14T11:23:33.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.880+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.0 size=1048576 2024-09-14T11:23:33.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.880+0000 7f296241c780 1 < canceled part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.1 size=1048576 2024-09-14T11:23:33.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.881+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~FOGKCWVAXP6T.2 size=485027 2024-09-14T11:23:33.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.883+0000 7f296241c780 1 < canceled multipart upload key=C1T4CLU3400T upload=FOGKCWVAXP6T tag=O46O4SU529M6 type=write size=3630755 2024-09-14T11:23:33.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.884+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=SQZ8H45HCH9O type=write size=179564 2024-09-14T11:23:33.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.885+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.0 size=1048576 2024-09-14T11:23:33.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.886+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.1 size=1048576 2024-09-14T11:23:33.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.887+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~IT55GZFPHJN4.2 size=393727 2024-09-14T11:23:33.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.889+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=IT55GZFPHJN4 tag=S04RIBCNYY9W type=write size=3539455 2024-09-14T11:23:33.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.891+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~1ROABA89IOZC.0 size=296691 2024-09-14T11:23:33.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.891+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=1ROABA89IOZC tag=L3V73LOVIZE5 type=write size=1345267 2024-09-14T11:23:33.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.892+0000 7f296241c780 1 < canceled operation key=ILOY74OSG5CQ tag=QTQUBS6ERELA type=del size=3789224 2024-09-14T11:23:33.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.894+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~SJG02GJ20GSF.0 size=546776 2024-09-14T11:23:33.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.894+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=SJG02GJ20GSF tag=QP9KWB5AISUS type=write size=1595352 2024-09-14T11:23:33.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.897+0000 7f296241c780 1 < suggested remove operation key=3T0SINQVBAGF tag=M43NEBRLVBSW type=del 2024-09-14T11:23:33.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.899+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=EA2NBCRUG123 type=del size=2112354 2024-09-14T11:23:33.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.902+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.0 size=1048576 2024-09-14T11:23:33.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.903+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.1 size=1048576 2024-09-14T11:23:33.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.905+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~YYSQK4QEBHIC.2 size=50402 2024-09-14T11:23:33.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.907+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=YYSQK4QEBHIC tag=A1ZUPMXENEH3 type=write size=3196130 2024-09-14T11:23:33.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.909+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~5PO7KZR0JT8V.0 size=957835 2024-09-14T11:23:33.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.909+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=5PO7KZR0JT8V tag=L842KJP6V6HA type=write size=2006411 2024-09-14T11:23:33.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.911+0000 7f296241c780 1 < suggested update operation key=OIT1KUT6UEP2 tag=F1S9BX7TAIXM type=del size=3896073 2024-09-14T11:23:33.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.912+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=MOEH17H5K4FG type=del size=3520096 2024-09-14T11:23:33.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.913+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=88A6LE3AHX21 type=del 2024-09-14T11:23:33.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.915+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~Y3QW2AUHVBS1.0 size=1048576 2024-09-14T11:23:33.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.916+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~Y3QW2AUHVBS1.1 size=1029162 2024-09-14T11:23:33.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.916+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=Y3QW2AUHVBS1 tag=EF3NG1UUSTJB type=write size=3126314 2024-09-14T11:23:33.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.917+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=1317ZREBGRBS type=write size=802831 2024-09-14T11:23:33.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.918+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=U7VHI2J3846M type=del size=4109677 2024-09-14T11:23:33.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.919+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=ELRIJRUO3LZW type=del 2024-09-14T11:23:33.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.921+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.0 size=1048576 2024-09-14T11:23:33.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.922+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.1 size=1048576 2024-09-14T11:23:33.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.923+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.2 size=335882 2024-09-14T11:23:33.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.923+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=L169Q3WO8PPC tag=AWF2KBLK0WWP type=write size=3481610 2024-09-14T11:23:33.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.925+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=D1YA3TZGCHSN type=write size=1038960 2024-09-14T11:23:33.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.926+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=39EX3866QX6J type=del size=315624 2024-09-14T11:23:33.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.927+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~QRHF3CFOPVKT.0 size=274286 2024-09-14T11:23:33.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.929+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=QRHF3CFOPVKT tag=9POCIBJOD98E type=write size=1322862 2024-09-14T11:23:33.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.930+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=JWVIHYZYWSU9 type=del size=49005 2024-09-14T11:23:33.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.931+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=7KGZO7PFSSKY type=del 2024-09-14T11:23:33.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.932+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=44LWZ7EHD7O8 type=del size=3445686 2024-09-14T11:23:33.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.935+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=CIZKWCOHNT0L type=del 2024-09-14T11:23:33.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.936+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=CMNVWH413PMD type=del size=540415 2024-09-14T11:23:33.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.937+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~YYVPMX5LW457.0 size=921116 2024-09-14T11:23:33.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.939+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=YYVPMX5LW457 tag=P07MHIIRXGQA type=write size=1969692 2024-09-14T11:23:33.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.940+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=IKW1LQDNUDGU type=del size=2360649 2024-09-14T11:23:33.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.941+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~SFYJT7DVLW4L.0 size=1048576 2024-09-14T11:23:33.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.942+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~SFYJT7DVLW4L.1 size=670482 2024-09-14T11:23:33.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.944+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=SFYJT7DVLW4L tag=LKYVENYJZYEU type=write size=2767634 2024-09-14T11:23:33.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.945+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=XAGU9MI8OXN7 type=del size=2648511 2024-09-14T11:23:33.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.948+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=XTV2715TE5HV type=del size=262900 2024-09-14T11:23:33.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.949+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=ZKOV9OD6C681 type=del size=2571514 2024-09-14T11:23:33.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.951+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=SQZ8H45HCH9O type=write size=179564 2024-09-14T11:23:33.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.952+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=PNG78RUUATPE type=del size=1439376 2024-09-14T11:23:33.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.953+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~1ROABA89IOZC.0 size=296691 2024-09-14T11:23:33.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.955+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=1ROABA89IOZC tag=L3V73LOVIZE5 type=write size=1345267 2024-09-14T11:23:33.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.957+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~DZYZ08N6R0YO.0 size=962682 2024-09-14T11:23:33.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.957+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=DZYZ08N6R0YO tag=KU8G0IE6BKQF type=write size=2011258 2024-09-14T11:23:33.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.959+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~SJG02GJ20GSF.0 size=546776 2024-09-14T11:23:33.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.961+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=SJG02GJ20GSF tag=QP9KWB5AISUS type=write size=1595352 2024-09-14T11:23:33.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.963+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~XQ0ZFVS7KGK8.0 size=541606 2024-09-14T11:23:33.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.963+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=XQ0ZFVS7KGK8 tag=31VIMC1V261A type=write size=1590182 2024-09-14T11:23:33.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.964+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=EA2NBCRUG123 type=del 2024-09-14T11:23:33.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.965+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=C0LPVI5OHF0K type=write size=273657 2024-09-14T11:23:33.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.966+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~5PO7KZR0JT8V.0 size=957835 2024-09-14T11:23:33.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.968+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=5PO7KZR0JT8V tag=L842KJP6V6HA type=write size=2006411 2024-09-14T11:23:33.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.969+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=5UO30QKFHKAK type=del size=28258 2024-09-14T11:23:33.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.970+0000 7f296241c780 1 < canceled operation key=19TC05N1D5FR tag=MOEH17H5K4FG type=del size=3520096 2024-09-14T11:23:33.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.972+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~0NFAK9K6YUOV.0 size=1048576 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.973+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~0NFAK9K6YUOV.1 size=1005027 2024-09-14T11:23:33.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.973+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=0NFAK9K6YUOV tag=2SKAIALBJIUQ type=write size=3102179 2024-09-14T11:23:33.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.974+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~Y3QW2AUHVBS1.0 size=1048576 2024-09-14T11:23:33.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.975+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~Y3QW2AUHVBS1.1 size=1029162 2024-09-14T11:23:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.977+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=Y3QW2AUHVBS1 tag=EF3NG1UUSTJB type=write size=3126314 2024-09-14T11:23:33.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.980+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.0 size=1048576 2024-09-14T11:23:33.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.980+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.1 size=1048576 2024-09-14T11:23:33.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.981+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.2 size=124669 2024-09-14T11:23:33.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.981+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=JEY6SFG7N61Z tag=JI6G4ZHC12YO type=write size=3270397 2024-09-14T11:23:33.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.984+0000 7f296241c780 1 < suggested remove operation key=19TC05N1D5FR tag=U7VHI2J3846M type=del 2024-09-14T11:23:33.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.986+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~1NCBN578HS23.0 size=491859 2024-09-14T11:23:33.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.986+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=1NCBN578HS23 tag=Q5IBAF6P8XF5 type=write size=1540435 2024-09-14T11:23:33.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.987+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.0 size=1048576 2024-09-14T11:23:33.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.988+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.1 size=1048576 2024-09-14T11:23:33.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.989+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~L169Q3WO8PPC.2 size=335882 2024-09-14T11:23:33.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.991+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=L169Q3WO8PPC tag=AWF2KBLK0WWP type=write size=3481610 2024-09-14T11:23:33.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.992+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=KWQTYW6A042L type=del size=2301795 2024-09-14T11:23:33.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.993+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=39EX3866QX6J type=del 2024-09-14T11:23:33.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.994+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=RJ352JW3S0QH type=del size=323925 2024-09-14T11:23:33.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.995+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=JWVIHYZYWSU9 type=del 2024-09-14T11:23:33.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.998+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~IGFZTP6RF07Z.0 size=1048576 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.999+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~IGFZTP6RF07Z.1 size=829509 2024-09-14T11:23:33.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:33.999+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=IGFZTP6RF07Z tag=E2OG5SPWWD7R type=write size=2926661 2024-09-14T11:23:33.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.000+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=44LWZ7EHD7O8 type=del 2024-09-14T11:23:33.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.001+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=59QNKRDN5DGR type=write size=905821 2024-09-14T11:23:34.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.003+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=CMNVWH413PMD type=del 2024-09-14T11:23:34.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.004+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=SNQBQ70L7HWQ type=del size=2778147 2024-09-14T11:23:34.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.005+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=IKW1LQDNUDGU type=del 2024-09-14T11:23:34.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.006+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=RX5R67TVQ9N9 type=del size=1627820 2024-09-14T11:23:34.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.007+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=XAGU9MI8OXN7 type=del size=2648511 2024-09-14T11:23:34.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.009+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~8JSLL7KTVEV1.0 size=1048576 2024-09-14T11:23:34.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.011+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~8JSLL7KTVEV1.1 size=997330 2024-09-14T11:23:34.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.011+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=8JSLL7KTVEV1 tag=E2MS4XWZ603O type=write size=3094482 2024-09-14T11:23:34.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.013+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=ZKOV9OD6C681 type=del 2024-09-14T11:23:34.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.015+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.0 size=1048576 2024-09-14T11:23:34.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.016+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.1 size=1048576 2024-09-14T11:23:34.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.016+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.2 size=357777 2024-09-14T11:23:34.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.016+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=G98F45O4B5QK tag=R5WQLAGW1PLP type=write size=3503505 2024-09-14T11:23:34.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.018+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=PNG78RUUATPE type=del 2024-09-14T11:23:34.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.020+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.0 size=1048576 2024-09-14T11:23:34.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.020+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.1 size=1048576 2024-09-14T11:23:34.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.021+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.2 size=330148 2024-09-14T11:23:34.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.021+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=NBUYK74C0PZV tag=K9RIXK9RY655 type=write size=3475876 2024-09-14T11:23:34.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.023+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~DZYZ08N6R0YO.0 size=962682 2024-09-14T11:23:34.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.024+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=DZYZ08N6R0YO tag=KU8G0IE6BKQF type=write size=2011258 2024-09-14T11:23:34.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.027+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~AGRV20MBR541.0 size=596774 2024-09-14T11:23:34.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.027+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=AGRV20MBR541 tag=S58D9Y10TPZJ type=write size=1645350 2024-09-14T11:23:34.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.028+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~XQ0ZFVS7KGK8.0 size=541606 2024-09-14T11:23:34.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.029+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=XQ0ZFVS7KGK8 tag=31VIMC1V261A type=write size=1590182 2024-09-14T11:23:34.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.031+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.0 size=1048576 2024-09-14T11:23:34.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.032+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.1 size=1048576 2024-09-14T11:23:34.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.033+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.2 size=428662 2024-09-14T11:23:34.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.033+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=ECP2EO1NU5KF tag=XFGQYJBPNS4K type=write size=3574390 2024-09-14T11:23:34.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.034+0000 7f296241c780 1 < completed write operation key=CQU8M12JCE9T tag=C0LPVI5OHF0K type=write size=273657 2024-09-14T11:23:34.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.036+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=40UP5FYYTCXK type=write size=82679 2024-09-14T11:23:34.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.037+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=5UO30QKFHKAK type=del 2024-09-14T11:23:34.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.039+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~T0TY865ZBRPR.0 size=1048576 2024-09-14T11:23:34.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.040+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~T0TY865ZBRPR.1 size=244564 2024-09-14T11:23:34.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.040+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=T0TY865ZBRPR tag=CKYNAQHA5VI5 type=write size=2341716 2024-09-14T11:23:34.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.041+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~0NFAK9K6YUOV.0 size=1048576 2024-09-14T11:23:34.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.042+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~0NFAK9K6YUOV.1 size=1005027 2024-09-14T11:23:34.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.044+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=0NFAK9K6YUOV tag=2SKAIALBJIUQ type=write size=3102179 2024-09-14T11:23:34.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.045+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=FD1060VI8QKO type=del size=3703609 2024-09-14T11:23:34.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.046+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.0 size=1048576 2024-09-14T11:23:34.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.047+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.1 size=1048576 2024-09-14T11:23:34.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.048+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~JEY6SFG7N61Z.2 size=124669 2024-09-14T11:23:34.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.049+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=JEY6SFG7N61Z tag=JI6G4ZHC12YO type=write size=3270397 2024-09-14T11:23:34.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.051+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=WN8KDTL5ZV46 type=del size=3957255 2024-09-14T11:23:34.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.052+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~1NCBN578HS23.0 size=491859 2024-09-14T11:23:34.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.053+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=1NCBN578HS23 tag=Q5IBAF6P8XF5 type=write size=1540435 2024-09-14T11:23:34.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.054+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=0KW1YVC6PK97 type=del size=2119469 2024-09-14T11:23:34.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.055+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=KWQTYW6A042L type=del 2024-09-14T11:23:34.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.057+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=15Y697CUUFGY type=del size=1196512 2024-09-14T11:23:34.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.059+0000 7f296241c780 1 < suggested update operation key=QL439L2X13OR tag=RJ352JW3S0QH type=del size=323925 2024-09-14T11:23:34.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.060+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=2EVCICM7WSEK type=del size=3274327 2024-09-14T11:23:34.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.061+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~IGFZTP6RF07Z.0 size=1048576 2024-09-14T11:23:34.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.062+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~IGFZTP6RF07Z.1 size=829509 2024-09-14T11:23:34.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.064+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=IGFZTP6RF07Z tag=E2OG5SPWWD7R type=write size=2926661 2024-09-14T11:23:34.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.065+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=XHX9F2DO9IJE type=del size=2697381 2024-09-14T11:23:34.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.066+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=59QNKRDN5DGR type=write size=905821 2024-09-14T11:23:34.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.067+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=BGOTAK534HBI type=write size=129816 2024-09-14T11:23:34.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.069+0000 7f296241c780 1 < suggested update operation key=O35OFLNOZ488 tag=SNQBQ70L7HWQ type=del size=2778147 2024-09-14T11:23:34.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.071+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=NHB8W50ZBNPR type=del size=821551 2024-09-14T11:23:34.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.072+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=RX5R67TVQ9N9 type=del 2024-09-14T11:23:34.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.073+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=ZQ8GLN31KDE4 type=del size=3142109 2024-09-14T11:23:34.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.074+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~8JSLL7KTVEV1.0 size=1048576 2024-09-14T11:23:34.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.075+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~8JSLL7KTVEV1.1 size=997330 2024-09-14T11:23:34.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.077+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=8JSLL7KTVEV1 tag=E2MS4XWZ603O type=write size=3094482 2024-09-14T11:23:34.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.079+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~2R52S878C6UH.0 size=227083 2024-09-14T11:23:34.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.079+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=2R52S878C6UH tag=OUECHP6IN7YF type=write size=1275659 2024-09-14T11:23:34.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.080+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.0 size=1048576 2024-09-14T11:23:34.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.081+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.1 size=1048576 2024-09-14T11:23:34.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.082+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~G98F45O4B5QK.2 size=357777 2024-09-14T11:23:34.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.084+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=G98F45O4B5QK tag=R5WQLAGW1PLP type=write size=3503505 2024-09-14T11:23:34.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.086+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=0BU741IMG5CH type=del size=3519545 2024-09-14T11:23:34.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.087+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.0 size=1048576 2024-09-14T11:23:34.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.088+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.1 size=1048576 2024-09-14T11:23:34.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.089+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~NBUYK74C0PZV.2 size=330148 2024-09-14T11:23:34.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.091+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=NBUYK74C0PZV tag=K9RIXK9RY655 type=write size=3475876 2024-09-14T11:23:34.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.092+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=QQXQ2MEJULNC type=write size=320314 2024-09-14T11:23:34.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.092+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~AGRV20MBR541.0 size=596774 2024-09-14T11:23:34.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.094+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=AGRV20MBR541 tag=S58D9Y10TPZJ type=write size=1645350 2024-09-14T11:23:34.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.096+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=9TIS2130C5PT type=del size=1076813 2024-09-14T11:23:34.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.097+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.0 size=1048576 2024-09-14T11:23:34.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.098+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.1 size=1048576 2024-09-14T11:23:34.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.099+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~ECP2EO1NU5KF.2 size=428662 2024-09-14T11:23:34.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.101+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=ECP2EO1NU5KF tag=XFGQYJBPNS4K type=write size=3574390 2024-09-14T11:23:34.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.102+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=59S5XNGP9K4O type=del size=819380 2024-09-14T11:23:34.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.104+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=40UP5FYYTCXK type=write size=82679 2024-09-14T11:23:34.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.106+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~9Y9QV0KHHIK6.0 size=179622 2024-09-14T11:23:34.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.106+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=9Y9QV0KHHIK6 tag=4ENKRNSGK2NK type=write size=1228198 2024-09-14T11:23:34.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.107+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~T0TY865ZBRPR.0 size=1048576 2024-09-14T11:23:34.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.108+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~T0TY865ZBRPR.1 size=244564 2024-09-14T11:23:34.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.110+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=T0TY865ZBRPR tag=CKYNAQHA5VI5 type=write size=2341716 2024-09-14T11:23:34.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.112+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~BB1070LQHDSX.0 size=1048576 2024-09-14T11:23:34.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.115+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~BB1070LQHDSX.1 size=272038 2024-09-14T11:23:34.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.115+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=BB1070LQHDSX tag=DZ3GQ16ZCVN2 type=write size=2369190 2024-09-14T11:23:34.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.116+0000 7f296241c780 1 < canceled operation key=ILOY74OSG5CQ tag=FD1060VI8QKO type=del size=3703609 2024-09-14T11:23:34.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.117+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=H2RCXLT7C5WR type=del size=2020820 2024-09-14T11:23:34.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.120+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=WN8KDTL5ZV46 type=del 2024-09-14T11:23:34.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.122+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~JUYQH9W23CXL.0 size=1048576 2024-09-14T11:23:34.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.123+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~JUYQH9W23CXL.1 size=179561 2024-09-14T11:23:34.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.123+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=JUYQH9W23CXL tag=PP58LMYA3BKP type=write size=2276713 2024-09-14T11:23:34.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.125+0000 7f296241c780 1 < suggested remove operation key=R1M982MUIF44 tag=0KW1YVC6PK97 type=del 2024-09-14T11:23:34.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.126+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=MHMEIXYHQ76E type=write size=787658 2024-09-14T11:23:34.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.127+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=15Y697CUUFGY type=del size=1196512 2024-09-14T11:23:34.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.128+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=86EZQAJEOMOV type=del size=3312813 2024-09-14T11:23:34.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.130+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=2EVCICM7WSEK type=del 2024-09-14T11:23:34.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.132+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.0 size=1048576 2024-09-14T11:23:34.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.133+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.1 size=1048576 2024-09-14T11:23:34.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.133+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.2 size=348793 2024-09-14T11:23:34.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.133+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=36VN16M2ES3I tag=HVDTU6PE5LVA type=write size=3494521 2024-09-14T11:23:34.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.135+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=XHX9F2DO9IJE type=del 2024-09-14T11:23:34.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.136+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=H1Z065HSC3X9 type=write size=747537 2024-09-14T11:23:34.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.137+0000 7f296241c780 -1 < failed to complete operation key=O35OFLNOZ488 tag=BGOTAK534HBI type=write size=129816: (22) Invalid argument 2024-09-14T11:23:34.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.139+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~CVYGF7IJ6DCT.0 size=1048576 2024-09-14T11:23:34.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.140+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~CVYGF7IJ6DCT.1 size=318949 2024-09-14T11:23:34.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.140+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=CVYGF7IJ6DCT tag=0BT75SEQ0S7A type=write size=2416101 2024-09-14T11:23:34.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.142+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=NHB8W50ZBNPR type=del 2024-09-14T11:23:34.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.144+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.0 size=1048576 2024-09-14T11:23:34.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.144+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.1 size=1048576 2024-09-14T11:23:34.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.145+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.2 size=259457 2024-09-14T11:23:34.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.145+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=HPQUJNIYCU9G tag=4EVW8PTNQAOB type=write size=3405185 2024-09-14T11:23:34.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.148+0000 7f296241c780 1 < suggested remove operation key=GJ2Y7ICBEZJX tag=ZQ8GLN31KDE4 type=del 2024-09-14T11:23:34.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.149+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=525FAR0CI3PQ type=del size=1728648 2024-09-14T11:23:34.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.150+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~2R52S878C6UH.0 size=227083 2024-09-14T11:23:34.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.152+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=2R52S878C6UH tag=OUECHP6IN7YF type=write size=1275659 2024-09-14T11:23:34.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.153+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=H4JB5HMG4Y9D type=del size=1276564 2024-09-14T11:23:34.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.154+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=0BU741IMG5CH type=del 2024-09-14T11:23:34.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.155+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=94V8Y44C9H24 type=del size=1466016 2024-09-14T11:23:34.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.157+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=QQXQ2MEJULNC type=write size=320314 2024-09-14T11:23:34.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.158+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=M85LDCWNFLGZ type=del size=3679664 2024-09-14T11:23:34.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.159+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=9TIS2130C5PT type=del 2024-09-14T11:23:34.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.160+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=11D9A8O3N19K type=del size=194014 2024-09-14T11:23:34.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.161+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=59S5XNGP9K4O type=del 2024-09-14T11:23:34.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.162+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=16O1YCYCJRM7 type=del size=1232102 2024-09-14T11:23:34.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.164+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~9Y9QV0KHHIK6.0 size=179622 2024-09-14T11:23:34.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.165+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=9Y9QV0KHHIK6 tag=4ENKRNSGK2NK type=write size=1228198 2024-09-14T11:23:34.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.167+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=6CW3AJYKWU9A type=del size=396873 2024-09-14T11:23:34.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.168+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~BB1070LQHDSX.0 size=1048576 2024-09-14T11:23:34.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.169+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~BB1070LQHDSX.1 size=272038 2024-09-14T11:23:34.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.170+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=BB1070LQHDSX tag=DZ3GQ16ZCVN2 type=write size=2369190 2024-09-14T11:23:34.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.173+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~SPNNUPM5VG8A.0 size=537728 2024-09-14T11:23:34.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.173+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=SPNNUPM5VG8A tag=WGT44TE02CYH type=write size=1586304 2024-09-14T11:23:34.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.174+0000 7f296241c780 1 < canceled operation key=L8NA53KOAT58 tag=H2RCXLT7C5WR type=del size=2020820 2024-09-14T11:23:34.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.176+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~JZ0XBOFH7CIO.0 size=1048576 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.177+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~JZ0XBOFH7CIO.1 size=1006018 2024-09-14T11:23:34.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.177+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=JZ0XBOFH7CIO tag=PVEOY8F81HKZ type=write size=3103170 2024-09-14T11:23:34.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.178+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~JUYQH9W23CXL.0 size=1048576 2024-09-14T11:23:34.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.179+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~JUYQH9W23CXL.1 size=179561 2024-09-14T11:23:34.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.181+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=JUYQH9W23CXL tag=PP58LMYA3BKP type=write size=2276713 2024-09-14T11:23:34.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.182+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=0BEB765VZEMW type=del size=995973 2024-09-14T11:23:34.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.185+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=MHMEIXYHQ76E type=write size=787658 2024-09-14T11:23:34.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.186+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=4H0DSDRKRYO7 type=del size=1473459 2024-09-14T11:23:34.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.187+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=86EZQAJEOMOV type=del 2024-09-14T11:23:34.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.188+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=3G83YQ8T1X7K type=del size=2136410 2024-09-14T11:23:34.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.189+0000 7f296241c780 1 < canceled part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.0 size=1048576 2024-09-14T11:23:34.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.190+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.1 size=1048576 2024-09-14T11:23:34.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.191+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~36VN16M2ES3I.2 size=348793 2024-09-14T11:23:34.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.193+0000 7f296241c780 1 < canceled multipart upload key=19TC05N1D5FR upload=36VN16M2ES3I tag=HVDTU6PE5LVA type=write size=3494521 2024-09-14T11:23:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.195+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~B08D8W6NEHDA.0 size=1048576 2024-09-14T11:23:34.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.196+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~B08D8W6NEHDA.1 size=917689 2024-09-14T11:23:34.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.196+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=B08D8W6NEHDA tag=YKXY2CRCM3TT type=write size=3014841 2024-09-14T11:23:34.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.199+0000 7f296241c780 1 < suggested update operation key=R1M982MUIF44 tag=H1Z065HSC3X9 type=write size=747537 2024-09-14T11:23:34.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.200+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=BFBJH15T9567 type=del size=392746 2024-09-14T11:23:34.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.201+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~CVYGF7IJ6DCT.0 size=1048576 2024-09-14T11:23:34.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.202+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~CVYGF7IJ6DCT.1 size=318949 2024-09-14T11:23:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.204+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=CVYGF7IJ6DCT tag=0BT75SEQ0S7A type=write size=2416101 2024-09-14T11:23:34.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.206+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~H5WL71W3O22Q.0 size=117456 2024-09-14T11:23:34.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.206+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=H5WL71W3O22Q tag=XJ7ETWBVHW71 type=write size=1166032 2024-09-14T11:23:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.208+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.0 size=1048576 2024-09-14T11:23:34.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.209+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.1 size=1048576 2024-09-14T11:23:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.210+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HPQUJNIYCU9G.2 size=259457 2024-09-14T11:23:34.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.212+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=HPQUJNIYCU9G tag=4EVW8PTNQAOB type=write size=3405185 2024-09-14T11:23:34.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.213+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=VM0JY3E79U60 type=write size=817607 2024-09-14T11:23:34.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.214+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=525FAR0CI3PQ type=del 2024-09-14T11:23:34.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.215+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=KI2VN1C09OTP type=del size=3451171 2024-09-14T11:23:34.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.218+0000 7f296241c780 1 < suggested update operation key=QL439L2X13OR tag=H4JB5HMG4Y9D type=del size=1276564 2024-09-14T11:23:34.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.219+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=G10JBLA7W8IN type=del size=4029556 2024-09-14T11:23:34.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.221+0000 7f296241c780 1 < suggested remove operation key=5XAAGDKVBZ0P tag=94V8Y44C9H24 type=del 2024-09-14T11:23:34.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.222+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=GMDG9WU02Q6Y type=write size=942289 2024-09-14T11:23:34.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.223+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=M85LDCWNFLGZ type=del 2024-09-14T11:23:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.224+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=SQKI6K84OL1O type=del size=2045965 2024-09-14T11:23:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.226+0000 7f296241c780 -1 < failed to complete operation key=R1M982MUIF44 tag=11D9A8O3N19K type=del size=194014: (22) Invalid argument 2024-09-14T11:23:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.228+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HKKAYUZU1UFZ.0 size=1048576 2024-09-14T11:23:34.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.229+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~HKKAYUZU1UFZ.1 size=570825 2024-09-14T11:23:34.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.229+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=HKKAYUZU1UFZ tag=SOGIBK24ZONL type=write size=2667977 2024-09-14T11:23:34.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.231+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=16O1YCYCJRM7 type=del 2024-09-14T11:23:34.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.232+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=E0E5VY4KSR96 type=del size=4077867 2024-09-14T11:23:34.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.233+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=6CW3AJYKWU9A type=del 2024-09-14T11:23:34.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.234+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=P8CWB6X2G0EB type=del size=2247572 2024-09-14T11:23:34.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.236+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~SPNNUPM5VG8A.0 size=537728 2024-09-14T11:23:34.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.238+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=SPNNUPM5VG8A tag=WGT44TE02CYH type=write size=1586304 2024-09-14T11:23:34.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.239+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=QE6OT9XCMB0Z type=del size=3776159 2024-09-14T11:23:34.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.240+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~JZ0XBOFH7CIO.0 size=1048576 2024-09-14T11:23:34.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.241+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~JZ0XBOFH7CIO.1 size=1006018 2024-09-14T11:23:34.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.243+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=JZ0XBOFH7CIO tag=PVEOY8F81HKZ type=write size=3103170 2024-09-14T11:23:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.244+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=O43OBHKV48R6 type=del size=1858223 2024-09-14T11:23:34.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.245+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=0BEB765VZEMW type=del 2024-09-14T11:23:34.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.247+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=Q59D5B3HLP9S type=del size=1704716 2024-09-14T11:23:34.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.248+0000 7f296241c780 -1 < failed to complete operation key=QL439L2X13OR tag=4H0DSDRKRYO7 type=del size=1473459: (22) Invalid argument 2024-09-14T11:23:34.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.249+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=3RP4HVYVSX1E type=del size=3847681 2024-09-14T11:23:34.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.250+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=3G83YQ8T1X7K type=del 2024-09-14T11:23:34.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.251+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=XHQ88P2NM3Y9 type=del size=318456 2024-09-14T11:23:34.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.253+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~B08D8W6NEHDA.0 size=1048576 2024-09-14T11:23:34.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.253+0000 7f296241c780 1 < canceled part key=_multipart_GJ2Y7ICBEZJX.2~B08D8W6NEHDA.1 size=917689 2024-09-14T11:23:34.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.254+0000 7f296241c780 1 < canceled multipart upload key=GJ2Y7ICBEZJX upload=B08D8W6NEHDA tag=YKXY2CRCM3TT type=write size=3014841 2024-09-14T11:23:34.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.256+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=85M6IUBQQ5AJ type=del size=680671 2024-09-14T11:23:34.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.258+0000 7f296241c780 1 < suggested update operation key=HZD8WW0H4AAD tag=BFBJH15T9567 type=del size=392746 2024-09-14T11:23:34.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.259+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=50PIT3NB82J3 type=del size=2718462 2024-09-14T11:23:34.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.260+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~H5WL71W3O22Q.0 size=117456 2024-09-14T11:23:34.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.262+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=H5WL71W3O22Q tag=XJ7ETWBVHW71 type=write size=1166032 2024-09-14T11:23:34.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.263+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=03S1BL4TJCFF type=del size=2834485 2024-09-14T11:23:34.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.264+0000 7f296241c780 1 < completed write operation key=JW3RIVHUFGPI tag=VM0JY3E79U60 type=write size=817607 2024-09-14T11:23:34.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.266+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~AWQ6AX5W2YQ1.0 size=198410 2024-09-14T11:23:34.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.266+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=AWQ6AX5W2YQ1 tag=OEB3AZMTQU2I type=write size=1246986 2024-09-14T11:23:34.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.267+0000 7f296241c780 1 < canceled operation key=3T0SINQVBAGF tag=KI2VN1C09OTP type=del size=3451171 2024-09-14T11:23:34.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.269+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~8FZLDD1R0HIF.0 size=744013 2024-09-14T11:23:34.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.269+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=8FZLDD1R0HIF tag=WJPXRX6ETT1L type=write size=1792589 2024-09-14T11:23:34.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.270+0000 7f296241c780 1 < canceled operation key=R1M982MUIF44 tag=G10JBLA7W8IN type=del size=4029556 2024-09-14T11:23:34.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.271+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=GIFNQTT3YDBO type=del size=1072108 2024-09-14T11:23:34.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.273+0000 7f296241c780 1 < completed write operation key=TNT7E4GX5ZR7 tag=GMDG9WU02Q6Y type=write size=942289 2024-09-14T11:23:34.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.274+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=GU01R6ZDCMFZ type=write size=588042 2024-09-14T11:23:34.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.275+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=SQKI6K84OL1O type=del 2024-09-14T11:23:34.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.277+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.0 size=1048576 2024-09-14T11:23:34.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.278+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.1 size=1048576 2024-09-14T11:23:34.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.279+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.2 size=278232 2024-09-14T11:23:34.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.279+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=SHQ8I0DK0C23 tag=30HMZNO1AOBN type=write size=3423960 2024-09-14T11:23:34.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.280+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HKKAYUZU1UFZ.0 size=1048576 2024-09-14T11:23:34.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.281+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~HKKAYUZU1UFZ.1 size=570825 2024-09-14T11:23:34.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.283+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=HKKAYUZU1UFZ tag=SOGIBK24ZONL type=write size=2667977 2024-09-14T11:23:34.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.285+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.0 size=1048576 2024-09-14T11:23:34.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.286+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.1 size=1048576 2024-09-14T11:23:34.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.287+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.2 size=871676 2024-09-14T11:23:34.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.287+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=1BB6PQD4303B tag=5MCBHYEZMEZY type=write size=4017404 2024-09-14T11:23:34.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.288+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=E0E5VY4KSR96 type=del 2024-09-14T11:23:34.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.289+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=7EDKGUH41BSV type=del size=1248430 2024-09-14T11:23:34.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.290+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=P8CWB6X2G0EB type=del 2024-09-14T11:23:34.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.292+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.0 size=1048576 2024-09-14T11:23:34.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.293+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.1 size=1048576 2024-09-14T11:23:34.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.294+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.2 size=196136 2024-09-14T11:23:34.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.294+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=TCEQWNVPJP0L tag=EUDVMMAXHPM5 type=write size=3341864 2024-09-14T11:23:34.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.295+0000 7f296241c780 1 < canceled operation key=GJ2Y7ICBEZJX tag=QE6OT9XCMB0Z type=del size=3776159 2024-09-14T11:23:34.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.296+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=NC34DS9VSVPZ type=del size=2602619 2024-09-14T11:23:34.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.297+0000 7f296241c780 -1 < failed to complete operation key=HZD8WW0H4AAD tag=O43OBHKV48R6 type=del size=1858223: (22) Invalid argument 2024-09-14T11:23:34.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.300+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~4VPKQOPV2VZF.0 size=1048576 2024-09-14T11:23:34.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.300+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~4VPKQOPV2VZF.1 size=780267 2024-09-14T11:23:34.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.300+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=4VPKQOPV2VZF tag=AM76BGUHK99V type=write size=2877419 2024-09-14T11:23:34.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.303+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=Q59D5B3HLP9S type=del 2024-09-14T11:23:34.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.306+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~2QWBSB4ALE6Q.0 size=753525 2024-09-14T11:23:34.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.306+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=2QWBSB4ALE6Q tag=Q9LEUUVE08FQ type=write size=1802101 2024-09-14T11:23:34.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.307+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=3RP4HVYVSX1E type=del size=3847681 2024-09-14T11:23:34.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.308+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=TBJUI6NXPU34 type=write size=902099 2024-09-14T11:23:34.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.309+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=XHQ88P2NM3Y9 type=del 2024-09-14T11:23:34.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.310+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=MK5BS6FIRARF type=del size=1603368 2024-09-14T11:23:34.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.312+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=85M6IUBQQ5AJ type=del 2024-09-14T11:23:34.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.314+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.0 size=1048576 2024-09-14T11:23:34.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.315+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.1 size=1048576 2024-09-14T11:23:34.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.316+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.2 size=174003 2024-09-14T11:23:34.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.316+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=ZI7N8YUPWHV8 tag=A6KBDPL1OXKF type=write size=3319731 2024-09-14T11:23:34.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.317+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=50PIT3NB82J3 type=del 2024-09-14T11:23:34.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.318+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=GXZLO8XLU9NM type=write size=674612 2024-09-14T11:23:34.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.319+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=03S1BL4TJCFF type=del 2024-09-14T11:23:34.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.321+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~AOBF0C15WD6C.0 size=953014 2024-09-14T11:23:34.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.321+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=AOBF0C15WD6C tag=1DJMN2EE6XGB type=write size=2001590 2024-09-14T11:23:34.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.322+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~AWQ6AX5W2YQ1.0 size=198410 2024-09-14T11:23:34.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.324+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=AWQ6AX5W2YQ1 tag=OEB3AZMTQU2I type=write size=1246986 2024-09-14T11:23:34.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.325+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=JPXZT777P66P type=write size=810832 2024-09-14T11:23:34.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.327+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~8FZLDD1R0HIF.0 size=744013 2024-09-14T11:23:34.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.328+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=8FZLDD1R0HIF tag=WJPXRX6ETT1L type=write size=1792589 2024-09-14T11:23:34.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.330+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=CBQUFTGYE29U type=del size=1409547 2024-09-14T11:23:34.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.332+0000 7f296241c780 1 < suggested update operation key=5XAAGDKVBZ0P tag=GIFNQTT3YDBO type=del size=1072108 2024-09-14T11:23:34.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.333+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=0U4OXMRB1YT7 type=write size=479581 2024-09-14T11:23:34.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.334+0000 7f296241c780 1 < completed write operation key=GJ2Y7ICBEZJX tag=GU01R6ZDCMFZ type=write size=588042 2024-09-14T11:23:34.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.335+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=ZOBS5RHC34CT type=write size=107592 2024-09-14T11:23:34.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.336+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.0 size=1048576 2024-09-14T11:23:34.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.337+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.1 size=1048576 2024-09-14T11:23:34.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.339+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~SHQ8I0DK0C23.2 size=278232 2024-09-14T11:23:34.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.342+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=SHQ8I0DK0C23 tag=30HMZNO1AOBN type=write size=3423960 2024-09-14T11:23:34.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.343+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=6OQJXE21J23I type=del size=773047 2024-09-14T11:23:34.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.344+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.0 size=1048576 2024-09-14T11:23:34.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.345+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.1 size=1048576 2024-09-14T11:23:34.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.345+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~1BB6PQD4303B.2 size=871676 2024-09-14T11:23:34.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.348+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=1BB6PQD4303B tag=5MCBHYEZMEZY type=write size=4017404 2024-09-14T11:23:34.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.349+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=5O44GZE40T22 type=del size=985074 2024-09-14T11:23:34.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.350+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=7EDKGUH41BSV type=del 2024-09-14T11:23:34.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.351+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=WJ4PUQT2FPCA type=write size=1033772 2024-09-14T11:23:34.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.352+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.0 size=1048576 2024-09-14T11:23:34.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.353+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.1 size=1048576 2024-09-14T11:23:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.354+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~TCEQWNVPJP0L.2 size=196136 2024-09-14T11:23:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.356+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=TCEQWNVPJP0L tag=EUDVMMAXHPM5 type=write size=3341864 2024-09-14T11:23:34.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.357+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=NZ1WZXAUUW3U type=del size=2190095 2024-09-14T11:23:34.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.359+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=NC34DS9VSVPZ type=del 2024-09-14T11:23:34.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.361+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~4VEGFQYSEFSG.0 size=478427 2024-09-14T11:23:34.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.361+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=4VEGFQYSEFSG tag=WIYKNUGXRBWJ type=write size=1527003 2024-09-14T11:23:34.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.362+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~4VPKQOPV2VZF.0 size=1048576 2024-09-14T11:23:34.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.363+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~4VPKQOPV2VZF.1 size=780267 2024-09-14T11:23:34.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.364+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=4VPKQOPV2VZF tag=AM76BGUHK99V type=write size=2877419 2024-09-14T11:23:34.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.366+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.0 size=1048576 2024-09-14T11:23:34.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.367+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.1 size=1048576 2024-09-14T11:23:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.368+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.2 size=823611 2024-09-14T11:23:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.368+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=8Y0PREK4E8KX tag=9KKINEJ0IQU7 type=write size=3969339 2024-09-14T11:23:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.369+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~2QWBSB4ALE6Q.0 size=753525 2024-09-14T11:23:34.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.371+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=2QWBSB4ALE6Q tag=Q9LEUUVE08FQ type=write size=1802101 2024-09-14T11:23:34.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.373+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~T3WJU0A40KJM.0 size=409719 2024-09-14T11:23:34.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.373+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=T3WJU0A40KJM tag=1E96TJ602GS7 type=write size=1458295 2024-09-14T11:23:34.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.375+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=TBJUI6NXPU34 type=write size=902099 2024-09-14T11:23:34.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.377+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~39FR99G0GS7X.0 size=1048576 2024-09-14T11:23:34.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.378+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~39FR99G0GS7X.1 size=929466 2024-09-14T11:23:34.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.378+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=39FR99G0GS7X tag=087SJKLO2XXP type=write size=3026618 2024-09-14T11:23:34.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.381+0000 7f296241c780 1 < suggested remove operation key=I1XBOS1L5D98 tag=MK5BS6FIRARF type=del 2024-09-14T11:23:34.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.382+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=IROE4AOUHO6Q type=del size=2276717 2024-09-14T11:23:34.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.383+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.0 size=1048576 2024-09-14T11:23:34.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.383+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.1 size=1048576 2024-09-14T11:23:34.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.384+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~ZI7N8YUPWHV8.2 size=174003 2024-09-14T11:23:34.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.386+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=ZI7N8YUPWHV8 tag=A6KBDPL1OXKF type=write size=3319731 2024-09-14T11:23:34.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.389+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~9X3XHU3A3O1S.0 size=1048576 2024-09-14T11:23:34.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.390+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~9X3XHU3A3O1S.1 size=147433 2024-09-14T11:23:34.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.390+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=9X3XHU3A3O1S tag=8FC1G6Y8ALSU type=write size=2244585 2024-09-14T11:23:34.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.391+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=GXZLO8XLU9NM type=write size=674612 2024-09-14T11:23:34.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.392+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=2JUM82VQI30K type=del size=570008 2024-09-14T11:23:34.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.393+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~AOBF0C15WD6C.0 size=953014 2024-09-14T11:23:34.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.395+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=AOBF0C15WD6C tag=1DJMN2EE6XGB type=write size=2001590 2024-09-14T11:23:34.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.397+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=LYX0ILUGBBP9 type=write size=626113 2024-09-14T11:23:34.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.398+0000 7f296241c780 1 < completed write operation key=FGK7YH1GB4W5 tag=JPXZT777P66P type=write size=810832 2024-09-14T11:23:34.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.399+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=CG4WNEIZ7E2M type=del size=3893602 2024-09-14T11:23:34.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.400+0000 7f296241c780 -1 < failed to complete operation key=I1XBOS1L5D98 tag=CBQUFTGYE29U type=del size=1409547: (22) Invalid argument 2024-09-14T11:23:34.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.401+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=EREWVWOAWQPJ type=del size=2667408 2024-09-14T11:23:34.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.403+0000 7f296241c780 1 < completed write operation key=JW3RIVHUFGPI tag=0U4OXMRB1YT7 type=write size=479581 2024-09-14T11:23:34.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.404+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=DH8PREPUK2BX type=del size=2623016 2024-09-14T11:23:34.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.406+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=ZOBS5RHC34CT type=write size=107592 2024-09-14T11:23:34.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.408+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.0 size=1048576 2024-09-14T11:23:34.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.409+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.1 size=1048576 2024-09-14T11:23:34.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.410+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.2 size=680321 2024-09-14T11:23:34.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.410+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=ZF2G0O9JNH3F tag=R4AO5HFUDMOH type=write size=3826049 2024-09-14T11:23:34.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.412+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=6OQJXE21J23I type=del 2024-09-14T11:23:34.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.414+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~6RDNY4VIYAMA.0 size=119448 2024-09-14T11:23:34.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.414+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=6RDNY4VIYAMA tag=TTYELMXV4M76 type=write size=1168024 2024-09-14T11:23:34.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.416+0000 7f296241c780 1 < suggested remove operation key=5XAAGDKVBZ0P tag=5O44GZE40T22 type=del 2024-09-14T11:23:34.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.417+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=K948YTQK05TX type=del size=3868143 2024-09-14T11:23:34.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.419+0000 7f296241c780 1 < completed write operation key=CQU8M12JCE9T tag=WJ4PUQT2FPCA type=write size=1033772 2024-09-14T11:23:34.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.420+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=OHFH88N2YLYN type=del size=3278264 2024-09-14T11:23:34.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.421+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=NZ1WZXAUUW3U type=del 2024-09-14T11:23:34.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.422+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=BOOHPL85EAF8 type=del size=2886285 2024-09-14T11:23:34.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.423+0000 7f296241c780 1 < canceled part key=_multipart_XTS8B3LEW0Y3.2~4VEGFQYSEFSG.0 size=478427 2024-09-14T11:23:34.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.425+0000 7f296241c780 1 < canceled multipart upload key=XTS8B3LEW0Y3 upload=4VEGFQYSEFSG tag=WIYKNUGXRBWJ type=write size=1527003 2024-09-14T11:23:34.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.426+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=4GG0P7ABWNBE type=del size=2945262 2024-09-14T11:23:34.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.427+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.0 size=1048576 2024-09-14T11:23:34.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.428+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.1 size=1048576 2024-09-14T11:23:34.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.429+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~8Y0PREK4E8KX.2 size=823611 2024-09-14T11:23:34.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.431+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=8Y0PREK4E8KX tag=9KKINEJ0IQU7 type=write size=3969339 2024-09-14T11:23:34.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.433+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~AO86I8E0OD3H.0 size=285659 2024-09-14T11:23:34.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.433+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=AO86I8E0OD3H tag=12X30UQZN9GV type=write size=1334235 2024-09-14T11:23:34.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.434+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~T3WJU0A40KJM.0 size=409719 2024-09-14T11:23:34.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.436+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=T3WJU0A40KJM tag=1E96TJ602GS7 type=write size=1458295 2024-09-14T11:23:34.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.437+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=P31AOR4XKK21 type=del size=1575722 2024-09-14T11:23:34.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.439+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~39FR99G0GS7X.0 size=1048576 2024-09-14T11:23:34.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.440+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~39FR99G0GS7X.1 size=929466 2024-09-14T11:23:34.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.442+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=39FR99G0GS7X tag=087SJKLO2XXP type=write size=3026618 2024-09-14T11:23:34.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.444+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.0 size=1048576 2024-09-14T11:23:34.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.445+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.1 size=1048576 2024-09-14T11:23:34.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.446+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.2 size=805365 2024-09-14T11:23:34.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.446+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=C6PGSAT7P5V5 tag=21XRM0ATQY9O type=write size=3951093 2024-09-14T11:23:34.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.447+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=IROE4AOUHO6Q type=del 2024-09-14T11:23:34.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.448+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=5UKY2DDZFXVU type=del size=89179 2024-09-14T11:23:34.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.449+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~9X3XHU3A3O1S.0 size=1048576 2024-09-14T11:23:34.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.451+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~9X3XHU3A3O1S.1 size=147433 2024-09-14T11:23:34.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.455+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=9X3XHU3A3O1S tag=8FC1G6Y8ALSU type=write size=2244585 2024-09-14T11:23:34.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.456+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=9SB7N3K9KBBG type=del size=353847 2024-09-14T11:23:34.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.459+0000 7f296241c780 1 < suggested update operation key=JW3RIVHUFGPI tag=2JUM82VQI30K type=del size=570008 2024-09-14T11:23:34.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.460+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=KOMSICL0H2KZ type=del size=3429921 2024-09-14T11:23:34.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.462+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=LYX0ILUGBBP9 type=write size=626113 2024-09-14T11:23:34.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.463+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=BTFSELQVZLMW type=del size=2893966 2024-09-14T11:23:34.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.465+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=CG4WNEIZ7E2M type=del 2024-09-14T11:23:34.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.466+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=7I04916H9U1Z type=del size=1180451 2024-09-14T11:23:34.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.467+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=EREWVWOAWQPJ type=del 2024-09-14T11:23:34.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.469+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.0 size=1048576 2024-09-14T11:23:34.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.470+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.1 size=1048576 2024-09-14T11:23:34.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.471+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.2 size=915167 2024-09-14T11:23:34.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.471+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=8SVA7MUQ3YS2 tag=TJYP09MCOJ3Q type=write size=4060895 2024-09-14T11:23:34.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.472+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=DH8PREPUK2BX type=del 2024-09-14T11:23:34.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.475+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=PR5170MZCSLG type=del size=861031 2024-09-14T11:23:34.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.476+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.0 size=1048576 2024-09-14T11:23:34.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.477+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.1 size=1048576 2024-09-14T11:23:34.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.478+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~ZF2G0O9JNH3F.2 size=680321 2024-09-14T11:23:34.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.480+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=ZF2G0O9JNH3F tag=R4AO5HFUDMOH type=write size=3826049 2024-09-14T11:23:34.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.482+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.0 size=1048576 2024-09-14T11:23:34.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.483+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.1 size=1048576 2024-09-14T11:23:34.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.484+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.2 size=778807 2024-09-14T11:23:34.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.484+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=XGFW6ERDTL4D tag=K9LXP9DAKYB4 type=write size=3924535 2024-09-14T11:23:34.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.485+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~6RDNY4VIYAMA.0 size=119448 2024-09-14T11:23:34.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.487+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=6RDNY4VIYAMA tag=TTYELMXV4M76 type=write size=1168024 2024-09-14T11:23:34.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.488+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=CIDD6MREP3AK type=del size=1160868 2024-09-14T11:23:34.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.489+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=K948YTQK05TX type=del 2024-09-14T11:23:34.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.490+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=UL4KE42ZH2BP type=del size=2645157 2024-09-14T11:23:34.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.491+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=OHFH88N2YLYN type=del 2024-09-14T11:23:34.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.492+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=76OTCUSH6JIK type=del size=3036560 2024-09-14T11:23:34.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.494+0000 7f296241c780 1 < canceled operation key=JH1QJE5V4M9H tag=BOOHPL85EAF8 type=del size=2886285 2024-09-14T11:23:34.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.496+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~90UM30Q4XMVO.0 size=1048576 2024-09-14T11:23:34.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.497+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~90UM30Q4XMVO.1 size=409273 2024-09-14T11:23:34.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.497+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=90UM30Q4XMVO tag=PJP8OK5B0AND type=write size=2506425 2024-09-14T11:23:34.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.498+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=4GG0P7ABWNBE type=del 2024-09-14T11:23:34.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.499+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=XY0EIHU5CPVN type=write size=433080 2024-09-14T11:23:34.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.499+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~AO86I8E0OD3H.0 size=285659 2024-09-14T11:23:34.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.501+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=AO86I8E0OD3H tag=12X30UQZN9GV type=write size=1334235 2024-09-14T11:23:34.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.502+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=S6GRM0N2U5BN type=del size=2263261 2024-09-14T11:23:34.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.504+0000 7f296241c780 -1 < failed to complete operation key=JW3RIVHUFGPI tag=P31AOR4XKK21 type=del size=1575722: (22) Invalid argument 2024-09-14T11:23:34.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.506+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~612BOUTY5S97.0 size=1048576 2024-09-14T11:23:34.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.507+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~612BOUTY5S97.1 size=21952 2024-09-14T11:23:34.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.507+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=612BOUTY5S97 tag=JBL3AYL0SERR type=write size=2119104 2024-09-14T11:23:34.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.508+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.0 size=1048576 2024-09-14T11:23:34.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.509+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.1 size=1048576 2024-09-14T11:23:34.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.510+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~C6PGSAT7P5V5.2 size=805365 2024-09-14T11:23:34.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.512+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=C6PGSAT7P5V5 tag=21XRM0ATQY9O type=write size=3951093 2024-09-14T11:23:34.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.513+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=R9O2WN1RAD2L type=del size=2226029 2024-09-14T11:23:34.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.514+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=5UKY2DDZFXVU type=del 2024-09-14T11:23:34.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.516+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=60I5MAJ7QJO7 type=del size=903485 2024-09-14T11:23:34.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.518+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=9SB7N3K9KBBG type=del 2024-09-14T11:23:34.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.519+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=045RQ4MFGWUQ type=del size=1230399 2024-09-14T11:23:34.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.521+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=KOMSICL0H2KZ type=del 2024-09-14T11:23:34.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.523+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~CB51662578BZ.0 size=1048576 2024-09-14T11:23:34.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.524+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~CB51662578BZ.1 size=202282 2024-09-14T11:23:34.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.524+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=CB51662578BZ tag=5GI0CC164UXE type=write size=2299434 2024-09-14T11:23:34.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.525+0000 7f296241c780 1 < canceled operation key=QIVVKYC646IH tag=BTFSELQVZLMW type=del size=2893966 2024-09-14T11:23:34.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.526+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=U5QQRL41L02X type=del size=734769 2024-09-14T11:23:34.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.527+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=7I04916H9U1Z type=del 2024-09-14T11:23:34.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.529+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=UEW7QOQIZK31 type=del size=1099535 2024-09-14T11:23:34.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.530+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.0 size=1048576 2024-09-14T11:23:34.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.531+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.1 size=1048576 2024-09-14T11:23:34.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.532+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~8SVA7MUQ3YS2.2 size=915167 2024-09-14T11:23:34.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.534+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=8SVA7MUQ3YS2 tag=TJYP09MCOJ3Q type=write size=4060895 2024-09-14T11:23:34.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.536+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~8L41OJO2E6L2.0 size=758847 2024-09-14T11:23:34.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.536+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=8L41OJO2E6L2 tag=5F4PSN1GHBVD type=write size=1807423 2024-09-14T11:23:34.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.537+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=PR5170MZCSLG type=del 2024-09-14T11:23:34.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.539+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.0 size=1048576 2024-09-14T11:23:34.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.540+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.1 size=1048576 2024-09-14T11:23:34.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.541+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.2 size=15505 2024-09-14T11:23:34.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.541+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=AZ2QEOUIIBV1 tag=6DCEI3H6WDFC type=write size=3161233 2024-09-14T11:23:34.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.542+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.0 size=1048576 2024-09-14T11:23:34.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.543+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.1 size=1048576 2024-09-14T11:23:34.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.544+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XGFW6ERDTL4D.2 size=778807 2024-09-14T11:23:34.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.546+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=XGFW6ERDTL4D tag=K9LXP9DAKYB4 type=write size=3924535 2024-09-14T11:23:34.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.548+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.0 size=1048576 2024-09-14T11:23:34.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.549+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.1 size=1048576 2024-09-14T11:23:34.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.550+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.2 size=112773 2024-09-14T11:23:34.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.550+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=OZOS2WYZZWMZ tag=TOPDJZIWD2RP type=write size=3258501 2024-09-14T11:23:34.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.551+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=CIDD6MREP3AK type=del 2024-09-14T11:23:34.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.552+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=7DVPHFS0A7VC type=del size=1315226 2024-09-14T11:23:34.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.554+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=UL4KE42ZH2BP type=del 2024-09-14T11:23:34.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.555+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=GWJQ1VLOVEAY type=del size=3803318 2024-09-14T11:23:34.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.556+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=76OTCUSH6JIK type=del 2024-09-14T11:23:34.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.560+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~G6XFWFWU818S.0 size=691014 2024-09-14T11:23:34.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.560+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=G6XFWFWU818S tag=EV5H23Q2I3N2 type=write size=1739590 2024-09-14T11:23:34.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.560+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~90UM30Q4XMVO.0 size=1048576 2024-09-14T11:23:34.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.561+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~90UM30Q4XMVO.1 size=409273 2024-09-14T11:23:34.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.563+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=90UM30Q4XMVO tag=PJP8OK5B0AND type=write size=2506425 2024-09-14T11:23:34.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.567+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~0X2WYC080MPK.0 size=806461 2024-09-14T11:23:34.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.567+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=0X2WYC080MPK tag=OEUQ48WSP06B type=write size=1855037 2024-09-14T11:23:34.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.568+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=XY0EIHU5CPVN type=write size=433080 2024-09-14T11:23:34.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.571+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~FFSP129LQ0LS.0 size=1048576 2024-09-14T11:23:34.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.572+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~FFSP129LQ0LS.1 size=864593 2024-09-14T11:23:34.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.572+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=FFSP129LQ0LS tag=54CXPUHG52IV type=write size=2961745 2024-09-14T11:23:34.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.573+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=S6GRM0N2U5BN type=del 2024-09-14T11:23:34.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.574+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=FDFFCT5U6F87 type=del size=3218820 2024-09-14T11:23:34.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.575+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~612BOUTY5S97.0 size=1048576 2024-09-14T11:23:34.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.576+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~612BOUTY5S97.1 size=21952 2024-09-14T11:23:34.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.578+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=612BOUTY5S97 tag=JBL3AYL0SERR type=write size=2119104 2024-09-14T11:23:34.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.580+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~MFBQ3TEQ4Y3H.0 size=114814 2024-09-14T11:23:34.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.580+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=MFBQ3TEQ4Y3H tag=CPSGJV0JN67V type=write size=1163390 2024-09-14T11:23:34.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.581+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=R9O2WN1RAD2L type=del 2024-09-14T11:23:34.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.583+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~ZFAC7GPIM2P7.0 size=857936 2024-09-14T11:23:34.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.583+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=ZFAC7GPIM2P7 tag=4XB0XYGA1SHY type=write size=1906512 2024-09-14T11:23:34.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.584+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=60I5MAJ7QJO7 type=del 2024-09-14T11:23:34.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.585+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=1A87CDI8JVLQ type=del size=3727828 2024-09-14T11:23:34.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.587+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=045RQ4MFGWUQ type=del 2024-09-14T11:23:34.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.588+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~H0YPCUGMCG01.0 size=1048576 2024-09-14T11:23:34.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.590+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~H0YPCUGMCG01.1 size=61681 2024-09-14T11:23:34.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.590+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=H0YPCUGMCG01 tag=TV1FA609SDPD type=write size=2158833 2024-09-14T11:23:34.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.591+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~CB51662578BZ.0 size=1048576 2024-09-14T11:23:34.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.592+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~CB51662578BZ.1 size=202282 2024-09-14T11:23:34.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.594+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=CB51662578BZ tag=5GI0CC164UXE type=write size=2299434 2024-09-14T11:23:34.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.595+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=MS0GIX1KBY7H type=del size=3424763 2024-09-14T11:23:34.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.596+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=U5QQRL41L02X type=del 2024-09-14T11:23:34.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.598+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~8HM335D8RWZT.0 size=694348 2024-09-14T11:23:34.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.598+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=8HM335D8RWZT tag=8BXBNJ9W4UV0 type=write size=1742924 2024-09-14T11:23:34.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.599+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=UEW7QOQIZK31 type=del 2024-09-14T11:23:34.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.601+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=0C0FC8V8VVNF type=del size=637093 2024-09-14T11:23:34.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.602+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~8L41OJO2E6L2.0 size=758847 2024-09-14T11:23:34.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.604+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=8L41OJO2E6L2 tag=5F4PSN1GHBVD type=write size=1807423 2024-09-14T11:23:34.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.605+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=BZJC3AJWY2RH type=del size=3618081 2024-09-14T11:23:34.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.606+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.0 size=1048576 2024-09-14T11:23:34.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.607+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.1 size=1048576 2024-09-14T11:23:34.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.608+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~AZ2QEOUIIBV1.2 size=15505 2024-09-14T11:23:34.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.610+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=AZ2QEOUIIBV1 tag=6DCEI3H6WDFC type=write size=3161233 2024-09-14T11:23:34.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.611+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=BP4GZ5RM05IE type=del size=480405 2024-09-14T11:23:34.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.612+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.0 size=1048576 2024-09-14T11:23:34.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.613+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.1 size=1048576 2024-09-14T11:23:34.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.614+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~OZOS2WYZZWMZ.2 size=112773 2024-09-14T11:23:34.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.616+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=OZOS2WYZZWMZ tag=TOPDJZIWD2RP type=write size=3258501 2024-09-14T11:23:34.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.618+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=BTYK0RFZ3DOB type=del size=2612592 2024-09-14T11:23:34.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.619+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=7DVPHFS0A7VC type=del 2024-09-14T11:23:34.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.620+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=1I4OBN9HFWSY type=del size=117169 2024-09-14T11:23:34.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.621+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=GWJQ1VLOVEAY type=del 2024-09-14T11:23:34.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.622+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=TIUBW4KUSHLX type=del size=3492487 2024-09-14T11:23:34.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.623+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~G6XFWFWU818S.0 size=691014 2024-09-14T11:23:34.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.625+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=G6XFWFWU818S tag=EV5H23Q2I3N2 type=write size=1739590 2024-09-14T11:23:34.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.627+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~MWNT7SRV9RC2.0 size=330672 2024-09-14T11:23:34.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.627+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=MWNT7SRV9RC2 tag=ZXGQ4ZK03AGO type=write size=1379248 2024-09-14T11:23:34.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.629+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~0X2WYC080MPK.0 size=806461 2024-09-14T11:23:34.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.631+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=0X2WYC080MPK tag=OEUQ48WSP06B type=write size=1855037 2024-09-14T11:23:34.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.632+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=CC3ED5ZAR5G6 type=del size=2214618 2024-09-14T11:23:34.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.633+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~FFSP129LQ0LS.0 size=1048576 2024-09-14T11:23:34.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.634+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~FFSP129LQ0LS.1 size=864593 2024-09-14T11:23:34.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.636+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=FFSP129LQ0LS tag=54CXPUHG52IV type=write size=2961745 2024-09-14T11:23:34.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.638+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~7BDFS8BIA3HP.0 size=1048576 2024-09-14T11:23:34.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.639+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~7BDFS8BIA3HP.1 size=392828 2024-09-14T11:23:34.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.639+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=7BDFS8BIA3HP tag=FHCSAMGU7JML type=write size=2489980 2024-09-14T11:23:34.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.641+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=FDFFCT5U6F87 type=del size=3218820 2024-09-14T11:23:34.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.642+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=PULRXWC692EG type=del size=1161817 2024-09-14T11:23:34.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.643+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~MFBQ3TEQ4Y3H.0 size=114814 2024-09-14T11:23:34.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.645+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=MFBQ3TEQ4Y3H tag=CPSGJV0JN67V type=write size=1163390 2024-09-14T11:23:34.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.646+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=T5F45QNKV84V type=del size=361398 2024-09-14T11:23:34.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.647+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~ZFAC7GPIM2P7.0 size=857936 2024-09-14T11:23:34.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.649+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=ZFAC7GPIM2P7 tag=4XB0XYGA1SHY type=write size=1906512 2024-09-14T11:23:34.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.650+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=GUTYM0R6ZGV8 type=del size=2170685 2024-09-14T11:23:34.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.652+0000 7f296241c780 1 < suggested update operation key=CQU8M12JCE9T tag=1A87CDI8JVLQ type=del size=3727828 2024-09-14T11:23:34.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.653+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=WFQA540C89PI type=del size=257277 2024-09-14T11:23:34.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.655+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~H0YPCUGMCG01.0 size=1048576 2024-09-14T11:23:34.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.656+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~H0YPCUGMCG01.1 size=61681 2024-09-14T11:23:34.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.657+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=H0YPCUGMCG01 tag=TV1FA609SDPD type=write size=2158833 2024-09-14T11:23:34.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.660+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~PR2RDVGSJD09.0 size=836353 2024-09-14T11:23:34.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.660+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=PR2RDVGSJD09 tag=2I7I9I391QIT type=write size=1884929 2024-09-14T11:23:34.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.661+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=MS0GIX1KBY7H type=del 2024-09-14T11:23:34.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.662+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=OGRLQQDVJRQ4 type=del size=1559323 2024-09-14T11:23:34.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.663+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~8HM335D8RWZT.0 size=694348 2024-09-14T11:23:34.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.665+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=8HM335D8RWZT tag=8BXBNJ9W4UV0 type=write size=1742924 2024-09-14T11:23:34.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.667+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~0ZXA04W7YHWN.0 size=1048576 2024-09-14T11:23:34.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.668+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~0ZXA04W7YHWN.1 size=47388 2024-09-14T11:23:34.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.668+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=0ZXA04W7YHWN tag=O8U7EB1H8V61 type=write size=2144540 2024-09-14T11:23:34.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.669+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=0C0FC8V8VVNF type=del 2024-09-14T11:23:34.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.671+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=FPO9G4FD34F9 type=write size=142946 2024-09-14T11:23:34.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.673+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=BZJC3AJWY2RH type=del 2024-09-14T11:23:34.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.676+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~VSV7TSRH15J3.0 size=812736 2024-09-14T11:23:34.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.676+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=VSV7TSRH15J3 tag=XC9AK5U8237N type=write size=1861312 2024-09-14T11:23:34.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.677+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=BP4GZ5RM05IE type=del 2024-09-14T11:23:34.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.678+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=8G6R3ZM4RHKE type=write size=631588 2024-09-14T11:23:34.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.681+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=BTYK0RFZ3DOB type=del 2024-09-14T11:23:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.683+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~BTHTP41D8UJJ.0 size=255351 2024-09-14T11:23:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.683+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=BTHTP41D8UJJ tag=E7ATXUI5208Z type=write size=1303927 2024-09-14T11:23:34.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.684+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=1I4OBN9HFWSY type=del 2024-09-14T11:23:34.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.685+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=2GAAATWO20OM type=del size=2177221 2024-09-14T11:23:34.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.686+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=TIUBW4KUSHLX type=del 2024-09-14T11:23:34.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.688+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~0FQI5PFGD51A.0 size=553121 2024-09-14T11:23:34.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.688+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=0FQI5PFGD51A tag=P39N25HHBVE5 type=write size=1601697 2024-09-14T11:23:34.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.689+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~MWNT7SRV9RC2.0 size=330672 2024-09-14T11:23:34.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.691+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=MWNT7SRV9RC2 tag=ZXGQ4ZK03AGO type=write size=1379248 2024-09-14T11:23:34.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.692+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=6QWE1ZT1GR8U type=del size=2050444 2024-09-14T11:23:34.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.694+0000 7f296241c780 1 < suggested remove operation key=XTS8B3LEW0Y3 tag=CC3ED5ZAR5G6 type=del 2024-09-14T11:23:34.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.696+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=Q27HD487FL6O type=del size=1409149 2024-09-14T11:23:34.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.697+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~7BDFS8BIA3HP.0 size=1048576 2024-09-14T11:23:34.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.698+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~7BDFS8BIA3HP.1 size=392828 2024-09-14T11:23:34.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.699+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=7BDFS8BIA3HP tag=FHCSAMGU7JML type=write size=2489980 2024-09-14T11:23:34.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.701+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=2GOHOZGDMGUL type=del size=1082105 2024-09-14T11:23:34.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.702+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=PULRXWC692EG type=del 2024-09-14T11:23:34.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.704+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.0 size=1048576 2024-09-14T11:23:34.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.705+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.1 size=1048576 2024-09-14T11:23:34.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.706+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.2 size=743102 2024-09-14T11:23:34.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.706+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=PS3W5C0GENYW tag=KVJYN9ZKQWRK type=write size=3888830 2024-09-14T11:23:34.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.707+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=T5F45QNKV84V type=del 2024-09-14T11:23:34.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.708+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=KNC3U2N462GR type=write size=39967 2024-09-14T11:23:34.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.709+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=GUTYM0R6ZGV8 type=del 2024-09-14T11:23:34.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.711+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.0 size=1048576 2024-09-14T11:23:34.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.712+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.1 size=1048576 2024-09-14T11:23:34.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.713+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.2 size=696403 2024-09-14T11:23:34.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.713+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=VTCAW4JSIC15 tag=3N0ANRVLB9GU type=write size=3842131 2024-09-14T11:23:34.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.714+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=WFQA540C89PI type=del 2024-09-14T11:23:34.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.716+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=13SO0ZTTBGSP type=del size=1427419 2024-09-14T11:23:34.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.717+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~PR2RDVGSJD09.0 size=836353 2024-09-14T11:23:34.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.719+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=PR2RDVGSJD09 tag=2I7I9I391QIT type=write size=1884929 2024-09-14T11:23:34.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.721+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ROWPUEKJVZTD.0 size=1048576 2024-09-14T11:23:34.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.722+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~ROWPUEKJVZTD.1 size=775137 2024-09-14T11:23:34.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.722+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=ROWPUEKJVZTD tag=15V20UGDE6QQ type=write size=2872289 2024-09-14T11:23:34.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.723+0000 7f296241c780 1 < canceled operation key=19TC05N1D5FR tag=OGRLQQDVJRQ4 type=del size=1559323 2024-09-14T11:23:34.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.724+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=DN49AFLSBMKW type=write size=455743 2024-09-14T11:23:34.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.725+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~0ZXA04W7YHWN.0 size=1048576 2024-09-14T11:23:34.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.726+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~0ZXA04W7YHWN.1 size=47388 2024-09-14T11:23:34.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.728+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=0ZXA04W7YHWN tag=O8U7EB1H8V61 type=write size=2144540 2024-09-14T11:23:34.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.729+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=ZZXLBQKXDRV5 type=del size=2349864 2024-09-14T11:23:34.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.731+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=FPO9G4FD34F9 type=write size=142946 2024-09-14T11:23:34.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.732+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=LFSVONZOZAMV type=write size=720641 2024-09-14T11:23:34.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.732+0000 7f296241c780 1 < canceled part key=_multipart_0A90ZOC79OWP.2~VSV7TSRH15J3.0 size=812736 2024-09-14T11:23:34.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.734+0000 7f296241c780 1 < canceled multipart upload key=0A90ZOC79OWP upload=VSV7TSRH15J3 tag=XC9AK5U8237N type=write size=1861312 2024-09-14T11:23:34.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.736+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~6ISK4JJSLUDE.0 size=1048576 2024-09-14T11:23:34.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.737+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~6ISK4JJSLUDE.1 size=697923 2024-09-14T11:23:34.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.737+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=6ISK4JJSLUDE tag=TZNEBCSTQ3WP type=write size=2795075 2024-09-14T11:23:34.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.739+0000 7f296241c780 1 < suggested remove operation key=LK9LRQM3TZRR tag=8G6R3ZM4RHKE type=write 2024-09-14T11:23:34.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.741+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~M6XPN43UHYJP.0 size=88409 2024-09-14T11:23:34.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.741+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=M6XPN43UHYJP tag=RW7HNCXVH0SE type=write size=1136985 2024-09-14T11:23:34.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.743+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~BTHTP41D8UJJ.0 size=255351 2024-09-14T11:23:34.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.744+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=BTHTP41D8UJJ tag=E7ATXUI5208Z type=write size=1303927 2024-09-14T11:23:34.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.745+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=D0WKTAESHHNJ type=del size=304635 2024-09-14T11:23:34.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.746+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=2GAAATWO20OM type=del 2024-09-14T11:23:34.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.748+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=Q05QVL0EU64Q type=del size=4140710 2024-09-14T11:23:34.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.749+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~0FQI5PFGD51A.0 size=553121 2024-09-14T11:23:34.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.750+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=0FQI5PFGD51A tag=P39N25HHBVE5 type=write size=1601697 2024-09-14T11:23:34.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.751+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=N3938N4WRR95 type=del size=1051821 2024-09-14T11:23:34.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.752+0000 7f296241c780 -1 < failed to complete operation key=LK9LRQM3TZRR tag=6QWE1ZT1GR8U type=del size=2050444: (22) Invalid argument 2024-09-14T11:23:34.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.755+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.0 size=1048576 2024-09-14T11:23:34.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.756+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.1 size=1048576 2024-09-14T11:23:34.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.757+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.2 size=448812 2024-09-14T11:23:34.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.757+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=89J2GTNRHK7O tag=AT423ACLRRRK type=write size=3594540 2024-09-14T11:23:34.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.758+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=Q27HD487FL6O type=del 2024-09-14T11:23:34.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.760+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=M1GYLB1240G1 type=del size=1757274 2024-09-14T11:23:34.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.761+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=2GOHOZGDMGUL type=del 2024-09-14T11:23:34.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.763+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.0 size=1048576 2024-09-14T11:23:34.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.764+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.1 size=1048576 2024-09-14T11:23:34.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.765+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.2 size=254194 2024-09-14T11:23:34.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.765+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=S9X66CW4A34G tag=IJI66YQZ1Z78 type=write size=3399922 2024-09-14T11:23:34.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.766+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.0 size=1048576 2024-09-14T11:23:34.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.767+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.1 size=1048576 2024-09-14T11:23:34.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.767+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~PS3W5C0GENYW.2 size=743102 2024-09-14T11:23:34.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.769+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=PS3W5C0GENYW tag=KVJYN9ZKQWRK type=write size=3888830 2024-09-14T11:23:34.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.770+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=1MBLN4HYT5OP type=del size=3995606 2024-09-14T11:23:34.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.772+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=KNC3U2N462GR type=write size=39967 2024-09-14T11:23:34.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.776+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.0 size=1048576 2024-09-14T11:23:34.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.776+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.1 size=1048576 2024-09-14T11:23:34.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.777+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.2 size=71537 2024-09-14T11:23:34.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.777+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=HHYH05O8DVY9 tag=VAE12AJFDNWL type=write size=3217265 2024-09-14T11:23:34.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.779+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.0 size=1048576 2024-09-14T11:23:34.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.779+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.1 size=1048576 2024-09-14T11:23:34.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.780+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~VTCAW4JSIC15.2 size=696403 2024-09-14T11:23:34.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.782+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=VTCAW4JSIC15 tag=3N0ANRVLB9GU type=write size=3842131 2024-09-14T11:23:34.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.785+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.0 size=1048576 2024-09-14T11:23:34.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.786+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.1 size=1048576 2024-09-14T11:23:34.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.787+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.2 size=443691 2024-09-14T11:23:34.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.787+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=LJGIG7E2SLE7 tag=J6HIT27A9WG1 type=write size=3589419 2024-09-14T11:23:34.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.788+0000 7f296241c780 1 < canceled operation key=7WGFBTAM25J9 tag=13SO0ZTTBGSP type=del size=1427419 2024-09-14T11:23:34.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.789+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=ZF35W8LB9PE6 type=write size=767258 2024-09-14T11:23:34.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.790+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ROWPUEKJVZTD.0 size=1048576 2024-09-14T11:23:34.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.791+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~ROWPUEKJVZTD.1 size=775137 2024-09-14T11:23:34.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.793+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=ROWPUEKJVZTD tag=15V20UGDE6QQ type=write size=2872289 2024-09-14T11:23:34.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.794+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=5IDJ9JQZUCX3 type=del size=3738410 2024-09-14T11:23:34.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.795+0000 7f296241c780 1 < completed write operation key=QIVVKYC646IH tag=DN49AFLSBMKW type=write size=455743 2024-09-14T11:23:34.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.796+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=6E75J9CE6AY8 type=write size=45549 2024-09-14T11:23:34.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.799+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=ZZXLBQKXDRV5 type=del size=2349864 2024-09-14T11:23:34.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.800+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=384EEZ4OF5R2 type=del size=1526650 2024-09-14T11:23:34.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.801+0000 7f296241c780 1 < completed write operation key=JW3RIVHUFGPI tag=LFSVONZOZAMV type=write size=720641 2024-09-14T11:23:34.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.803+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~R85X5TK3XN4C.0 size=940337 2024-09-14T11:23:34.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.803+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=R85X5TK3XN4C tag=5F13GT46VVQP type=write size=1988913 2024-09-14T11:23:34.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.804+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~6ISK4JJSLUDE.0 size=1048576 2024-09-14T11:23:34.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.805+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~6ISK4JJSLUDE.1 size=697923 2024-09-14T11:23:34.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.807+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=6ISK4JJSLUDE tag=TZNEBCSTQ3WP type=write size=2795075 2024-09-14T11:23:34.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.808+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FDV6B4WQSJ11 type=del size=651277 2024-09-14T11:23:34.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.809+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~M6XPN43UHYJP.0 size=88409 2024-09-14T11:23:34.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.811+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=M6XPN43UHYJP tag=RW7HNCXVH0SE type=write size=1136985 2024-09-14T11:23:34.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.812+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=KWXQQMFG0B0G type=del size=133862 2024-09-14T11:23:34.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.814+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=D0WKTAESHHNJ type=del 2024-09-14T11:23:34.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.815+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=XE4PQSY8WGRZ type=del size=903218 2024-09-14T11:23:34.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.817+0000 7f296241c780 1 < suggested remove operation key=XTS8B3LEW0Y3 tag=Q05QVL0EU64Q type=del 2024-09-14T11:23:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.818+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=U65GIGGETK2U type=del size=634620 2024-09-14T11:23:34.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.819+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=N3938N4WRR95 type=del size=1051821 2024-09-14T11:23:34.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.821+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~7CMUJV7SYPAD.0 size=1048576 2024-09-14T11:23:34.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.822+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~7CMUJV7SYPAD.1 size=417844 2024-09-14T11:23:34.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.822+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=7CMUJV7SYPAD tag=IDHP3JZSQMGQ type=write size=2514996 2024-09-14T11:23:34.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.824+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.0 size=1048576 2024-09-14T11:23:34.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.824+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.1 size=1048576 2024-09-14T11:23:34.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.825+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~89J2GTNRHK7O.2 size=448812 2024-09-14T11:23:34.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.827+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=89J2GTNRHK7O tag=AT423ACLRRRK type=write size=3594540 2024-09-14T11:23:34.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.831+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.0 size=1048576 2024-09-14T11:23:34.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.832+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.1 size=1048576 2024-09-14T11:23:34.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.833+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.2 size=318463 2024-09-14T11:23:34.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.833+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=QIB58JUPAH15 tag=GC52D3CA5GBU type=write size=3464191 2024-09-14T11:23:34.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.835+0000 7f296241c780 1 < suggested remove operation key=QIVVKYC646IH tag=M1GYLB1240G1 type=del 2024-09-14T11:23:34.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.838+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~KDABGWKR5AME.0 size=1048576 2024-09-14T11:23:34.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.838+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~KDABGWKR5AME.1 size=345283 2024-09-14T11:23:34.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.838+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=KDABGWKR5AME tag=4VMCE8VWFMGX type=write size=2442435 2024-09-14T11:23:34.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.840+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.0 size=1048576 2024-09-14T11:23:34.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.840+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.1 size=1048576 2024-09-14T11:23:34.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.841+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~S9X66CW4A34G.2 size=254194 2024-09-14T11:23:34.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.843+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=S9X66CW4A34G tag=IJI66YQZ1Z78 type=write size=3399922 2024-09-14T11:23:34.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.845+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=Y7CZJQUVK6Y7 type=del size=553815 2024-09-14T11:23:34.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.846+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=1MBLN4HYT5OP type=del 2024-09-14T11:23:34.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.847+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=H8CA6I57SPW2 type=del size=63051 2024-09-14T11:23:34.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.848+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.0 size=1048576 2024-09-14T11:23:34.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.848+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.1 size=1048576 2024-09-14T11:23:34.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.849+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~HHYH05O8DVY9.2 size=71537 2024-09-14T11:23:34.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.851+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=HHYH05O8DVY9 tag=VAE12AJFDNWL type=write size=3217265 2024-09-14T11:23:34.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.853+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~9KTIB6ZJ8LLU.0 size=551805 2024-09-14T11:23:34.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.853+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=9KTIB6ZJ8LLU tag=BVRWIUF246YL type=write size=1600381 2024-09-14T11:23:34.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.854+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.0 size=1048576 2024-09-14T11:23:34.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.856+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.1 size=1048576 2024-09-14T11:23:34.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.857+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~LJGIG7E2SLE7.2 size=443691 2024-09-14T11:23:34.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.859+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=LJGIG7E2SLE7 tag=J6HIT27A9WG1 type=write size=3589419 2024-09-14T11:23:34.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.860+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=LF31GAF9MSU7 type=del size=3261386 2024-09-14T11:23:34.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.862+0000 7f296241c780 1 < suggested update operation key=L8NA53KOAT58 tag=ZF35W8LB9PE6 type=write size=767258 2024-09-14T11:23:34.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.863+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=WB763CPN7U77 type=del size=3533378 2024-09-14T11:23:34.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.864+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=5IDJ9JQZUCX3 type=del 2024-09-14T11:23:34.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.865+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=2GJVS3QFTJEE type=write size=537867 2024-09-14T11:23:34.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.866+0000 7f296241c780 1 < canceled operation key=ILOY74OSG5CQ tag=6E75J9CE6AY8 type=write size=45549 2024-09-14T11:23:34.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.867+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=0HBKTI2RPIRZ type=write size=757553 2024-09-14T11:23:34.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.868+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=384EEZ4OF5R2 type=del 2024-09-14T11:23:34.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.871+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.0 size=1048576 2024-09-14T11:23:34.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.871+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.1 size=1048576 2024-09-14T11:23:34.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.872+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.2 size=785149 2024-09-14T11:23:34.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.872+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=NX6TNYE6HQ2N tag=JCH4X4QQJT51 type=write size=3930877 2024-09-14T11:23:34.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.873+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~R85X5TK3XN4C.0 size=940337 2024-09-14T11:23:34.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.875+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=R85X5TK3XN4C tag=5F13GT46VVQP type=write size=1988913 2024-09-14T11:23:34.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.876+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=SLVWJCO20C4E type=write size=566106 2024-09-14T11:23:34.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.877+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=FDV6B4WQSJ11 type=del size=651277 2024-09-14T11:23:34.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.879+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WO579GVE6PZE.0 size=1048576 2024-09-14T11:23:34.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.880+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WO579GVE6PZE.1 size=230923 2024-09-14T11:23:34.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.880+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=WO579GVE6PZE tag=WEWDO7O3GKLK type=write size=2328075 2024-09-14T11:23:34.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.881+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=KWXQQMFG0B0G type=del 2024-09-14T11:23:34.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.882+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=8COX14CCYZ43 type=del size=3856931 2024-09-14T11:23:34.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.884+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=XE4PQSY8WGRZ type=del 2024-09-14T11:23:34.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.885+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=4D5IE2OZBZ5A type=del size=2530135 2024-09-14T11:23:34.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.886+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=U65GIGGETK2U type=del 2024-09-14T11:23:34.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.887+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=IVEEUWH2FIYU type=del size=3961732 2024-09-14T11:23:34.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.887+0000 7f296241c780 1 < canceled part key=_multipart_R1M982MUIF44.2~7CMUJV7SYPAD.0 size=1048576 2024-09-14T11:23:34.886 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.888+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~7CMUJV7SYPAD.1 size=417844 2024-09-14T11:23:34.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.890+0000 7f296241c780 1 < canceled multipart upload key=R1M982MUIF44 upload=7CMUJV7SYPAD tag=IDHP3JZSQMGQ type=write size=2514996 2024-09-14T11:23:34.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.891+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=H20J4V5CIK2L type=del size=4130814 2024-09-14T11:23:34.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.893+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.0 size=1048576 2024-09-14T11:23:34.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.894+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.1 size=1048576 2024-09-14T11:23:34.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.895+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~QIB58JUPAH15.2 size=318463 2024-09-14T11:23:34.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.898+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=QIB58JUPAH15 tag=GC52D3CA5GBU type=write size=3464191 2024-09-14T11:23:34.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.899+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=7KHKNNI57UCY type=del size=1212661 2024-09-14T11:23:34.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.900+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~KDABGWKR5AME.0 size=1048576 2024-09-14T11:23:34.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.901+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~KDABGWKR5AME.1 size=345283 2024-09-14T11:23:34.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.903+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=KDABGWKR5AME tag=4VMCE8VWFMGX type=write size=2442435 2024-09-14T11:23:34.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.905+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.0 size=1048576 2024-09-14T11:23:34.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.906+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.1 size=1048576 2024-09-14T11:23:34.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.907+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.2 size=183974 2024-09-14T11:23:34.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.907+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=ZEIT6WFYX8MV tag=FZWRL8K853UV type=write size=3329702 2024-09-14T11:23:34.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.908+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=Y7CZJQUVK6Y7 type=del 2024-09-14T11:23:34.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.910+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~BAAR5X3NCUPS.0 size=1048576 2024-09-14T11:23:34.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.913+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~BAAR5X3NCUPS.1 size=738909 2024-09-14T11:23:34.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.913+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=BAAR5X3NCUPS tag=IB90TD2YBK5A type=write size=2836061 2024-09-14T11:23:34.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.915+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=H8CA6I57SPW2 type=del size=63051 2024-09-14T11:23:34.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.917+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~DQS8X2WJA24G.0 size=211259 2024-09-14T11:23:34.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.917+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=DQS8X2WJA24G tag=2PY880FP2NRZ type=write size=1259835 2024-09-14T11:23:34.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.919+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~9KTIB6ZJ8LLU.0 size=551805 2024-09-14T11:23:34.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.921+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=9KTIB6ZJ8LLU tag=BVRWIUF246YL type=write size=1600381 2024-09-14T11:23:34.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.922+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=H4JLP5RG0MFV type=del size=1535162 2024-09-14T11:23:34.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.923+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=LF31GAF9MSU7 type=del 2024-09-14T11:23:34.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.925+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~JKO0XTVOJJU6.0 size=104407 2024-09-14T11:23:34.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.925+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=JKO0XTVOJJU6 tag=DMR361K4281T type=write size=1152983 2024-09-14T11:23:34.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.926+0000 7f296241c780 1 < canceled operation key=C1T4CLU3400T tag=WB763CPN7U77 type=del size=3533378 2024-09-14T11:23:34.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.928+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~PADZFUD7EG3U.0 size=400763 2024-09-14T11:23:34.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.928+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=PADZFUD7EG3U tag=BEY593A5GAO0 type=write size=1449339 2024-09-14T11:23:34.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.929+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=2GJVS3QFTJEE type=write size=537867 2024-09-14T11:23:34.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.931+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=ZDCCK5JDHCTF type=del size=1798919 2024-09-14T11:23:34.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.932+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=0HBKTI2RPIRZ type=write size=757553 2024-09-14T11:23:34.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.934+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.0 size=1048576 2024-09-14T11:23:34.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.935+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.1 size=1048576 2024-09-14T11:23:34.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.936+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.2 size=55525 2024-09-14T11:23:34.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.936+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=XFCX5OAXLL4F tag=2EJ7SU4YIQBF type=write size=3201253 2024-09-14T11:23:34.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.937+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.0 size=1048576 2024-09-14T11:23:34.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.938+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.1 size=1048576 2024-09-14T11:23:34.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.939+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~NX6TNYE6HQ2N.2 size=785149 2024-09-14T11:23:34.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.941+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=NX6TNYE6HQ2N tag=JCH4X4QQJT51 type=write size=3930877 2024-09-14T11:23:34.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.943+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~QQCMU3E21XTG.0 size=1048576 2024-09-14T11:23:34.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.944+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~QQCMU3E21XTG.1 size=527980 2024-09-14T11:23:34.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.944+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=QQCMU3E21XTG tag=IXX20FYEFAJJ type=write size=2625132 2024-09-14T11:23:34.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.945+0000 7f296241c780 1 < completed write operation key=O35OFLNOZ488 tag=SLVWJCO20C4E type=write size=566106 2024-09-14T11:23:34.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.947+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=NDFC24UQU6WM type=del size=1002912 2024-09-14T11:23:34.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.948+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WO579GVE6PZE.0 size=1048576 2024-09-14T11:23:34.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.949+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WO579GVE6PZE.1 size=230923 2024-09-14T11:23:34.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.950+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=WO579GVE6PZE tag=WEWDO7O3GKLK type=write size=2328075 2024-09-14T11:23:34.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.952+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=99R7N088M75H type=write size=273532 2024-09-14T11:23:34.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.953+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=8COX14CCYZ43 type=del 2024-09-14T11:23:34.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.955+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~CPWTEK9A4SJM.0 size=1048576 2024-09-14T11:23:34.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.956+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~CPWTEK9A4SJM.1 size=433449 2024-09-14T11:23:34.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.956+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=CPWTEK9A4SJM tag=1YP3KO0REW8M type=write size=2530601 2024-09-14T11:23:34.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.957+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=4D5IE2OZBZ5A type=del 2024-09-14T11:23:34.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.959+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~7EBTFY2852VS.0 size=773665 2024-09-14T11:23:34.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.959+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=7EBTFY2852VS tag=C2A9DMB9QLUG type=write size=1822241 2024-09-14T11:23:34.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.960+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=IVEEUWH2FIYU type=del 2024-09-14T11:23:34.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.961+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=0VWVMZ55A2JF type=write size=197013 2024-09-14T11:23:34.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.962+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=H20J4V5CIK2L type=del 2024-09-14T11:23:34.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.964+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~6BRR838UREWW.0 size=322154 2024-09-14T11:23:34.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.964+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=6BRR838UREWW tag=BSRPO6CSZ3K1 type=write size=1370730 2024-09-14T11:23:34.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.965+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=7KHKNNI57UCY type=del 2024-09-14T11:23:34.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.966+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=URQMI8YK5TC0 type=del size=1263693 2024-09-14T11:23:34.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.967+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.0 size=1048576 2024-09-14T11:23:34.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.968+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.1 size=1048576 2024-09-14T11:23:34.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.969+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~ZEIT6WFYX8MV.2 size=183974 2024-09-14T11:23:34.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.971+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=ZEIT6WFYX8MV tag=FZWRL8K853UV type=write size=3329702 2024-09-14T11:23:34.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.972+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=NJG73LM918TI type=del size=1911153 2024-09-14T11:23:34.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.973+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~BAAR5X3NCUPS.0 size=1048576 2024-09-14T11:23:34.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.974+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~BAAR5X3NCUPS.1 size=738909 2024-09-14T11:23:34.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.976+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=BAAR5X3NCUPS tag=IB90TD2YBK5A type=write size=2836061 2024-09-14T11:23:34.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.977+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=YU0MQDMR5BP3 type=del size=3501293 2024-09-14T11:23:34.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.978+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~DQS8X2WJA24G.0 size=211259 2024-09-14T11:23:34.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.980+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=DQS8X2WJA24G tag=2PY880FP2NRZ type=write size=1259835 2024-09-14T11:23:34.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.982+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~P2P3MHRAU2SB.0 size=41213 2024-09-14T11:23:34.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.982+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=P2P3MHRAU2SB tag=VGK9C9STNPV9 type=write size=1089789 2024-09-14T11:23:34.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.983+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=H4JLP5RG0MFV type=del 2024-09-14T11:23:34.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.984+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=NBP7F7KRXVFC type=del size=154245 2024-09-14T11:23:34.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.985+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~JKO0XTVOJJU6.0 size=104407 2024-09-14T11:23:34.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.987+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=JKO0XTVOJJU6 tag=DMR361K4281T type=write size=1152983 2024-09-14T11:23:34.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.988+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=702NHAOQMM6P type=write size=269527 2024-09-14T11:23:34.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.989+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~PADZFUD7EG3U.0 size=400763 2024-09-14T11:23:34.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.991+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=PADZFUD7EG3U tag=BEY593A5GAO0 type=write size=1449339 2024-09-14T11:23:34.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.993+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~59PX32T49PWX.0 size=596402 2024-09-14T11:23:34.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.993+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=59PX32T49PWX tag=1RIKQTXQFXQM type=write size=1644978 2024-09-14T11:23:34.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.995+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=ZDCCK5JDHCTF type=del 2024-09-14T11:23:34.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.996+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=UJICXDZK25XL type=del size=105420 2024-09-14T11:23:34.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.997+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.0 size=1048576 2024-09-14T11:23:34.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.999+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.1 size=1048576 2024-09-14T11:23:34.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:34.999+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~XFCX5OAXLL4F.2 size=55525 2024-09-14T11:23:35.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.002+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=XFCX5OAXLL4F tag=2EJ7SU4YIQBF type=write size=3201253 2024-09-14T11:23:35.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.003+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=P7LLAG2AJHKF type=del size=3915635 2024-09-14T11:23:35.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.005+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~QQCMU3E21XTG.0 size=1048576 2024-09-14T11:23:35.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.005+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~QQCMU3E21XTG.1 size=527980 2024-09-14T11:23:35.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.007+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=QQCMU3E21XTG tag=IXX20FYEFAJJ type=write size=2625132 2024-09-14T11:23:35.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.010+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~X6W7QMKDPC7Q.0 size=483383 2024-09-14T11:23:35.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.010+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=X6W7QMKDPC7Q tag=NTS8TF1RHOO0 type=write size=1531959 2024-09-14T11:23:35.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.011+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=NDFC24UQU6WM type=del 2024-09-14T11:23:35.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.012+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=ZD99W3OMG60K type=del size=3386875 2024-09-14T11:23:35.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.013+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=99R7N088M75H type=write size=273532 2024-09-14T11:23:35.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.015+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~ZB5S4YB2XGR5.0 size=1048576 2024-09-14T11:23:35.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.016+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~ZB5S4YB2XGR5.1 size=563326 2024-09-14T11:23:35.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.016+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=ZB5S4YB2XGR5 tag=6JKF0AK7CETL type=write size=2660478 2024-09-14T11:23:35.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.018+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~CPWTEK9A4SJM.0 size=1048576 2024-09-14T11:23:35.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.018+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~CPWTEK9A4SJM.1 size=433449 2024-09-14T11:23:35.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.020+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=CPWTEK9A4SJM tag=1YP3KO0REW8M type=write size=2530601 2024-09-14T11:23:35.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.021+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=IADN6JI36DPO type=del size=3124066 2024-09-14T11:23:35.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.023+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~7EBTFY2852VS.0 size=773665 2024-09-14T11:23:35.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.025+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=7EBTFY2852VS tag=C2A9DMB9QLUG type=write size=1822241 2024-09-14T11:23:35.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.027+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.0 size=1048576 2024-09-14T11:23:35.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.027+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.1 size=1048576 2024-09-14T11:23:35.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.028+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.2 size=296133 2024-09-14T11:23:35.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.028+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=TKW3ZQZ3ZNI8 tag=WRA8D9IJJSW0 type=write size=3441861 2024-09-14T11:23:35.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.030+0000 7f296241c780 1 < completed write operation key=O35OFLNOZ488 tag=0VWVMZ55A2JF type=write size=197013 2024-09-14T11:23:35.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.031+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=2S673NBQCS3J type=del size=2378609 2024-09-14T11:23:35.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.032+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~6BRR838UREWW.0 size=322154 2024-09-14T11:23:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.034+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=6BRR838UREWW tag=BSRPO6CSZ3K1 type=write size=1370730 2024-09-14T11:23:35.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.036+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~IONJZUZSMIKC.0 size=168612 2024-09-14T11:23:35.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.036+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=IONJZUZSMIKC tag=NLQI41QBS6T3 type=write size=1217188 2024-09-14T11:23:35.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.037+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=URQMI8YK5TC0 type=del 2024-09-14T11:23:35.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.038+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=0BZ63LA38UDP type=del size=3241187 2024-09-14T11:23:35.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.040+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=NJG73LM918TI type=del 2024-09-14T11:23:35.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.042+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.0 size=1048576 2024-09-14T11:23:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.043+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.1 size=1048576 2024-09-14T11:23:35.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.044+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.2 size=428939 2024-09-14T11:23:35.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.044+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=D5SVTJ71GTCA tag=8E9O0KU0ELKE type=write size=3574667 2024-09-14T11:23:35.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.045+0000 7f296241c780 1 < canceled operation key=QIVVKYC646IH tag=YU0MQDMR5BP3 type=del size=3501293 2024-09-14T11:23:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.047+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~FW0WW7SOZJRS.0 size=617412 2024-09-14T11:23:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.047+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=FW0WW7SOZJRS tag=GY1ZNYJN7HCK type=write size=1665988 2024-09-14T11:23:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.048+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~P2P3MHRAU2SB.0 size=41213 2024-09-14T11:23:35.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.050+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=P2P3MHRAU2SB tag=VGK9C9STNPV9 type=write size=1089789 2024-09-14T11:23:35.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.052+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.0 size=1048576 2024-09-14T11:23:35.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.053+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.1 size=1048576 2024-09-14T11:23:35.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.053+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.2 size=867650 2024-09-14T11:23:35.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.053+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=0IHSDHC30AMQ tag=U10AXOX5Y4OQ type=write size=4013378 2024-09-14T11:23:35.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.055+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=NBP7F7KRXVFC type=del 2024-09-14T11:23:35.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.056+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=G0E6BR8JX5Z5 type=write size=117621 2024-09-14T11:23:35.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.057+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=702NHAOQMM6P type=write size=269527 2024-09-14T11:23:35.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.059+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~SVDC1EIE8HG5.0 size=1048576 2024-09-14T11:23:35.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.060+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~SVDC1EIE8HG5.1 size=188451 2024-09-14T11:23:35.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.060+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=SVDC1EIE8HG5 tag=X5YZ4VIKSDVK type=write size=2285603 2024-09-14T11:23:35.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.061+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~59PX32T49PWX.0 size=596402 2024-09-14T11:23:35.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.063+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=59PX32T49PWX tag=1RIKQTXQFXQM type=write size=1644978 2024-09-14T11:23:35.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.064+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=9P3PX4SOG70Y type=del size=1005042 2024-09-14T11:23:35.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.065+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=UJICXDZK25XL type=del 2024-09-14T11:23:35.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.067+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~VRN4H6C9LX0I.0 size=953420 2024-09-14T11:23:35.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.067+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=VRN4H6C9LX0I tag=HW67J8SUIE2C type=write size=2001996 2024-09-14T11:23:35.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.068+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=P7LLAG2AJHKF type=del 2024-09-14T11:23:35.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.070+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=EIUOFN02AAGU type=del size=1662935 2024-09-14T11:23:35.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.071+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~X6W7QMKDPC7Q.0 size=483383 2024-09-14T11:23:35.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.073+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=X6W7QMKDPC7Q tag=NTS8TF1RHOO0 type=write size=1531959 2024-09-14T11:23:35.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.074+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=BTCYF6DWYI93 type=del size=681755 2024-09-14T11:23:35.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.075+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=ZD99W3OMG60K type=del 2024-09-14T11:23:35.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.077+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.0 size=1048576 2024-09-14T11:23:35.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.078+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.1 size=1048576 2024-09-14T11:23:35.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.079+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.2 size=1023244 2024-09-14T11:23:35.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.079+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=P93CFGYXOINE tag=1YDPPNGG6KQJ type=write size=4168972 2024-09-14T11:23:35.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.080+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~ZB5S4YB2XGR5.0 size=1048576 2024-09-14T11:23:35.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.081+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~ZB5S4YB2XGR5.1 size=563326 2024-09-14T11:23:35.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.083+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=ZB5S4YB2XGR5 tag=6JKF0AK7CETL type=write size=2660478 2024-09-14T11:23:35.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.084+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=IPS886Z6FSKH type=del size=4136222 2024-09-14T11:23:35.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.085+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=IADN6JI36DPO type=del 2024-09-14T11:23:35.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.088+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~U7W46QEFEZ42.0 size=727771 2024-09-14T11:23:35.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.088+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=U7W46QEFEZ42 tag=7YZ8IOJJIVRE type=write size=1776347 2024-09-14T11:23:35.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.088+0000 7f296241c780 1 < canceled part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.0 size=1048576 2024-09-14T11:23:35.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.088+0000 7f296241c780 1 < canceled part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.1 size=1048576 2024-09-14T11:23:35.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.088+0000 7f296241c780 1 < canceled part key=_multipart_6DNKZWENMDM9.2~TKW3ZQZ3ZNI8.2 size=296133 2024-09-14T11:23:35.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.090+0000 7f296241c780 1 < canceled multipart upload key=6DNKZWENMDM9 upload=TKW3ZQZ3ZNI8 tag=WRA8D9IJJSW0 type=write size=3441861 2024-09-14T11:23:35.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.091+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=9BZ9U1TPMVX1 type=del size=3286199 2024-09-14T11:23:35.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.092+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=2S673NBQCS3J type=del 2024-09-14T11:23:35.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.094+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=LC082SY705AE type=del size=1269498 2024-09-14T11:23:35.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.094+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~IONJZUZSMIKC.0 size=168612 2024-09-14T11:23:35.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.096+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=IONJZUZSMIKC tag=NLQI41QBS6T3 type=write size=1217188 2024-09-14T11:23:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.098+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~B679HYW8E2NW.0 size=665249 2024-09-14T11:23:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.098+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=B679HYW8E2NW tag=WOIIAK1DFV4S type=write size=1713825 2024-09-14T11:23:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.100+0000 7f296241c780 1 < canceled operation key=JW3RIVHUFGPI tag=0BZ63LA38UDP type=del size=3241187 2024-09-14T11:23:35.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.102+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.0 size=1048576 2024-09-14T11:23:35.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.103+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.1 size=1048576 2024-09-14T11:23:35.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.104+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.2 size=961866 2024-09-14T11:23:35.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.104+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=13176930ZQGT tag=VADF2SRCH2DZ type=write size=4107594 2024-09-14T11:23:35.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.105+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.0 size=1048576 2024-09-14T11:23:35.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.106+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.1 size=1048576 2024-09-14T11:23:35.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.107+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~D5SVTJ71GTCA.2 size=428939 2024-09-14T11:23:35.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.111+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=D5SVTJ71GTCA tag=8E9O0KU0ELKE type=write size=3574667 2024-09-14T11:23:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.113+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=RMK8I3AXFFKY type=del size=1826368 2024-09-14T11:23:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.115+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~FW0WW7SOZJRS.0 size=617412 2024-09-14T11:23:35.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.118+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=FW0WW7SOZJRS tag=GY1ZNYJN7HCK type=write size=1665988 2024-09-14T11:23:35.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.120+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~7AMXMY9YNNNH.0 size=1048576 2024-09-14T11:23:35.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.121+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~7AMXMY9YNNNH.1 size=282575 2024-09-14T11:23:35.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.121+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=7AMXMY9YNNNH tag=HDPAD1E411SY type=write size=2379727 2024-09-14T11:23:35.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.123+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.0 size=1048576 2024-09-14T11:23:35.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.124+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.1 size=1048576 2024-09-14T11:23:35.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.125+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~0IHSDHC30AMQ.2 size=867650 2024-09-14T11:23:35.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.127+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=0IHSDHC30AMQ tag=U10AXOX5Y4OQ type=write size=4013378 2024-09-14T11:23:35.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.128+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=RCLU5QN7TYU2 type=del size=3529441 2024-09-14T11:23:35.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.130+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=G0E6BR8JX5Z5 type=write 2024-09-14T11:23:35.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.133+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~7A09V1S0BUDF.0 size=1048576 2024-09-14T11:23:35.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.134+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~7A09V1S0BUDF.1 size=698359 2024-09-14T11:23:35.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.134+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=7A09V1S0BUDF tag=SVVRU0W11SSL type=write size=2795511 2024-09-14T11:23:35.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.134+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~SVDC1EIE8HG5.0 size=1048576 2024-09-14T11:23:35.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.135+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~SVDC1EIE8HG5.1 size=188451 2024-09-14T11:23:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.137+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=SVDC1EIE8HG5 tag=X5YZ4VIKSDVK type=write size=2285603 2024-09-14T11:23:35.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.139+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~27VOQ4XPD77S.0 size=569258 2024-09-14T11:23:35.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.139+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=27VOQ4XPD77S tag=BA89P26F0JW7 type=write size=1617834 2024-09-14T11:23:35.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.141+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=9P3PX4SOG70Y type=del size=1005042 2024-09-14T11:23:35.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.144+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~MXB5FLXOMXCP.0 size=1048576 2024-09-14T11:23:35.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.144+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~MXB5FLXOMXCP.1 size=469476 2024-09-14T11:23:35.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.144+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=MXB5FLXOMXCP tag=E05ZQ3DQQ7SY type=write size=2566628 2024-09-14T11:23:35.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.146+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~VRN4H6C9LX0I.0 size=953420 2024-09-14T11:23:35.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.148+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=VRN4H6C9LX0I tag=HW67J8SUIE2C type=write size=2001996 2024-09-14T11:23:35.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.149+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=292E5X0AKWG1 type=del size=3799641 2024-09-14T11:23:35.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.150+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=EIUOFN02AAGU type=del 2024-09-14T11:23:35.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.151+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=C3AW2OKATTZI type=del size=397424 2024-09-14T11:23:35.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.152+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=BTCYF6DWYI93 type=del 2024-09-14T11:23:35.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.155+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~LFYK04W6M3UE.0 size=207560 2024-09-14T11:23:35.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.155+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=LFYK04W6M3UE tag=1NQFO1XSLLNW type=write size=1256136 2024-09-14T11:23:35.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.156+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.0 size=1048576 2024-09-14T11:23:35.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.157+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.1 size=1048576 2024-09-14T11:23:35.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.158+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~P93CFGYXOINE.2 size=1023244 2024-09-14T11:23:35.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.160+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=P93CFGYXOINE tag=1YDPPNGG6KQJ type=write size=4168972 2024-09-14T11:23:35.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.161+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=YOWB7HQZ74O0 type=del size=3972331 2024-09-14T11:23:35.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.162+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=IPS886Z6FSKH type=del 2024-09-14T11:23:35.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.164+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~MTOKHNRRDF7R.0 size=1048576 2024-09-14T11:23:35.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.165+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~MTOKHNRRDF7R.1 size=1026656 2024-09-14T11:23:35.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.165+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=MTOKHNRRDF7R tag=8TOP4TX2QXPC type=write size=3123808 2024-09-14T11:23:35.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.166+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~U7W46QEFEZ42.0 size=727771 2024-09-14T11:23:35.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.168+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=U7W46QEFEZ42 tag=7YZ8IOJJIVRE type=write size=1776347 2024-09-14T11:23:35.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.169+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=RQ4PR8TP3J7K type=write size=671775 2024-09-14T11:23:35.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.170+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=9BZ9U1TPMVX1 type=del 2024-09-14T11:23:35.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.172+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=B2RDPCXNMDZ7 type=del size=2959265 2024-09-14T11:23:35.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.173+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=LC082SY705AE type=del 2024-09-14T11:23:35.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.175+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.0 size=1048576 2024-09-14T11:23:35.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.176+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.1 size=1048576 2024-09-14T11:23:35.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.177+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.2 size=498857 2024-09-14T11:23:35.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.177+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=8YMN131MO7BA tag=HQVW0YOSBSQV type=write size=3644585 2024-09-14T11:23:35.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.178+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~B679HYW8E2NW.0 size=665249 2024-09-14T11:23:35.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.180+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=B679HYW8E2NW tag=WOIIAK1DFV4S type=write size=1713825 2024-09-14T11:23:35.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.181+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=9F8AM17GERFJ type=del size=4052272 2024-09-14T11:23:35.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.183+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.0 size=1048576 2024-09-14T11:23:35.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.183+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.1 size=1048576 2024-09-14T11:23:35.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.183+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~13176930ZQGT.2 size=961866 2024-09-14T11:23:35.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.185+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=13176930ZQGT tag=VADF2SRCH2DZ type=write size=4107594 2024-09-14T11:23:35.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.186+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=2O6SA026LKT1 type=del size=346638 2024-09-14T11:23:35.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.189+0000 7f296241c780 1 < suggested remove operation key=CQU8M12JCE9T tag=RMK8I3AXFFKY type=del 2024-09-14T11:23:35.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.190+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FWQSLJEHSNM7 type=del size=2597053 2024-09-14T11:23:35.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.191+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~7AMXMY9YNNNH.0 size=1048576 2024-09-14T11:23:35.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.192+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~7AMXMY9YNNNH.1 size=282575 2024-09-14T11:23:35.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.194+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=7AMXMY9YNNNH tag=HDPAD1E411SY type=write size=2379727 2024-09-14T11:23:35.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.195+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=HSPYJ0YQ4B5X type=del size=2697969 2024-09-14T11:23:35.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.198+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=RCLU5QN7TYU2 type=del 2024-09-14T11:23:35.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.199+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=KT9GPACX69QB type=del size=2263434 2024-09-14T11:23:35.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.199+0000 7f296241c780 1 < canceled part key=_multipart_0A90ZOC79OWP.2~7A09V1S0BUDF.0 size=1048576 2024-09-14T11:23:35.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.200+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~7A09V1S0BUDF.1 size=698359 2024-09-14T11:23:35.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.202+0000 7f296241c780 1 < canceled multipart upload key=0A90ZOC79OWP upload=7A09V1S0BUDF tag=SVVRU0W11SSL type=write size=2795511 2024-09-14T11:23:35.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.203+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=IIQYAONG74N6 type=del size=3761993 2024-09-14T11:23:35.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.204+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~27VOQ4XPD77S.0 size=569258 2024-09-14T11:23:35.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.206+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=27VOQ4XPD77S tag=BA89P26F0JW7 type=write size=1617834 2024-09-14T11:23:35.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.207+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=WLAKCRZ239BC type=del size=2557336 2024-09-14T11:23:35.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.208+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~MXB5FLXOMXCP.0 size=1048576 2024-09-14T11:23:35.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.209+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~MXB5FLXOMXCP.1 size=469476 2024-09-14T11:23:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.211+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=MXB5FLXOMXCP tag=E05ZQ3DQQ7SY type=write size=2566628 2024-09-14T11:23:35.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.212+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=7ZQS1QV8PM9H type=del size=1898757 2024-09-14T11:23:35.211 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.213+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=292E5X0AKWG1 type=del 2024-09-14T11:23:35.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.214+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=2KO364P7SXI5 type=del size=1107674 2024-09-14T11:23:35.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.216+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=C3AW2OKATTZI type=del 2024-09-14T11:23:35.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.217+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=LFCZSSS7IBEZ type=del size=2743019 2024-09-14T11:23:35.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.217+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~LFYK04W6M3UE.0 size=207560 2024-09-14T11:23:35.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.219+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=LFYK04W6M3UE tag=1NQFO1XSLLNW type=write size=1256136 2024-09-14T11:23:35.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.220+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=FHGP3V82OF3S type=del size=3213293 2024-09-14T11:23:35.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.221+0000 7f296241c780 -1 < failed to complete operation key=CQU8M12JCE9T tag=YOWB7HQZ74O0 type=del size=3972331: (22) Invalid argument 2024-09-14T11:23:35.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.224+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~WH9UBTJX6XKC.0 size=49634 2024-09-14T11:23:35.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.224+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=WH9UBTJX6XKC tag=8VM06MDTK5BK type=write size=1098210 2024-09-14T11:23:35.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.225+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~MTOKHNRRDF7R.0 size=1048576 2024-09-14T11:23:35.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.225+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~MTOKHNRRDF7R.1 size=1026656 2024-09-14T11:23:35.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.227+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=MTOKHNRRDF7R tag=8TOP4TX2QXPC type=write size=3123808 2024-09-14T11:23:35.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.230+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~N0SY1ZLBN9IH.0 size=709998 2024-09-14T11:23:35.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.230+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=N0SY1ZLBN9IH tag=93AC1RACD5HE type=write size=1758574 2024-09-14T11:23:35.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.231+0000 7f296241c780 1 < canceled operation key=JW3RIVHUFGPI tag=RQ4PR8TP3J7K type=write size=671775 2024-09-14T11:23:35.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.233+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.0 size=1048576 2024-09-14T11:23:35.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.234+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.1 size=1048576 2024-09-14T11:23:35.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.235+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.2 size=780802 2024-09-14T11:23:35.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.235+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=ALUK9TNTP7ZL tag=BHEOY5CE4XA2 type=write size=3926530 2024-09-14T11:23:35.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.237+0000 7f296241c780 1 < suggested remove operation key=LK9LRQM3TZRR tag=B2RDPCXNMDZ7 type=del 2024-09-14T11:23:35.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.240+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~PF22HM6Z6I1D.0 size=226527 2024-09-14T11:23:35.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.240+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=PF22HM6Z6I1D tag=HAJ2Q0IU6NYP type=write size=1275103 2024-09-14T11:23:35.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.241+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.0 size=1048576 2024-09-14T11:23:35.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.242+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.1 size=1048576 2024-09-14T11:23:35.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.243+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~8YMN131MO7BA.2 size=498857 2024-09-14T11:23:35.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.245+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=8YMN131MO7BA tag=HQVW0YOSBSQV type=write size=3644585 2024-09-14T11:23:35.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.248+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~3I10Q48FHSQF.0 size=1048576 2024-09-14T11:23:35.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.249+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~3I10Q48FHSQF.1 size=360018 2024-09-14T11:23:35.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.249+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=3I10Q48FHSQF tag=GEZKJTA5A76Q type=write size=2457170 2024-09-14T11:23:35.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.250+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=9F8AM17GERFJ type=del 2024-09-14T11:23:35.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.252+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~509Y487WV1ZL.0 size=653968 2024-09-14T11:23:35.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.252+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=509Y487WV1ZL tag=X71P6I2JPCC5 type=write size=1702544 2024-09-14T11:23:35.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.253+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=2O6SA026LKT1 type=del 2024-09-14T11:23:35.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.255+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.0 size=1048576 2024-09-14T11:23:35.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.255+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.1 size=1048576 2024-09-14T11:23:35.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.256+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.2 size=540043 2024-09-14T11:23:35.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.256+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=A3IJ84R1IGJV tag=RLB544RWI9TB type=write size=3685771 2024-09-14T11:23:35.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.257+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=FWQSLJEHSNM7 type=del 2024-09-14T11:23:35.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.258+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=4J462RQIJG11 type=write size=167842 2024-09-14T11:23:35.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.260+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=HSPYJ0YQ4B5X type=del 2024-09-14T11:23:35.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.262+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~JGXWIMMQ7CLT.0 size=1048576 2024-09-14T11:23:35.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.263+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~JGXWIMMQ7CLT.1 size=965457 2024-09-14T11:23:35.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.263+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=JGXWIMMQ7CLT tag=U3VX336QFIPE type=write size=3062609 2024-09-14T11:23:35.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.265+0000 7f296241c780 1 < suggested remove operation key=JW3RIVHUFGPI tag=KT9GPACX69QB type=del 2024-09-14T11:23:35.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.266+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=TJZQ8SOQX2CX type=del size=2017635 2024-09-14T11:23:35.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.268+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=IIQYAONG74N6 type=del size=3761993 2024-09-14T11:23:35.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.270+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.0 size=1048576 2024-09-14T11:23:35.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.270+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.1 size=1048576 2024-09-14T11:23:35.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.271+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.2 size=48327 2024-09-14T11:23:35.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.271+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=6WJ3U8UYYET1 tag=LLGWEEFEQVI9 type=write size=3194055 2024-09-14T11:23:35.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.272+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=WLAKCRZ239BC type=del 2024-09-14T11:23:35.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.274+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~00EJN3JVREF0.0 size=1048576 2024-09-14T11:23:35.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.275+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~00EJN3JVREF0.1 size=220722 2024-09-14T11:23:35.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.275+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=00EJN3JVREF0 tag=RTRP3Z0ABH44 type=write size=2317874 2024-09-14T11:23:35.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.276+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=7ZQS1QV8PM9H type=del 2024-09-14T11:23:35.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.277+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=0B8VBFIX4L2F type=write size=375886 2024-09-14T11:23:35.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.279+0000 7f296241c780 1 < suggested remove operation key=I1XBOS1L5D98 tag=2KO364P7SXI5 type=del 2024-09-14T11:23:35.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.280+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=4GVCLZ3ZTADI type=del size=1642607 2024-09-14T11:23:35.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.283+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=LFCZSSS7IBEZ type=del 2024-09-14T11:23:35.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.284+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=44EG74XMAKI1 type=del size=373764 2024-09-14T11:23:35.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.285+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=FHGP3V82OF3S type=del 2024-09-14T11:23:35.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.286+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=VPMBY4TG0H6O type=del size=3130153 2024-09-14T11:23:35.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.288+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~WH9UBTJX6XKC.0 size=49634 2024-09-14T11:23:35.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.289+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=WH9UBTJX6XKC tag=8VM06MDTK5BK type=write size=1098210 2024-09-14T11:23:35.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.290+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=0GL6WNB3S3TQ type=del size=1620553 2024-09-14T11:23:35.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.291+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~N0SY1ZLBN9IH.0 size=709998 2024-09-14T11:23:35.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.292+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=N0SY1ZLBN9IH tag=93AC1RACD5HE type=write size=1758574 2024-09-14T11:23:35.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.294+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=JDHC36Q920NP type=del size=529120 2024-09-14T11:23:35.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.294+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.0 size=1048576 2024-09-14T11:23:35.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.295+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.1 size=1048576 2024-09-14T11:23:35.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.296+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~ALUK9TNTP7ZL.2 size=780802 2024-09-14T11:23:35.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.297+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=ALUK9TNTP7ZL tag=BHEOY5CE4XA2 type=write size=3926530 2024-09-14T11:23:35.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.298+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=Y5A6BOQT76HY type=write size=239548 2024-09-14T11:23:35.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.299+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~PF22HM6Z6I1D.0 size=226527 2024-09-14T11:23:35.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.301+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=PF22HM6Z6I1D tag=HAJ2Q0IU6NYP type=write size=1275103 2024-09-14T11:23:35.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.303+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~24S1VZJFF6UM.0 size=1048576 2024-09-14T11:23:35.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.303+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~24S1VZJFF6UM.1 size=357888 2024-09-14T11:23:35.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.303+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=24S1VZJFF6UM tag=BPN1M17OOAWO type=write size=2455040 2024-09-14T11:23:35.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.305+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~3I10Q48FHSQF.0 size=1048576 2024-09-14T11:23:35.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.305+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~3I10Q48FHSQF.1 size=360018 2024-09-14T11:23:35.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.307+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=3I10Q48FHSQF tag=GEZKJTA5A76Q type=write size=2457170 2024-09-14T11:23:35.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.309+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.0 size=1048576 2024-09-14T11:23:35.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.310+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.1 size=1048576 2024-09-14T11:23:35.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.312+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.2 size=393519 2024-09-14T11:23:35.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.312+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=LSEYS8NJR757 tag=M568O7R1IFPY type=write size=3539247 2024-09-14T11:23:35.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.313+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~509Y487WV1ZL.0 size=653968 2024-09-14T11:23:35.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.315+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=509Y487WV1ZL tag=X71P6I2JPCC5 type=write size=1702544 2024-09-14T11:23:35.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.316+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=O6HBC2BYD6YH type=del size=1366405 2024-09-14T11:23:35.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.317+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.0 size=1048576 2024-09-14T11:23:35.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.318+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.1 size=1048576 2024-09-14T11:23:35.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.319+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~A3IJ84R1IGJV.2 size=540043 2024-09-14T11:23:35.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.321+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=A3IJ84R1IGJV tag=RLB544RWI9TB type=write size=3685771 2024-09-14T11:23:35.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.322+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=KIA075DO9ZGK type=write size=1003768 2024-09-14T11:23:35.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.323+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=4J462RQIJG11 type=write size=167842 2024-09-14T11:23:35.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.324+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=LRO17WD4HD39 type=write size=409498 2024-09-14T11:23:35.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.326+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~JGXWIMMQ7CLT.0 size=1048576 2024-09-14T11:23:35.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.327+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~JGXWIMMQ7CLT.1 size=965457 2024-09-14T11:23:35.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.331+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=JGXWIMMQ7CLT tag=U3VX336QFIPE type=write size=3062609 2024-09-14T11:23:35.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.334+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=5ERBB8OLGDNK type=del size=3583845 2024-09-14T11:23:35.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.335+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=TJZQ8SOQX2CX type=del 2024-09-14T11:23:35.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.337+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~RGS53713Z0DP.0 size=1048576 2024-09-14T11:23:35.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.338+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~RGS53713Z0DP.1 size=916723 2024-09-14T11:23:35.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.338+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=RGS53713Z0DP tag=G1L4IKC5952H type=write size=3013875 2024-09-14T11:23:35.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.340+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.0 size=1048576 2024-09-14T11:23:35.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.341+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.1 size=1048576 2024-09-14T11:23:35.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.341+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~6WJ3U8UYYET1.2 size=48327 2024-09-14T11:23:35.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.344+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=6WJ3U8UYYET1 tag=LLGWEEFEQVI9 type=write size=3194055 2024-09-14T11:23:35.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.345+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=C1PTNCKBAE1F type=del size=2243062 2024-09-14T11:23:35.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.346+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~00EJN3JVREF0.0 size=1048576 2024-09-14T11:23:35.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.347+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~00EJN3JVREF0.1 size=220722 2024-09-14T11:23:35.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.349+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=00EJN3JVREF0 tag=RTRP3Z0ABH44 type=write size=2317874 2024-09-14T11:23:35.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.351+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.0 size=1048576 2024-09-14T11:23:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.352+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.1 size=1048576 2024-09-14T11:23:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.353+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.2 size=1046169 2024-09-14T11:23:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.353+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=P65361212AO6 tag=E3IRWFJ178RN type=write size=4191897 2024-09-14T11:23:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.354+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=0B8VBFIX4L2F type=write size=375886 2024-09-14T11:23:35.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.355+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=9PMCPCM04ZIT type=del size=2141493 2024-09-14T11:23:35.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.356+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=4GVCLZ3ZTADI type=del 2024-09-14T11:23:35.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.357+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=ZIYS7MXZHPLS type=write size=178114 2024-09-14T11:23:35.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.359+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=44EG74XMAKI1 type=del 2024-09-14T11:23:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.361+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.0 size=1048576 2024-09-14T11:23:35.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.362+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.1 size=1048576 2024-09-14T11:23:35.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.363+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.2 size=552761 2024-09-14T11:23:35.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.363+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=GR8KBPPR4MN8 tag=4J9DCIO02C5Z type=write size=3698489 2024-09-14T11:23:35.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.365+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=VPMBY4TG0H6O type=del 2024-09-14T11:23:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.366+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=E9GSP5XAC22R type=del size=3180644 2024-09-14T11:23:35.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.368+0000 7f296241c780 1 < suggested remove operation key=19TC05N1D5FR tag=0GL6WNB3S3TQ type=del 2024-09-14T11:23:35.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.369+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=HQP9LGCHDUA6 type=del size=3390521 2024-09-14T11:23:35.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.370+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=JDHC36Q920NP type=del 2024-09-14T11:23:35.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.372+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=28A7W0M6LNCG type=del size=3579075 2024-09-14T11:23:35.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.373+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=Y5A6BOQT76HY type=write size=239548 2024-09-14T11:23:35.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.374+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=A6NCEVNEUT69 type=del size=2459411 2024-09-14T11:23:35.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.375+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~24S1VZJFF6UM.0 size=1048576 2024-09-14T11:23:35.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.376+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~24S1VZJFF6UM.1 size=357888 2024-09-14T11:23:35.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.378+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=24S1VZJFF6UM tag=BPN1M17OOAWO type=write size=2455040 2024-09-14T11:23:35.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.379+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=6DIBOP1FGIZ6 type=write size=371137 2024-09-14T11:23:35.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.380+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.0 size=1048576 2024-09-14T11:23:35.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.381+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.1 size=1048576 2024-09-14T11:23:35.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.382+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~LSEYS8NJR757.2 size=393519 2024-09-14T11:23:35.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.384+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=LSEYS8NJR757 tag=M568O7R1IFPY type=write size=3539247 2024-09-14T11:23:35.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.385+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=QARPZ87F96WA type=del size=706974 2024-09-14T11:23:35.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.386+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=O6HBC2BYD6YH type=del 2024-09-14T11:23:35.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.387+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=3VW8O9KKA71H type=del size=326334 2024-09-14T11:23:35.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.389+0000 7f296241c780 1 < canceled operation key=5N30QR6SN49T tag=KIA075DO9ZGK type=write size=1003768 2024-09-14T11:23:35.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.390+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=AU2ZLQS5GYOU type=del size=2633522 2024-09-14T11:23:35.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.392+0000 7f296241c780 1 < suggested update operation key=CQU8M12JCE9T tag=LRO17WD4HD39 type=write size=409498 2024-09-14T11:23:35.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.393+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=UT1N22CT19WO type=del size=923218 2024-09-14T11:23:35.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.395+0000 7f296241c780 1 < suggested update operation key=MO1WWGC42DD4 tag=5ERBB8OLGDNK type=del size=3583845 2024-09-14T11:23:35.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.397+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=L73NCFWGZ6NJ type=del size=1840592 2024-09-14T11:23:35.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.397+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~RGS53713Z0DP.0 size=1048576 2024-09-14T11:23:35.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.398+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~RGS53713Z0DP.1 size=916723 2024-09-14T11:23:35.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.400+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=RGS53713Z0DP tag=G1L4IKC5952H type=write size=3013875 2024-09-14T11:23:35.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.402+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~TPL104K5YDPX.0 size=1048576 2024-09-14T11:23:35.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.403+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~TPL104K5YDPX.1 size=659163 2024-09-14T11:23:35.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.403+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=TPL104K5YDPX tag=XKOAR3CZXS4H type=write size=2756315 2024-09-14T11:23:35.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.405+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=C1PTNCKBAE1F type=del 2024-09-14T11:23:35.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.406+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=SL9N06W771E3 type=write size=928558 2024-09-14T11:23:35.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.407+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.0 size=1048576 2024-09-14T11:23:35.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.408+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.1 size=1048576 2024-09-14T11:23:35.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.409+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~P65361212AO6.2 size=1046169 2024-09-14T11:23:35.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.411+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=P65361212AO6 tag=E3IRWFJ178RN type=write size=4191897 2024-09-14T11:23:35.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.412+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=D59O6WOVN624 type=del size=1288316 2024-09-14T11:23:35.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.413+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=9PMCPCM04ZIT type=del 2024-09-14T11:23:35.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.415+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.0 size=1048576 2024-09-14T11:23:35.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.416+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.1 size=1048576 2024-09-14T11:23:35.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.417+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.2 size=79536 2024-09-14T11:23:35.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.417+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=9N5Y8FQ511Y8 tag=3SNNCQRE6XI6 type=write size=3225264 2024-09-14T11:23:35.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.418+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=ZIYS7MXZHPLS type=write size=178114 2024-09-14T11:23:35.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.420+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.0 size=1048576 2024-09-14T11:23:35.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.421+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.1 size=1048576 2024-09-14T11:23:35.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.422+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.2 size=325473 2024-09-14T11:23:35.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.422+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=R6WRDZ0IUBQ8 tag=P1T5Y2A0AQ0D type=write size=3471201 2024-09-14T11:23:35.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.423+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.0 size=1048576 2024-09-14T11:23:35.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.424+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.1 size=1048576 2024-09-14T11:23:35.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.424+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~GR8KBPPR4MN8.2 size=552761 2024-09-14T11:23:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.426+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=GR8KBPPR4MN8 tag=4J9DCIO02C5Z type=write size=3698489 2024-09-14T11:23:35.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.428+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=VCZHX49QKLQC type=del size=1760891 2024-09-14T11:23:35.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.430+0000 7f296241c780 1 < suggested remove operation key=FGK7YH1GB4W5 tag=E9GSP5XAC22R type=del 2024-09-14T11:23:35.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.432+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=ZT5Q6OB2ZK2B type=del size=3752872 2024-09-14T11:23:35.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.433+0000 7f296241c780 -1 < failed to complete operation key=FGK7YH1GB4W5 tag=HQP9LGCHDUA6 type=del size=3390521: (22) Invalid argument 2024-09-14T11:23:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.435+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~DYUM4JSBOQED.0 size=205786 2024-09-14T11:23:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.435+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=DYUM4JSBOQED tag=SKTLOI80WDQQ type=write size=1254362 2024-09-14T11:23:35.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.436+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=28A7W0M6LNCG type=del 2024-09-14T11:23:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.439+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=GR7HH6M3FQEI type=del size=151886 2024-09-14T11:23:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.440+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=A6NCEVNEUT69 type=del 2024-09-14T11:23:35.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.443+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~KZOD44POSS27.0 size=242820 2024-09-14T11:23:35.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.443+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=KZOD44POSS27 tag=LPGRWRY4B3EX type=write size=1291396 2024-09-14T11:23:35.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.445+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=6DIBOP1FGIZ6 type=write size=371137 2024-09-14T11:23:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.446+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=57C0UN2XOCRX type=del size=407572 2024-09-14T11:23:35.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.447+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=QARPZ87F96WA type=del 2024-09-14T11:23:35.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.448+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=XJ9PA2J0S3WA type=write size=800907 2024-09-14T11:23:35.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.449+0000 7f296241c780 1 < canceled operation key=GJ2Y7ICBEZJX tag=3VW8O9KKA71H type=del size=326334 2024-09-14T11:23:35.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.451+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=YN94H81M5KN6 type=del size=2537980 2024-09-14T11:23:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.452+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=AU2ZLQS5GYOU type=del size=2633522 2024-09-14T11:23:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.453+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=VAPIHKCR3C0Z type=del size=1411448 2024-09-14T11:23:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.454+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=UT1N22CT19WO type=del 2024-09-14T11:23:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.455+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=NKYQ3KCLXXMU type=del size=2251456 2024-09-14T11:23:35.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.457+0000 7f296241c780 1 < suggested update operation key=HFH3VKZ4T0IR tag=L73NCFWGZ6NJ type=del size=1840592 2024-09-14T11:23:35.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.458+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=P1BG2O0NKGYH type=del size=2731537 2024-09-14T11:23:35.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.459+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~TPL104K5YDPX.0 size=1048576 2024-09-14T11:23:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.460+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~TPL104K5YDPX.1 size=659163 2024-09-14T11:23:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.462+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=TPL104K5YDPX tag=XKOAR3CZXS4H type=write size=2756315 2024-09-14T11:23:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.464+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~RE0VDL8LD52L.0 size=1048576 2024-09-14T11:23:35.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.465+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~RE0VDL8LD52L.1 size=995977 2024-09-14T11:23:35.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.465+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=RE0VDL8LD52L tag=OKK9QNHYQR3Q type=write size=3093129 2024-09-14T11:23:35.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.468+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=SL9N06W771E3 type=write 2024-09-14T11:23:35.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.469+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=OXQ13NUQVFCB type=del size=2739756 2024-09-14T11:23:35.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.470+0000 7f296241c780 1 < canceled operation key=HZD8WW0H4AAD tag=D59O6WOVN624 type=del size=1288316 2024-09-14T11:23:35.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.471+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=YY5VVQBS2VYD type=del size=3289485 2024-09-14T11:23:35.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.473+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.0 size=1048576 2024-09-14T11:23:35.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.474+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.1 size=1048576 2024-09-14T11:23:35.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.474+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~9N5Y8FQ511Y8.2 size=79536 2024-09-14T11:23:35.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.476+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=9N5Y8FQ511Y8 tag=3SNNCQRE6XI6 type=write size=3225264 2024-09-14T11:23:35.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.478+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~E7MH90R3XAHV.0 size=428729 2024-09-14T11:23:35.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.478+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=E7MH90R3XAHV tag=YHY9R6SVKFE0 type=write size=1477305 2024-09-14T11:23:35.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.480+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.0 size=1048576 2024-09-14T11:23:35.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.481+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.1 size=1048576 2024-09-14T11:23:35.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.482+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~R6WRDZ0IUBQ8.2 size=325473 2024-09-14T11:23:35.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.484+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=R6WRDZ0IUBQ8 tag=P1T5Y2A0AQ0D type=write size=3471201 2024-09-14T11:23:35.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.485+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=IIQY73P222M6 type=del size=828757 2024-09-14T11:23:35.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.486+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=VCZHX49QKLQC type=del 2024-09-14T11:23:35.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.489+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~IWZ17QPYP56L.0 size=376104 2024-09-14T11:23:35.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.489+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=IWZ17QPYP56L tag=EHJIB4Q95JY6 type=write size=1424680 2024-09-14T11:23:35.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.490+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=ZT5Q6OB2ZK2B type=del 2024-09-14T11:23:35.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.491+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=4TGZCHD2ABFP type=del size=1283037 2024-09-14T11:23:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.492+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~DYUM4JSBOQED.0 size=205786 2024-09-14T11:23:35.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.494+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=DYUM4JSBOQED tag=SKTLOI80WDQQ type=write size=1254362 2024-09-14T11:23:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.495+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=4LS08BC0ILMB type=del size=2077355 2024-09-14T11:23:35.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.496+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=GR7HH6M3FQEI type=del 2024-09-14T11:23:35.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.497+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=CY21E1924TSS type=del size=1483824 2024-09-14T11:23:35.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.498+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~KZOD44POSS27.0 size=242820 2024-09-14T11:23:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.500+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=KZOD44POSS27 tag=LPGRWRY4B3EX type=write size=1291396 2024-09-14T11:23:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.501+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=ZGMBIOCXVX63 type=del size=2908428 2024-09-14T11:23:35.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.502+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=57C0UN2XOCRX type=del 2024-09-14T11:23:35.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.504+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~TMCHK170LTWH.0 size=427822 2024-09-14T11:23:35.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.504+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=TMCHK170LTWH tag=R25PIC7S0HW1 type=write size=1476398 2024-09-14T11:23:35.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.506+0000 7f296241c780 1 < completed write operation key=CQU8M12JCE9T tag=XJ9PA2J0S3WA type=write size=800907 2024-09-14T11:23:35.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.507+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=AEAZ6LE5VGQ7 type=write size=724433 2024-09-14T11:23:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.509+0000 7f296241c780 1 < suggested remove operation key=7WGFBTAM25J9 tag=YN94H81M5KN6 type=del 2024-09-14T11:23:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.510+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=5W8JBA5C3EW9 type=del size=427631 2024-09-14T11:23:35.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.512+0000 7f296241c780 1 < suggested remove operation key=L8NA53KOAT58 tag=VAPIHKCR3C0Z type=del 2024-09-14T11:23:35.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.514+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=Z0Y9VW4ZEXBE type=del size=371555 2024-09-14T11:23:35.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.515+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=NKYQ3KCLXXMU type=del 2024-09-14T11:23:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.516+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=RCOVLN1ZHZOD type=del size=2976804 2024-09-14T11:23:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.517+0000 7f296241c780 -1 < failed to complete operation key=6DNKZWENMDM9 tag=P1BG2O0NKGYH type=del size=2731537: (22) Invalid argument 2024-09-14T11:23:35.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.519+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.0 size=1048576 2024-09-14T11:23:35.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.520+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.1 size=1048576 2024-09-14T11:23:35.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.521+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.2 size=827799 2024-09-14T11:23:35.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.521+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=O3KO9NNLSBYH tag=DRZ2RA3GJEB2 type=write size=3973527 2024-09-14T11:23:35.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.522+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~RE0VDL8LD52L.0 size=1048576 2024-09-14T11:23:35.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.523+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~RE0VDL8LD52L.1 size=995977 2024-09-14T11:23:35.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.525+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=RE0VDL8LD52L tag=OKK9QNHYQR3Q type=write size=3093129 2024-09-14T11:23:35.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.526+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=2A0SSACUKUZP type=del size=82473 2024-09-14T11:23:35.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.527+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=OXQ13NUQVFCB type=del 2024-09-14T11:23:35.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.529+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~DD7J71U3C7R3.0 size=1048576 2024-09-14T11:23:35.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.530+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~DD7J71U3C7R3.1 size=84470 2024-09-14T11:23:35.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.530+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=DD7J71U3C7R3 tag=AGQQFLL1YV2J type=write size=2181622 2024-09-14T11:23:35.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.531+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=YY5VVQBS2VYD type=del 2024-09-14T11:23:35.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.532+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=2AOW2ZWFM0KA type=write size=889942 2024-09-14T11:23:35.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.533+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~E7MH90R3XAHV.0 size=428729 2024-09-14T11:23:35.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.535+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=E7MH90R3XAHV tag=YHY9R6SVKFE0 type=write size=1477305 2024-09-14T11:23:35.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.538+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.0 size=1048576 2024-09-14T11:23:35.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.538+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.1 size=1048576 2024-09-14T11:23:35.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.539+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.2 size=903656 2024-09-14T11:23:35.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.539+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=E6D5T4BM9LDR tag=NPVKR9QXHRQ8 type=write size=4049384 2024-09-14T11:23:35.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.541+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=IIQY73P222M6 type=del 2024-09-14T11:23:35.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.543+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.0 size=1048576 2024-09-14T11:23:35.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.544+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.1 size=1048576 2024-09-14T11:23:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.545+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.2 size=52515 2024-09-14T11:23:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.545+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=B4HR23BA8R8T tag=FMOQ9UA4G91P type=write size=3198243 2024-09-14T11:23:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.546+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~IWZ17QPYP56L.0 size=376104 2024-09-14T11:23:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.548+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=IWZ17QPYP56L tag=EHJIB4Q95JY6 type=write size=1424680 2024-09-14T11:23:35.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.549+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=MX5025MUKK3J type=del size=2437578 2024-09-14T11:23:35.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.551+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=4TGZCHD2ABFP type=del 2024-09-14T11:23:35.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.553+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~OR0JH1YHUN0C.0 size=1048576 2024-09-14T11:23:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.554+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~OR0JH1YHUN0C.1 size=88179 2024-09-14T11:23:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.554+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=OR0JH1YHUN0C tag=2SG6NV5DP1BN type=write size=2185331 2024-09-14T11:23:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.555+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=4LS08BC0ILMB type=del 2024-09-14T11:23:35.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.556+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=3RJT2X55LCTO type=del size=1710859 2024-09-14T11:23:35.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.558+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=CY21E1924TSS type=del size=1483824 2024-09-14T11:23:35.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.560+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=IA6HIWNA682C type=del size=3229945 2024-09-14T11:23:35.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.561+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=ZGMBIOCXVX63 type=del 2024-09-14T11:23:35.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.563+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~A0EJF54E8JWP.0 size=1010776 2024-09-14T11:23:35.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.563+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=A0EJF54E8JWP tag=00S3QO18X46Z type=write size=2059352 2024-09-14T11:23:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.564+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~TMCHK170LTWH.0 size=427822 2024-09-14T11:23:35.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.566+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=TMCHK170LTWH tag=R25PIC7S0HW1 type=write size=1476398 2024-09-14T11:23:35.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.567+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=QQBTQA9BYUMZ type=del size=3062333 2024-09-14T11:23:35.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.570+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=AEAZ6LE5VGQ7 type=write size=724433 2024-09-14T11:23:35.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.573+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.0 size=1048576 2024-09-14T11:23:35.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.574+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.1 size=1048576 2024-09-14T11:23:35.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.575+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.2 size=298532 2024-09-14T11:23:35.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.575+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=61S3U8H5UULK tag=XV46N0V64SMR type=write size=3444260 2024-09-14T11:23:35.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.577+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=5W8JBA5C3EW9 type=del 2024-09-14T11:23:35.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.579+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~YQD8VJGOHT9M.0 size=702681 2024-09-14T11:23:35.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.579+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=YQD8VJGOHT9M tag=EFT9KX4IISM5 type=write size=1751257 2024-09-14T11:23:35.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.580+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=Z0Y9VW4ZEXBE type=del 2024-09-14T11:23:35.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.581+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=VVDAK0EIYBG2 type=del size=1645089 2024-09-14T11:23:35.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.583+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=RCOVLN1ZHZOD type=del size=2976804 2024-09-14T11:23:35.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.585+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=MOQDZDFXV1VA type=del size=2206795 2024-09-14T11:23:35.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.586+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.0 size=1048576 2024-09-14T11:23:35.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.587+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.1 size=1048576 2024-09-14T11:23:35.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.588+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~O3KO9NNLSBYH.2 size=827799 2024-09-14T11:23:35.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.590+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=O3KO9NNLSBYH tag=DRZ2RA3GJEB2 type=write size=3973527 2024-09-14T11:23:35.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.592+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.0 size=1048576 2024-09-14T11:23:35.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.594+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.1 size=1048576 2024-09-14T11:23:35.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.595+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.2 size=501754 2024-09-14T11:23:35.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.595+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=ESK1UWT9EXRE tag=TDHIJP1IDJLP type=write size=3647482 2024-09-14T11:23:35.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.598+0000 7f296241c780 1 < suggested remove operation key=19TC05N1D5FR tag=2A0SSACUKUZP type=del 2024-09-14T11:23:35.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.599+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=0K5G4DZ9YC35 type=write size=362552 2024-09-14T11:23:35.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.600+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~DD7J71U3C7R3.0 size=1048576 2024-09-14T11:23:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.601+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~DD7J71U3C7R3.1 size=84470 2024-09-14T11:23:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.602+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=DD7J71U3C7R3 tag=AGQQFLL1YV2J type=write size=2181622 2024-09-14T11:23:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.605+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~WZEA49D4JR0Z.0 size=1006079 2024-09-14T11:23:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.605+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=WZEA49D4JR0Z tag=QUC7BCG5UNZ6 type=write size=2054655 2024-09-14T11:23:35.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.607+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=2AOW2ZWFM0KA type=write size=889942 2024-09-14T11:23:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.608+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=T242GQDU3VJ2 type=del size=4000884 2024-09-14T11:23:35.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.609+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.0 size=1048576 2024-09-14T11:23:35.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.610+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.1 size=1048576 2024-09-14T11:23:35.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.611+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~E6D5T4BM9LDR.2 size=903656 2024-09-14T11:23:35.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.613+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=E6D5T4BM9LDR tag=NPVKR9QXHRQ8 type=write size=4049384 2024-09-14T11:23:35.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.615+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.0 size=1048576 2024-09-14T11:23:35.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.616+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.1 size=1048576 2024-09-14T11:23:35.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.616+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.2 size=10527 2024-09-14T11:23:35.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.616+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=W1W6691TASS3 tag=ZQ9RI5DMUZP7 type=write size=3156255 2024-09-14T11:23:35.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.618+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.0 size=1048576 2024-09-14T11:23:35.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.619+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.1 size=1048576 2024-09-14T11:23:35.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.619+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~B4HR23BA8R8T.2 size=52515 2024-09-14T11:23:35.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.621+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=B4HR23BA8R8T tag=FMOQ9UA4G91P type=write size=3198243 2024-09-14T11:23:35.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.622+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=45N316RDO876 type=write size=199081 2024-09-14T11:23:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.625+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=MX5025MUKK3J type=del size=2437578 2024-09-14T11:23:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.626+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=23E6KLTJ73RK type=del size=1757380 2024-09-14T11:23:35.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.627+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~OR0JH1YHUN0C.0 size=1048576 2024-09-14T11:23:35.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.628+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~OR0JH1YHUN0C.1 size=88179 2024-09-14T11:23:35.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.630+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=OR0JH1YHUN0C tag=2SG6NV5DP1BN type=write size=2185331 2024-09-14T11:23:35.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.632+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~3EBIWWGL0UWF.0 size=16625 2024-09-14T11:23:35.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.632+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=3EBIWWGL0UWF tag=E6301T6H65BT type=write size=1065201 2024-09-14T11:23:35.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.634+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=3RJT2X55LCTO type=del size=1710859 2024-09-14T11:23:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.635+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=P9VOFKXAD8NT type=del size=1023732 2024-09-14T11:23:35.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.637+0000 7f296241c780 1 < suggested update operation key=19TC05N1D5FR tag=IA6HIWNA682C type=del size=3229945 2024-09-14T11:23:35.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.638+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=H59O0XMU7X5F type=del size=2424806 2024-09-14T11:23:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.640+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~A0EJF54E8JWP.0 size=1010776 2024-09-14T11:23:35.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.642+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=A0EJF54E8JWP tag=00S3QO18X46Z type=write size=2059352 2024-09-14T11:23:35.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.643+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=YI02BN0SZDEU type=del size=3146273 2024-09-14T11:23:35.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.645+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=QQBTQA9BYUMZ type=del 2024-09-14T11:23:35.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.646+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=KO1JDYUVCMR8 type=del size=1000298 2024-09-14T11:23:35.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.647+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.0 size=1048576 2024-09-14T11:23:35.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.648+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.1 size=1048576 2024-09-14T11:23:35.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.649+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~61S3U8H5UULK.2 size=298532 2024-09-14T11:23:35.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.651+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=61S3U8H5UULK tag=XV46N0V64SMR type=write size=3444260 2024-09-14T11:23:35.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.653+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=Y6DFQFADT384 type=del size=1596427 2024-09-14T11:23:35.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.654+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~YQD8VJGOHT9M.0 size=702681 2024-09-14T11:23:35.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.656+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=YQD8VJGOHT9M tag=EFT9KX4IISM5 type=write size=1751257 2024-09-14T11:23:35.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.659+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.0 size=1048576 2024-09-14T11:23:35.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.660+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.1 size=1048576 2024-09-14T11:23:35.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.661+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.2 size=983484 2024-09-14T11:23:35.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.661+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=FS99DD7Q8CCB tag=4OX7LSGRC93Q type=write size=4129212 2024-09-14T11:23:35.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.662+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=VVDAK0EIYBG2 type=del 2024-09-14T11:23:35.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.666+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.0 size=1048576 2024-09-14T11:23:35.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.668+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.1 size=1048576 2024-09-14T11:23:35.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.669+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.2 size=55943 2024-09-14T11:23:35.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.669+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=KCZDNFLUXRS7 tag=X1VN4KM54EMP type=write size=3201671 2024-09-14T11:23:35.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.670+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=MOQDZDFXV1VA type=del 2024-09-14T11:23:35.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.671+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=L9DGAD8ACSVW type=del size=1010594 2024-09-14T11:23:35.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.672+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.0 size=1048576 2024-09-14T11:23:35.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.673+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.1 size=1048576 2024-09-14T11:23:35.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.673+0000 7f296241c780 1 < canceled part key=_multipart_5N30QR6SN49T.2~ESK1UWT9EXRE.2 size=501754 2024-09-14T11:23:35.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.675+0000 7f296241c780 1 < canceled multipart upload key=5N30QR6SN49T upload=ESK1UWT9EXRE tag=TDHIJP1IDJLP type=write size=3647482 2024-09-14T11:23:35.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.676+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=4065OQJVP00C type=del size=1923396 2024-09-14T11:23:35.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.678+0000 7f296241c780 1 < suggested update operation key=XTS8B3LEW0Y3 tag=0K5G4DZ9YC35 type=write size=362552 2024-09-14T11:23:35.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.679+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=G4XBUBKNG57W type=write size=659183 2024-09-14T11:23:35.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.680+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~WZEA49D4JR0Z.0 size=1006079 2024-09-14T11:23:35.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.683+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=WZEA49D4JR0Z tag=QUC7BCG5UNZ6 type=write size=2054655 2024-09-14T11:23:35.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.684+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=JFF296CUTZZA type=del size=2757106 2024-09-14T11:23:35.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.685+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=T242GQDU3VJ2 type=del 2024-09-14T11:23:35.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.686+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=TREU87DADNM6 type=write size=773724 2024-09-14T11:23:35.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.687+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.0 size=1048576 2024-09-14T11:23:35.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.688+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.1 size=1048576 2024-09-14T11:23:35.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.689+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~W1W6691TASS3.2 size=10527 2024-09-14T11:23:35.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.691+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=W1W6691TASS3 tag=ZQ9RI5DMUZP7 type=write size=3156255 2024-09-14T11:23:35.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.693+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~V2536IXY8092.0 size=1048576 2024-09-14T11:23:35.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.694+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~V2536IXY8092.1 size=919023 2024-09-14T11:23:35.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.694+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=V2536IXY8092 tag=NMFODKNN4TDF type=write size=3016175 2024-09-14T11:23:35.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.695+0000 7f296241c780 -1 < failed to complete operation key=XTS8B3LEW0Y3 tag=45N316RDO876 type=write size=199081: (22) Invalid argument 2024-09-14T11:23:35.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.696+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=34PS9F6AV4O1 type=del size=2213497 2024-09-14T11:23:35.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.697+0000 7f296241c780 -1 < failed to complete operation key=19TC05N1D5FR tag=23E6KLTJ73RK type=del size=1757380: (22) Invalid argument 2024-09-14T11:23:35.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.699+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~P0Q0ZQYGBFS9.0 size=518087 2024-09-14T11:23:35.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.699+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=P0Q0ZQYGBFS9 tag=SO05KN6GTOZT type=write size=1566663 2024-09-14T11:23:35.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.700+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~3EBIWWGL0UWF.0 size=16625 2024-09-14T11:23:35.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.702+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=3EBIWWGL0UWF tag=E6301T6H65BT type=write size=1065201 2024-09-14T11:23:35.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.704+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~TFO82AB38IQ2.0 size=1048576 2024-09-14T11:23:35.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.705+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~TFO82AB38IQ2.1 size=416457 2024-09-14T11:23:35.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.705+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=TFO82AB38IQ2 tag=D72T7QU8PJAW type=write size=2513609 2024-09-14T11:23:35.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.706+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=P9VOFKXAD8NT type=del 2024-09-14T11:23:35.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.708+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~398S0CNQPIWR.0 size=596028 2024-09-14T11:23:35.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.708+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=398S0CNQPIWR tag=G5WSXTEGZSVO type=write size=1644604 2024-09-14T11:23:35.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.710+0000 7f296241c780 1 < suggested remove operation key=MO1WWGC42DD4 tag=H59O0XMU7X5F type=del 2024-09-14T11:23:35.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.711+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=NPC4UN7S9MR4 type=del size=3192163 2024-09-14T11:23:35.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.712+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=YI02BN0SZDEU type=del 2024-09-14T11:23:35.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.713+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=G5QF71S5JNVB type=write size=964281 2024-09-14T11:23:35.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.715+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=KO1JDYUVCMR8 type=del 2024-09-14T11:23:35.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.717+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~F29T7522W08R.0 size=1048576 2024-09-14T11:23:35.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.717+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~F29T7522W08R.1 size=52865 2024-09-14T11:23:35.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.717+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=F29T7522W08R tag=WX6Z3AHZ2TEJ type=write size=2150017 2024-09-14T11:23:35.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.719+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=Y6DFQFADT384 type=del 2024-09-14T11:23:35.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.721+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~3MVWEBIUJBDF.0 size=343427 2024-09-14T11:23:35.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.721+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=3MVWEBIUJBDF tag=4OO90IERCQRO type=write size=1392003 2024-09-14T11:23:35.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.721+0000 7f296241c780 1 < canceled part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.0 size=1048576 2024-09-14T11:23:35.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.722+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.1 size=1048576 2024-09-14T11:23:35.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.723+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~FS99DD7Q8CCB.2 size=983484 2024-09-14T11:23:35.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.725+0000 7f296241c780 1 < canceled multipart upload key=XTS8B3LEW0Y3 upload=FS99DD7Q8CCB tag=4OX7LSGRC93Q type=write size=4129212 2024-09-14T11:23:35.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.727+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.0 size=1048576 2024-09-14T11:23:35.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.728+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.1 size=1048576 2024-09-14T11:23:35.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.729+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.2 size=40384 2024-09-14T11:23:35.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.729+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=6SH6H1KKH011 tag=0L24O12EMQ1B type=write size=3186112 2024-09-14T11:23:35.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.730+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.0 size=1048576 2024-09-14T11:23:35.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.731+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.1 size=1048576 2024-09-14T11:23:35.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.732+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~KCZDNFLUXRS7.2 size=55943 2024-09-14T11:23:35.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.734+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=KCZDNFLUXRS7 tag=X1VN4KM54EMP type=write size=3201671 2024-09-14T11:23:35.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.736+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.0 size=1048576 2024-09-14T11:23:35.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.737+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.1 size=1048576 2024-09-14T11:23:35.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.738+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.2 size=364901 2024-09-14T11:23:35.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.738+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=ZVHT3ZDIYXWY tag=BBO6L1VJO4MF type=write size=3510629 2024-09-14T11:23:35.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.739+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=L9DGAD8ACSVW type=del 2024-09-14T11:23:35.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.740+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=GTPHTS4E7U89 type=del size=945835 2024-09-14T11:23:35.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.741+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=4065OQJVP00C type=del 2024-09-14T11:23:35.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.742+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=CL1QXWZIAP6N type=del size=2553670 2024-09-14T11:23:35.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.743+0000 7f296241c780 1 < completed write operation key=OIT1KUT6UEP2 tag=G4XBUBKNG57W type=write size=659183 2024-09-14T11:23:35.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.745+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=5KDJVKZBV6N6 type=del size=2378934 2024-09-14T11:23:35.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.746+0000 7f296241c780 1 < canceled operation key=OIT1KUT6UEP2 tag=JFF296CUTZZA type=del size=2757106 2024-09-14T11:23:35.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.747+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=52FEIC4Y7NCI type=del size=978932 2024-09-14T11:23:35.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.748+0000 7f296241c780 1 < canceled operation key=LK9LRQM3TZRR tag=TREU87DADNM6 type=write size=773724 2024-09-14T11:23:35.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.749+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=ZADHV55MEJGV type=del size=1367866 2024-09-14T11:23:35.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.750+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~V2536IXY8092.0 size=1048576 2024-09-14T11:23:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.751+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~V2536IXY8092.1 size=919023 2024-09-14T11:23:35.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.753+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=V2536IXY8092 tag=NMFODKNN4TDF type=write size=3016175 2024-09-14T11:23:35.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.755+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~UW1ASN91HCDL.0 size=1048576 2024-09-14T11:23:35.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.756+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~UW1ASN91HCDL.1 size=404461 2024-09-14T11:23:35.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.756+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=UW1ASN91HCDL tag=MACI3JGCFXH6 type=write size=2501613 2024-09-14T11:23:35.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.757+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=34PS9F6AV4O1 type=del 2024-09-14T11:23:35.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.759+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=6BFW1ZC0DNFL type=write size=315375 2024-09-14T11:23:35.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.760+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~P0Q0ZQYGBFS9.0 size=518087 2024-09-14T11:23:35.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.762+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=P0Q0ZQYGBFS9 tag=SO05KN6GTOZT type=write size=1566663 2024-09-14T11:23:35.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.763+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=OKRCCYYDFU08 type=del size=3162090 2024-09-14T11:23:35.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.764+0000 7f296241c780 1 < canceled part key=_multipart_I1XBOS1L5D98.2~TFO82AB38IQ2.0 size=1048576 2024-09-14T11:23:35.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.765+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~TFO82AB38IQ2.1 size=416457 2024-09-14T11:23:35.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.767+0000 7f296241c780 1 < canceled multipart upload key=I1XBOS1L5D98 upload=TFO82AB38IQ2 tag=D72T7QU8PJAW type=write size=2513609 2024-09-14T11:23:35.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.769+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.0 size=1048576 2024-09-14T11:23:35.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.770+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.1 size=1048576 2024-09-14T11:23:35.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.772+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.2 size=675255 2024-09-14T11:23:35.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.772+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=E4K0ALQRF6H4 tag=NBYE371YVUA1 type=write size=3820983 2024-09-14T11:23:35.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.773+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~398S0CNQPIWR.0 size=596028 2024-09-14T11:23:35.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.775+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=398S0CNQPIWR tag=G5WSXTEGZSVO type=write size=1644604 2024-09-14T11:23:35.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.776+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=PYBSE0BNLL74 type=del size=2827813 2024-09-14T11:23:35.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.778+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=NPC4UN7S9MR4 type=del size=3192163 2024-09-14T11:23:35.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.779+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=VDFYIZRQB2FY type=del size=4022270 2024-09-14T11:23:35.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.781+0000 7f296241c780 1 < suggested update operation key=MO1WWGC42DD4 tag=G5QF71S5JNVB type=write size=964281 2024-09-14T11:23:35.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.782+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=FJO6648CFVC4 type=del size=4147679 2024-09-14T11:23:35.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.784+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~F29T7522W08R.0 size=1048576 2024-09-14T11:23:35.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.784+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~F29T7522W08R.1 size=52865 2024-09-14T11:23:35.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.786+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=F29T7522W08R tag=WX6Z3AHZ2TEJ type=write size=2150017 2024-09-14T11:23:35.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.788+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.0 size=1048576 2024-09-14T11:23:35.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.789+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.1 size=1048576 2024-09-14T11:23:35.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.790+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.2 size=567086 2024-09-14T11:23:35.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.790+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=XK11NPGTFOKA tag=FXZ45AKHQOW5 type=write size=3712814 2024-09-14T11:23:35.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.792+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~3MVWEBIUJBDF.0 size=343427 2024-09-14T11:23:35.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.793+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=3MVWEBIUJBDF tag=4OO90IERCQRO type=write size=1392003 2024-09-14T11:23:35.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.794+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=I4OOA636T3AL type=del size=319944 2024-09-14T11:23:35.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.796+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.0 size=1048576 2024-09-14T11:23:35.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.796+0000 7f296241c780 1 < canceled part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.1 size=1048576 2024-09-14T11:23:35.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.797+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~6SH6H1KKH011.2 size=40384 2024-09-14T11:23:35.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.799+0000 7f296241c780 1 < canceled multipart upload key=HZD8WW0H4AAD upload=6SH6H1KKH011 tag=0L24O12EMQ1B type=write size=3186112 2024-09-14T11:23:35.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.800+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=FUIHMPJFUXDZ type=del size=2219984 2024-09-14T11:23:35.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.801+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.0 size=1048576 2024-09-14T11:23:35.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.802+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.1 size=1048576 2024-09-14T11:23:35.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.805+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ZVHT3ZDIYXWY.2 size=364901 2024-09-14T11:23:35.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.807+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=ZVHT3ZDIYXWY tag=BBO6L1VJO4MF type=write size=3510629 2024-09-14T11:23:35.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.809+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.0 size=1048576 2024-09-14T11:23:35.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.810+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.1 size=1048576 2024-09-14T11:23:35.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.811+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.2 size=641785 2024-09-14T11:23:35.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.811+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=MTCQB9XXHWKX tag=9XUUWQRROUKE type=write size=3787513 2024-09-14T11:23:35.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.812+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=GTPHTS4E7U89 type=del 2024-09-14T11:23:35.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.814+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~Y930CUTPUD8D.0 size=1048576 2024-09-14T11:23:35.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.815+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~Y930CUTPUD8D.1 size=239307 2024-09-14T11:23:35.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.815+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=Y930CUTPUD8D tag=B4Q72L25CFX8 type=write size=2336459 2024-09-14T11:23:35.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.817+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=CL1QXWZIAP6N type=del size=2553670 2024-09-14T11:23:35.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.818+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=9U17C90CVT1E type=write size=258544 2024-09-14T11:23:35.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.819+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=5KDJVKZBV6N6 type=del 2024-09-14T11:23:35.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.821+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=M8WWQ4UARD8O type=write size=159188 2024-09-14T11:23:35.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.822+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=52FEIC4Y7NCI type=del 2024-09-14T11:23:35.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.823+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=TEZVTQ8KDB96 type=del size=2226485 2024-09-14T11:23:35.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.824+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=ZADHV55MEJGV type=del 2024-09-14T11:23:35.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.827+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~USBE1E740ZRA.0 size=1048576 2024-09-14T11:23:35.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.828+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~USBE1E740ZRA.1 size=922499 2024-09-14T11:23:35.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.828+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=USBE1E740ZRA tag=9RF4MA8XXF5I type=write size=3019651 2024-09-14T11:23:35.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.829+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~UW1ASN91HCDL.0 size=1048576 2024-09-14T11:23:35.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.830+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~UW1ASN91HCDL.1 size=404461 2024-09-14T11:23:35.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.832+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=UW1ASN91HCDL tag=MACI3JGCFXH6 type=write size=2501613 2024-09-14T11:23:35.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.833+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=2HPFGVLSX2YS type=del size=2829646 2024-09-14T11:23:35.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.834+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=6BFW1ZC0DNFL type=write size=315375 2024-09-14T11:23:35.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.835+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=WNCAA2CZ7E8J type=del size=3451654 2024-09-14T11:23:35.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.837+0000 7f296241c780 1 < suggested update operation key=7WGFBTAM25J9 tag=OKRCCYYDFU08 type=del size=3162090 2024-09-14T11:23:35.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.839+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~R7354K1SUIKD.0 size=1048576 2024-09-14T11:23:35.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.840+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~R7354K1SUIKD.1 size=713544 2024-09-14T11:23:35.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.840+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=R7354K1SUIKD tag=RZJTMC9YCS1C type=write size=2810696 2024-09-14T11:23:35.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.842+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.0 size=1048576 2024-09-14T11:23:35.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.843+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.1 size=1048576 2024-09-14T11:23:35.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.843+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~E4K0ALQRF6H4.2 size=675255 2024-09-14T11:23:35.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.846+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=E4K0ALQRF6H4 tag=NBYE371YVUA1 type=write size=3820983 2024-09-14T11:23:35.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.848+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.0 size=1048576 2024-09-14T11:23:35.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.849+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.1 size=1048576 2024-09-14T11:23:35.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.850+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.2 size=731240 2024-09-14T11:23:35.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.850+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=JV5FC3MGOF37 tag=LVBN51ALG8OD type=write size=3876968 2024-09-14T11:23:35.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.851+0000 7f296241c780 1 < canceled operation key=I6UYPPUMN0FB tag=PYBSE0BNLL74 type=del size=2827813 2024-09-14T11:23:35.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.852+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=GVAD3ZLU7FP1 type=del size=3449800 2024-09-14T11:23:35.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.853+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=VDFYIZRQB2FY type=del 2024-09-14T11:23:35.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.855+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=KPR422ME215Q type=del size=3919216 2024-09-14T11:23:35.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.856+0000 7f296241c780 1 < canceled operation key=3T0SINQVBAGF tag=FJO6648CFVC4 type=del size=4147679 2024-09-14T11:23:35.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.857+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=SRPZ1K9W4LYP type=del size=471332 2024-09-14T11:23:35.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.859+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.0 size=1048576 2024-09-14T11:23:35.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.860+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.1 size=1048576 2024-09-14T11:23:35.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.861+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~XK11NPGTFOKA.2 size=567086 2024-09-14T11:23:35.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.863+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=XK11NPGTFOKA tag=FXZ45AKHQOW5 type=write size=3712814 2024-09-14T11:23:35.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.864+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=C2TZ8X86D1RU type=del size=3346396 2024-09-14T11:23:35.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.866+0000 7f296241c780 1 < suggested update operation key=MO1WWGC42DD4 tag=I4OOA636T3AL type=del size=319944 2024-09-14T11:23:35.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.867+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=HX5UD4026GEP type=write size=1043637 2024-09-14T11:23:35.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.869+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=FUIHMPJFUXDZ type=del 2024-09-14T11:23:35.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.870+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=IDZ56QS79VND type=del size=640538 2024-09-14T11:23:35.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.871+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.0 size=1048576 2024-09-14T11:23:35.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.872+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.1 size=1048576 2024-09-14T11:23:35.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.873+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~MTCQB9XXHWKX.2 size=641785 2024-09-14T11:23:35.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.875+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=MTCQB9XXHWKX tag=9XUUWQRROUKE type=write size=3787513 2024-09-14T11:23:35.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.876+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=JC9IV0FM94R8 type=del size=64403 2024-09-14T11:23:35.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.877+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~Y930CUTPUD8D.0 size=1048576 2024-09-14T11:23:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.878+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~Y930CUTPUD8D.1 size=239307 2024-09-14T11:23:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.880+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=Y930CUTPUD8D tag=B4Q72L25CFX8 type=write size=2336459 2024-09-14T11:23:35.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.882+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=O2K49W0FPWV9 type=del size=2123153 2024-09-14T11:23:35.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.885+0000 7f296241c780 1 < canceled operation key=KBMD123LTZA7 tag=9U17C90CVT1E type=write size=258544 2024-09-14T11:23:35.886 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.887+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=66GVIG55W77T type=del size=1485185 2024-09-14T11:23:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.889+0000 7f296241c780 1 < completed write operation key=L0GW4TPQCSUY tag=M8WWQ4UARD8O type=write size=159188 2024-09-14T11:23:35.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.890+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=AKIK5PIVHOHJ type=del size=3257733 2024-09-14T11:23:35.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.891+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=TEZVTQ8KDB96 type=del 2024-09-14T11:23:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.893+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~PTZB0YVP6TWQ.0 size=1048576 2024-09-14T11:23:35.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.894+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~PTZB0YVP6TWQ.1 size=178970 2024-09-14T11:23:35.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.894+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=PTZB0YVP6TWQ tag=6V8KYHK27VFA type=write size=2276122 2024-09-14T11:23:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.895+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~USBE1E740ZRA.0 size=1048576 2024-09-14T11:23:35.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.896+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~USBE1E740ZRA.1 size=922499 2024-09-14T11:23:35.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.898+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=USBE1E740ZRA tag=9RF4MA8XXF5I type=write size=3019651 2024-09-14T11:23:35.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.899+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=FW6MQF53YMM8 type=write size=963597 2024-09-14T11:23:35.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.901+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=2HPFGVLSX2YS type=del 2024-09-14T11:23:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.902+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=6VBVN1VKNHQD type=del size=1788094 2024-09-14T11:23:35.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.904+0000 7f296241c780 -1 < failed to complete operation key=MO1WWGC42DD4 tag=WNCAA2CZ7E8J type=del size=3451654: (22) Invalid argument 2024-09-14T11:23:35.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.906+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=W3D8EGRFW93R type=write size=950667 2024-09-14T11:23:35.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.907+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~R7354K1SUIKD.0 size=1048576 2024-09-14T11:23:35.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.908+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~R7354K1SUIKD.1 size=713544 2024-09-14T11:23:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.910+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=R7354K1SUIKD tag=RZJTMC9YCS1C type=write size=2810696 2024-09-14T11:23:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.911+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=3YHV3ZLW4AF4 type=del size=3566984 2024-09-14T11:23:35.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.913+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.0 size=1048576 2024-09-14T11:23:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.914+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.1 size=1048576 2024-09-14T11:23:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.915+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~JV5FC3MGOF37.2 size=731240 2024-09-14T11:23:35.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.917+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=JV5FC3MGOF37 tag=LVBN51ALG8OD type=write size=3876968 2024-09-14T11:23:35.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.918+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=LB7QN31V1YKN type=del size=1305184 2024-09-14T11:23:35.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.919+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=GVAD3ZLU7FP1 type=del 2024-09-14T11:23:35.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.920+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=EBKRFL8XS43M type=del size=1934258 2024-09-14T11:23:35.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.921+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=KPR422ME215Q type=del 2024-09-14T11:23:35.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.922+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=BHH5J7G005DL type=del size=58896 2024-09-14T11:23:35.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.923+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=SRPZ1K9W4LYP type=del 2024-09-14T11:23:35.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.924+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=BBRCDDLG7674 type=del size=1580570 2024-09-14T11:23:35.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.927+0000 7f296241c780 1 < suggested update operation key=FGK7YH1GB4W5 tag=C2TZ8X86D1RU type=del size=3346396 2024-09-14T11:23:35.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.928+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=GLM1TEDIJU3D type=del size=2755137 2024-09-14T11:23:35.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.929+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=HX5UD4026GEP type=write size=1043637 2024-09-14T11:23:35.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.930+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=B2CED6FOS2HU type=del size=1135688 2024-09-14T11:23:35.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.931+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=IDZ56QS79VND type=del 2024-09-14T11:23:35.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.933+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.0 size=1048576 2024-09-14T11:23:35.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.934+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.1 size=1048576 2024-09-14T11:23:35.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.935+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.2 size=766462 2024-09-14T11:23:35.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.935+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=3HBC00RN4STR tag=B11L40RLOQRL type=write size=3912190 2024-09-14T11:23:35.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.936+0000 7f296241c780 1 < completed delete operation key=3T0SINQVBAGF tag=JC9IV0FM94R8 type=del 2024-09-14T11:23:35.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.937+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=LK29FSPW1VXC type=del size=102970 2024-09-14T11:23:35.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.938+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=O2K49W0FPWV9 type=del 2024-09-14T11:23:35.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.939+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=L0MYHBMJAEJV type=del size=351285 2024-09-14T11:23:35.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.940+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=66GVIG55W77T type=del 2024-09-14T11:23:35.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.941+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=3H1PG3QKCLYP type=del size=3776014 2024-09-14T11:23:35.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.942+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=AKIK5PIVHOHJ type=del 2024-09-14T11:23:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.944+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=1L2FCJLWH75J type=write size=24248 2024-09-14T11:23:35.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.945+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~PTZB0YVP6TWQ.0 size=1048576 2024-09-14T11:23:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.946+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~PTZB0YVP6TWQ.1 size=178970 2024-09-14T11:23:35.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.948+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=PTZB0YVP6TWQ tag=6V8KYHK27VFA type=write size=2276122 2024-09-14T11:23:35.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.949+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=CE3THKVCIRBS type=del size=4029163 2024-09-14T11:23:35.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.950+0000 7f296241c780 1 < completed write operation key=K61XH5E6TF3Y tag=FW6MQF53YMM8 type=write size=963597 2024-09-14T11:23:35.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.952+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.0 size=1048576 2024-09-14T11:23:35.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.953+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.1 size=1048576 2024-09-14T11:23:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.954+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.2 size=238456 2024-09-14T11:23:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.954+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=EXUMZVL6SSUA tag=HILJDAZG57P3 type=write size=3384184 2024-09-14T11:23:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.957+0000 7f296241c780 1 < suggested remove operation key=R1M982MUIF44 tag=6VBVN1VKNHQD type=del 2024-09-14T11:23:35.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.958+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=PECZ9HLE72L9 type=del size=228394 2024-09-14T11:23:35.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.959+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=W3D8EGRFW93R type=write size=950667 2024-09-14T11:23:35.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.961+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~NS5WEUMS0GXJ.0 size=1048576 2024-09-14T11:23:35.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.962+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~NS5WEUMS0GXJ.1 size=521315 2024-09-14T11:23:35.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.962+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=NS5WEUMS0GXJ tag=Z8DC7BX0N91Z type=write size=2618467 2024-09-14T11:23:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.963+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=3YHV3ZLW4AF4 type=del 2024-09-14T11:23:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.964+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=MKVD03X1RLXD type=del size=2381086 2024-09-14T11:23:35.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.966+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=LB7QN31V1YKN type=del 2024-09-14T11:23:35.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.968+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=0KQN4WPKE7G3 type=write size=34905 2024-09-14T11:23:35.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.969+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=EBKRFL8XS43M type=del 2024-09-14T11:23:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.971+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.0 size=1048576 2024-09-14T11:23:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.972+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.1 size=1048576 2024-09-14T11:23:35.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.973+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.2 size=649896 2024-09-14T11:23:35.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.973+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=3T1RS6GU20NP tag=2N032R8CMRJB type=write size=3795624 2024-09-14T11:23:35.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.974+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=BHH5J7G005DL type=del 2024-09-14T11:23:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.976+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.0 size=1048576 2024-09-14T11:23:35.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.977+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.1 size=1048576 2024-09-14T11:23:35.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.978+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.2 size=170467 2024-09-14T11:23:35.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.978+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=84EUPDXDJFN2 tag=LOQADB8J1JFQ type=write size=3316195 2024-09-14T11:23:35.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.979+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=BBRCDDLG7674 type=del 2024-09-14T11:23:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.981+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~153677OTTWQR.0 size=643157 2024-09-14T11:23:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.981+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=153677OTTWQR tag=3HZ4B0N6HQRE type=write size=1691733 2024-09-14T11:23:35.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.982+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=GLM1TEDIJU3D type=del 2024-09-14T11:23:35.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.984+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=X3USTK4HIU7J type=del size=436708 2024-09-14T11:23:35.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.985+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=B2CED6FOS2HU type=del 2024-09-14T11:23:35.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.986+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=R8P1XYU7MUA3 type=del size=2826546 2024-09-14T11:23:35.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.988+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.0 size=1048576 2024-09-14T11:23:35.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.988+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.1 size=1048576 2024-09-14T11:23:35.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.989+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~3HBC00RN4STR.2 size=766462 2024-09-14T11:23:35.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.991+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=3HBC00RN4STR tag=B11L40RLOQRL type=write size=3912190 2024-09-14T11:23:35.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.992+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=KV7NLDMAOE18 type=del size=1162964 2024-09-14T11:23:35.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.993+0000 7f296241c780 1 < canceled operation key=HZD8WW0H4AAD tag=LK29FSPW1VXC type=del size=102970 2024-09-14T11:23:35.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.995+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=4387YYD7492S type=del size=4120997 2024-09-14T11:23:35.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.996+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=L0MYHBMJAEJV type=del 2024-09-14T11:23:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:35.998+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=07C2I6PWJNKK type=del size=2514511 2024-09-14T11:23:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.000+0000 7f296241c780 1 < suggested remove operation key=FGK7YH1GB4W5 tag=3H1PG3QKCLYP type=del 2024-09-14T11:23:35.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.001+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=59LNJXLW5VA7 type=del size=395391 2024-09-14T11:23:36.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.003+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=1L2FCJLWH75J type=write 2024-09-14T11:23:36.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.004+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=MUSLR242V6WG type=del size=3413702 2024-09-14T11:23:36.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.005+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=CE3THKVCIRBS type=del 2024-09-14T11:23:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.007+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~013Z6ND9ZJG9.0 size=1048576 2024-09-14T11:23:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.008+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~013Z6ND9ZJG9.1 size=544574 2024-09-14T11:23:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.008+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=013Z6ND9ZJG9 tag=624GBKRE3BT7 type=write size=2641726 2024-09-14T11:23:36.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.009+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.0 size=1048576 2024-09-14T11:23:36.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.010+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.1 size=1048576 2024-09-14T11:23:36.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.011+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~EXUMZVL6SSUA.2 size=238456 2024-09-14T11:23:36.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.013+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=EXUMZVL6SSUA tag=HILJDAZG57P3 type=write size=3384184 2024-09-14T11:23:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.015+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.0 size=1048576 2024-09-14T11:23:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.016+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.1 size=1048576 2024-09-14T11:23:36.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.017+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.2 size=714581 2024-09-14T11:23:36.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.017+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=2QFPL7JA1KRB tag=JS6BC8DVPLEP type=write size=3860309 2024-09-14T11:23:36.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.018+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=PECZ9HLE72L9 type=del 2024-09-14T11:23:36.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.020+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.0 size=1048576 2024-09-14T11:23:36.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.021+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.1 size=1048576 2024-09-14T11:23:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.022+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.2 size=82794 2024-09-14T11:23:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.022+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=2KPIYCSS5SR3 tag=3TZ7LWJI1ELG type=write size=3228522 2024-09-14T11:23:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.023+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~NS5WEUMS0GXJ.0 size=1048576 2024-09-14T11:23:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.024+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~NS5WEUMS0GXJ.1 size=521315 2024-09-14T11:23:36.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.026+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=NS5WEUMS0GXJ tag=Z8DC7BX0N91Z type=write size=2618467 2024-09-14T11:23:36.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.028+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~79MTGASSEDOS.0 size=1048576 2024-09-14T11:23:36.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.029+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~79MTGASSEDOS.1 size=58518 2024-09-14T11:23:36.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.029+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=79MTGASSEDOS tag=751NO3UA5BU0 type=write size=2155670 2024-09-14T11:23:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.031+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=MKVD03X1RLXD type=del size=2381086 2024-09-14T11:23:36.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.032+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=YNNAC9FOU2TJ type=del size=1700175 2024-09-14T11:23:36.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.033+0000 7f296241c780 1 < completed write operation key=QIVVKYC646IH tag=0KQN4WPKE7G3 type=write size=34905 2024-09-14T11:23:36.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.035+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.0 size=1048576 2024-09-14T11:23:36.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.036+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.1 size=1048576 2024-09-14T11:23:36.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.037+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.2 size=546360 2024-09-14T11:23:36.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.037+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=2AU1MI1NVRWD tag=OEGXCWP7D296 type=write size=3692088 2024-09-14T11:23:36.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.038+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.0 size=1048576 2024-09-14T11:23:36.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.039+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.1 size=1048576 2024-09-14T11:23:36.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.040+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~3T1RS6GU20NP.2 size=649896 2024-09-14T11:23:36.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.042+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=3T1RS6GU20NP tag=2N032R8CMRJB type=write size=3795624 2024-09-14T11:23:36.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.045+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.0 size=1048576 2024-09-14T11:23:36.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.046+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.1 size=1048576 2024-09-14T11:23:36.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.047+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.2 size=918405 2024-09-14T11:23:36.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.047+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=UVTORQRM3LAA tag=1LDW7MJKPB2R type=write size=4064133 2024-09-14T11:23:36.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.048+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.0 size=1048576 2024-09-14T11:23:36.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.049+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.1 size=1048576 2024-09-14T11:23:36.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.050+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~84EUPDXDJFN2.2 size=170467 2024-09-14T11:23:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.052+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=84EUPDXDJFN2 tag=LOQADB8J1JFQ type=write size=3316195 2024-09-14T11:23:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.054+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~9YJCV0RQTUOJ.0 size=299749 2024-09-14T11:23:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.054+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=9YJCV0RQTUOJ tag=GLWB53KLI8JM type=write size=1348325 2024-09-14T11:23:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.055+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~153677OTTWQR.0 size=643157 2024-09-14T11:23:36.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.057+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=153677OTTWQR tag=3HZ4B0N6HQRE type=write size=1691733 2024-09-14T11:23:36.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.058+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=PGR4SSOYRLWI type=del size=2912945 2024-09-14T11:23:36.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.059+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=X3USTK4HIU7J type=del 2024-09-14T11:23:36.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.060+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=0E63ES2RLPIN type=del size=3185027 2024-09-14T11:23:36.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.062+0000 7f296241c780 -1 < failed to complete operation key=TNT7E4GX5ZR7 tag=R8P1XYU7MUA3 type=del size=2826546: (22) Invalid argument 2024-09-14T11:23:36.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.064+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~M5I3VGNZUB3Y.0 size=1048576 2024-09-14T11:23:36.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.065+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~M5I3VGNZUB3Y.1 size=891406 2024-09-14T11:23:36.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.065+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=M5I3VGNZUB3Y tag=OAKKJRNHJAFP type=write size=2988558 2024-09-14T11:23:36.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.066+0000 7f296241c780 -1 < failed to complete operation key=0A90ZOC79OWP tag=KV7NLDMAOE18 type=del size=1162964: (22) Invalid argument 2024-09-14T11:23:36.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.067+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=AB1YOT98P6XR type=write size=820901 2024-09-14T11:23:36.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.068+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=4387YYD7492S type=del size=4120997 2024-09-14T11:23:36.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.069+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=7AJNJGF0U8IV type=del size=3229299 2024-09-14T11:23:36.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.070+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=07C2I6PWJNKK type=del 2024-09-14T11:23:36.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.071+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=WAUDIELSJNY0 type=del size=2176015 2024-09-14T11:23:36.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.073+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=59LNJXLW5VA7 type=del 2024-09-14T11:23:36.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.075+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~B1AX2BTGKG4F.0 size=1048576 2024-09-14T11:23:36.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.076+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~B1AX2BTGKG4F.1 size=320407 2024-09-14T11:23:36.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.076+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=B1AX2BTGKG4F tag=0DAELYLBXQVI type=write size=2417559 2024-09-14T11:23:36.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.077+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=MUSLR242V6WG type=del 2024-09-14T11:23:36.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.078+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=FG5YHISN3BNV type=del size=2853368 2024-09-14T11:23:36.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.080+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~013Z6ND9ZJG9.0 size=1048576 2024-09-14T11:23:36.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.081+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~013Z6ND9ZJG9.1 size=544574 2024-09-14T11:23:36.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.083+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=013Z6ND9ZJG9 tag=624GBKRE3BT7 type=write size=2641726 2024-09-14T11:23:36.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.085+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.0 size=1048576 2024-09-14T11:23:36.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.086+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.1 size=1048576 2024-09-14T11:23:36.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.087+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.2 size=870456 2024-09-14T11:23:36.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.087+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=36OZ20DUBRK4 tag=N1SDCJUN8GNN type=write size=4016184 2024-09-14T11:23:36.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.088+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.0 size=1048576 2024-09-14T11:23:36.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.089+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.1 size=1048576 2024-09-14T11:23:36.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.090+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~2QFPL7JA1KRB.2 size=714581 2024-09-14T11:23:36.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.092+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=2QFPL7JA1KRB tag=JS6BC8DVPLEP type=write size=3860309 2024-09-14T11:23:36.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.093+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=QQLGV98WA8DJ type=del size=424359 2024-09-14T11:23:36.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.094+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.0 size=1048576 2024-09-14T11:23:36.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.095+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.1 size=1048576 2024-09-14T11:23:36.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.096+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~2KPIYCSS5SR3.2 size=82794 2024-09-14T11:23:36.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.098+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=2KPIYCSS5SR3 tag=3TZ7LWJI1ELG type=write size=3228522 2024-09-14T11:23:36.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.101+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~1K7SISTIRX3U.0 size=1048576 2024-09-14T11:23:36.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.102+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~1K7SISTIRX3U.1 size=683684 2024-09-14T11:23:36.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.102+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=1K7SISTIRX3U tag=WBI6OQ18ENTQ type=write size=2780836 2024-09-14T11:23:36.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.104+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~79MTGASSEDOS.0 size=1048576 2024-09-14T11:23:36.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.106+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~79MTGASSEDOS.1 size=58518 2024-09-14T11:23:36.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.110+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=79MTGASSEDOS tag=751NO3UA5BU0 type=write size=2155670 2024-09-14T11:23:36.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.111+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=V5DA66EFO16D type=del size=4173495 2024-09-14T11:23:36.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.112+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=YNNAC9FOU2TJ type=del 2024-09-14T11:23:36.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.113+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=660L2FI7GX9E type=del size=324432 2024-09-14T11:23:36.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.114+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.0 size=1048576 2024-09-14T11:23:36.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.115+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.1 size=1048576 2024-09-14T11:23:36.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.116+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~2AU1MI1NVRWD.2 size=546360 2024-09-14T11:23:36.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.118+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=2AU1MI1NVRWD tag=OEGXCWP7D296 type=write size=3692088 2024-09-14T11:23:36.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.119+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=Q36TG0FR3G22 type=del size=2436315 2024-09-14T11:23:36.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.120+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.0 size=1048576 2024-09-14T11:23:36.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.120+0000 7f296241c780 1 < canceled part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.1 size=1048576 2024-09-14T11:23:36.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.121+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~UVTORQRM3LAA.2 size=918405 2024-09-14T11:23:36.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.123+0000 7f296241c780 1 < canceled multipart upload key=QL439L2X13OR upload=UVTORQRM3LAA tag=1LDW7MJKPB2R type=write size=4064133 2024-09-14T11:23:36.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.125+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~QK2JTMC4YU0H.0 size=546452 2024-09-14T11:23:36.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.125+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=QK2JTMC4YU0H tag=9JRN0HIC0ROM type=write size=1595028 2024-09-14T11:23:36.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.126+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~9YJCV0RQTUOJ.0 size=299749 2024-09-14T11:23:36.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.128+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=9YJCV0RQTUOJ tag=GLWB53KLI8JM type=write size=1348325 2024-09-14T11:23:36.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.130+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~0WPW9OTK863I.0 size=1048576 2024-09-14T11:23:36.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.131+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~0WPW9OTK863I.1 size=351280 2024-09-14T11:23:36.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.131+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=0WPW9OTK863I tag=2VVUENZF6UHD type=write size=2448432 2024-09-14T11:23:36.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.132+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=PGR4SSOYRLWI type=del 2024-09-14T11:23:36.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.133+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=7IIF29LYJKZG type=del size=675172 2024-09-14T11:23:36.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.135+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=0E63ES2RLPIN type=del size=3185027 2024-09-14T11:23:36.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.136+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=GLAX8TUZJJIP type=del size=1204569 2024-09-14T11:23:36.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.137+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~M5I3VGNZUB3Y.0 size=1048576 2024-09-14T11:23:36.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.138+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~M5I3VGNZUB3Y.1 size=891406 2024-09-14T11:23:36.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.140+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=M5I3VGNZUB3Y tag=OAKKJRNHJAFP type=write size=2988558 2024-09-14T11:23:36.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.141+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=40DSG1XT4SM1 type=del size=3125552 2024-09-14T11:23:36.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.142+0000 7f296241c780 1 < completed write operation key=KVQ49I9RAYXA tag=AB1YOT98P6XR type=write size=820901 2024-09-14T11:23:36.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.143+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=5PLSGLIFWQ53 type=del size=1234742 2024-09-14T11:23:36.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.144+0000 7f296241c780 1 < canceled operation key=I1XBOS1L5D98 tag=7AJNJGF0U8IV type=del size=3229299 2024-09-14T11:23:36.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.147+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.0 size=1048576 2024-09-14T11:23:36.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.147+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.1 size=1048576 2024-09-14T11:23:36.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.148+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.2 size=722218 2024-09-14T11:23:36.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.148+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=A4NPYBZMYG1I tag=BXIETYK2KJOJ type=write size=3867946 2024-09-14T11:23:36.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.150+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=WAUDIELSJNY0 type=del 2024-09-14T11:23:36.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.151+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=ZB3ABSWW5KKY type=write size=182901 2024-09-14T11:23:36.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.152+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~B1AX2BTGKG4F.0 size=1048576 2024-09-14T11:23:36.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.153+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~B1AX2BTGKG4F.1 size=320407 2024-09-14T11:23:36.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.155+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=B1AX2BTGKG4F tag=0DAELYLBXQVI type=write size=2417559 2024-09-14T11:23:36.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.156+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=UP7A2OVMLY0M type=write size=645114 2024-09-14T11:23:36.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.157+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=FG5YHISN3BNV type=del 2024-09-14T11:23:36.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.158+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=DENOWPQAQEQT type=write size=376636 2024-09-14T11:23:36.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.160+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.0 size=1048576 2024-09-14T11:23:36.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.161+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.1 size=1048576 2024-09-14T11:23:36.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.161+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~36OZ20DUBRK4.2 size=870456 2024-09-14T11:23:36.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.164+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=36OZ20DUBRK4 tag=N1SDCJUN8GNN type=write size=4016184 2024-09-14T11:23:36.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.166+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.0 size=1048576 2024-09-14T11:23:36.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.167+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.1 size=1048576 2024-09-14T11:23:36.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.168+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.2 size=786589 2024-09-14T11:23:36.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.168+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=CQNHDC0RCWVM tag=4SB56SKC3BOV type=write size=3932317 2024-09-14T11:23:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.169+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=QQLGV98WA8DJ type=del 2024-09-14T11:23:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.170+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=PHIBN644EXPQ type=del size=3160501 2024-09-14T11:23:36.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.171+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~1K7SISTIRX3U.0 size=1048576 2024-09-14T11:23:36.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.172+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~1K7SISTIRX3U.1 size=683684 2024-09-14T11:23:36.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.175+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=1K7SISTIRX3U tag=WBI6OQ18ENTQ type=write size=2780836 2024-09-14T11:23:36.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.176+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=BLMBE13FL9J8 type=del size=2416323 2024-09-14T11:23:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.177+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=V5DA66EFO16D type=del 2024-09-14T11:23:36.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.178+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=Y4JHJVQGFKFY type=del size=4012519 2024-09-14T11:23:36.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.180+0000 7f296241c780 1 < suggested update operation key=19TC05N1D5FR tag=660L2FI7GX9E type=del size=324432 2024-09-14T11:23:36.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.182+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=9DMATSL49E2Z type=del size=2446106 2024-09-14T11:23:36.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.183+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=Q36TG0FR3G22 type=del 2024-09-14T11:23:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.184+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=QDC8O2KOYY8P type=del size=1972637 2024-09-14T11:23:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.185+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~QK2JTMC4YU0H.0 size=546452 2024-09-14T11:23:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.187+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=QK2JTMC4YU0H tag=9JRN0HIC0ROM type=write size=1595028 2024-09-14T11:23:36.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.188+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=TLXE58KRWIGN type=write size=512077 2024-09-14T11:23:36.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.190+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~0WPW9OTK863I.0 size=1048576 2024-09-14T11:23:36.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.190+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~0WPW9OTK863I.1 size=351280 2024-09-14T11:23:36.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.191+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=0WPW9OTK863I tag=2VVUENZF6UHD type=write size=2448432 2024-09-14T11:23:36.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.193+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=3NBHW7KJFFPL type=del size=1736257 2024-09-14T11:23:36.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.194+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=7IIF29LYJKZG type=del 2024-09-14T11:23:36.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.195+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=YSVYXBH2JGHV type=del size=385694 2024-09-14T11:23:36.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.196+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=GLAX8TUZJJIP type=del 2024-09-14T11:23:36.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.198+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=18VAIV7PJUC6 type=del size=3015488 2024-09-14T11:23:36.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.199+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=40DSG1XT4SM1 type=del 2024-09-14T11:23:36.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.200+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=VQWWYEO65AO7 type=write size=947084 2024-09-14T11:23:36.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.201+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=5PLSGLIFWQ53 type=del 2024-09-14T11:23:36.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.204+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~ZND1XI42HKVW.0 size=1048576 2024-09-14T11:23:36.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.204+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~ZND1XI42HKVW.1 size=532143 2024-09-14T11:23:36.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.204+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=ZND1XI42HKVW tag=LYJFR7FHTELS type=write size=2629295 2024-09-14T11:23:36.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.206+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.0 size=1048576 2024-09-14T11:23:36.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.206+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.1 size=1048576 2024-09-14T11:23:36.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.207+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~A4NPYBZMYG1I.2 size=722218 2024-09-14T11:23:36.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.209+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=A4NPYBZMYG1I tag=BXIETYK2KJOJ type=write size=3867946 2024-09-14T11:23:36.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.211+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ZYTY7UWZCQPA.0 size=1048576 2024-09-14T11:23:36.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.212+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~ZYTY7UWZCQPA.1 size=791750 2024-09-14T11:23:36.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.212+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=ZYTY7UWZCQPA tag=0PBNU3YUYLVA type=write size=2888902 2024-09-14T11:23:36.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.214+0000 7f296241c780 1 < completed write operation key=7WGFBTAM25J9 tag=ZB3ABSWW5KKY type=write size=182901 2024-09-14T11:23:36.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.215+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=4RRBZ2XWQ540 type=write size=616812 2024-09-14T11:23:36.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.217+0000 7f296241c780 1 < completed write operation key=QL439L2X13OR tag=UP7A2OVMLY0M type=write size=645114 2024-09-14T11:23:36.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.219+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.0 size=1048576 2024-09-14T11:23:36.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.220+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.1 size=1048576 2024-09-14T11:23:36.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.220+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.2 size=488050 2024-09-14T11:23:36.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.220+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=SX4FXG8WGW5R tag=3H0WORV4SXFZ type=write size=3633778 2024-09-14T11:23:36.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.222+0000 7f296241c780 1 < completed write operation key=5N30QR6SN49T tag=DENOWPQAQEQT type=write size=376636 2024-09-14T11:23:36.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.223+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=F3S3M984KQO8 type=write size=928540 2024-09-14T11:23:36.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.224+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.0 size=1048576 2024-09-14T11:23:36.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.225+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.1 size=1048576 2024-09-14T11:23:36.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.226+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~CQNHDC0RCWVM.2 size=786589 2024-09-14T11:23:36.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.228+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=CQNHDC0RCWVM tag=4SB56SKC3BOV type=write size=3932317 2024-09-14T11:23:36.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.229+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=40C2CVDHUHJJ type=del size=3520772 2024-09-14T11:23:36.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.230+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=PHIBN644EXPQ type=del 2024-09-14T11:23:36.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.231+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=ODQ7OP04FRK0 type=del size=708892 2024-09-14T11:23:36.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.232+0000 7f296241c780 1 < canceled operation key=I6UYPPUMN0FB tag=BLMBE13FL9J8 type=del size=2416323 2024-09-14T11:23:36.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.234+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~VCFBT5ZEP0MH.0 size=136674 2024-09-14T11:23:36.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.234+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=VCFBT5ZEP0MH tag=N3EAOZOL7EZG type=write size=1185250 2024-09-14T11:23:36.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.236+0000 7f296241c780 1 < suggested update operation key=CQU8M12JCE9T tag=Y4JHJVQGFKFY type=del size=4012519 2024-09-14T11:23:36.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.239+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~T9UBM9DJSO7T.0 size=626976 2024-09-14T11:23:36.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.239+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=T9UBM9DJSO7T tag=9DT7TLETG2R9 type=write size=1675552 2024-09-14T11:23:36.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.240+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=9DMATSL49E2Z type=del 2024-09-14T11:23:36.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.241+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=K894E2NZPFBP type=del size=3191737 2024-09-14T11:23:36.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.243+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=QDC8O2KOYY8P type=del 2024-09-14T11:23:36.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.244+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=FOYO55J1P6RD type=del size=3594147 2024-09-14T11:23:36.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.245+0000 7f296241c780 1 < completed write operation key=JH1QJE5V4M9H tag=TLXE58KRWIGN type=write size=512077 2024-09-14T11:23:36.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.247+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=C7CV6VNY4RBK type=write size=120536 2024-09-14T11:23:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.248+0000 7f296241c780 1 < canceled operation key=L8NA53KOAT58 tag=3NBHW7KJFFPL type=del size=1736257 2024-09-14T11:23:36.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.250+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.0 size=1048576 2024-09-14T11:23:36.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.251+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.1 size=1048576 2024-09-14T11:23:36.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.251+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.2 size=928705 2024-09-14T11:23:36.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.251+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=8PUXUOLT4WEB tag=1MPABQ17TOKC type=write size=4074433 2024-09-14T11:23:36.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.253+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=YSVYXBH2JGHV type=del 2024-09-14T11:23:36.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.254+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=2DA76K8I6WB7 type=del size=3623469 2024-09-14T11:23:36.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.256+0000 7f296241c780 1 < suggested remove operation key=I6UYPPUMN0FB tag=18VAIV7PJUC6 type=del 2024-09-14T11:23:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.258+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~HIKQQK49GWMC.0 size=1048576 2024-09-14T11:23:36.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.259+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~HIKQQK49GWMC.1 size=379311 2024-09-14T11:23:36.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.259+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=HIKQQK49GWMC tag=SIGB7OBZV1DY type=write size=2476463 2024-09-14T11:23:36.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.260+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=VQWWYEO65AO7 type=write size=947084 2024-09-14T11:23:36.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.261+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=NKKR5YD1ZE63 type=del size=3040757 2024-09-14T11:23:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.262+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~ZND1XI42HKVW.0 size=1048576 2024-09-14T11:23:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.263+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~ZND1XI42HKVW.1 size=532143 2024-09-14T11:23:36.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.265+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=ZND1XI42HKVW tag=LYJFR7FHTELS type=write size=2629295 2024-09-14T11:23:36.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.266+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=YLP1XMNO10Y7 type=del size=295740 2024-09-14T11:23:36.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.267+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ZYTY7UWZCQPA.0 size=1048576 2024-09-14T11:23:36.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.268+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~ZYTY7UWZCQPA.1 size=791750 2024-09-14T11:23:36.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.270+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=ZYTY7UWZCQPA tag=0PBNU3YUYLVA type=write size=2888902 2024-09-14T11:23:36.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.271+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=IE3UZVN5LEYI type=del size=2355076 2024-09-14T11:23:36.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.273+0000 7f296241c780 1 < completed write operation key=JH1QJE5V4M9H tag=4RRBZ2XWQ540 type=write size=616812 2024-09-14T11:23:36.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.274+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=GIG6HK6ED3BZ type=del size=2498147 2024-09-14T11:23:36.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.275+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.0 size=1048576 2024-09-14T11:23:36.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.276+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.1 size=1048576 2024-09-14T11:23:36.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.276+0000 7f296241c780 1 < canceled part key=_multipart_L0GW4TPQCSUY.2~SX4FXG8WGW5R.2 size=488050 2024-09-14T11:23:36.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.278+0000 7f296241c780 1 < canceled multipart upload key=L0GW4TPQCSUY upload=SX4FXG8WGW5R tag=3H0WORV4SXFZ type=write size=3633778 2024-09-14T11:23:36.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.280+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~943GP98EAX75.0 size=468055 2024-09-14T11:23:36.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.280+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=943GP98EAX75 tag=4X6ZGWCHSH2N type=write size=1516631 2024-09-14T11:23:36.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.281+0000 7f296241c780 1 < completed write operation key=5XAAGDKVBZ0P tag=F3S3M984KQO8 type=write size=928540 2024-09-14T11:23:36.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.283+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.0 size=1048576 2024-09-14T11:23:36.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.284+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.1 size=1048576 2024-09-14T11:23:36.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.285+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.2 size=714427 2024-09-14T11:23:36.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.285+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=N4ABFH3I5HMW tag=RM6WU1TIQEGP type=write size=3860155 2024-09-14T11:23:36.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.286+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=40C2CVDHUHJJ type=del 2024-09-14T11:23:36.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.287+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=I5KJKUYFX9WR type=del size=2283093 2024-09-14T11:23:36.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.288+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=ODQ7OP04FRK0 type=del 2024-09-14T11:23:36.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.290+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~0992KS84K1J7.0 size=156271 2024-09-14T11:23:36.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.290+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=0992KS84K1J7 tag=TONFXEHFE9MZ type=write size=1204847 2024-09-14T11:23:36.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.291+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~VCFBT5ZEP0MH.0 size=136674 2024-09-14T11:23:36.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.293+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=VCFBT5ZEP0MH tag=N3EAOZOL7EZG type=write size=1185250 2024-09-14T11:23:36.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.294+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=MQKU3M3M4LII type=del size=824541 2024-09-14T11:23:36.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.295+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~T9UBM9DJSO7T.0 size=626976 2024-09-14T11:23:36.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.297+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=T9UBM9DJSO7T tag=9DT7TLETG2R9 type=write size=1675552 2024-09-14T11:23:36.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.298+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=FOKEZP6VYB21 type=del size=1512081 2024-09-14T11:23:36.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.300+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=K894E2NZPFBP type=del 2024-09-14T11:23:36.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.301+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=HU2HD7GJHL63 type=del size=192277 2024-09-14T11:23:36.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.303+0000 7f296241c780 1 < completed delete operation key=JH1QJE5V4M9H tag=FOYO55J1P6RD type=del 2024-09-14T11:23:36.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.305+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.0 size=1048576 2024-09-14T11:23:36.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.305+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.1 size=1048576 2024-09-14T11:23:36.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.306+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.2 size=232951 2024-09-14T11:23:36.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.306+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=QWJHH99J1XRM tag=AQ9SPKB8TOEY type=write size=3378679 2024-09-14T11:23:36.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.308+0000 7f296241c780 1 < suggested remove operation key=JW3RIVHUFGPI tag=C7CV6VNY4RBK type=write 2024-09-14T11:23:36.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.309+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=KIMUCQVIAXT4 type=del size=952198 2024-09-14T11:23:36.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.310+0000 7f296241c780 1 < canceled part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.0 size=1048576 2024-09-14T11:23:36.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.311+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.1 size=1048576 2024-09-14T11:23:36.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.311+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~8PUXUOLT4WEB.2 size=928705 2024-09-14T11:23:36.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.313+0000 7f296241c780 1 < canceled multipart upload key=7WGFBTAM25J9 upload=8PUXUOLT4WEB tag=1MPABQ17TOKC type=write size=4074433 2024-09-14T11:23:36.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.314+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=HBDW9K3Y658O type=del size=2248402 2024-09-14T11:23:36.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.315+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=2DA76K8I6WB7 type=del 2024-09-14T11:23:36.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.317+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~PGLFDS871XVG.0 size=338795 2024-09-14T11:23:36.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.317+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=PGLFDS871XVG tag=HWLZ3J2H8KPX type=write size=1387371 2024-09-14T11:23:36.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.318+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~HIKQQK49GWMC.0 size=1048576 2024-09-14T11:23:36.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.321+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~HIKQQK49GWMC.1 size=379311 2024-09-14T11:23:36.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.324+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=HIKQQK49GWMC tag=SIGB7OBZV1DY type=write size=2476463 2024-09-14T11:23:36.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.327+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.0 size=1048576 2024-09-14T11:23:36.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.328+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.1 size=1048576 2024-09-14T11:23:36.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.329+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.2 size=200345 2024-09-14T11:23:36.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.329+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=P0E3IW0MOSUK tag=8WQHCXWPRV1H type=write size=3346073 2024-09-14T11:23:36.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.330+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=NKKR5YD1ZE63 type=del 2024-09-14T11:23:36.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.332+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~2UG7QFOKLSUK.0 size=1048576 2024-09-14T11:23:36.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.333+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~2UG7QFOKLSUK.1 size=275052 2024-09-14T11:23:36.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.333+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=2UG7QFOKLSUK tag=CEHSI2FHULJW type=write size=2372204 2024-09-14T11:23:36.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.334+0000 7f296241c780 1 < canceled operation key=HZD8WW0H4AAD tag=YLP1XMNO10Y7 type=del size=295740 2024-09-14T11:23:36.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.335+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=VRRFFFWRMWBC type=del size=545502 2024-09-14T11:23:36.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.336+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=IE3UZVN5LEYI type=del 2024-09-14T11:23:36.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.337+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=X8MU5MRH1L1W type=del size=3127185 2024-09-14T11:23:36.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.338+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=GIG6HK6ED3BZ type=del 2024-09-14T11:23:36.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.340+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~QGCOK3F0RTZA.0 size=631286 2024-09-14T11:23:36.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.340+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=QGCOK3F0RTZA tag=U7WXNU00S0ES type=write size=1679862 2024-09-14T11:23:36.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.342+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~943GP98EAX75.0 size=468055 2024-09-14T11:23:36.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.344+0000 7f296241c780 1 < completed multipart upload key=19TC05N1D5FR upload=943GP98EAX75 tag=4X6ZGWCHSH2N type=write size=1516631 2024-09-14T11:23:36.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.345+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=1SZ382USR90V type=del size=1852253 2024-09-14T11:23:36.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.346+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.0 size=1048576 2024-09-14T11:23:36.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.346+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.1 size=1048576 2024-09-14T11:23:36.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.346+0000 7f296241c780 1 < canceled part key=_multipart_I6UYPPUMN0FB.2~N4ABFH3I5HMW.2 size=714427 2024-09-14T11:23:36.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.348+0000 7f296241c780 1 < canceled multipart upload key=I6UYPPUMN0FB upload=N4ABFH3I5HMW tag=RM6WU1TIQEGP type=write size=3860155 2024-09-14T11:23:36.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.349+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=537MYQF4J7IN type=del size=3418916 2024-09-14T11:23:36.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.351+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=I5KJKUYFX9WR type=del size=2283093 2024-09-14T11:23:36.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.352+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=9Y660DHGA3FG type=del size=3390347 2024-09-14T11:23:36.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.353+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~0992KS84K1J7.0 size=156271 2024-09-14T11:23:36.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.355+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=0992KS84K1J7 tag=TONFXEHFE9MZ type=write size=1204847 2024-09-14T11:23:36.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.356+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=5825NJAI051L type=del size=2769923 2024-09-14T11:23:36.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.357+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=MQKU3M3M4LII type=del 2024-09-14T11:23:36.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.358+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=CABL39UNKQWW type=write size=236771 2024-09-14T11:23:36.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.359+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=FOKEZP6VYB21 type=del 2024-09-14T11:23:36.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.360+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=DHKE2U8N6RV2 type=del size=830606 2024-09-14T11:23:36.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.362+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=HU2HD7GJHL63 type=del 2024-09-14T11:23:36.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.363+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=AL8DHQADV7Q8 type=del size=1229540 2024-09-14T11:23:36.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.364+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.0 size=1048576 2024-09-14T11:23:36.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.365+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.1 size=1048576 2024-09-14T11:23:36.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.366+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~QWJHH99J1XRM.2 size=232951 2024-09-14T11:23:36.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.368+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=QWJHH99J1XRM tag=AQ9SPKB8TOEY type=write size=3378679 2024-09-14T11:23:36.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.369+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=IOYETIJL5QOC type=del size=2532427 2024-09-14T11:23:36.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.370+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=KIMUCQVIAXT4 type=del 2024-09-14T11:23:36.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.372+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=M4354D7D3ZSW type=del size=851027 2024-09-14T11:23:36.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.373+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=HBDW9K3Y658O type=del 2024-09-14T11:23:36.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.374+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=3D74SPGJ8PVN type=del size=1190453 2024-09-14T11:23:36.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.375+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~PGLFDS871XVG.0 size=338795 2024-09-14T11:23:36.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.377+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=PGLFDS871XVG tag=HWLZ3J2H8KPX type=write size=1387371 2024-09-14T11:23:36.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.379+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~G381RMZL98MB.0 size=1048576 2024-09-14T11:23:36.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.380+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~G381RMZL98MB.1 size=372306 2024-09-14T11:23:36.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.380+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=G381RMZL98MB tag=6B9PGPCFXBSF type=write size=2469458 2024-09-14T11:23:36.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.381+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.0 size=1048576 2024-09-14T11:23:36.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.382+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.1 size=1048576 2024-09-14T11:23:36.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.383+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~P0E3IW0MOSUK.2 size=200345 2024-09-14T11:23:36.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.385+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=P0E3IW0MOSUK tag=8WQHCXWPRV1H type=write size=3346073 2024-09-14T11:23:36.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.386+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=ZWSBRK3BQXWN type=del size=1836027 2024-09-14T11:23:36.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.387+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~2UG7QFOKLSUK.0 size=1048576 2024-09-14T11:23:36.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.388+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~2UG7QFOKLSUK.1 size=275052 2024-09-14T11:23:36.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.390+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=2UG7QFOKLSUK tag=CEHSI2FHULJW type=write size=2372204 2024-09-14T11:23:36.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.391+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=A3XKA4EDV415 type=del size=2592802 2024-09-14T11:23:36.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.393+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=VRRFFFWRMWBC type=del 2024-09-14T11:23:36.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.394+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=TNXYLRPCQPBV type=del size=2256705 2024-09-14T11:23:36.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.396+0000 7f296241c780 1 < suggested update operation key=JW3RIVHUFGPI tag=X8MU5MRH1L1W type=del size=3127185 2024-09-14T11:23:36.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.399+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=SO21X7OJ5SB8 type=del size=1444327 2024-09-14T11:23:36.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.400+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~QGCOK3F0RTZA.0 size=631286 2024-09-14T11:23:36.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.402+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=QGCOK3F0RTZA tag=U7WXNU00S0ES type=write size=1679862 2024-09-14T11:23:36.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.403+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=ZD7TMHLYLO1I type=del size=649518 2024-09-14T11:23:36.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.404+0000 7f296241c780 -1 < failed to complete operation key=C1T4CLU3400T tag=1SZ382USR90V type=del size=1852253: (22) Invalid argument 2024-09-14T11:23:36.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.405+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=Y3NK2M9HSYK1 type=del size=505467 2024-09-14T11:23:36.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.406+0000 7f296241c780 -1 < failed to complete operation key=JW3RIVHUFGPI tag=537MYQF4J7IN type=del size=3418916: (22) Invalid argument 2024-09-14T11:23:36.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.407+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=M4VP9J0Y66LS type=write size=126529 2024-09-14T11:23:36.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.408+0000 7f296241c780 1 < canceled operation key=OIT1KUT6UEP2 tag=9Y660DHGA3FG type=del size=3390347 2024-09-14T11:23:36.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.411+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~NWAWEOWAPWJK.0 size=327610 2024-09-14T11:23:36.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.411+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=NWAWEOWAPWJK tag=Q514N3HIN47E type=write size=1376186 2024-09-14T11:23:36.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.412+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=5825NJAI051L type=del 2024-09-14T11:23:36.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.413+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=WD4GRL36AH98 type=del size=1978027 2024-09-14T11:23:36.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.414+0000 7f296241c780 1 < completed write operation key=MO1WWGC42DD4 tag=CABL39UNKQWW type=write size=236771 2024-09-14T11:23:36.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.416+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~XNSG086QC8XV.0 size=1048576 2024-09-14T11:23:36.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.417+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~XNSG086QC8XV.1 size=1029091 2024-09-14T11:23:36.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.417+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=XNSG086QC8XV tag=ZTROVIY81BD2 type=write size=3126243 2024-09-14T11:23:36.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.419+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=DHKE2U8N6RV2 type=del 2024-09-14T11:23:36.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.421+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Z1Q44F3T41DY.0 size=1048576 2024-09-14T11:23:36.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.422+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~Z1Q44F3T41DY.1 size=119847 2024-09-14T11:23:36.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.422+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=Z1Q44F3T41DY tag=XBDSVPGK9FII type=write size=2216999 2024-09-14T11:23:36.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.423+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=AL8DHQADV7Q8 type=del 2024-09-14T11:23:36.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.425+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.0 size=1048576 2024-09-14T11:23:36.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.426+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.1 size=1048576 2024-09-14T11:23:36.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.427+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.2 size=813597 2024-09-14T11:23:36.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.427+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=3FQIP7HIXLNI tag=Z2WIBM6JJY6V type=write size=3959325 2024-09-14T11:23:36.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.428+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=IOYETIJL5QOC type=del 2024-09-14T11:23:36.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.430+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~N6LYDWUDRTIM.0 size=169109 2024-09-14T11:23:36.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.430+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=N6LYDWUDRTIM tag=FIXCIMX1SWOC type=write size=1217685 2024-09-14T11:23:36.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.431+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=M4354D7D3ZSW type=del 2024-09-14T11:23:36.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.435+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~OJMMVL32TPE4.0 size=1048576 2024-09-14T11:23:36.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.436+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~OJMMVL32TPE4.1 size=121241 2024-09-14T11:23:36.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.436+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=OJMMVL32TPE4 tag=9XFO9R85Q0JZ type=write size=2218393 2024-09-14T11:23:36.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.437+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=3D74SPGJ8PVN type=del 2024-09-14T11:23:36.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.438+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=7MMEKLMP2B6V type=del size=3673324 2024-09-14T11:23:36.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.439+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~G381RMZL98MB.0 size=1048576 2024-09-14T11:23:36.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.440+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~G381RMZL98MB.1 size=372306 2024-09-14T11:23:36.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.442+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=G381RMZL98MB tag=6B9PGPCFXBSF type=write size=2469458 2024-09-14T11:23:36.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.444+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~IU76UIF299M5.0 size=680214 2024-09-14T11:23:36.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.444+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=IU76UIF299M5 tag=WKLRMJR206CR type=write size=1728790 2024-09-14T11:23:36.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.445+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=ZWSBRK3BQXWN type=del 2024-09-14T11:23:36.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.446+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=AAEGR5SH108Z type=write size=12412 2024-09-14T11:23:36.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.447+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=A3XKA4EDV415 type=del 2024-09-14T11:23:36.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.449+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=P3HOOG1RSCOT type=del size=2224045 2024-09-14T11:23:36.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.450+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=TNXYLRPCQPBV type=del 2024-09-14T11:23:36.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.452+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~Y79NXYUPYJ7H.0 size=1048576 2024-09-14T11:23:36.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.453+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~Y79NXYUPYJ7H.1 size=102870 2024-09-14T11:23:36.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.453+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=Y79NXYUPYJ7H tag=5UDSZXGASXJG type=write size=2200022 2024-09-14T11:23:36.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.454+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=SO21X7OJ5SB8 type=del 2024-09-14T11:23:36.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.455+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=5M7OYK8GYP7M type=del size=1550822 2024-09-14T11:23:36.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.457+0000 7f296241c780 1 < suggested update operation key=3T0SINQVBAGF tag=ZD7TMHLYLO1I type=del size=649518 2024-09-14T11:23:36.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.458+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=15SE1YGZNS49 type=del size=4165609 2024-09-14T11:23:36.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.459+0000 7f296241c780 1 < completed delete operation key=LK9LRQM3TZRR tag=Y3NK2M9HSYK1 type=del 2024-09-14T11:23:36.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.461+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=IG0LT1BVMUQG type=del size=2308649 2024-09-14T11:23:36.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.462+0000 7f296241c780 1 < completed write operation key=JH1QJE5V4M9H tag=M4VP9J0Y66LS type=write size=126529 2024-09-14T11:23:36.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.463+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=4A0SP2VDSCVZ type=del size=3975520 2024-09-14T11:23:36.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.464+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~NWAWEOWAPWJK.0 size=327610 2024-09-14T11:23:36.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.466+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=NWAWEOWAPWJK tag=Q514N3HIN47E type=write size=1376186 2024-09-14T11:23:36.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.467+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=WP8I6V2U1PMP type=del size=1355026 2024-09-14T11:23:36.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.470+0000 7f296241c780 1 < suggested update operation key=6DNKZWENMDM9 tag=WD4GRL36AH98 type=del size=1978027 2024-09-14T11:23:36.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.472+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.0 size=1048576 2024-09-14T11:23:36.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.473+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.1 size=1048576 2024-09-14T11:23:36.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.474+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.2 size=875249 2024-09-14T11:23:36.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.474+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=XJT5A0U5V924 tag=0A83NTP3YHOY type=write size=4020977 2024-09-14T11:23:36.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.475+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~XNSG086QC8XV.0 size=1048576 2024-09-14T11:23:36.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.476+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~XNSG086QC8XV.1 size=1029091 2024-09-14T11:23:36.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.480+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=XNSG086QC8XV tag=ZTROVIY81BD2 type=write size=3126243 2024-09-14T11:23:36.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.482+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~GXV5AC22JIBQ.0 size=989216 2024-09-14T11:23:36.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.482+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=GXV5AC22JIBQ tag=2786ZXQAYMGE type=write size=2037792 2024-09-14T11:23:36.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.484+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~Z1Q44F3T41DY.0 size=1048576 2024-09-14T11:23:36.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.484+0000 7f296241c780 1 < canceled part key=_multipart_CQU8M12JCE9T.2~Z1Q44F3T41DY.1 size=119847 2024-09-14T11:23:36.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.486+0000 7f296241c780 1 < canceled multipart upload key=CQU8M12JCE9T upload=Z1Q44F3T41DY tag=XBDSVPGK9FII type=write size=2216999 2024-09-14T11:23:36.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.487+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=5F1QWV5BXMJG type=del size=263913 2024-09-14T11:23:36.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.488+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.0 size=1048576 2024-09-14T11:23:36.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.489+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.1 size=1048576 2024-09-14T11:23:36.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.490+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~3FQIP7HIXLNI.2 size=813597 2024-09-14T11:23:36.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.492+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=3FQIP7HIXLNI tag=Z2WIBM6JJY6V type=write size=3959325 2024-09-14T11:23:36.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.493+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=2FBWFDS2UPB2 type=del size=3057887 2024-09-14T11:23:36.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.494+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~N6LYDWUDRTIM.0 size=169109 2024-09-14T11:23:36.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.496+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=N6LYDWUDRTIM tag=FIXCIMX1SWOC type=write size=1217685 2024-09-14T11:23:36.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.497+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=CUN9MWJ49FYJ type=del size=3500499 2024-09-14T11:23:36.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.498+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~OJMMVL32TPE4.0 size=1048576 2024-09-14T11:23:36.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.499+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~OJMMVL32TPE4.1 size=121241 2024-09-14T11:23:36.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.501+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=OJMMVL32TPE4 tag=9XFO9R85Q0JZ type=write size=2218393 2024-09-14T11:23:36.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.502+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=GABTX0OI5XGF type=del size=739163 2024-09-14T11:23:36.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.505+0000 7f296241c780 1 < suggested update operation key=5N30QR6SN49T tag=7MMEKLMP2B6V type=del size=3673324 2024-09-14T11:23:36.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.506+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=2KFIQTZA1YHW type=write size=23063 2024-09-14T11:23:36.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.507+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~IU76UIF299M5.0 size=680214 2024-09-14T11:23:36.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.509+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=IU76UIF299M5 tag=WKLRMJR206CR type=write size=1728790 2024-09-14T11:23:36.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.511+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~31Q630GEH7R2.0 size=58232 2024-09-14T11:23:36.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.511+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=31Q630GEH7R2 tag=PK4UB5UCUKIS type=write size=1106808 2024-09-14T11:23:36.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.512+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=AAEGR5SH108Z type=write size=12412 2024-09-14T11:23:36.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.513+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=D0PW71HQQKBE type=del size=1542986 2024-09-14T11:23:36.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.514+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=P3HOOG1RSCOT type=del 2024-09-14T11:23:36.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.516+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~UKPLSLXDKL9D.0 size=902387 2024-09-14T11:23:36.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.516+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=UKPLSLXDKL9D tag=Y4JCJK3HUZTZ type=write size=1950963 2024-09-14T11:23:36.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.517+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~Y79NXYUPYJ7H.0 size=1048576 2024-09-14T11:23:36.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.519+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~Y79NXYUPYJ7H.1 size=102870 2024-09-14T11:23:36.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.521+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=Y79NXYUPYJ7H tag=5UDSZXGASXJG type=write size=2200022 2024-09-14T11:23:36.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.522+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=6UTSP99CT621 type=write size=682907 2024-09-14T11:23:36.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.524+0000 7f296241c780 1 < suggested update operation key=C1T4CLU3400T tag=5M7OYK8GYP7M type=del size=1550822 2024-09-14T11:23:36.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.526+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=XC3CZ54D0JGP type=del size=2632753 2024-09-14T11:23:36.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.528+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=15SE1YGZNS49 type=del size=4165609 2024-09-14T11:23:36.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.530+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~N3W2OW3VWU24.0 size=1048576 2024-09-14T11:23:36.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.531+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~N3W2OW3VWU24.1 size=637887 2024-09-14T11:23:36.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.531+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=N3W2OW3VWU24 tag=KBFAPTK9BFZF type=write size=2735039 2024-09-14T11:23:36.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.533+0000 7f296241c780 1 < suggested update operation key=L0GW4TPQCSUY tag=IG0LT1BVMUQG type=del size=2308649 2024-09-14T11:23:36.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.534+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=N1C0PLOPH5NY type=del size=3515352 2024-09-14T11:23:36.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.535+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=4A0SP2VDSCVZ type=del 2024-09-14T11:23:36.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.536+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=8T30ZS75KPTK type=del size=3331690 2024-09-14T11:23:36.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.537+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=WP8I6V2U1PMP type=del 2024-09-14T11:23:36.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.540+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=6KA5CEQWA17C type=del size=652202 2024-09-14T11:23:36.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.541+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.0 size=1048576 2024-09-14T11:23:36.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.542+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.1 size=1048576 2024-09-14T11:23:36.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.543+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~XJT5A0U5V924.2 size=875249 2024-09-14T11:23:36.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.546+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=XJT5A0U5V924 tag=0A83NTP3YHOY type=write size=4020977 2024-09-14T11:23:36.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.548+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~VK06SM3WTLGX.0 size=1048576 2024-09-14T11:23:36.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.549+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~VK06SM3WTLGX.1 size=196582 2024-09-14T11:23:36.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.549+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=VK06SM3WTLGX tag=Z9JLQ3M1CQH1 type=write size=2293734 2024-09-14T11:23:36.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.551+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~GXV5AC22JIBQ.0 size=989216 2024-09-14T11:23:36.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.552+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=GXV5AC22JIBQ tag=2786ZXQAYMGE type=write size=2037792 2024-09-14T11:23:36.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.554+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.0 size=1048576 2024-09-14T11:23:36.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.555+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.1 size=1048576 2024-09-14T11:23:36.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.556+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.2 size=150969 2024-09-14T11:23:36.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.556+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=UXTRPEAN49HH tag=NP1CAZENZA7S type=write size=3296697 2024-09-14T11:23:36.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.557+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=5F1QWV5BXMJG type=del 2024-09-14T11:23:36.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.559+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=PH59IWNB3VNR type=del size=3041634 2024-09-14T11:23:36.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.560+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=2FBWFDS2UPB2 type=del 2024-09-14T11:23:36.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.561+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=5BGMIN1KQPEX type=write size=589988 2024-09-14T11:23:36.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.562+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=CUN9MWJ49FYJ type=del 2024-09-14T11:23:36.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.565+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~67AGV0E1Z2N7.0 size=578135 2024-09-14T11:23:36.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.565+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=67AGV0E1Z2N7 tag=SK3AODBXX1GD type=write size=1626711 2024-09-14T11:23:36.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.566+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=GABTX0OI5XGF type=del 2024-09-14T11:23:36.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.567+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=RSHTWJQACV5O type=del size=1293618 2024-09-14T11:23:36.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.568+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=2KFIQTZA1YHW type=write size=23063 2024-09-14T11:23:36.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.569+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=Y4XH9D13P319 type=del size=1192531 2024-09-14T11:23:36.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.570+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~31Q630GEH7R2.0 size=58232 2024-09-14T11:23:36.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.572+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=31Q630GEH7R2 tag=PK4UB5UCUKIS type=write size=1106808 2024-09-14T11:23:36.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.573+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=8RGTNUUMC20Z type=del size=2575367 2024-09-14T11:23:36.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.574+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=D0PW71HQQKBE type=del 2024-09-14T11:23:36.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.576+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~QI72WMSZSPZ7.0 size=1048576 2024-09-14T11:23:36.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.577+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~QI72WMSZSPZ7.1 size=274906 2024-09-14T11:23:36.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.577+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=QI72WMSZSPZ7 tag=C76DV97PJKMV type=write size=2372058 2024-09-14T11:23:36.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.578+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~UKPLSLXDKL9D.0 size=902387 2024-09-14T11:23:36.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.580+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=UKPLSLXDKL9D tag=Y4JCJK3HUZTZ type=write size=1950963 2024-09-14T11:23:36.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.581+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=QGKC3LIUM4CQ type=del size=1434599 2024-09-14T11:23:36.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.582+0000 7f296241c780 1 < completed write operation key=R1M982MUIF44 tag=6UTSP99CT621 type=write size=682907 2024-09-14T11:23:36.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.585+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.0 size=1048576 2024-09-14T11:23:36.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.585+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.1 size=1048576 2024-09-14T11:23:36.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.586+0000 7f296241c780 1 > prepared part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.2 size=533043 2024-09-14T11:23:36.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.586+0000 7f296241c780 1 > prepared multipart upload key=HZD8WW0H4AAD upload=RP9UAHEJ3EJH tag=VTHW2P01LXWE type=write size=3678771 2024-09-14T11:23:36.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.587+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=XC3CZ54D0JGP type=del 2024-09-14T11:23:36.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.589+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=ALBF4N5V94C9 type=del size=2678518 2024-09-14T11:23:36.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.590+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~N3W2OW3VWU24.0 size=1048576 2024-09-14T11:23:36.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.591+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~N3W2OW3VWU24.1 size=637887 2024-09-14T11:23:36.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.592+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=N3W2OW3VWU24 tag=KBFAPTK9BFZF type=write size=2735039 2024-09-14T11:23:36.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.594+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=FTXA1LZO3EUP type=del size=360578 2024-09-14T11:23:36.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.595+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=N1C0PLOPH5NY type=del size=3515352 2024-09-14T11:23:36.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.597+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~9U604R2SVK1P.0 size=1048576 2024-09-14T11:23:36.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.599+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~9U604R2SVK1P.1 size=138077 2024-09-14T11:23:36.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.599+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=9U604R2SVK1P tag=OPOB9SLUWWUN type=write size=2235229 2024-09-14T11:23:36.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.601+0000 7f296241c780 1 < suggested remove operation key=K61XH5E6TF3Y tag=8T30ZS75KPTK type=del 2024-09-14T11:23:36.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.603+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.0 size=1048576 2024-09-14T11:23:36.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.604+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.1 size=1048576 2024-09-14T11:23:36.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.605+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.2 size=888476 2024-09-14T11:23:36.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.605+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=GKHBYYK3GHTE tag=1OG08HS4Y4E2 type=write size=4034204 2024-09-14T11:23:36.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.606+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=6KA5CEQWA17C type=del 2024-09-14T11:23:36.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.607+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=5V20YN247EU9 type=write size=710900 2024-09-14T11:23:36.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.607+0000 7f296241c780 1 < canceled part key=_multipart_ILOY74OSG5CQ.2~VK06SM3WTLGX.0 size=1048576 2024-09-14T11:23:36.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.608+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~VK06SM3WTLGX.1 size=196582 2024-09-14T11:23:36.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.611+0000 7f296241c780 1 < canceled multipart upload key=ILOY74OSG5CQ upload=VK06SM3WTLGX tag=Z9JLQ3M1CQH1 type=write size=2293734 2024-09-14T11:23:36.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.612+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=56U1Y61YSX30 type=del size=3834121 2024-09-14T11:23:36.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.613+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.0 size=1048576 2024-09-14T11:23:36.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.614+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.1 size=1048576 2024-09-14T11:23:36.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.615+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~UXTRPEAN49HH.2 size=150969 2024-09-14T11:23:36.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.617+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=UXTRPEAN49HH tag=NP1CAZENZA7S type=write size=3296697 2024-09-14T11:23:36.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.619+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~ERN3E8QBY24X.0 size=1048576 2024-09-14T11:23:36.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.620+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~ERN3E8QBY24X.1 size=102166 2024-09-14T11:23:36.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.620+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=ERN3E8QBY24X tag=0K98AE1J6K6P type=write size=2199318 2024-09-14T11:23:36.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.621+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=PH59IWNB3VNR type=del 2024-09-14T11:23:36.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.622+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=Y3CEG6NS2OKO type=del size=2875125 2024-09-14T11:23:36.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.623+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=5BGMIN1KQPEX type=write size=589988 2024-09-14T11:23:36.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.625+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=78HRM6NCJCKV type=del size=1261860 2024-09-14T11:23:36.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.626+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~67AGV0E1Z2N7.0 size=578135 2024-09-14T11:23:36.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.628+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=67AGV0E1Z2N7 tag=SK3AODBXX1GD type=write size=1626711 2024-09-14T11:23:36.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.629+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=DHPF6SLCJPKM type=del size=2568485 2024-09-14T11:23:36.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.630+0000 7f296241c780 1 < canceled operation key=XTS8B3LEW0Y3 tag=RSHTWJQACV5O type=del size=1293618 2024-09-14T11:23:36.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.631+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=4E11SJZPGT90 type=del size=3531707 2024-09-14T11:23:36.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.634+0000 7f296241c780 1 < suggested remove operation key=I6UYPPUMN0FB tag=Y4XH9D13P319 type=del 2024-09-14T11:23:36.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.635+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=TM7G3JK12AK1 type=del size=2811882 2024-09-14T11:23:36.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.636+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=8RGTNUUMC20Z type=del 2024-09-14T11:23:36.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.637+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=07XOOXSDKSCC type=del size=3955716 2024-09-14T11:23:36.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.638+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~QI72WMSZSPZ7.0 size=1048576 2024-09-14T11:23:36.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.639+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~QI72WMSZSPZ7.1 size=274906 2024-09-14T11:23:36.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.641+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=QI72WMSZSPZ7 tag=C76DV97PJKMV type=write size=2372058 2024-09-14T11:23:36.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.642+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=RWT6JUYGOSHT type=del size=1294873 2024-09-14T11:23:36.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.644+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=QGKC3LIUM4CQ type=del 2024-09-14T11:23:36.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.646+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~H9W3GLQLGUJC.0 size=1048576 2024-09-14T11:23:36.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.647+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~H9W3GLQLGUJC.1 size=74981 2024-09-14T11:23:36.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.647+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=H9W3GLQLGUJC tag=Q3H07556PDAV type=write size=2172133 2024-09-14T11:23:36.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.648+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.0 size=1048576 2024-09-14T11:23:36.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.649+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.1 size=1048576 2024-09-14T11:23:36.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.650+0000 7f296241c780 1 < completed part key=_multipart_HZD8WW0H4AAD.2~RP9UAHEJ3EJH.2 size=533043 2024-09-14T11:23:36.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.652+0000 7f296241c780 1 < completed multipart upload key=HZD8WW0H4AAD upload=RP9UAHEJ3EJH tag=VTHW2P01LXWE type=write size=3678771 2024-09-14T11:23:36.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.655+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.0 size=1048576 2024-09-14T11:23:36.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.656+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.1 size=1048576 2024-09-14T11:23:36.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.657+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.2 size=192059 2024-09-14T11:23:36.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.657+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=2KYMV0KVZX60 tag=OUNB7FPF5M20 type=write size=3337787 2024-09-14T11:23:36.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.658+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=ALBF4N5V94C9 type=del 2024-09-14T11:23:36.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.659+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=NIUUY5XU3QFK type=del size=4182663 2024-09-14T11:23:36.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.661+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=FTXA1LZO3EUP type=del 2024-09-14T11:23:36.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.663+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~VZGXOO1A3TTX.0 size=109604 2024-09-14T11:23:36.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.663+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=VZGXOO1A3TTX tag=QOM6RDPW34AD type=write size=1158180 2024-09-14T11:23:36.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.664+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~9U604R2SVK1P.0 size=1048576 2024-09-14T11:23:36.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.665+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~9U604R2SVK1P.1 size=138077 2024-09-14T11:23:36.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.667+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=9U604R2SVK1P tag=OPOB9SLUWWUN type=write size=2235229 2024-09-14T11:23:36.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.669+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~GTT5WKE0SH0C.0 size=797261 2024-09-14T11:23:36.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.669+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=GTT5WKE0SH0C tag=0QKITDK0XVXH type=write size=1845837 2024-09-14T11:23:36.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.669+0000 7f296241c780 1 < canceled part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.0 size=1048576 2024-09-14T11:23:36.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.670+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.1 size=1048576 2024-09-14T11:23:36.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.671+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~GKHBYYK3GHTE.2 size=888476 2024-09-14T11:23:36.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.673+0000 7f296241c780 1 < canceled multipart upload key=GJ2Y7ICBEZJX upload=GKHBYYK3GHTE tag=1OG08HS4Y4E2 type=write size=4034204 2024-09-14T11:23:36.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.674+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=3EGX0GYFEEUD type=del size=1349520 2024-09-14T11:23:36.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.676+0000 7f296241c780 1 < canceled operation key=5XAAGDKVBZ0P tag=5V20YN247EU9 type=write size=710900 2024-09-14T11:23:36.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.677+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=3E8YO090WM3G type=del size=1187726 2024-09-14T11:23:36.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.678+0000 7f296241c780 1 < canceled operation key=QIVVKYC646IH tag=56U1Y61YSX30 type=del size=3834121 2024-09-14T11:23:36.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.679+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=V3CKKH3W34TD type=del size=1659788 2024-09-14T11:23:36.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.681+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~ERN3E8QBY24X.0 size=1048576 2024-09-14T11:23:36.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.682+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~ERN3E8QBY24X.1 size=102166 2024-09-14T11:23:36.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.684+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=ERN3E8QBY24X tag=0K98AE1J6K6P type=write size=2199318 2024-09-14T11:23:36.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.686+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~TC6X1TU4VTSG.0 size=726679 2024-09-14T11:23:36.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.686+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=TC6X1TU4VTSG tag=PXTQREKX1D04 type=write size=1775255 2024-09-14T11:23:36.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.687+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=Y3CEG6NS2OKO type=del 2024-09-14T11:23:36.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.688+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=GWBN3BUSAN8Z type=write size=114275 2024-09-14T11:23:36.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.689+0000 7f296241c780 1 < canceled operation key=L8NA53KOAT58 tag=78HRM6NCJCKV type=del size=1261860 2024-09-14T11:23:36.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.691+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FQ191CF8XRYV type=del size=3756377 2024-09-14T11:23:36.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.692+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=DHPF6SLCJPKM type=del 2024-09-14T11:23:36.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.693+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=JXZ2JQ0H3ARI type=write size=890229 2024-09-14T11:23:36.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.696+0000 7f296241c780 1 < suggested remove operation key=TNT7E4GX5ZR7 tag=4E11SJZPGT90 type=del 2024-09-14T11:23:36.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.697+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=99D4BZVEJENY type=del size=242470 2024-09-14T11:23:36.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.698+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=TM7G3JK12AK1 type=del 2024-09-14T11:23:36.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.700+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=NURQIUU19NUH type=del size=3122541 2024-09-14T11:23:36.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.701+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=07XOOXSDKSCC type=del 2024-09-14T11:23:36.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.702+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=ZP8FGDBNCFTR type=del size=370612 2024-09-14T11:23:36.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.705+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=RWT6JUYGOSHT type=del size=1294873 2024-09-14T11:23:36.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.706+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=VHMDLGT7KJBG type=write size=599864 2024-09-14T11:23:36.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.706+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~H9W3GLQLGUJC.0 size=1048576 2024-09-14T11:23:36.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.707+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~H9W3GLQLGUJC.1 size=74981 2024-09-14T11:23:36.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.709+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=H9W3GLQLGUJC tag=Q3H07556PDAV type=write size=2172133 2024-09-14T11:23:36.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.711+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~4Z3E1O0D5UXL.0 size=1048576 2024-09-14T11:23:36.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.712+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~4Z3E1O0D5UXL.1 size=407302 2024-09-14T11:23:36.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.712+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=4Z3E1O0D5UXL tag=IOADTPU3C41Y type=write size=2504454 2024-09-14T11:23:36.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.714+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.0 size=1048576 2024-09-14T11:23:36.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.715+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.1 size=1048576 2024-09-14T11:23:36.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.715+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~2KYMV0KVZX60.2 size=192059 2024-09-14T11:23:36.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.716+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=2KYMV0KVZX60 tag=OUNB7FPF5M20 type=write size=3337787 2024-09-14T11:23:36.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.718+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=OGZ1CKWT7590 type=del size=3203487 2024-09-14T11:23:36.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.719+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=NIUUY5XU3QFK type=del 2024-09-14T11:23:36.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.720+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=9O26MJWRCB2R type=del size=3755775 2024-09-14T11:23:36.719 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.721+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~VZGXOO1A3TTX.0 size=109604 2024-09-14T11:23:36.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.723+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=VZGXOO1A3TTX tag=QOM6RDPW34AD type=write size=1158180 2024-09-14T11:23:36.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.725+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~CSQPJLAIFAPU.0 size=386235 2024-09-14T11:23:36.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.725+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=CSQPJLAIFAPU tag=A0KP6AQ6S4IO type=write size=1434811 2024-09-14T11:23:36.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.726+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~GTT5WKE0SH0C.0 size=797261 2024-09-14T11:23:36.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.728+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=GTT5WKE0SH0C tag=0QKITDK0XVXH type=write size=1845837 2024-09-14T11:23:36.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.730+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~V36OU6ILN961.0 size=1048576 2024-09-14T11:23:36.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.731+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~V36OU6ILN961.1 size=528457 2024-09-14T11:23:36.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.731+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=V36OU6ILN961 tag=J5B12W7KRSOS type=write size=2625609 2024-09-14T11:23:36.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.732+0000 7f296241c780 -1 < failed to complete operation key=JH1QJE5V4M9H tag=3EGX0GYFEEUD type=del size=1349520: (22) Invalid argument 2024-09-14T11:23:36.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.734+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.0 size=1048576 2024-09-14T11:23:36.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.735+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.1 size=1048576 2024-09-14T11:23:36.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.736+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.2 size=729774 2024-09-14T11:23:36.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.736+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=UDS80A3OTQ7E tag=CW07U37J5S8W type=write size=3875502 2024-09-14T11:23:36.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.740+0000 7f296241c780 1 < suggested update operation key=JW3RIVHUFGPI tag=3E8YO090WM3G type=del size=1187726 2024-09-14T11:23:36.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.741+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=CNTCXYYHX71D type=write size=443112 2024-09-14T11:23:36.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.743+0000 7f296241c780 1 < suggested update operation key=K61XH5E6TF3Y tag=V3CKKH3W34TD type=del size=1659788 2024-09-14T11:23:36.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.744+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=JC86QH2QB2PJ type=del size=3740097 2024-09-14T11:23:36.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.745+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~TC6X1TU4VTSG.0 size=726679 2024-09-14T11:23:36.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.747+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=TC6X1TU4VTSG tag=PXTQREKX1D04 type=write size=1775255 2024-09-14T11:23:36.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.749+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~BTFP8A4ODZZJ.0 size=142287 2024-09-14T11:23:36.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.749+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=BTFP8A4ODZZJ tag=ZARWCXW2ZGKY type=write size=1190863 2024-09-14T11:23:36.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.750+0000 7f296241c780 1 < completed write operation key=6DNKZWENMDM9 tag=GWBN3BUSAN8Z type=write size=114275 2024-09-14T11:23:36.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.752+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=HCPYJ72UPLS2 type=write size=882325 2024-09-14T11:23:36.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.753+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=FQ191CF8XRYV type=del 2024-09-14T11:23:36.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.754+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=LBDJEB1PTHKK type=write size=457094 2024-09-14T11:23:36.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.755+0000 7f296241c780 1 < canceled operation key=O35OFLNOZ488 tag=JXZ2JQ0H3ARI type=write size=890229 2024-09-14T11:23:36.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.756+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=F3K8M11G4C9V type=del size=4042163 2024-09-14T11:23:36.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.757+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=99D4BZVEJENY type=del 2024-09-14T11:23:36.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.761+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~7IB4WWB3SWUU.0 size=1048576 2024-09-14T11:23:36.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.761+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~7IB4WWB3SWUU.1 size=337602 2024-09-14T11:23:36.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.761+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=7IB4WWB3SWUU tag=8RRLYQ7ED4S3 type=write size=2434754 2024-09-14T11:23:36.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.764+0000 7f296241c780 1 < suggested remove operation key=QL439L2X13OR tag=NURQIUU19NUH type=del 2024-09-14T11:23:36.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.765+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=HY32KWYUZLDT type=del size=3770685 2024-09-14T11:23:36.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.766+0000 7f296241c780 1 < canceled operation key=LK9LRQM3TZRR tag=ZP8FGDBNCFTR type=del size=370612 2024-09-14T11:23:36.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.769+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~D9ECXZW77B2E.0 size=991844 2024-09-14T11:23:36.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.769+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=D9ECXZW77B2E tag=6J1CZSEGH7Z2 type=write size=2040420 2024-09-14T11:23:36.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.772+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=VHMDLGT7KJBG type=write size=599864 2024-09-14T11:23:36.772 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.774+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.0 size=1048576 2024-09-14T11:23:36.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.775+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.1 size=1048576 2024-09-14T11:23:36.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.776+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.2 size=474865 2024-09-14T11:23:36.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.776+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=PTZYL71B20HS tag=CUX3998SUQ6G type=write size=3620593 2024-09-14T11:23:36.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.777+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~4Z3E1O0D5UXL.0 size=1048576 2024-09-14T11:23:36.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.778+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~4Z3E1O0D5UXL.1 size=407302 2024-09-14T11:23:36.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.780+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=4Z3E1O0D5UXL tag=IOADTPU3C41Y type=write size=2504454 2024-09-14T11:23:36.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.781+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=PWDW83J1URG9 type=del size=3499280 2024-09-14T11:23:36.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.783+0000 7f296241c780 -1 < failed to complete operation key=K61XH5E6TF3Y tag=OGZ1CKWT7590 type=del size=3203487: (22) Invalid argument 2024-09-14T11:23:36.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.784+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=Q3V2ZGZ6H4KR type=del size=1347287 2024-09-14T11:23:36.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.786+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=9O26MJWRCB2R type=del size=3755775 2024-09-14T11:23:36.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.787+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=1XQ93D6DRS7R type=del size=3641842 2024-09-14T11:23:36.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.788+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~CSQPJLAIFAPU.0 size=386235 2024-09-14T11:23:36.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.790+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=CSQPJLAIFAPU tag=A0KP6AQ6S4IO type=write size=1434811 2024-09-14T11:23:36.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.791+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=V4P5GDPA25C4 type=del size=2775199 2024-09-14T11:23:36.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.792+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~V36OU6ILN961.0 size=1048576 2024-09-14T11:23:36.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.792+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~V36OU6ILN961.1 size=528457 2024-09-14T11:23:36.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.794+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=V36OU6ILN961 tag=J5B12W7KRSOS type=write size=2625609 2024-09-14T11:23:36.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.795+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=71CM3V24UJBI type=del size=1829603 2024-09-14T11:23:36.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.796+0000 7f296241c780 1 < canceled part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.0 size=1048576 2024-09-14T11:23:36.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.797+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.1 size=1048576 2024-09-14T11:23:36.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.798+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~UDS80A3OTQ7E.2 size=729774 2024-09-14T11:23:36.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.799+0000 7f296241c780 1 < canceled multipart upload key=FGK7YH1GB4W5 upload=UDS80A3OTQ7E tag=CW07U37J5S8W type=write size=3875502 2024-09-14T11:23:36.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.801+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=5WLEH61ZMVKL type=del size=2428791 2024-09-14T11:23:36.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.802+0000 7f296241c780 1 < completed write operation key=ILOY74OSG5CQ tag=CNTCXYYHX71D type=write size=443112 2024-09-14T11:23:36.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.804+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.0 size=1048576 2024-09-14T11:23:36.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.805+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.1 size=1048576 2024-09-14T11:23:36.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.806+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.2 size=65838 2024-09-14T11:23:36.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.806+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=UWXD9TKF1FDK tag=LJS94XVM4Z3W type=write size=3211566 2024-09-14T11:23:36.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.807+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=JC86QH2QB2PJ type=del 2024-09-14T11:23:36.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.808+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=YWNYITA8FUOT type=del size=2244861 2024-09-14T11:23:36.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.809+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~BTFP8A4ODZZJ.0 size=142287 2024-09-14T11:23:36.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.811+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=BTFP8A4ODZZJ tag=ZARWCXW2ZGKY type=write size=1190863 2024-09-14T11:23:36.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.813+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=CUY9T7SH0Y2Q type=del size=1004996 2024-09-14T11:23:36.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.815+0000 7f296241c780 1 < suggested remove operation key=L8NA53KOAT58 tag=HCPYJ72UPLS2 type=write 2024-09-14T11:23:36.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.816+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=OEMM75TNDZDF type=del size=1246693 2024-09-14T11:23:36.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.817+0000 7f296241c780 -1 < failed to complete operation key=TNT7E4GX5ZR7 tag=LBDJEB1PTHKK type=write size=457094: (22) Invalid argument 2024-09-14T11:23:36.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.819+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~LQ3N8QOB3MRN.0 size=1048576 2024-09-14T11:23:36.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.820+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~LQ3N8QOB3MRN.1 size=389215 2024-09-14T11:23:36.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.820+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=LQ3N8QOB3MRN tag=0BXV25983XCP type=write size=2486367 2024-09-14T11:23:36.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.821+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=F3K8M11G4C9V type=del 2024-09-14T11:23:36.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.823+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.0 size=1048576 2024-09-14T11:23:36.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.824+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.1 size=1048576 2024-09-14T11:23:36.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.825+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.2 size=439067 2024-09-14T11:23:36.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.825+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=1S35CND6W5ZM tag=LTTOKKAVBY0M type=write size=3584795 2024-09-14T11:23:36.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.826+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~7IB4WWB3SWUU.0 size=1048576 2024-09-14T11:23:36.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.827+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~7IB4WWB3SWUU.1 size=337602 2024-09-14T11:23:36.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.829+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=7IB4WWB3SWUU tag=8RRLYQ7ED4S3 type=write size=2434754 2024-09-14T11:23:36.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.830+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=2VE76Z0QOIFQ type=del size=4152736 2024-09-14T11:23:36.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.831+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=HY32KWYUZLDT type=del 2024-09-14T11:23:36.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.833+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=F0PZONRGGAFU type=del size=3336021 2024-09-14T11:23:36.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.834+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~D9ECXZW77B2E.0 size=991844 2024-09-14T11:23:36.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.836+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=D9ECXZW77B2E tag=6J1CZSEGH7Z2 type=write size=2040420 2024-09-14T11:23:36.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.838+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.0 size=1048576 2024-09-14T11:23:36.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.839+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.1 size=1048576 2024-09-14T11:23:36.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.840+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.2 size=908155 2024-09-14T11:23:36.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.840+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=I96UIMHGCDKR tag=64W7FMXY70HY type=write size=4053883 2024-09-14T11:23:36.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.841+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.0 size=1048576 2024-09-14T11:23:36.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.842+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.1 size=1048576 2024-09-14T11:23:36.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.843+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~PTZYL71B20HS.2 size=474865 2024-09-14T11:23:36.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.845+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=PTZYL71B20HS tag=CUX3998SUQ6G type=write size=3620593 2024-09-14T11:23:36.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.846+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=PKCGTJ7M3ZYU type=write size=797943 2024-09-14T11:23:36.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.848+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=PWDW83J1URG9 type=del size=3499280 2024-09-14T11:23:36.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.849+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=Y6N8EGQ17O9J type=del size=573435 2024-09-14T11:23:36.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.850+0000 7f296241c780 1 < completed delete operation key=FGK7YH1GB4W5 tag=Q3V2ZGZ6H4KR type=del 2024-09-14T11:23:36.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.851+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=36RIY6NY2N69 type=del size=1785822 2024-09-14T11:23:36.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.853+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=1XQ93D6DRS7R type=del 2024-09-14T11:23:36.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.854+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=PA2BIHM9BMY3 type=del size=3421717 2024-09-14T11:23:36.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.855+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=V4P5GDPA25C4 type=del 2024-09-14T11:23:36.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.858+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~U3K990C4V1AO.0 size=739340 2024-09-14T11:23:36.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.858+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=U3K990C4V1AO tag=ODGHJ12A2AQA type=write size=1787916 2024-09-14T11:23:36.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.859+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=71CM3V24UJBI type=del 2024-09-14T11:23:36.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.860+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=XJUQXCCIE43L type=del size=142029 2024-09-14T11:23:36.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.861+0000 7f296241c780 1 < canceled operation key=HFH3VKZ4T0IR tag=5WLEH61ZMVKL type=del size=2428791 2024-09-14T11:23:36.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.863+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.0 size=1048576 2024-09-14T11:23:36.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.864+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.1 size=1048576 2024-09-14T11:23:36.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.865+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.2 size=549858 2024-09-14T11:23:36.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.865+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=GS3FO858TII0 tag=2Q7WAAOVWHP8 type=write size=3695586 2024-09-14T11:23:36.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.867+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.0 size=1048576 2024-09-14T11:23:36.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.868+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.1 size=1048576 2024-09-14T11:23:36.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.869+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~UWXD9TKF1FDK.2 size=65838 2024-09-14T11:23:36.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.871+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=UWXD9TKF1FDK tag=LJS94XVM4Z3W type=write size=3211566 2024-09-14T11:23:36.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.872+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=N6SV0FLGCZYM type=del size=2121678 2024-09-14T11:23:36.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.874+0000 7f296241c780 1 < suggested update operation key=HZD8WW0H4AAD tag=YWNYITA8FUOT type=del size=2244861 2024-09-14T11:23:36.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.875+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=O67ZFK8GM139 type=del size=2067082 2024-09-14T11:23:36.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.877+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=CUY9T7SH0Y2Q type=del 2024-09-14T11:23:36.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.880+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~9FEI7IX3MGTF.0 size=428592 2024-09-14T11:23:36.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.880+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=9FEI7IX3MGTF tag=OZ897I0E67X7 type=write size=1477168 2024-09-14T11:23:36.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.881+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=OEMM75TNDZDF type=del 2024-09-14T11:23:36.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.884+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.0 size=1048576 2024-09-14T11:23:36.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.885+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.1 size=1048576 2024-09-14T11:23:36.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.886+0000 7f296241c780 1 > prepared part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.2 size=322837 2024-09-14T11:23:36.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.886+0000 7f296241c780 1 > prepared multipart upload key=KBMD123LTZA7 upload=LUSFYV6F7JAA tag=LWC0WEYOQRWL type=write size=3468565 2024-09-14T11:23:36.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.887+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~LQ3N8QOB3MRN.0 size=1048576 2024-09-14T11:23:36.886 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.888+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~LQ3N8QOB3MRN.1 size=389215 2024-09-14T11:23:36.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.890+0000 7f296241c780 1 < completed multipart upload key=I1XBOS1L5D98 upload=LQ3N8QOB3MRN tag=0BXV25983XCP type=write size=2486367 2024-09-14T11:23:36.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.891+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=FYSV8QRW7T4D type=write size=290892 2024-09-14T11:23:36.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.892+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.0 size=1048576 2024-09-14T11:23:36.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.893+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.1 size=1048576 2024-09-14T11:23:36.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.894+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~1S35CND6W5ZM.2 size=439067 2024-09-14T11:23:36.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.896+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=1S35CND6W5ZM tag=LTTOKKAVBY0M type=write size=3584795 2024-09-14T11:23:36.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.898+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.0 size=1048576 2024-09-14T11:23:36.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.899+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.1 size=1048576 2024-09-14T11:23:36.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.900+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.2 size=354217 2024-09-14T11:23:36.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.900+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=PWDOBRCOGDQK tag=APTX12NP2WZQ type=write size=3499945 2024-09-14T11:23:36.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.903+0000 7f296241c780 1 < suggested remove operation key=QIVVKYC646IH tag=2VE76Z0QOIFQ type=del 2024-09-14T11:23:36.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.905+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~UW5A9O8A1NBO.0 size=830828 2024-09-14T11:23:36.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.905+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=UW5A9O8A1NBO tag=JZ9MNWYTW9E4 type=write size=1879404 2024-09-14T11:23:36.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.908+0000 7f296241c780 1 < suggested remove operation key=6DNKZWENMDM9 tag=F0PZONRGGAFU type=del 2024-09-14T11:23:36.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.910+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.0 size=1048576 2024-09-14T11:23:36.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.911+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.1 size=1048576 2024-09-14T11:23:36.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.912+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.2 size=781847 2024-09-14T11:23:36.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.912+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=SUS2FVAAZTV6 tag=5EKC87MRZQH6 type=write size=3927575 2024-09-14T11:23:36.911 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.913+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.0 size=1048576 2024-09-14T11:23:36.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.914+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.1 size=1048576 2024-09-14T11:23:36.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.915+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~I96UIMHGCDKR.2 size=908155 2024-09-14T11:23:36.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.917+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=I96UIMHGCDKR tag=64W7FMXY70HY type=write size=4053883 2024-09-14T11:23:36.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.919+0000 7f296241c780 1 > prepared part key=_multipart_3T0SINQVBAGF.2~3BX6AANRH3ZC.0 size=171111 2024-09-14T11:23:36.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.919+0000 7f296241c780 1 > prepared multipart upload key=3T0SINQVBAGF upload=3BX6AANRH3ZC tag=AL0QN2RBCGXA type=write size=1219687 2024-09-14T11:23:36.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.920+0000 7f296241c780 1 < completed write operation key=L8NA53KOAT58 tag=PKCGTJ7M3ZYU type=write size=797943 2024-09-14T11:23:36.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.922+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~CMI1P93K61RH.0 size=645940 2024-09-14T11:23:36.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.922+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=CMI1P93K61RH tag=3AZDXGD7U26K type=write size=1694516 2024-09-14T11:23:36.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.923+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=Y6N8EGQ17O9J type=del 2024-09-14T11:23:36.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.924+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=Q9D3F01BLL9T type=del size=1283431 2024-09-14T11:23:36.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.925+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=36RIY6NY2N69 type=del 2024-09-14T11:23:36.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.926+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=M3220JE6OK4A type=del size=3821739 2024-09-14T11:23:36.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.928+0000 7f296241c780 1 < suggested update operation key=TNT7E4GX5ZR7 tag=PA2BIHM9BMY3 type=del size=3421717 2024-09-14T11:23:36.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.930+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.0 size=1048576 2024-09-14T11:23:36.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.931+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.1 size=1048576 2024-09-14T11:23:36.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.932+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.2 size=236798 2024-09-14T11:23:36.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.932+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=KE8COAJOZLT8 tag=UEMZRL2K17EC type=write size=3382526 2024-09-14T11:23:36.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.933+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~U3K990C4V1AO.0 size=739340 2024-09-14T11:23:36.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.935+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=U3K990C4V1AO tag=ODGHJ12A2AQA type=write size=1787916 2024-09-14T11:23:36.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.937+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.0 size=1048576 2024-09-14T11:23:36.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.937+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.1 size=1048576 2024-09-14T11:23:36.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.938+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.2 size=623408 2024-09-14T11:23:36.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.938+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=24QYA4LHECHW tag=JLYSIXQGNZ96 type=write size=3769136 2024-09-14T11:23:36.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.940+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=XJUQXCCIE43L type=del 2024-09-14T11:23:36.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.942+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~WU56MK5YKSX0.0 size=1048576 2024-09-14T11:23:36.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.943+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~WU56MK5YKSX0.1 size=606191 2024-09-14T11:23:36.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.943+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=WU56MK5YKSX0 tag=0VW0048OL351 type=write size=2703343 2024-09-14T11:23:36.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.944+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.0 size=1048576 2024-09-14T11:23:36.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.945+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.1 size=1048576 2024-09-14T11:23:36.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.946+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~GS3FO858TII0.2 size=549858 2024-09-14T11:23:36.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.947+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=GS3FO858TII0 tag=2Q7WAAOVWHP8 type=write size=3695586 2024-09-14T11:23:36.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.950+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~17JZ8C4MJ1T8.0 size=1048576 2024-09-14T11:23:36.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.950+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~17JZ8C4MJ1T8.1 size=1037633 2024-09-14T11:23:36.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.950+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=17JZ8C4MJ1T8 tag=E2TH6GEW0BUH type=write size=3134785 2024-09-14T11:23:36.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.952+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=N6SV0FLGCZYM type=del 2024-09-14T11:23:36.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.956+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.0 size=1048576 2024-09-14T11:23:36.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.957+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.1 size=1048576 2024-09-14T11:23:36.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.957+0000 7f296241c780 1 > prepared part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.2 size=644403 2024-09-14T11:23:36.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.957+0000 7f296241c780 1 > prepared multipart upload key=CQU8M12JCE9T upload=1VZROALF8L94 tag=OCQL6VB83TBR type=write size=3790131 2024-09-14T11:23:36.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.959+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=O67ZFK8GM139 type=del 2024-09-14T11:23:36.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.960+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=EMTEVSE1KBW7 type=del size=3177705 2024-09-14T11:23:36.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.961+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~9FEI7IX3MGTF.0 size=428592 2024-09-14T11:23:36.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.963+0000 7f296241c780 1 < completed multipart upload key=QL439L2X13OR upload=9FEI7IX3MGTF tag=OZ897I0E67X7 type=write size=1477168 2024-09-14T11:23:36.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.964+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=CFS1NI1BFQDA type=del size=2597268 2024-09-14T11:23:36.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.965+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.0 size=1048576 2024-09-14T11:23:36.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.966+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.1 size=1048576 2024-09-14T11:23:36.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.967+0000 7f296241c780 1 < completed part key=_multipart_KBMD123LTZA7.2~LUSFYV6F7JAA.2 size=322837 2024-09-14T11:23:36.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.969+0000 7f296241c780 1 < completed multipart upload key=KBMD123LTZA7 upload=LUSFYV6F7JAA tag=LWC0WEYOQRWL type=write size=3468565 2024-09-14T11:23:36.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.971+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.0 size=1048576 2024-09-14T11:23:36.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.972+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.1 size=1048576 2024-09-14T11:23:36.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.973+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.2 size=565167 2024-09-14T11:23:36.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.973+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=6YU81ML7VC8N tag=AHBV2A4RRVZE type=write size=3710895 2024-09-14T11:23:36.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.975+0000 7f296241c780 1 < completed write operation key=QL439L2X13OR tag=FYSV8QRW7T4D type=write size=290892 2024-09-14T11:23:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.976+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=4PUM7EVUGED3 type=del size=3685668 2024-09-14T11:23:36.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.978+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.0 size=1048576 2024-09-14T11:23:36.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.978+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.1 size=1048576 2024-09-14T11:23:36.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.979+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~PWDOBRCOGDQK.2 size=354217 2024-09-14T11:23:36.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.981+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=PWDOBRCOGDQK tag=APTX12NP2WZQ type=write size=3499945 2024-09-14T11:23:36.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.982+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=AZBK22RAQ07E type=del size=2748858 2024-09-14T11:23:36.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.984+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~UW5A9O8A1NBO.0 size=830828 2024-09-14T11:23:36.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.987+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=UW5A9O8A1NBO tag=JZ9MNWYTW9E4 type=write size=1879404 2024-09-14T11:23:36.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.989+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~M2FRALJZ09K0.0 size=1048576 2024-09-14T11:23:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.990+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~M2FRALJZ09K0.1 size=328533 2024-09-14T11:23:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.990+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=M2FRALJZ09K0 tag=VX3OAG8DHZ3D type=write size=2425685 2024-09-14T11:23:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.991+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.0 size=1048576 2024-09-14T11:23:36.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.992+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.1 size=1048576 2024-09-14T11:23:36.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.993+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~SUS2FVAAZTV6.2 size=781847 2024-09-14T11:23:36.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.995+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=SUS2FVAAZTV6 tag=5EKC87MRZQH6 type=write size=3927575 2024-09-14T11:23:36.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.996+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=NKGCXNIFAD4A type=write size=232075 2024-09-14T11:23:36.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.997+0000 7f296241c780 1 < completed part key=_multipart_3T0SINQVBAGF.2~3BX6AANRH3ZC.0 size=171111 2024-09-14T11:23:36.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:36.999+0000 7f296241c780 1 < completed multipart upload key=3T0SINQVBAGF upload=3BX6AANRH3ZC tag=AL0QN2RBCGXA type=write size=1219687 2024-09-14T11:23:36.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.000+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=N8YPF8DEW03Y type=del size=328820 2024-09-14T11:23:36.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.001+0000 7f296241c780 1 < canceled part key=_multipart_5XAAGDKVBZ0P.2~CMI1P93K61RH.0 size=645940 2024-09-14T11:23:37.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.003+0000 7f296241c780 1 < canceled multipart upload key=5XAAGDKVBZ0P upload=CMI1P93K61RH tag=3AZDXGD7U26K type=write size=1694516 2024-09-14T11:23:37.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.004+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=5ATIST0DTYS0 type=del size=1238331 2024-09-14T11:23:37.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.005+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=Q9D3F01BLL9T type=del 2024-09-14T11:23:37.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.006+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=JFTKYLWSKUX5 type=del size=2938028 2024-09-14T11:23:37.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.008+0000 7f296241c780 -1 < failed to complete operation key=TNT7E4GX5ZR7 tag=M3220JE6OK4A type=del size=3821739: (22) Invalid argument 2024-09-14T11:23:37.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.010+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~8OCLYGJ8SBJI.0 size=266298 2024-09-14T11:23:37.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.010+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=8OCLYGJ8SBJI tag=DJTS3HUDDQD8 type=write size=1314874 2024-09-14T11:23:37.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.011+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.0 size=1048576 2024-09-14T11:23:37.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.012+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.1 size=1048576 2024-09-14T11:23:37.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.013+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~KE8COAJOZLT8.2 size=236798 2024-09-14T11:23:37.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.015+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=KE8COAJOZLT8 tag=UEMZRL2K17EC type=write size=3382526 2024-09-14T11:23:37.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.016+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=8VAUNXMRQ0DB type=del size=4114295 2024-09-14T11:23:37.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.017+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.0 size=1048576 2024-09-14T11:23:37.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.018+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.1 size=1048576 2024-09-14T11:23:37.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.019+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~24QYA4LHECHW.2 size=623408 2024-09-14T11:23:37.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.021+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=24QYA4LHECHW tag=JLYSIXQGNZ96 type=write size=3769136 2024-09-14T11:23:37.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.023+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~MARZSOIM64SA.0 size=537508 2024-09-14T11:23:37.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.023+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=MARZSOIM64SA tag=0MN3NUZFSMHE type=write size=1586084 2024-09-14T11:23:37.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.024+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~WU56MK5YKSX0.0 size=1048576 2024-09-14T11:23:37.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.025+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~WU56MK5YKSX0.1 size=606191 2024-09-14T11:23:37.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.027+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=WU56MK5YKSX0 tag=0VW0048OL351 type=write size=2703343 2024-09-14T11:23:37.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.029+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~9VLZCU8PQE2Y.0 size=858440 2024-09-14T11:23:37.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.029+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=9VLZCU8PQE2Y tag=U8K71XQ6BTOT type=write size=1907016 2024-09-14T11:23:37.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.030+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~17JZ8C4MJ1T8.0 size=1048576 2024-09-14T11:23:37.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.031+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~17JZ8C4MJ1T8.1 size=1037633 2024-09-14T11:23:37.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.033+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=17JZ8C4MJ1T8 tag=E2TH6GEW0BUH type=write size=3134785 2024-09-14T11:23:37.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.034+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=F8SAMSX3C1UZ type=del size=2331103 2024-09-14T11:23:37.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.035+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.0 size=1048576 2024-09-14T11:23:37.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.036+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.1 size=1048576 2024-09-14T11:23:37.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.037+0000 7f296241c780 1 < completed part key=_multipart_CQU8M12JCE9T.2~1VZROALF8L94.2 size=644403 2024-09-14T11:23:37.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.039+0000 7f296241c780 1 < completed multipart upload key=CQU8M12JCE9T upload=1VZROALF8L94 tag=OCQL6VB83TBR type=write size=3790131 2024-09-14T11:23:37.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.041+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~PIXYKRFQMYRO.0 size=1048576 2024-09-14T11:23:37.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.042+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~PIXYKRFQMYRO.1 size=135168 2024-09-14T11:23:37.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.042+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=PIXYKRFQMYRO tag=L5ANY50CX10W type=write size=2232320 2024-09-14T11:23:37.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.043+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=EMTEVSE1KBW7 type=del 2024-09-14T11:23:37.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.044+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=98M6YMFRD6OS type=del size=3972255 2024-09-14T11:23:37.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.046+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=CFS1NI1BFQDA type=del size=2597268 2024-09-14T11:23:37.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.047+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=IZZPQ8CZM6BC type=del size=4098050 2024-09-14T11:23:37.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.048+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.0 size=1048576 2024-09-14T11:23:37.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.048+0000 7f296241c780 1 < canceled part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.1 size=1048576 2024-09-14T11:23:37.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.049+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~6YU81ML7VC8N.2 size=565167 2024-09-14T11:23:37.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.051+0000 7f296241c780 1 < canceled multipart upload key=XTS8B3LEW0Y3 upload=6YU81ML7VC8N tag=AHBV2A4RRVZE type=write size=3710895 2024-09-14T11:23:37.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.053+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~WLR330UVO5X1.0 size=1048576 2024-09-14T11:23:37.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.054+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~WLR330UVO5X1.1 size=767889 2024-09-14T11:23:37.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.054+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=WLR330UVO5X1 tag=HT8K6VZA7G27 type=write size=2865041 2024-09-14T11:23:37.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.055+0000 7f296241c780 1 < canceled operation key=K61XH5E6TF3Y tag=4PUM7EVUGED3 type=del size=3685668 2024-09-14T11:23:37.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.057+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~KMF9CSRGT56A.0 size=1048576 2024-09-14T11:23:37.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.057+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~KMF9CSRGT56A.1 size=75272 2024-09-14T11:23:37.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.057+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=KMF9CSRGT56A tag=A8O0N4SY0S9U type=write size=2172424 2024-09-14T11:23:37.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.060+0000 7f296241c780 1 < suggested update operation key=LK9LRQM3TZRR tag=AZBK22RAQ07E type=del size=2748858 2024-09-14T11:23:37.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.061+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=DGO52ZRN87XF type=del size=709182 2024-09-14T11:23:37.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.062+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~M2FRALJZ09K0.0 size=1048576 2024-09-14T11:23:37.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.063+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~M2FRALJZ09K0.1 size=328533 2024-09-14T11:23:37.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.065+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=M2FRALJZ09K0 tag=VX3OAG8DHZ3D type=write size=2425685 2024-09-14T11:23:37.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.067+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~A4FWVBB3YVG7.0 size=1048576 2024-09-14T11:23:37.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.068+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~A4FWVBB3YVG7.1 size=401982 2024-09-14T11:23:37.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.068+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=A4FWVBB3YVG7 tag=H675RUOF6D5H type=write size=2499134 2024-09-14T11:23:37.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.069+0000 7f296241c780 1 < completed write operation key=R1M982MUIF44 tag=NKGCXNIFAD4A type=write size=232075 2024-09-14T11:23:37.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.071+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.0 size=1048576 2024-09-14T11:23:37.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.072+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.1 size=1048576 2024-09-14T11:23:37.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.073+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.2 size=293683 2024-09-14T11:23:37.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.073+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=TKHSNZF5OKP1 tag=D5K9WP3UJMX6 type=write size=3439411 2024-09-14T11:23:37.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.075+0000 7f296241c780 1 < suggested update operation key=I1XBOS1L5D98 tag=N8YPF8DEW03Y type=del size=328820 2024-09-14T11:23:37.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.077+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.0 size=1048576 2024-09-14T11:23:37.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.078+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.1 size=1048576 2024-09-14T11:23:37.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.079+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.2 size=1019174 2024-09-14T11:23:37.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.079+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=FPAN19CA45VT tag=MF3YJVQYZ452 type=write size=4164902 2024-09-14T11:23:37.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.080+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=5ATIST0DTYS0 type=del 2024-09-14T11:23:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.081+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=OQKNY6L7E7ME type=del size=2976220 2024-09-14T11:23:37.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.082+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=JFTKYLWSKUX5 type=del 2024-09-14T11:23:37.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.083+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=KME3JFI1U04O type=del size=3357391 2024-09-14T11:23:37.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.084+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~8OCLYGJ8SBJI.0 size=266298 2024-09-14T11:23:37.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.086+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=8OCLYGJ8SBJI tag=DJTS3HUDDQD8 type=write size=1314874 2024-09-14T11:23:37.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.087+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=IZEEFJZDO4ND type=del size=1357434 2024-09-14T11:23:37.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.088+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=8VAUNXMRQ0DB type=del 2024-09-14T11:23:37.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.090+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=2NEKP6BWGQSK type=del size=2286051 2024-09-14T11:23:37.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.092+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~MARZSOIM64SA.0 size=537508 2024-09-14T11:23:37.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.094+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=MARZSOIM64SA tag=0MN3NUZFSMHE type=write size=1586084 2024-09-14T11:23:37.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.095+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=ZX5KYCYL3P7D type=del size=1764002 2024-09-14T11:23:37.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.098+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~9VLZCU8PQE2Y.0 size=858440 2024-09-14T11:23:37.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.100+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=9VLZCU8PQE2Y tag=U8K71XQ6BTOT type=write size=1907016 2024-09-14T11:23:37.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.101+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=CAHC5WUA6ZZ2 type=del size=3759622 2024-09-14T11:23:37.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.102+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=F8SAMSX3C1UZ type=del 2024-09-14T11:23:37.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.104+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=YSBJP893HQDT type=del size=3049348 2024-09-14T11:23:37.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.105+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~PIXYKRFQMYRO.0 size=1048576 2024-09-14T11:23:37.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.106+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~PIXYKRFQMYRO.1 size=135168 2024-09-14T11:23:37.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.108+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=PIXYKRFQMYRO tag=L5ANY50CX10W type=write size=2232320 2024-09-14T11:23:37.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.110+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.0 size=1048576 2024-09-14T11:23:37.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.111+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.1 size=1048576 2024-09-14T11:23:37.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.112+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.2 size=770686 2024-09-14T11:23:37.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.112+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=9C5CSMMNPQ6R tag=V18IJU8GXZ6S type=write size=3916414 2024-09-14T11:23:37.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.113+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=98M6YMFRD6OS type=del 2024-09-14T11:23:37.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.114+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=N1ZPGB8SOPPP type=del size=3078555 2024-09-14T11:23:37.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.115+0000 7f296241c780 1 < completed delete operation key=ILOY74OSG5CQ tag=IZZPQ8CZM6BC type=del 2024-09-14T11:23:37.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.116+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=QXZZSLI1BLQC type=del size=843848 2024-09-14T11:23:37.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.117+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~WLR330UVO5X1.0 size=1048576 2024-09-14T11:23:37.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.118+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~WLR330UVO5X1.1 size=767889 2024-09-14T11:23:37.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.120+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=WLR330UVO5X1 tag=HT8K6VZA7G27 type=write size=2865041 2024-09-14T11:23:37.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.122+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.0 size=1048576 2024-09-14T11:23:37.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.123+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.1 size=1048576 2024-09-14T11:23:37.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.124+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.2 size=299102 2024-09-14T11:23:37.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.124+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=VHB742HQGXR1 tag=KVHTZKHG2AEA type=write size=3444830 2024-09-14T11:23:37.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.125+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~KMF9CSRGT56A.0 size=1048576 2024-09-14T11:23:37.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.126+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~KMF9CSRGT56A.1 size=75272 2024-09-14T11:23:37.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.128+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=KMF9CSRGT56A tag=A8O0N4SY0S9U type=write size=2172424 2024-09-14T11:23:37.127 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.129+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=324SS9KJBP3Q type=del size=4122726 2024-09-14T11:23:37.128 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.130+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=DGO52ZRN87XF type=del 2024-09-14T11:23:37.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.132+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.0 size=1048576 2024-09-14T11:23:37.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.133+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.1 size=1048576 2024-09-14T11:23:37.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.134+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.2 size=197286 2024-09-14T11:23:37.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.134+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=J5B0JCFC5A6D tag=PNWV6GS1GWFY type=write size=3343014 2024-09-14T11:23:37.133 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.135+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~A4FWVBB3YVG7.0 size=1048576 2024-09-14T11:23:37.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.136+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~A4FWVBB3YVG7.1 size=401982 2024-09-14T11:23:37.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.138+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=A4FWVBB3YVG7 tag=H675RUOF6D5H type=write size=2499134 2024-09-14T11:23:37.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.139+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=KKDX12HOKFL5 type=write size=811062 2024-09-14T11:23:37.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.140+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.0 size=1048576 2024-09-14T11:23:37.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.141+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.1 size=1048576 2024-09-14T11:23:37.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.142+0000 7f296241c780 1 < completed part key=_multipart_I6UYPPUMN0FB.2~TKHSNZF5OKP1.2 size=293683 2024-09-14T11:23:37.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.143+0000 7f296241c780 1 < completed multipart upload key=I6UYPPUMN0FB upload=TKHSNZF5OKP1 tag=D5K9WP3UJMX6 type=write size=3439411 2024-09-14T11:23:37.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.145+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=US0SAIK0SI47 type=del size=788485 2024-09-14T11:23:37.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.146+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.0 size=1048576 2024-09-14T11:23:37.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.146+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.1 size=1048576 2024-09-14T11:23:37.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.146+0000 7f296241c780 1 < canceled part key=_multipart_19TC05N1D5FR.2~FPAN19CA45VT.2 size=1019174 2024-09-14T11:23:37.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.148+0000 7f296241c780 1 < canceled multipart upload key=19TC05N1D5FR upload=FPAN19CA45VT tag=MF3YJVQYZ452 type=write size=4164902 2024-09-14T11:23:37.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.149+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=H57D7OW8VR16 type=del size=113883 2024-09-14T11:23:37.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.150+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=OQKNY6L7E7ME type=del 2024-09-14T11:23:37.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.152+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~XAI2NUM81ENO.0 size=1048576 2024-09-14T11:23:37.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.153+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~XAI2NUM81ENO.1 size=887167 2024-09-14T11:23:37.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.153+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=XAI2NUM81ENO tag=TIKUGBXKG97H type=write size=2984319 2024-09-14T11:23:37.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.156+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=KME3JFI1U04O type=del size=3357391 2024-09-14T11:23:37.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.157+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~RO7931DQB736.0 size=1048576 2024-09-14T11:23:37.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.158+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~RO7931DQB736.1 size=280118 2024-09-14T11:23:37.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.158+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=RO7931DQB736 tag=03I8Y75TBE1E type=write size=2377270 2024-09-14T11:23:37.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.159+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=IZEEFJZDO4ND type=del 2024-09-14T11:23:37.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.161+0000 7f296241c780 1 > prepared part key=_multipart_R1M982MUIF44.2~UVW44MAK5N3A.0 size=671591 2024-09-14T11:23:37.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.161+0000 7f296241c780 1 > prepared multipart upload key=R1M982MUIF44 upload=UVW44MAK5N3A tag=2CCY9510022P type=write size=1720167 2024-09-14T11:23:37.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.162+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=2NEKP6BWGQSK type=del 2024-09-14T11:23:37.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.164+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.0 size=1048576 2024-09-14T11:23:37.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.165+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.1 size=1048576 2024-09-14T11:23:37.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.166+0000 7f296241c780 1 > prepared part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.2 size=998293 2024-09-14T11:23:37.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.166+0000 7f296241c780 1 > prepared multipart upload key=GJ2Y7ICBEZJX upload=Y4BFU24DIONC tag=HL0FNHKHW4NG type=write size=4144021 2024-09-14T11:23:37.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.167+0000 7f296241c780 1 < canceled operation key=FGK7YH1GB4W5 tag=ZX5KYCYL3P7D type=del size=1764002 2024-09-14T11:23:37.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.168+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=7K5NWHDN7QPC type=del size=1690606 2024-09-14T11:23:37.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.171+0000 7f296241c780 1 < suggested update operation key=I6UYPPUMN0FB tag=CAHC5WUA6ZZ2 type=del size=3759622 2024-09-14T11:23:37.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.172+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=EUFIQR5O7XPM type=del size=2706710 2024-09-14T11:23:37.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.173+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=YSBJP893HQDT type=del 2024-09-14T11:23:37.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.174+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=FNAH6VLR65YL type=del size=3190504 2024-09-14T11:23:37.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.175+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.0 size=1048576 2024-09-14T11:23:37.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.176+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.1 size=1048576 2024-09-14T11:23:37.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.177+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~9C5CSMMNPQ6R.2 size=770686 2024-09-14T11:23:37.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.181+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=9C5CSMMNPQ6R tag=V18IJU8GXZ6S type=write size=3916414 2024-09-14T11:23:37.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.182+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=IGZ1TJG8UYRH type=del size=2507679 2024-09-14T11:23:37.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.183+0000 7f296241c780 1 < completed delete operation key=OIT1KUT6UEP2 tag=N1ZPGB8SOPPP type=del 2024-09-14T11:23:37.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.185+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=MYPITRYLV21T type=del size=1019429 2024-09-14T11:23:37.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.186+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=QXZZSLI1BLQC type=del 2024-09-14T11:23:37.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.187+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=S4DCITY5AXT0 type=write size=683527 2024-09-14T11:23:37.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.188+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.0 size=1048576 2024-09-14T11:23:37.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.189+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.1 size=1048576 2024-09-14T11:23:37.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.190+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~VHB742HQGXR1.2 size=299102 2024-09-14T11:23:37.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.192+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=VHB742HQGXR1 tag=KVHTZKHG2AEA type=write size=3444830 2024-09-14T11:23:37.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.194+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~K36VBU0GM9Y7.0 size=1048576 2024-09-14T11:23:37.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.195+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~K36VBU0GM9Y7.1 size=179439 2024-09-14T11:23:37.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.195+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=K36VBU0GM9Y7 tag=8POLCZJI1ZTK type=write size=2276591 2024-09-14T11:23:37.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.196+0000 7f296241c780 1 < completed delete operation key=5N30QR6SN49T tag=324SS9KJBP3Q type=del 2024-09-14T11:23:37.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.200+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.0 size=1048576 2024-09-14T11:23:37.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.201+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.1 size=1048576 2024-09-14T11:23:37.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.202+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.2 size=38076 2024-09-14T11:23:37.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.202+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=IPIA33SO6QAK tag=AY4W220GRNN0 type=write size=3183804 2024-09-14T11:23:37.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.203+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.0 size=1048576 2024-09-14T11:23:37.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.204+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.1 size=1048576 2024-09-14T11:23:37.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.205+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~J5B0JCFC5A6D.2 size=197286 2024-09-14T11:23:37.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.208+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=J5B0JCFC5A6D tag=PNWV6GS1GWFY type=write size=3343014 2024-09-14T11:23:37.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.209+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=9NOUGRRELTAC type=del size=885824 2024-09-14T11:23:37.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.210+0000 7f296241c780 1 < completed write operation key=C1T4CLU3400T tag=KKDX12HOKFL5 type=write size=811062 2024-09-14T11:23:37.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.211+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=DBW7VFX678SU type=del size=2792260 2024-09-14T11:23:37.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.212+0000 7f296241c780 1 < canceled operation key=6DNKZWENMDM9 tag=US0SAIK0SI47 type=del size=788485 2024-09-14T11:23:37.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.214+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=SJJYFWE1JEFB type=del size=2536750 2024-09-14T11:23:37.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.216+0000 7f296241c780 1 < suggested update operation key=HFH3VKZ4T0IR tag=H57D7OW8VR16 type=del size=113883 2024-09-14T11:23:37.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.217+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=A2Y4WLGV70YM type=write size=752213 2024-09-14T11:23:37.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.218+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~XAI2NUM81ENO.0 size=1048576 2024-09-14T11:23:37.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.219+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~XAI2NUM81ENO.1 size=887167 2024-09-14T11:23:37.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.221+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=XAI2NUM81ENO tag=TIKUGBXKG97H type=write size=2984319 2024-09-14T11:23:37.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.224+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.0 size=1048576 2024-09-14T11:23:37.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.224+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.1 size=1048576 2024-09-14T11:23:37.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.225+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.2 size=100444 2024-09-14T11:23:37.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.225+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=TNHXBONPQS2N tag=A3VIGF1JP7IJ type=write size=3246172 2024-09-14T11:23:37.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.227+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~RO7931DQB736.0 size=1048576 2024-09-14T11:23:37.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.228+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~RO7931DQB736.1 size=280118 2024-09-14T11:23:37.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.230+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=RO7931DQB736 tag=03I8Y75TBE1E type=write size=2377270 2024-09-14T11:23:37.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.232+0000 7f296241c780 1 > prepared part key=_multipart_ILOY74OSG5CQ.2~HZA8KZXICOBF.0 size=385550 2024-09-14T11:23:37.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.232+0000 7f296241c780 1 > prepared multipart upload key=ILOY74OSG5CQ upload=HZA8KZXICOBF tag=R4MLVIOOI7QQ type=write size=1434126 2024-09-14T11:23:37.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.233+0000 7f296241c780 1 < completed part key=_multipart_R1M982MUIF44.2~UVW44MAK5N3A.0 size=671591 2024-09-14T11:23:37.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.235+0000 7f296241c780 1 < completed multipart upload key=R1M982MUIF44 upload=UVW44MAK5N3A tag=2CCY9510022P type=write size=1720167 2024-09-14T11:23:37.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.236+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=RGQUDLKP0BRL type=del size=3298467 2024-09-14T11:23:37.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.238+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.0 size=1048576 2024-09-14T11:23:37.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.238+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.1 size=1048576 2024-09-14T11:23:37.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.239+0000 7f296241c780 1 < completed part key=_multipart_GJ2Y7ICBEZJX.2~Y4BFU24DIONC.2 size=998293 2024-09-14T11:23:37.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.242+0000 7f296241c780 1 < completed multipart upload key=GJ2Y7ICBEZJX upload=Y4BFU24DIONC tag=HL0FNHKHW4NG type=write size=4144021 2024-09-14T11:23:37.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.243+0000 7f296241c780 1 > prepared operation key=QL439L2X13OR tag=YY6N40QIWUZA type=del size=42366 2024-09-14T11:23:37.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.244+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=7K5NWHDN7QPC type=del 2024-09-14T11:23:37.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.245+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=SYJ1U72PBC2V type=del size=3182826 2024-09-14T11:23:37.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.246+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=EUFIQR5O7XPM type=del 2024-09-14T11:23:37.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.247+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=BCR3IZYS1IUW type=del size=625020 2024-09-14T11:23:37.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.248+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=FNAH6VLR65YL type=del 2024-09-14T11:23:37.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.249+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=Q0393HAZS00R type=del size=4082067 2024-09-14T11:23:37.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.251+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=IGZ1TJG8UYRH type=del 2024-09-14T11:23:37.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.253+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~RJS402Q1MD6L.0 size=1048576 2024-09-14T11:23:37.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.254+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~RJS402Q1MD6L.1 size=738042 2024-09-14T11:23:37.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.254+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=RJS402Q1MD6L tag=VT4KK1C5T0UD type=write size=2835194 2024-09-14T11:23:37.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.255+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=MYPITRYLV21T type=del 2024-09-14T11:23:37.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.256+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=4JC0IGLDO0Y1 type=del size=1132430 2024-09-14T11:23:37.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.257+0000 7f296241c780 1 < completed write operation key=TNT7E4GX5ZR7 tag=S4DCITY5AXT0 type=write size=683527 2024-09-14T11:23:37.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.258+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=9WL8PDH479RT type=del size=4183511 2024-09-14T11:23:37.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.259+0000 7f296241c780 1 < canceled part key=_multipart_QL439L2X13OR.2~K36VBU0GM9Y7.0 size=1048576 2024-09-14T11:23:37.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.260+0000 7f296241c780 1 < completed part key=_multipart_QL439L2X13OR.2~K36VBU0GM9Y7.1 size=179439 2024-09-14T11:23:37.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.261+0000 7f296241c780 1 < canceled multipart upload key=QL439L2X13OR upload=K36VBU0GM9Y7 tag=8POLCZJI1ZTK type=write size=2276591 2024-09-14T11:23:37.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.263+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=V5KAR2GV8FY6 type=del size=2742984 2024-09-14T11:23:37.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.264+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.0 size=1048576 2024-09-14T11:23:37.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.265+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.1 size=1048576 2024-09-14T11:23:37.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.265+0000 7f296241c780 1 < completed part key=_multipart_L8NA53KOAT58.2~IPIA33SO6QAK.2 size=38076 2024-09-14T11:23:37.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.267+0000 7f296241c780 1 < completed multipart upload key=L8NA53KOAT58 upload=IPIA33SO6QAK tag=AY4W220GRNN0 type=write size=3183804 2024-09-14T11:23:37.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.269+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=3NLQ0K9X0QB0 type=del size=3301420 2024-09-14T11:23:37.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.273+0000 7f296241c780 1 < suggested remove operation key=KBMD123LTZA7 tag=9NOUGRRELTAC type=del 2024-09-14T11:23:37.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.275+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~MHOY6Q0TUUKS.0 size=1048576 2024-09-14T11:23:37.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.276+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~MHOY6Q0TUUKS.1 size=516047 2024-09-14T11:23:37.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.276+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=MHOY6Q0TUUKS tag=3YGWFEC291I2 type=write size=2613199 2024-09-14T11:23:37.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.277+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=DBW7VFX678SU type=del 2024-09-14T11:23:37.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.279+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.0 size=1048576 2024-09-14T11:23:37.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.280+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.1 size=1048576 2024-09-14T11:23:37.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.281+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.2 size=922323 2024-09-14T11:23:37.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.281+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=R85992P1O1QI tag=42GWTBJC25OQ type=write size=4068051 2024-09-14T11:23:37.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.283+0000 7f296241c780 1 < suggested remove operation key=L0GW4TPQCSUY tag=SJJYFWE1JEFB type=del 2024-09-14T11:23:37.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.284+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=XDA1W249AF2B type=write size=408223 2024-09-14T11:23:37.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.285+0000 7f296241c780 1 < completed write operation key=HZD8WW0H4AAD tag=A2Y4WLGV70YM type=write size=752213 2024-09-14T11:23:37.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.286+0000 7f296241c780 1 > prepared operation key=FGK7YH1GB4W5 tag=NP12FLXGIIBN type=del size=1858109 2024-09-14T11:23:37.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.286+0000 7f296241c780 1 < canceled part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.0 size=1048576 2024-09-14T11:23:37.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.287+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.1 size=1048576 2024-09-14T11:23:37.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.288+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~TNHXBONPQS2N.2 size=100444 2024-09-14T11:23:37.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.291+0000 7f296241c780 1 < canceled multipart upload key=JH1QJE5V4M9H upload=TNHXBONPQS2N tag=A3VIGF1JP7IJ type=write size=3246172 2024-09-14T11:23:37.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.292+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=T260KY779YJX type=del size=3078359 2024-09-14T11:23:37.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.293+0000 7f296241c780 1 < completed part key=_multipart_ILOY74OSG5CQ.2~HZA8KZXICOBF.0 size=385550 2024-09-14T11:23:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.295+0000 7f296241c780 1 < completed multipart upload key=ILOY74OSG5CQ upload=HZA8KZXICOBF tag=R4MLVIOOI7QQ type=write size=1434126 2024-09-14T11:23:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.297+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~5DCIYWZR19GD.0 size=1048576 2024-09-14T11:23:37.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.298+0000 7f296241c780 1 > prepared part key=_multipart_HFH3VKZ4T0IR.2~5DCIYWZR19GD.1 size=13607 2024-09-14T11:23:37.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.298+0000 7f296241c780 1 > prepared multipart upload key=HFH3VKZ4T0IR upload=5DCIYWZR19GD tag=R7WKKQLGV67G type=write size=2110759 2024-09-14T11:23:37.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.299+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=RGQUDLKP0BRL type=del 2024-09-14T11:23:37.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.301+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.0 size=1048576 2024-09-14T11:23:37.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.302+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.1 size=1048576 2024-09-14T11:23:37.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.303+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.2 size=827104 2024-09-14T11:23:37.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.303+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=54TC1FV1U8VO tag=SO81QDFKR044 type=write size=3972832 2024-09-14T11:23:37.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.304+0000 7f296241c780 1 < completed delete operation key=QL439L2X13OR tag=YY6N40QIWUZA type=del 2024-09-14T11:23:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.306+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~9LY9KNUME4HU.0 size=49095 2024-09-14T11:23:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.306+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=9LY9KNUME4HU tag=HHKDV7IAQR6G type=write size=1097671 2024-09-14T11:23:37.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.307+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=SYJ1U72PBC2V type=del 2024-09-14T11:23:37.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.310+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=A5HBRYFB8J3I type=del size=154071 2024-09-14T11:23:37.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.312+0000 7f296241c780 1 < suggested update operation key=GJ2Y7ICBEZJX tag=BCR3IZYS1IUW type=del size=625020 2024-09-14T11:23:37.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.313+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=3N9DMDVXD2FR type=del size=2116868 2024-09-14T11:23:37.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.314+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=Q0393HAZS00R type=del 2024-09-14T11:23:37.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.315+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=QBI59KK6P0A1 type=del size=1713407 2024-09-14T11:23:37.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.317+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~RJS402Q1MD6L.0 size=1048576 2024-09-14T11:23:37.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.317+0000 7f296241c780 1 < canceled part key=_multipart_LK9LRQM3TZRR.2~RJS402Q1MD6L.1 size=738042 2024-09-14T11:23:37.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.318+0000 7f296241c780 1 < canceled multipart upload key=LK9LRQM3TZRR upload=RJS402Q1MD6L tag=VT4KK1C5T0UD type=write size=2835194 2024-09-14T11:23:37.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.320+0000 7f296241c780 1 > prepared part key=_multipart_L8NA53KOAT58.2~DNJZJSQI4RSO.0 size=212784 2024-09-14T11:23:37.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.320+0000 7f296241c780 1 > prepared multipart upload key=L8NA53KOAT58 upload=DNJZJSQI4RSO tag=2F1SK7QU9UNV type=write size=1261360 2024-09-14T11:23:37.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.321+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=4JC0IGLDO0Y1 type=del 2024-09-14T11:23:37.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.322+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=DFG0H0PV2MDG type=del size=1736075 2024-09-14T11:23:37.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.324+0000 7f296241c780 1 < canceled operation key=TNT7E4GX5ZR7 tag=9WL8PDH479RT type=del size=4183511 2024-09-14T11:23:37.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.326+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~KTDKRKBBOZ4G.0 size=1048576 2024-09-14T11:23:37.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.326+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~KTDKRKBBOZ4G.1 size=206712 2024-09-14T11:23:37.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.326+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=KTDKRKBBOZ4G tag=5692O5S3O5F0 type=write size=2303864 2024-09-14T11:23:37.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.328+0000 7f296241c780 1 < completed delete operation key=TNT7E4GX5ZR7 tag=V5KAR2GV8FY6 type=del 2024-09-14T11:23:37.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.329+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=9BB07543KFTH type=del size=2200548 2024-09-14T11:23:37.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.330+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=3NLQ0K9X0QB0 type=del 2024-09-14T11:23:37.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.332+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.0 size=1048576 2024-09-14T11:23:37.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.333+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.1 size=1048576 2024-09-14T11:23:37.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.333+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.2 size=168895 2024-09-14T11:23:37.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.333+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=0GEHVERHL5FE tag=QKC2GQC1WLHK type=write size=3314623 2024-09-14T11:23:37.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.334+0000 7f296241c780 1 < canceled part key=_multipart_19TC05N1D5FR.2~MHOY6Q0TUUKS.0 size=1048576 2024-09-14T11:23:37.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.335+0000 7f296241c780 1 < completed part key=_multipart_19TC05N1D5FR.2~MHOY6Q0TUUKS.1 size=516047 2024-09-14T11:23:37.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.336+0000 7f296241c780 1 < canceled multipart upload key=19TC05N1D5FR upload=MHOY6Q0TUUKS tag=3YGWFEC291I2 type=write size=2613199 2024-09-14T11:23:37.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.338+0000 7f296241c780 1 > prepared operation key=MO1WWGC42DD4 tag=LCMI3C17D2ML type=del size=2135812 2024-09-14T11:23:37.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.339+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.0 size=1048576 2024-09-14T11:23:37.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.339+0000 7f296241c780 1 < canceled part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.1 size=1048576 2024-09-14T11:23:37.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.340+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~R85992P1O1QI.2 size=922323 2024-09-14T11:23:37.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.342+0000 7f296241c780 1 < canceled multipart upload key=0A90ZOC79OWP upload=R85992P1O1QI tag=42GWTBJC25OQ type=write size=4068051 2024-09-14T11:23:37.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.344+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.0 size=1048576 2024-09-14T11:23:37.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.344+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.1 size=1048576 2024-09-14T11:23:37.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.346+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.2 size=477556 2024-09-14T11:23:37.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.346+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=85S3H344POA9 tag=73ZO7G3LRMG6 type=write size=3623284 2024-09-14T11:23:37.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.347+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=XDA1W249AF2B type=write size=408223 2024-09-14T11:23:37.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.349+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.0 size=1048576 2024-09-14T11:23:37.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.350+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.1 size=1048576 2024-09-14T11:23:37.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.351+0000 7f296241c780 1 > prepared part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.2 size=806015 2024-09-14T11:23:37.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.351+0000 7f296241c780 1 > prepared multipart upload key=I1XBOS1L5D98 upload=AGK5X9BUBSCP tag=21HOT6WRCPWY type=write size=3951743 2024-09-14T11:23:37.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.353+0000 7f296241c780 1 < suggested update operation key=FGK7YH1GB4W5 tag=NP12FLXGIIBN type=del size=1858109 2024-09-14T11:23:37.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.355+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~QRBCWU52WN9S.0 size=1048576 2024-09-14T11:23:37.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.356+0000 7f296241c780 1 > prepared part key=_multipart_0A90ZOC79OWP.2~QRBCWU52WN9S.1 size=751080 2024-09-14T11:23:37.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.356+0000 7f296241c780 1 > prepared multipart upload key=0A90ZOC79OWP upload=QRBCWU52WN9S tag=XVBOTT0GUTK4 type=write size=2848232 2024-09-14T11:23:37.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.357+0000 7f296241c780 1 < completed delete operation key=CQU8M12JCE9T tag=T260KY779YJX type=del 2024-09-14T11:23:37.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.358+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=YLRI9M06QIME type=write size=154276 2024-09-14T11:23:37.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.360+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~5DCIYWZR19GD.0 size=1048576 2024-09-14T11:23:37.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.360+0000 7f296241c780 1 < completed part key=_multipart_HFH3VKZ4T0IR.2~5DCIYWZR19GD.1 size=13607 2024-09-14T11:23:37.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.362+0000 7f296241c780 1 < completed multipart upload key=HFH3VKZ4T0IR upload=5DCIYWZR19GD tag=R7WKKQLGV67G type=write size=2110759 2024-09-14T11:23:37.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.363+0000 7f296241c780 1 > prepared operation key=7WGFBTAM25J9 tag=UO8610K90BUF type=del size=3539387 2024-09-14T11:23:37.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.365+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.0 size=1048576 2024-09-14T11:23:37.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.365+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.1 size=1048576 2024-09-14T11:23:37.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.366+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~54TC1FV1U8VO.2 size=827104 2024-09-14T11:23:37.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.368+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=54TC1FV1U8VO tag=SO81QDFKR044 type=write size=3972832 2024-09-14T11:23:37.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.371+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~IQJ55L26GKK9.0 size=1048576 2024-09-14T11:23:37.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.372+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~IQJ55L26GKK9.1 size=808302 2024-09-14T11:23:37.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.372+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=IQJ55L26GKK9 tag=5WS8NU04WI2Z type=write size=2905454 2024-09-14T11:23:37.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.373+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~9LY9KNUME4HU.0 size=49095 2024-09-14T11:23:37.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.375+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=9LY9KNUME4HU tag=HHKDV7IAQR6G type=write size=1097671 2024-09-14T11:23:37.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.377+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~9YWZ5DBPE2HO.0 size=1048576 2024-09-14T11:23:37.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.378+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~9YWZ5DBPE2HO.1 size=685728 2024-09-14T11:23:37.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.378+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=9YWZ5DBPE2HO tag=DICZKAPRNCH8 type=write size=2782880 2024-09-14T11:23:37.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.379+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=A5HBRYFB8J3I type=del 2024-09-14T11:23:37.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.381+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=4713GZL1UVUO type=write size=1016466 2024-09-14T11:23:37.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.383+0000 7f296241c780 1 < suggested update operation key=KBMD123LTZA7 tag=3N9DMDVXD2FR type=del size=2116868 2024-09-14T11:23:37.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.384+0000 7f296241c780 1 > prepared operation key=L0GW4TPQCSUY tag=WBT3M9EFB13J type=del size=3846148 2024-09-14T11:23:37.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.385+0000 7f296241c780 1 < completed delete operation key=19TC05N1D5FR tag=QBI59KK6P0A1 type=del 2024-09-14T11:23:37.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.394+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.0 size=1048576 2024-09-14T11:23:37.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.395+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.1 size=1048576 2024-09-14T11:23:37.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.396+0000 7f296241c780 1 > prepared part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.2 size=484192 2024-09-14T11:23:37.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.396+0000 7f296241c780 1 > prepared multipart upload key=7WGFBTAM25J9 upload=VUTB329U1RJP tag=CYDUHH3JKBAX type=write size=3629920 2024-09-14T11:23:37.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.396+0000 7f296241c780 1 < canceled part key=_multipart_L8NA53KOAT58.2~DNJZJSQI4RSO.0 size=212784 2024-09-14T11:23:37.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.398+0000 7f296241c780 1 < canceled multipart upload key=L8NA53KOAT58 upload=DNJZJSQI4RSO tag=2F1SK7QU9UNV type=write size=1261360 2024-09-14T11:23:37.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.400+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=Y6E6DZKVRDVQ type=del size=3839548 2024-09-14T11:23:37.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.401+0000 7f296241c780 1 < completed delete operation key=QIVVKYC646IH tag=DFG0H0PV2MDG type=del 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.403+0000 7f296241c780 1 > prepared operation key=L8NA53KOAT58 tag=22GU1281CKBQ type=del size=4073242 2024-09-14T11:23:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.403+0000 7f296241c780 1 < canceled part key=_multipart_MO1WWGC42DD4.2~KTDKRKBBOZ4G.0 size=1048576 2024-09-14T11:23:37.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.404+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~KTDKRKBBOZ4G.1 size=206712 2024-09-14T11:23:37.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.406+0000 7f296241c780 1 < canceled multipart upload key=MO1WWGC42DD4 upload=KTDKRKBBOZ4G tag=5692O5S3O5F0 type=write size=2303864 2024-09-14T11:23:37.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.407+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=13P8F1WY7UGC type=del size=4089835 2024-09-14T11:23:37.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.409+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=9BB07543KFTH type=del 2024-09-14T11:23:37.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.410+0000 7f296241c780 1 > prepared operation key=HFH3VKZ4T0IR tag=98N31ERQ56Q6 type=del size=1752706 2024-09-14T11:23:37.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.411+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.0 size=1048576 2024-09-14T11:23:37.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.413+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.1 size=1048576 2024-09-14T11:23:37.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.415+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~0GEHVERHL5FE.2 size=168895 2024-09-14T11:23:37.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.417+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=0GEHVERHL5FE tag=QKC2GQC1WLHK type=write size=3314623 2024-09-14T11:23:37.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.419+0000 7f296241c780 1 > prepared part key=_multipart_L0GW4TPQCSUY.2~T9I3VO47RR64.0 size=19781 2024-09-14T11:23:37.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.419+0000 7f296241c780 1 > prepared multipart upload key=L0GW4TPQCSUY upload=T9I3VO47RR64 tag=PP8SFI32D16Y type=write size=1068357 2024-09-14T11:23:37.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.421+0000 7f296241c780 1 < completed delete operation key=MO1WWGC42DD4 tag=LCMI3C17D2ML type=del 2024-09-14T11:23:37.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.422+0000 7f296241c780 1 > prepared operation key=CQU8M12JCE9T tag=WSI6491UQ71R type=del size=3709339 2024-09-14T11:23:37.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.423+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.0 size=1048576 2024-09-14T11:23:37.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.424+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.1 size=1048576 2024-09-14T11:23:37.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.425+0000 7f296241c780 1 < completed part key=_multipart_6DNKZWENMDM9.2~85S3H344POA9.2 size=477556 2024-09-14T11:23:37.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.429+0000 7f296241c780 1 < completed multipart upload key=6DNKZWENMDM9 upload=85S3H344POA9 tag=73ZO7G3LRMG6 type=write size=3623284 2024-09-14T11:23:37.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.431+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=IGQW2332EQNC type=del size=1042669 2024-09-14T11:23:37.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.432+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.0 size=1048576 2024-09-14T11:23:37.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.433+0000 7f296241c780 1 < completed part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.1 size=1048576 2024-09-14T11:23:37.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.433+0000 7f296241c780 1 < canceled part key=_multipart_I1XBOS1L5D98.2~AGK5X9BUBSCP.2 size=806015 2024-09-14T11:23:37.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.435+0000 7f296241c780 1 < canceled multipart upload key=I1XBOS1L5D98 upload=AGK5X9BUBSCP tag=21HOT6WRCPWY type=write size=3951743 2024-09-14T11:23:37.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.437+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~WAVRP020HAI2.0 size=1048576 2024-09-14T11:23:37.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.437+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~WAVRP020HAI2.1 size=471458 2024-09-14T11:23:37.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.437+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=WAVRP020HAI2 tag=VRVVFEJ7O0KA type=write size=2568610 2024-09-14T11:23:37.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.439+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~QRBCWU52WN9S.0 size=1048576 2024-09-14T11:23:37.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.441+0000 7f296241c780 1 < completed part key=_multipart_0A90ZOC79OWP.2~QRBCWU52WN9S.1 size=751080 2024-09-14T11:23:37.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.443+0000 7f296241c780 1 < completed multipart upload key=0A90ZOC79OWP upload=QRBCWU52WN9S tag=XVBOTT0GUTK4 type=write size=2848232 2024-09-14T11:23:37.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.444+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=H769YWSEH59V type=del size=1261388 2024-09-14T11:23:37.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.445+0000 7f296241c780 1 < completed write operation key=I6UYPPUMN0FB tag=YLRI9M06QIME type=write size=154276 2024-09-14T11:23:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.447+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~EZ5XWJIU22P4.0 size=1048576 2024-09-14T11:23:37.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.448+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~EZ5XWJIU22P4.1 size=164758 2024-09-14T11:23:37.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.448+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=EZ5XWJIU22P4 tag=W1YKQP7OHVJL type=write size=2261910 2024-09-14T11:23:37.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.449+0000 7f296241c780 1 < completed delete operation key=7WGFBTAM25J9 tag=UO8610K90BUF type=del 2024-09-14T11:23:37.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.450+0000 7f296241c780 1 > prepared operation key=5N30QR6SN49T tag=I2Y7XCQG7H38 type=del size=3452424 2024-09-14T11:23:37.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.452+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~IQJ55L26GKK9.0 size=1048576 2024-09-14T11:23:37.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.452+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~IQJ55L26GKK9.1 size=808302 2024-09-14T11:23:37.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.455+0000 7f296241c780 1 < completed multipart upload key=JW3RIVHUFGPI upload=IQJ55L26GKK9 tag=5WS8NU04WI2Z type=write size=2905454 2024-09-14T11:23:37.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.456+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=546Y1K2CVBFK type=del size=1925081 2024-09-14T11:23:37.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.457+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~9YWZ5DBPE2HO.0 size=1048576 2024-09-14T11:23:37.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.458+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~9YWZ5DBPE2HO.1 size=685728 2024-09-14T11:23:37.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.460+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=9YWZ5DBPE2HO tag=DICZKAPRNCH8 type=write size=2782880 2024-09-14T11:23:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.461+0000 7f296241c780 1 > prepared operation key=JW3RIVHUFGPI tag=MKMSG87XS5Z2 type=del size=3798502 2024-09-14T11:23:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.463+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=4713GZL1UVUO type=write 2024-09-14T11:23:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.464+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=V7Q482OAPVBK type=del size=1274853 2024-09-14T11:23:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.465+0000 7f296241c780 1 < completed delete operation key=L0GW4TPQCSUY tag=WBT3M9EFB13J type=del 2024-09-14T11:23:37.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.466+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=WP9V7VJ02LL5 type=write size=1026743 2024-09-14T11:23:37.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.467+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.0 size=1048576 2024-09-14T11:23:37.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.468+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.1 size=1048576 2024-09-14T11:23:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.469+0000 7f296241c780 1 < completed part key=_multipart_7WGFBTAM25J9.2~VUTB329U1RJP.2 size=484192 2024-09-14T11:23:37.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.471+0000 7f296241c780 1 < completed multipart upload key=7WGFBTAM25J9 upload=VUTB329U1RJP tag=CYDUHH3JKBAX type=write size=3629920 2024-09-14T11:23:37.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.473+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=NH15FFORLBHU type=write size=531367 2024-09-14T11:23:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.474+0000 7f296241c780 1 < canceled operation key=K61XH5E6TF3Y tag=Y6E6DZKVRDVQ type=del size=3839548 2024-09-14T11:23:37.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.475+0000 7f296241c780 1 > prepared operation key=O35OFLNOZ488 tag=HYC2VC1BDD0H type=del size=1799552 2024-09-14T11:23:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.476+0000 7f296241c780 1 < completed delete operation key=L8NA53KOAT58 tag=22GU1281CKBQ type=del 2024-09-14T11:23:37.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.477+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=N7B5RFV2NQWN type=del size=2636835 2024-09-14T11:23:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.478+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=13P8F1WY7UGC type=del 2024-09-14T11:23:37.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.481+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~PJ35FXSE0LPQ.0 size=51824 2024-09-14T11:23:37.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.481+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=PJ35FXSE0LPQ tag=RX5LP0FQ20GG type=write size=1100400 2024-09-14T11:23:37.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.482+0000 7f296241c780 1 < completed delete operation key=HFH3VKZ4T0IR tag=98N31ERQ56Q6 type=del 2024-09-14T11:23:37.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.484+0000 7f296241c780 1 > prepared part key=_multipart_5XAAGDKVBZ0P.2~7FX4DCV1MCOE.0 size=785739 2024-09-14T11:23:37.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.484+0000 7f296241c780 1 > prepared multipart upload key=5XAAGDKVBZ0P upload=7FX4DCV1MCOE tag=NXM3AVMFLZT0 type=write size=1834315 2024-09-14T11:23:37.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.485+0000 7f296241c780 1 < completed part key=_multipart_L0GW4TPQCSUY.2~T9I3VO47RR64.0 size=19781 2024-09-14T11:23:37.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.487+0000 7f296241c780 1 < completed multipart upload key=L0GW4TPQCSUY upload=T9I3VO47RR64 tag=PP8SFI32D16Y type=write size=1068357 2024-09-14T11:23:37.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.488+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=CF74THJPSSZ0 type=del size=1959870 2024-09-14T11:23:37.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.489+0000 7f296241c780 1 < canceled operation key=CQU8M12JCE9T tag=WSI6491UQ71R type=del size=3709339 2024-09-14T11:23:37.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.491+0000 7f296241c780 1 > prepared operation key=HZD8WW0H4AAD tag=VILQQ09XF0ZG type=del size=629439 2024-09-14T11:23:37.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.493+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=IGQW2332EQNC type=del 2024-09-14T11:23:37.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.495+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~M14UXN5219OP.0 size=1048576 2024-09-14T11:23:37.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.496+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~M14UXN5219OP.1 size=741665 2024-09-14T11:23:37.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.496+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=M14UXN5219OP tag=TP90O6AMRPYT type=write size=2838817 2024-09-14T11:23:37.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.497+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~WAVRP020HAI2.0 size=1048576 2024-09-14T11:23:37.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.500+0000 7f296241c780 1 < completed part key=_multipart_C1T4CLU3400T.2~WAVRP020HAI2.1 size=471458 2024-09-14T11:23:37.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.502+0000 7f296241c780 1 < completed multipart upload key=C1T4CLU3400T upload=WAVRP020HAI2 tag=VRVVFEJ7O0KA type=write size=2568610 2024-09-14T11:23:37.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.503+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=Z1XI3WM7MLP3 type=del size=1088398 2024-09-14T11:23:37.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.504+0000 7f296241c780 1 < completed delete operation key=C1T4CLU3400T tag=H769YWSEH59V type=del 2024-09-14T11:23:37.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.505+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=W379XZCM0FT0 type=del size=4095123 2024-09-14T11:23:37.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.507+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~EZ5XWJIU22P4.0 size=1048576 2024-09-14T11:23:37.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.508+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~EZ5XWJIU22P4.1 size=164758 2024-09-14T11:23:37.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.510+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=EZ5XWJIU22P4 tag=W1YKQP7OHVJL type=write size=2261910 2024-09-14T11:23:37.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.511+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=SA7MUOKOYFO8 type=del size=3135087 2024-09-14T11:23:37.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.512+0000 7f296241c780 1 < canceled operation key=5N30QR6SN49T tag=I2Y7XCQG7H38 type=del size=3452424 2024-09-14T11:23:37.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.514+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.0 size=1048576 2024-09-14T11:23:37.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.515+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.1 size=1048576 2024-09-14T11:23:37.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.516+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.2 size=870322 2024-09-14T11:23:37.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.516+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=QYTQDID2KJ3Z tag=9NU7VSGK7UMK type=write size=4016050 2024-09-14T11:23:37.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.519+0000 7f296241c780 1 < suggested remove operation key=I6UYPPUMN0FB tag=546Y1K2CVBFK type=del 2024-09-14T11:23:37.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.521+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~CKB6KW9MCU17.0 size=816467 2024-09-14T11:23:37.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.521+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=CKB6KW9MCU17 tag=2Y4N3BND1CNB type=write size=1865043 2024-09-14T11:23:37.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.522+0000 7f296241c780 1 < completed delete operation key=JW3RIVHUFGPI tag=MKMSG87XS5Z2 type=del 2024-09-14T11:23:37.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.524+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.0 size=1048576 2024-09-14T11:23:37.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.525+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.1 size=1048576 2024-09-14T11:23:37.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.526+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.2 size=531047 2024-09-14T11:23:37.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.526+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=GXRS6CG00CI3 tag=9O25JFO73RJ2 type=write size=3676775 2024-09-14T11:23:37.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.527+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=V7Q482OAPVBK type=del 2024-09-14T11:23:37.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.528+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=SIAWII4DFBQV type=del size=3445196 2024-09-14T11:23:37.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.530+0000 7f296241c780 1 < suggested remove operation key=ILOY74OSG5CQ tag=WP9V7VJ02LL5 type=write 2024-09-14T11:23:37.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.532+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~KL8C2995X15Z.0 size=1048576 2024-09-14T11:23:37.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.534+0000 7f296241c780 1 > prepared part key=_multipart_MO1WWGC42DD4.2~KL8C2995X15Z.1 size=907331 2024-09-14T11:23:37.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.534+0000 7f296241c780 1 > prepared multipart upload key=MO1WWGC42DD4 upload=KL8C2995X15Z tag=74O5C20HPLF8 type=write size=3004483 2024-09-14T11:23:37.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.535+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=NH15FFORLBHU type=write size=531367 2024-09-14T11:23:37.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.536+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=5QCOXIK2FWYZ type=del size=2611949 2024-09-14T11:23:37.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.537+0000 7f296241c780 1 < completed delete operation key=O35OFLNOZ488 tag=HYC2VC1BDD0H type=del 2024-09-14T11:23:37.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.541+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.0 size=1048576 2024-09-14T11:23:37.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.542+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.1 size=1048576 2024-09-14T11:23:37.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.542+0000 7f296241c780 1 > prepared part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.2 size=269590 2024-09-14T11:23:37.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.542+0000 7f296241c780 1 > prepared multipart upload key=XTS8B3LEW0Y3 upload=UB25OWE13YYF tag=DDUVPYCR9PLJ type=write size=3415318 2024-09-14T11:23:37.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.544+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=N7B5RFV2NQWN type=del 2024-09-14T11:23:37.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.546+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.0 size=1048576 2024-09-14T11:23:37.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.547+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.1 size=1048576 2024-09-14T11:23:37.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.547+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.2 size=762149 2024-09-14T11:23:37.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.547+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=SKZCW644VYI8 tag=DD73SY1KVCB7 type=write size=3907877 2024-09-14T11:23:37.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.549+0000 7f296241c780 1 < completed part key=_multipart_FGK7YH1GB4W5.2~PJ35FXSE0LPQ.0 size=51824 2024-09-14T11:23:37.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.550+0000 7f296241c780 1 < completed multipart upload key=FGK7YH1GB4W5 upload=PJ35FXSE0LPQ tag=RX5LP0FQ20GG type=write size=1100400 2024-09-14T11:23:37.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.552+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=K23Z275BH9X1 type=write size=883545 2024-09-14T11:23:37.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.553+0000 7f296241c780 1 < completed part key=_multipart_5XAAGDKVBZ0P.2~7FX4DCV1MCOE.0 size=785739 2024-09-14T11:23:37.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.555+0000 7f296241c780 1 < completed multipart upload key=5XAAGDKVBZ0P upload=7FX4DCV1MCOE tag=NXM3AVMFLZT0 type=write size=1834315 2024-09-14T11:23:37.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.557+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~H4OEHGG5QHWV.0 size=902024 2024-09-14T11:23:37.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.557+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=H4OEHGG5QHWV tag=JI2H6T6G6HF6 type=write size=1950600 2024-09-14T11:23:37.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.558+0000 7f296241c780 -1 < failed to complete operation key=0A90ZOC79OWP tag=CF74THJPSSZ0 type=del size=1959870: (22) Invalid argument 2024-09-14T11:23:37.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.560+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.0 size=1048576 2024-09-14T11:23:37.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.561+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.1 size=1048576 2024-09-14T11:23:37.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.562+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.2 size=875162 2024-09-14T11:23:37.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.562+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=E1X0GT571K9C tag=SA4XYQ7GMZSY type=write size=4020890 2024-09-14T11:23:37.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.563+0000 7f296241c780 1 < completed delete operation key=HZD8WW0H4AAD tag=VILQQ09XF0ZG type=del 2024-09-14T11:23:37.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.564+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=7UAZFEGN0M7H type=del size=1503790 2024-09-14T11:23:37.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.564+0000 7f296241c780 1 < canceled part key=_multipart_TNT7E4GX5ZR7.2~M14UXN5219OP.0 size=1048576 2024-09-14T11:23:37.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.565+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~M14UXN5219OP.1 size=741665 2024-09-14T11:23:37.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.567+0000 7f296241c780 1 < canceled multipart upload key=TNT7E4GX5ZR7 upload=M14UXN5219OP tag=TP90O6AMRPYT type=write size=2838817 2024-09-14T11:23:37.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.569+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~9OLBB4QQTP54.0 size=1048576 2024-09-14T11:23:37.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.570+0000 7f296241c780 1 > prepared part key=_multipart_OIT1KUT6UEP2.2~9OLBB4QQTP54.1 size=396260 2024-09-14T11:23:37.568 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.570+0000 7f296241c780 1 > prepared multipart upload key=OIT1KUT6UEP2 upload=9OLBB4QQTP54 tag=Q28MMBJC4NQZ type=write size=2493412 2024-09-14T11:23:37.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.571+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=Z1XI3WM7MLP3 type=del 2024-09-14T11:23:37.571 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.573+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~9ZF2TMCN98XU.0 size=1048576 2024-09-14T11:23:37.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.574+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~9ZF2TMCN98XU.1 size=419504 2024-09-14T11:23:37.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.574+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=9ZF2TMCN98XU tag=SOOM98T3VXMM type=write size=2516656 2024-09-14T11:23:37.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.575+0000 7f296241c780 1 < completed delete operation key=5XAAGDKVBZ0P tag=W379XZCM0FT0 type=del 2024-09-14T11:23:37.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.577+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ACN7XJ4K8D5S.0 size=1048576 2024-09-14T11:23:37.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.578+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~ACN7XJ4K8D5S.1 size=590807 2024-09-14T11:23:37.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.578+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=ACN7XJ4K8D5S tag=ZKIJRBN04NZ0 type=write size=2687959 2024-09-14T11:23:37.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.579+0000 7f296241c780 1 < completed delete operation key=0A90ZOC79OWP tag=SA7MUOKOYFO8 type=del 2024-09-14T11:23:37.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.580+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=QG02GOLSY5FJ type=write size=504313 2024-09-14T11:23:37.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.581+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.0 size=1048576 2024-09-14T11:23:37.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.582+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.1 size=1048576 2024-09-14T11:23:37.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.583+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~QYTQDID2KJ3Z.2 size=870322 2024-09-14T11:23:37.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.585+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=QYTQDID2KJ3Z tag=9NU7VSGK7UMK type=write size=4016050 2024-09-14T11:23:37.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.587+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~IHYWHVW6FBUO.0 size=1048576 2024-09-14T11:23:37.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.589+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~IHYWHVW6FBUO.1 size=297522 2024-09-14T11:23:37.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.589+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=IHYWHVW6FBUO tag=IQGJ421AEQIU type=write size=2394674 2024-09-14T11:23:37.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.590+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~CKB6KW9MCU17.0 size=816467 2024-09-14T11:23:37.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.592+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=CKB6KW9MCU17 tag=2Y4N3BND1CNB type=write size=1865043 2024-09-14T11:23:37.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.593+0000 7f296241c780 1 > prepared operation key=TNT7E4GX5ZR7 tag=MVYU63ELRV14 type=write size=749631 2024-09-14T11:23:37.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.594+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.0 size=1048576 2024-09-14T11:23:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.596+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.1 size=1048576 2024-09-14T11:23:37.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.597+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~GXRS6CG00CI3.2 size=531047 2024-09-14T11:23:37.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.599+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=GXRS6CG00CI3 tag=9O25JFO73RJ2 type=write size=3676775 2024-09-14T11:23:37.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.601+0000 7f296241c780 1 > prepared operation key=6DNKZWENMDM9 tag=7K7M5VVY23QG type=del size=3123170 2024-09-14T11:23:37.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.602+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=SIAWII4DFBQV type=del 2024-09-14T11:23:37.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.603+0000 7f296241c780 1 > prepared operation key=QIVVKYC646IH tag=AGLB39G51WCI type=write size=1011076 2024-09-14T11:23:37.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.604+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~KL8C2995X15Z.0 size=1048576 2024-09-14T11:23:37.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.606+0000 7f296241c780 1 < completed part key=_multipart_MO1WWGC42DD4.2~KL8C2995X15Z.1 size=907331 2024-09-14T11:23:37.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.608+0000 7f296241c780 1 < completed multipart upload key=MO1WWGC42DD4 upload=KL8C2995X15Z tag=74O5C20HPLF8 type=write size=3004483 2024-09-14T11:23:37.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.610+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.0 size=1048576 2024-09-14T11:23:37.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.610+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.1 size=1048576 2024-09-14T11:23:37.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.611+0000 7f296241c780 1 > prepared part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.2 size=572929 2024-09-14T11:23:37.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.611+0000 7f296241c780 1 > prepared multipart upload key=JW3RIVHUFGPI upload=GC1X61PRLAEJ tag=SCUG3LZX8CO7 type=write size=3718657 2024-09-14T11:23:37.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.613+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=5QCOXIK2FWYZ type=del 2024-09-14T11:23:37.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.614+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=77FG201HZYW5 type=del size=3606523 2024-09-14T11:23:37.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.615+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.0 size=1048576 2024-09-14T11:23:37.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.616+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.1 size=1048576 2024-09-14T11:23:37.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.617+0000 7f296241c780 1 < completed part key=_multipart_XTS8B3LEW0Y3.2~UB25OWE13YYF.2 size=269590 2024-09-14T11:23:37.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.619+0000 7f296241c780 1 < completed multipart upload key=XTS8B3LEW0Y3 upload=UB25OWE13YYF tag=DDUVPYCR9PLJ type=write size=3415318 2024-09-14T11:23:37.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.622+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~VHV95BB1TU7M.0 size=1048576 2024-09-14T11:23:37.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.623+0000 7f296241c780 1 > prepared part key=_multipart_QIVVKYC646IH.2~VHV95BB1TU7M.1 size=224449 2024-09-14T11:23:37.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.623+0000 7f296241c780 1 > prepared multipart upload key=QIVVKYC646IH upload=VHV95BB1TU7M tag=X6X9VL3000GJ type=write size=2321601 2024-09-14T11:23:37.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.624+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.0 size=1048576 2024-09-14T11:23:37.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.625+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.1 size=1048576 2024-09-14T11:23:37.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.626+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~SKZCW644VYI8.2 size=762149 2024-09-14T11:23:37.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.628+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=SKZCW644VYI8 tag=DD73SY1KVCB7 type=write size=3907877 2024-09-14T11:23:37.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.629+0000 7f296241c780 1 > prepared operation key=JH1QJE5V4M9H tag=DTLW3WV1X6V5 type=del size=669106 2024-09-14T11:23:37.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.630+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=K23Z275BH9X1 type=write size=883545 2024-09-14T11:23:37.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.632+0000 7f296241c780 1 > prepared operation key=I1XBOS1L5D98 tag=59FTL73316QB type=del size=760065 2024-09-14T11:23:37.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.633+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~H4OEHGG5QHWV.0 size=902024 2024-09-14T11:23:37.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.635+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=H4OEHGG5QHWV tag=JI2H6T6G6HF6 type=write size=1950600 2024-09-14T11:23:37.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.636+0000 7f296241c780 1 > prepared operation key=GJ2Y7ICBEZJX tag=MHEMRIVZO7G1 type=del size=802725 2024-09-14T11:23:37.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.637+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.0 size=1048576 2024-09-14T11:23:37.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.638+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.1 size=1048576 2024-09-14T11:23:37.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.639+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~E1X0GT571K9C.2 size=875162 2024-09-14T11:23:37.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.641+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=E1X0GT571K9C tag=SA4XYQ7GMZSY type=write size=4020890 2024-09-14T11:23:37.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.643+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~KTUOZ1NFEMUH.0 size=1048576 2024-09-14T11:23:37.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.644+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~KTUOZ1NFEMUH.1 size=92989 2024-09-14T11:23:37.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.644+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=KTUOZ1NFEMUH tag=2U6N62L0JR6G type=write size=2190141 2024-09-14T11:23:37.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.646+0000 7f296241c780 1 < completed delete operation key=K61XH5E6TF3Y tag=7UAZFEGN0M7H type=del 2024-09-14T11:23:37.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.647+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=MER2VKLOSWTT type=del size=3962029 2024-09-14T11:23:37.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.650+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~9OLBB4QQTP54.0 size=1048576 2024-09-14T11:23:37.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.651+0000 7f296241c780 1 < completed part key=_multipart_OIT1KUT6UEP2.2~9OLBB4QQTP54.1 size=396260 2024-09-14T11:23:37.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.653+0000 7f296241c780 1 < completed multipart upload key=OIT1KUT6UEP2 upload=9OLBB4QQTP54 tag=Q28MMBJC4NQZ type=write size=2493412 2024-09-14T11:23:37.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.654+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=TU0D206CVY3M type=del size=1916643 2024-09-14T11:23:37.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.656+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~9ZF2TMCN98XU.0 size=1048576 2024-09-14T11:23:37.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.656+0000 7f296241c780 1 < canceled part key=_multipart_K61XH5E6TF3Y.2~9ZF2TMCN98XU.1 size=419504 2024-09-14T11:23:37.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.658+0000 7f296241c780 1 < canceled multipart upload key=K61XH5E6TF3Y upload=9ZF2TMCN98XU tag=SOOM98T3VXMM type=write size=2516656 2024-09-14T11:23:37.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.659+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=T440FQOMFPBA type=del size=697422 2024-09-14T11:23:37.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.660+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~ACN7XJ4K8D5S.0 size=1048576 2024-09-14T11:23:37.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.661+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~ACN7XJ4K8D5S.1 size=590807 2024-09-14T11:23:37.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.663+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=ACN7XJ4K8D5S tag=ZKIJRBN04NZ0 type=write size=2687959 2024-09-14T11:23:37.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.665+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~QO3OG0J9V6OL.0 size=1048576 2024-09-14T11:23:37.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.666+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~QO3OG0J9V6OL.1 size=178873 2024-09-14T11:23:37.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.666+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=QO3OG0J9V6OL tag=B2I17EZGJTE7 type=write size=2276025 2024-09-14T11:23:37.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.667+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=QG02GOLSY5FJ type=write size=504313 2024-09-14T11:23:37.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.668+0000 7f296241c780 1 > prepared operation key=KVQ49I9RAYXA tag=W1QEPK511T5S type=del size=3803894 2024-09-14T11:23:37.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.669+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~IHYWHVW6FBUO.0 size=1048576 2024-09-14T11:23:37.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.670+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~IHYWHVW6FBUO.1 size=297522 2024-09-14T11:23:37.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.672+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=IHYWHVW6FBUO tag=IQGJ421AEQIU type=write size=2394674 2024-09-14T11:23:37.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.673+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=O8ZSXVB2480U type=del size=3117705 2024-09-14T11:23:37.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.674+0000 7f296241c780 1 < completed write operation key=TNT7E4GX5ZR7 tag=MVYU63ELRV14 type=write size=749631 2024-09-14T11:23:37.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.676+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~T92HHW5NOJLY.0 size=1048576 2024-09-14T11:23:37.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.677+0000 7f296241c780 1 > prepared part key=_multipart_O35OFLNOZ488.2~T92HHW5NOJLY.1 size=1037037 2024-09-14T11:23:37.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.677+0000 7f296241c780 1 > prepared multipart upload key=O35OFLNOZ488 upload=T92HHW5NOJLY tag=4I4XELHY05WG type=write size=3134189 2024-09-14T11:23:37.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.678+0000 7f296241c780 1 < completed delete operation key=6DNKZWENMDM9 tag=7K7M5VVY23QG type=del 2024-09-14T11:23:37.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.680+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~YZGBV4E50ZEZ.0 size=1048576 2024-09-14T11:23:37.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.681+0000 7f296241c780 1 > prepared part key=_multipart_TNT7E4GX5ZR7.2~YZGBV4E50ZEZ.1 size=734770 2024-09-14T11:23:37.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.681+0000 7f296241c780 1 > prepared multipart upload key=TNT7E4GX5ZR7 upload=YZGBV4E50ZEZ tag=JO9I2D0G0M3J type=write size=2831922 2024-09-14T11:23:37.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.682+0000 7f296241c780 1 < completed write operation key=QIVVKYC646IH tag=AGLB39G51WCI type=write size=1011076 2024-09-14T11:23:37.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.683+0000 7f296241c780 1 > prepared operation key=19TC05N1D5FR tag=6RQF3N1M0FCC type=del size=952067 2024-09-14T11:23:37.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.684+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.0 size=1048576 2024-09-14T11:23:37.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.684+0000 7f296241c780 1 < canceled part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.1 size=1048576 2024-09-14T11:23:37.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.685+0000 7f296241c780 1 < completed part key=_multipart_JW3RIVHUFGPI.2~GC1X61PRLAEJ.2 size=572929 2024-09-14T11:23:37.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.687+0000 7f296241c780 1 < canceled multipart upload key=JW3RIVHUFGPI upload=GC1X61PRLAEJ tag=SCUG3LZX8CO7 type=write size=3718657 2024-09-14T11:23:37.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.688+0000 7f296241c780 1 > prepared operation key=XTS8B3LEW0Y3 tag=VOBYEV307CN0 type=del size=3354200 2024-09-14T11:23:37.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.689+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=77FG201HZYW5 type=del 2024-09-14T11:23:37.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.692+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~GUBU2VL5P1LH.0 size=993222 2024-09-14T11:23:37.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.692+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=GUBU2VL5P1LH tag=45ONFSE6ZYQX type=write size=2041798 2024-09-14T11:23:37.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.693+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~VHV95BB1TU7M.0 size=1048576 2024-09-14T11:23:37.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.694+0000 7f296241c780 1 < completed part key=_multipart_QIVVKYC646IH.2~VHV95BB1TU7M.1 size=224449 2024-09-14T11:23:37.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.696+0000 7f296241c780 1 < completed multipart upload key=QIVVKYC646IH upload=VHV95BB1TU7M tag=X6X9VL3000GJ type=write size=2321601 2024-09-14T11:23:37.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.697+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=FR2FJAJZFDS0 type=write size=865193 2024-09-14T11:23:37.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.699+0000 7f296241c780 1 < suggested update operation key=JH1QJE5V4M9H tag=DTLW3WV1X6V5 type=del size=669106 2024-09-14T11:23:37.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.701+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~M9T2E44G03H1.0 size=1048576 2024-09-14T11:23:37.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.702+0000 7f296241c780 1 > prepared part key=_multipart_JH1QJE5V4M9H.2~M9T2E44G03H1.1 size=435017 2024-09-14T11:23:37.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.702+0000 7f296241c780 1 > prepared multipart upload key=JH1QJE5V4M9H upload=M9T2E44G03H1 tag=BLK7V2GU8TWJ type=write size=2532169 2024-09-14T11:23:37.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.703+0000 7f296241c780 1 < completed delete operation key=I1XBOS1L5D98 tag=59FTL73316QB type=del 2024-09-14T11:23:37.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.704+0000 7f296241c780 1 > prepared operation key=KBMD123LTZA7 tag=MM98QQ3IXWVA type=del size=1178873 2024-09-14T11:23:37.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.705+0000 7f296241c780 1 < completed delete operation key=GJ2Y7ICBEZJX tag=MHEMRIVZO7G1 type=del 2024-09-14T11:23:37.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.706+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=TMEUIGD7VNRH type=write size=832643 2024-09-14T11:23:37.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.707+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~KTUOZ1NFEMUH.0 size=1048576 2024-09-14T11:23:37.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.708+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~KTUOZ1NFEMUH.1 size=92989 2024-09-14T11:23:37.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.710+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=KTUOZ1NFEMUH tag=2U6N62L0JR6G type=write size=2190141 2024-09-14T11:23:37.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.712+0000 7f296241c780 1 > prepared part key=_multipart_K61XH5E6TF3Y.2~OT0UYP8PW64J.0 size=978810 2024-09-14T11:23:37.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.712+0000 7f296241c780 1 > prepared multipart upload key=K61XH5E6TF3Y upload=OT0UYP8PW64J tag=F14PS8TESA9G type=write size=2027386 2024-09-14T11:23:37.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.713+0000 7f296241c780 1 < canceled operation key=19TC05N1D5FR tag=MER2VKLOSWTT type=del size=3962029 2024-09-14T11:23:37.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.715+0000 7f296241c780 1 > prepared operation key=0A90ZOC79OWP tag=BZDHWU9I22A9 type=del size=3367807 2024-09-14T11:23:37.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.716+0000 7f296241c780 1 < completed delete operation key=I6UYPPUMN0FB tag=TU0D206CVY3M type=del 2024-09-14T11:23:37.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.717+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=Y1IT66M36X0E type=write size=337359 2024-09-14T11:23:37.718 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.720+0000 7f296241c780 1 < suggested update operation key=5XAAGDKVBZ0P tag=T440FQOMFPBA type=del size=697422 2024-09-14T11:23:37.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.722+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~DIDV04PQLMP8.0 size=1048576 2024-09-14T11:23:37.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.723+0000 7f296241c780 1 > prepared part key=_multipart_5N30QR6SN49T.2~DIDV04PQLMP8.1 size=690733 2024-09-14T11:23:37.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.723+0000 7f296241c780 1 > prepared multipart upload key=5N30QR6SN49T upload=DIDV04PQLMP8 tag=6CT695S3XOGF type=write size=2787885 2024-09-14T11:23:37.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.724+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~QO3OG0J9V6OL.0 size=1048576 2024-09-14T11:23:37.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.725+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~QO3OG0J9V6OL.1 size=178873 2024-09-14T11:23:37.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.727+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=QO3OG0J9V6OL tag=B2I17EZGJTE7 type=write size=2276025 2024-09-14T11:23:37.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.729+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.0 size=1048576 2024-09-14T11:23:37.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.730+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.1 size=1048576 2024-09-14T11:23:37.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.731+0000 7f296241c780 1 > prepared part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.2 size=688322 2024-09-14T11:23:37.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.731+0000 7f296241c780 1 > prepared multipart upload key=LK9LRQM3TZRR upload=WB0IHC9LZRMD tag=35HC74DNH00J type=write size=3834050 2024-09-14T11:23:37.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.732+0000 7f296241c780 1 < completed delete operation key=KVQ49I9RAYXA tag=W1QEPK511T5S type=del 2024-09-14T11:23:37.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.733+0000 7f296241c780 1 > prepared operation key=ILOY74OSG5CQ tag=1ZUG7JET28GZ type=del size=2730900 2024-09-14T11:23:37.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.734+0000 7f296241c780 1 < completed delete operation key=R1M982MUIF44 tag=O8ZSXVB2480U type=del 2024-09-14T11:23:37.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.735+0000 7f296241c780 1 > prepared operation key=3T0SINQVBAGF tag=32PQ31ODRLBE type=del size=3013904 2024-09-14T11:23:37.735 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.737+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~T92HHW5NOJLY.0 size=1048576 2024-09-14T11:23:37.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.738+0000 7f296241c780 1 < completed part key=_multipart_O35OFLNOZ488.2~T92HHW5NOJLY.1 size=1037037 2024-09-14T11:23:37.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.740+0000 7f296241c780 1 < completed multipart upload key=O35OFLNOZ488 upload=T92HHW5NOJLY tag=4I4XELHY05WG type=write size=3134189 2024-09-14T11:23:37.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.741+0000 7f296241c780 1 > prepared operation key=I6UYPPUMN0FB tag=7E4XATDJ278P type=del size=2095557 2024-09-14T11:23:37.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.742+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~YZGBV4E50ZEZ.0 size=1048576 2024-09-14T11:23:37.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.743+0000 7f296241c780 1 < completed part key=_multipart_TNT7E4GX5ZR7.2~YZGBV4E50ZEZ.1 size=734770 2024-09-14T11:23:37.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.745+0000 7f296241c780 1 < completed multipart upload key=TNT7E4GX5ZR7 upload=YZGBV4E50ZEZ tag=JO9I2D0G0M3J type=write size=2831922 2024-09-14T11:23:37.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.747+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~A4CNQADEQE0L.0 size=1048576 2024-09-14T11:23:37.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.748+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~A4CNQADEQE0L.1 size=1048576 2024-09-14T11:23:37.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.749+0000 7f296241c780 1 > prepared part key=_multipart_KVQ49I9RAYXA.2~A4CNQADEQE0L.2 size=238152 2024-09-14T11:23:37.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.749+0000 7f296241c780 1 > prepared multipart upload key=KVQ49I9RAYXA upload=A4CNQADEQE0L tag=CPWE3LC50O5E type=write size=3383880 2024-09-14T11:23:37.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.750+0000 7f296241c780 1 < canceled operation key=19TC05N1D5FR tag=6RQF3N1M0FCC type=del size=952067 2024-09-14T11:23:37.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.752+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~XLBRK58SGGU3.0 size=1048576 2024-09-14T11:23:37.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.753+0000 7f296241c780 1 > prepared part key=_multipart_C1T4CLU3400T.2~XLBRK58SGGU3.1 size=897575 2024-09-14T11:23:37.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.753+0000 7f296241c780 1 > prepared multipart upload key=C1T4CLU3400T upload=XLBRK58SGGU3 tag=G7KE3UJECI3K type=write size=2994727 2024-09-14T11:23:37.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.754+0000 7f296241c780 1 < completed delete operation key=XTS8B3LEW0Y3 tag=VOBYEV307CN0 type=del 2024-09-14T11:23:37.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.758+0000 7f296241c780 1 > prepared part key=_multipart_I6UYPPUMN0FB.2~WKH4V845FW5Q.0 size=585430 2024-09-14T11:23:37.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.758+0000 7f296241c780 1 > prepared multipart upload key=I6UYPPUMN0FB upload=WKH4V845FW5Q tag=S7XPI3FVTT8L type=write size=1634006 2024-09-14T11:23:37.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.759+0000 7f296241c780 1 < completed part key=_multipart_KVQ49I9RAYXA.2~GUBU2VL5P1LH.0 size=993222 2024-09-14T11:23:37.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.761+0000 7f296241c780 1 < completed multipart upload key=KVQ49I9RAYXA upload=GUBU2VL5P1LH tag=45ONFSE6ZYQX type=write size=2041798 2024-09-14T11:23:37.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.763+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UUJZ4R1WVRLR.0 size=1048576 2024-09-14T11:23:37.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.764+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UUJZ4R1WVRLR.1 size=1048576 2024-09-14T11:23:37.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.765+0000 7f296241c780 1 > prepared part key=_multipart_QL439L2X13OR.2~UUJZ4R1WVRLR.2 size=76497 2024-09-14T11:23:37.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.765+0000 7f296241c780 1 > prepared multipart upload key=QL439L2X13OR upload=UUJZ4R1WVRLR tag=5S1R24JDVZTM type=write size=3222225 2024-09-14T11:23:37.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.766+0000 7f296241c780 1 < completed write operation key=KBMD123LTZA7 tag=FR2FJAJZFDS0 type=write size=865193 2024-09-14T11:23:37.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.767+0000 7f296241c780 1 > prepared operation key=C1T4CLU3400T tag=L69PB7YMS9OU type=del size=2550698 2024-09-14T11:23:37.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.769+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~M9T2E44G03H1.0 size=1048576 2024-09-14T11:23:37.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.770+0000 7f296241c780 1 < completed part key=_multipart_JH1QJE5V4M9H.2~M9T2E44G03H1.1 size=435017 2024-09-14T11:23:37.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.771+0000 7f296241c780 1 < completed multipart upload key=JH1QJE5V4M9H upload=M9T2E44G03H1 tag=BLK7V2GU8TWJ type=write size=2532169 2024-09-14T11:23:37.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.773+0000 7f296241c780 1 > prepared operation key=OIT1KUT6UEP2 tag=O18W29QH80IP type=del size=1180962 2024-09-14T11:23:37.772 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.774+0000 7f296241c780 1 < completed delete operation key=KBMD123LTZA7 tag=MM98QQ3IXWVA type=del 2024-09-14T11:23:37.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.776+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~U2ZKTUA8QA8N.0 size=1048576 2024-09-14T11:23:37.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.777+0000 7f296241c780 1 > prepared part key=_multipart_6DNKZWENMDM9.2~U2ZKTUA8QA8N.1 size=665587 2024-09-14T11:23:37.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.777+0000 7f296241c780 1 > prepared multipart upload key=6DNKZWENMDM9 upload=U2ZKTUA8QA8N tag=63MLG4RUQDJO type=write size=2762739 2024-09-14T11:23:37.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.778+0000 7f296241c780 1 < completed write operation key=0A90ZOC79OWP tag=TMEUIGD7VNRH type=write size=832643 2024-09-14T11:23:37.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.779+0000 7f296241c780 1 > prepared operation key=LK9LRQM3TZRR tag=R93910X6D7E5 type=del size=2566583 2024-09-14T11:23:37.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.780+0000 7f296241c780 1 < completed part key=_multipart_K61XH5E6TF3Y.2~OT0UYP8PW64J.0 size=978810 2024-09-14T11:23:37.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.782+0000 7f296241c780 1 < completed multipart upload key=K61XH5E6TF3Y upload=OT0UYP8PW64J tag=F14PS8TESA9G type=write size=2027386 2024-09-14T11:23:37.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.785+0000 7f296241c780 1 > prepared part key=_multipart_FGK7YH1GB4W5.2~NR8G0CBNUD2M.0 size=102196 2024-09-14T11:23:37.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.785+0000 7f296241c780 1 > prepared multipart upload key=FGK7YH1GB4W5 upload=NR8G0CBNUD2M tag=F17U0YASK7VG type=write size=1150772 2024-09-14T11:23:37.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.787+0000 7f296241c780 1 < suggested remove operation key=0A90ZOC79OWP tag=BZDHWU9I22A9 type=del 2024-09-14T11:23:37.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.788+0000 7f296241c780 1 > prepared operation key=K61XH5E6TF3Y tag=DLLUER2Q7KSV type=del size=812774 2024-09-14T11:23:37.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.790+0000 7f296241c780 1 < completed write operation key=LK9LRQM3TZRR tag=Y1IT66M36X0E type=write size=337359 2024-09-14T11:23:37.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.791+0000 7f296241c780 1 > prepared operation key=5XAAGDKVBZ0P tag=H4TDT1354EBJ type=write size=78345 2024-09-14T11:23:37.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.792+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~DIDV04PQLMP8.0 size=1048576 2024-09-14T11:23:37.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.793+0000 7f296241c780 1 < completed part key=_multipart_5N30QR6SN49T.2~DIDV04PQLMP8.1 size=690733 2024-09-14T11:23:37.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.795+0000 7f296241c780 1 < completed multipart upload key=5N30QR6SN49T upload=DIDV04PQLMP8 tag=6CT695S3XOGF type=write size=2787885 2024-09-14T11:23:37.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.797+0000 7f296241c780 1 > prepared part key=_multipart_19TC05N1D5FR.2~WSCR3XTOBKI9.0 size=761907 2024-09-14T11:23:37.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.797+0000 7f296241c780 1 > prepared multipart upload key=19TC05N1D5FR upload=WSCR3XTOBKI9 tag=MWV64DMCWWQX type=write size=1810483 2024-09-14T11:23:37.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.798+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.0 size=1048576 2024-09-14T11:23:37.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.799+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.1 size=1048576 2024-09-14T11:23:37.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.800+0000 7f296241c780 1 < completed part key=_multipart_LK9LRQM3TZRR.2~WB0IHC9LZRMD.2 size=688322 2024-09-14T11:23:37.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.802+0000 7f296241c780 1 < completed multipart upload key=LK9LRQM3TZRR upload=WB0IHC9LZRMD tag=35HC74DNH00J type=write size=3834050 2024-09-14T11:23:37.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:23:37.804+0000 7f296241c780 1 > prepared operation key=R1M982MUIF44 tag=P3VUI13BWOGN type=del size=1341893 2024-09-14T11:23:37.802 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] cls_rgw_stats.simulate (9021 ms) 2024-09-14T11:23:37.802 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 1 test from cls_rgw_stats (9021 ms total) 2024-09-14T11:23:37.802 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:23:37.802 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:37.913 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 1 test from 1 test suite ran. (10991 ms total) 2024-09-14T11:23:37.913 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 1 test. 2024-09-14T11:23:37.916 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:37.916 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:37.994 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:23:37.995 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:23:37.995 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:23:38.077 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:23:38.077 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:23:38.077 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:39.923 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:23:39.923 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:23:39.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (12 ms) 2024-09-14T11:23:39.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:23:39.940 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-09-14T11:23:39.940 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:23:39.943 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T11:23:39.943 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:23:39.946 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-14T11:23:39.946 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:23:39.953 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T11:23:39.953 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:23:39.958 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-09-14T11:23:39.958 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:23:39.961 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-14T11:23:39.962 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:23:39.966 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-14T11:23:39.966 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:23:39.970 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-14T11:23:39.970 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:23:39.975 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (6 ms) 2024-09-14T11:23:39.975 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:23:39.976 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-09-14T11:23:39.976 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:23:39.976 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T11:23:39.976 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:23:39.983 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:23:39.983 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:23:39.991 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-14T11:23:39.991 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:23:39.997 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-14T11:23:39.997 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:23:40.004 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-14T11:23:40.004 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:23:40.013 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_str (10 ms) 2024-09-14T11:23:40.013 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:23:40.022 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T11:23:40.022 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:23:40.025 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:23:40.025 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:23:40.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-14T11:23:40.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:23:40.028 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:23:40.028 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:23:40.029 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T11:23:40.029 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:23:40.034 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (5 ms) 2024-09-14T11:23:40.035 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:23:40.040 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-14T11:23:40.040 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:23:40.047 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:23:40.047 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:23:40.055 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-14T11:23:40.055 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:23:40.058 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:23:40.058 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:23:40.060 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T11:23:40.060 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:23:40.061 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:23:40.061 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:23:40.062 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-14T11:23:40.062 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:23:40.069 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-14T11:23:40.069 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 31 tests from CmpOmap (146 ms total) 2024-09-14T11:23:40.069 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:23:40.069 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:40.936 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 31 tests from 1 test suite ran. (2858 ms total) 2024-09-14T11:23:40.936 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 31 tests. 2024-09-14T11:23:40.939 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:40.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:41.023 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:23:41.024 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:23:41.025 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:23:41.110 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:23:41.110 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:23:41.110 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:41.110 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:23:41.110 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:23:43.941 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2831 ms) 2024-09-14T11:23:43.941 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:23:46.990 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3049 ms) 2024-09-14T11:23:46.990 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:23:49.991 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.Reserve (3002 ms) 2024-09-14T11:23:49.992 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:23:53.032 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3041 ms) 2024-09-14T11:23:53.033 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:23:56.046 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.Commit (3013 ms) 2024-09-14T11:23:56.046 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:23:59.075 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.Stats (3029 ms) 2024-09-14T11:23:59.075 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:24:03.098 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4023 ms) 2024-09-14T11:24:03.098 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:24:06.103 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.Abort (3005 ms) 2024-09-14T11:24:06.103 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:24:09.129 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.ReserveError (3027 ms) 2024-09-14T11:24:09.129 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:24:12.162 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.CommitError (3032 ms) 2024-09-14T11:24:12.162 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:24:15.179 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.AbortError (3017 ms) 2024-09-14T11:24:15.179 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:24:18.199 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3020 ms) 2024-09-14T11:24:18.199 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:24:21.207 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3008 ms) 2024-09-14T11:24:21.207 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:24:24.234 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3028 ms) 2024-09-14T11:24:24.234 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:24:27.243 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3006 ms) 2024-09-14T11:24:27.243 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:24:30.263 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3022 ms) 2024-09-14T11:24:30.263 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:24:33.290 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3027 ms) 2024-09-14T11:24:33.290 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:24:36.300 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.Cleanup (3010 ms) 2024-09-14T11:24:36.300 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:24:46.390 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10090 ms) 2024-09-14T11:24:46.390 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:24:49.401 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3012 ms) 2024-09-14T11:24:49.401 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:25:02.642 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13241 ms) 2024-09-14T11:25:02.643 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:25:06.670 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2024-09-14T11:25:06.670 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:25:12.691 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6022 ms) 2024-09-14T11:25:12.691 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:25:17.761 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5069 ms) 2024-09-14T11:25:17.761 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from TestCls2PCQueue (96651 ms total) 2024-09-14T11:25:17.761 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:17.761 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:17.761 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 24 tests from 1 test suite ran. (96651 ms total) 2024-09-14T11:25:17.762 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 24 tests. 2024-09-14T11:25:17.765 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:17.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:17.807 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:25:17.808 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:25:17.808 DEBUG:teuthology.orchestra.run.smithi116:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:25:17.900 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:17.900 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:17.901 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:25:17.901 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:19.776 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:25:19.776 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:25:19.795 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsAccount.add (19 ms) 2024-09-14T11:25:19.795 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:25:19.799 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:25:19.799 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:25:20.275 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsAccount.rm (476 ms) 2024-09-14T11:25:20.276 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:25:20.295 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] ClsAccount.list (20 ms) 2024-09-14T11:25:20.295 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from ClsAccount (520 ms total) 2024-09-14T11:25:20.295 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:20.295 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:20.789 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 4 tests from 1 test suite ran. (2888 ms total) 2024-09-14T11:25:20.789 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 4 tests. 2024-09-14T11:25:20.793 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:20.793 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:20.836 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:25:20.837 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:25:20.837 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:25:20.930 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:20.931 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:20.931 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:25:20.931 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:22.793 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:25:22.793 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:25:22.810 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.init_existing_queue (17 ms) 2024-09-14T11:25:22.810 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:25:22.812 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-14T11:25:22.812 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:25:22.815 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:25:22.816 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:25:22.820 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-14T11:25:22.820 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:25:22.821 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:25:22.821 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 6 tests from rgw_gc_log (29 ms total) 2024-09-14T11:25:22.821 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:22.821 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:23.805 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 6 tests from 1 test suite ran. (2875 ms total) 2024-09-14T11:25:23.806 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 6 tests. 2024-09-14T11:25:23.809 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:23.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:23.855 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:25:23.856 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:25:23.856 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:Running main() from gmock_main.cc 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i= 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.954 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i= 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i= 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.955 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.956 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.957 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.958 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.959 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i= 2024-09-14T11:25:23.960 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i= 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i= 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.961 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.962 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.965 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i=v1 2024-09-14T11:25:23.966 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i=v1 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns= i=v1 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.967 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.968 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.969 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.970 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.971 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:25:23.972 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: _obj[v1] 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.973 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.974 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.975 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.976 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_obj", 2024-09-14T11:25:23.977 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i= 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i= 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.978 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i= 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.979 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.980 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.981 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.982 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.983 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i= 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i= 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj 2024-09-14T11:25:23.984 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i= 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.985 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.986 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.987 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.988 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.989 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i=v1 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i=v1 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns= i=v1 2024-09-14T11:25:23.990 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.991 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.992 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.993 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.994 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.995 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:parsed: obj[v1] 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout: "obj1": { 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.996 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.997 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "obj2": { 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.998 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3": { 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:23.999 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "obj3-2": { 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.000 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "obj", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "v1", 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.001 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.002 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.003 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker_myobj", 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.004 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.005 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.006 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.007 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.008 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker_myobj", 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.009 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.010 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.011 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.012 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.013 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.014 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.015 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.016 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.017 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.018 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.019 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.020 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.021 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.022 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.023 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.024 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.025 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.026 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.027 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.028 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.029 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.030 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.031 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.032 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.033 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.034 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.035 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.036 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.037 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.038 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj", 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.039 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.040 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.041 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.042 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj", 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.043 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.044 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.045 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.046 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.047 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.048 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.049 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.050 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:25:24.051 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.052 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.053 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.054 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.055 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.056 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.057 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.058 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.059 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.060 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.061 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.062 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.063 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.064 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.065 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.066 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.067 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.068 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.069 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.070 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.071 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.072 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj_", 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.073 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.076 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj_", 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.077 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.078 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.079 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:25:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.083 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.084 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.085 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.086 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.087 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.088 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.089 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.090 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.091 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.092 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.093 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.094 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.095 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.096 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.097 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.098 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.099 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.100 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.101 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.102 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.103 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.104 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.104 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.104 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.104 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.104 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.105 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": "default-placement.data", 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "test", 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.106 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": "", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": "" 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.107 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "obj": { 2024-09-14T11:25:24.108 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.109 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.110 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.111 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker_myobj", 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.112 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.113 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker_myobj", 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.114 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.115 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.116 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.117 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.118 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.119 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.120 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.121 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.122 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.123 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.124 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.125 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "myobj", 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.127 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj", 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj", 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.131 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.132 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.133 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.134 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.135 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.136 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.137 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj" 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.138 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:25:24.139 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.140 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.141 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.142 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj", 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.143 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj_", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.144 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.145 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker___myobj_", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.146 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.147 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.148 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.149 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.150 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "", 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.151 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.152 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "marker__myobj_" 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.153 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.154 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "" 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj": { 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.155 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj": { 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.156 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "raw_obj2": { 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "pool": ".data-pool", 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: "loc": "" 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.157 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "new_obj2": { 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket": { 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "ebtest", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "marker": "marker", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_id": "bucket-id", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "tenant": "", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "explicit_placement": { 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "data_pool": ".data-pool", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "data_extra_pool": "", 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "index_pool": ".index-pool" 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "key": { 2024-09-14T11:25:24.158 INFO:tasks.workunit.client.0.smithi116.stdout: "name": "_myobj_", 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout: "instance": "inst", 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout: "ns": "ns" 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:25:24.159 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 4 tests. 2024-09-14T11:25:24.160 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:24.160 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:24.206 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:25:24.207 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:25:24.207 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:25:24.310 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:24.310 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:24.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.349+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 realm 2024-09-14T11:25:24.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:24.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.351+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.352+0000 7effb5213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.352+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.352+0000 7effb5213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:24.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.352+0000 7effb5213800 20 searching for the correct realm 2024-09-14T11:25:24.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.355+0000 7effb0992640 0 -- 172.21.15.116:0/2702731146 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x55eb45682300 msgr2=0x7effac0a6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:24.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.359+0000 7effb0992640 0 -- 172.21.15.116:0/2702731146 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7efe7c0846f0 msgr2=0x7efe7c086b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:24.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:24.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.365+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 zone default found 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 4 Realm: () 2024-09-14T11:25:24.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 zonegroup default 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.366+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.367+0000 7effb5213800 20 started sync module instance, tier type = 2024-09-14T11:25:24.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.367+0000 7effb5213800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:25:24.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=0 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=1 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=2 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=3 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=4 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=5 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.376+0000 7effb5213800 20 add_watcher() i=6 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.377+0000 7effb5213800 20 add_watcher() i=7 2024-09-14T11:25:24.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.377+0000 7effb5213800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:24.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.379+0000 7efe677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.379+0000 7effb5213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.379+0000 7effb5213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.379+0000 7effb5213800 5 note: GC not initialized 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.379+0000 7efe667e4640 20 reqs_thread_entry: start 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 Filter name: none 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7efe5ffff640 20 reqs_thread_entry: start 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:25:24.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:25:24.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:25:24.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 10 cache get: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= : miss 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.380+0000 7effb5213800 20 rados->read ofs=0 len=0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.381+0000 7effb5213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.381+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= info.flags=0x0 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.381+0000 7effb5213800 10 adding default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= to cache LRU end 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.381+0000 7effb5213800 10 cache get: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= : hit (negative entry) 2024-09-14T11:25:24.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.381+0000 7effb5213800 10 cache get: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= : hit (negative entry) 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.382+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.382+0000 7effb5213800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.382+0000 7effb5213800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.383+0000 7efe87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94468972675312 notifier 5646 bl.length()=697 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.383+0000 7efe87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:25:24.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.383+0000 7efe87fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:25:24.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:25:24.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7effb5213800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:25:24.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7effb5213800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:25:24.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7efe87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94468972667376 notifier 5646 bl.length()=194 2024-09-14T11:25:24.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7efe87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:25:24.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.386+0000 7efe87fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:25:24.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7effb5213800 10 cache put: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= info.flags=0x7 2024-09-14T11:25:24.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7effb5213800 10 moving default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= to cache LRU end 2024-09-14T11:25:24.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7effb5213800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:oTN/rM2jtsMgHRw9AAW23P9+S70=, ofs0, ns] 2024-09-14T11:25:24.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7efe87fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856705 cookie 94468972681664 notifier 5646 bl.length()=203 2024-09-14T11:25:24.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7efe87fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= info.flags=0x7 2024-09-14T11:25:24.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.390+0000 7efe87fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+oTN/rM2jtsMgHRw9AAW23P9+S70= to cache LRU end 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "display_name": "librgw test user", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "email": "librgw@example.com", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "suspended": 0, 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "subusers": [], 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "keys": [ 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: { 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "access_key": "oTN/rM2jtsMgHRw9AAW23P9+S70=", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "secret_key": "D72S3HB5/7u/JIfMXVL0U/uomOdzSvHK7DOHb44FCwSwfHZ14gO2vQ==", 2024-09-14T11:25:24.390 INFO:tasks.workunit.client.0.smithi116.stdout: "active": true, 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:25:24.382026Z" 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: ], 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "swift_keys": [], 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "caps": [], 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "default_placement": "", 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "placement_tags": [], 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_quota": { 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:25:24.391 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "user_quota": { 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "type": "rgw", 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "account_id": "", 2024-09-14T11:25:24.392 INFO:tasks.workunit.client.0.smithi116.stdout: "path": "/", 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:25:24.382010Z", 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stdout: "tags": [], 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stdout: "group_ids": [] 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.392+0000 7efe677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.395+0000 7effb5213800 20 remove_watcher() i=0 2024-09-14T11:25:24.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.395+0000 7effb5213800 2 removed watcher, disabling cache 2024-09-14T11:25:24.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.396+0000 7effb5213800 20 remove_watcher() i=1 2024-09-14T11:25:24.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.397+0000 7effb5213800 20 remove_watcher() i=2 2024-09-14T11:25:24.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.398+0000 7effb5213800 20 remove_watcher() i=3 2024-09-14T11:25:24.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.399+0000 7effb5213800 20 remove_watcher() i=4 2024-09-14T11:25:24.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.400+0000 7effb5213800 20 remove_watcher() i=5 2024-09-14T11:25:24.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.401+0000 7effb5213800 20 remove_watcher() i=6 2024-09-14T11:25:24.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:24.402+0000 7effb5213800 20 remove_watcher() i=7 2024-09-14T11:25:24.410 INFO:tasks.workunit.client.0.smithi116.stdout:phase 1.1 2024-09-14T11:25:24.431 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:25:24.431 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:24.431 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:25:24.431 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:24.442 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:24.442 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:24.611 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (181 ms) 2024-09-14T11:25:24.611 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:25:24.613 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:25:24.613 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:24.613 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:25:24.613 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:25:24.626 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:25:24.630 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/f1 2024-09-14T11:25:24.634 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/f2 2024-09-14T11:25:24.637 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:25:24.639 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:25:24.642 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:25:24.645 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:25:24.647 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:25:24.650 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:25:24.653 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:25:24.655 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:25:24.657 INFO:tasks.workunit.client.0.smithi116.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:25:24.660 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2024-09-14T11:25:24.660 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:25:24.769 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_DIRS1 (109 ms) 2024-09-14T11:25:24.769 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:25:24.769 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:25:24.769 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:25:24.788 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-14T11:25:24.788 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:25:24.836 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (49 ms) 2024-09-14T11:25:24.836 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:25:24.836 INFO:tasks.workunit.client.0.smithi116.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:25:24.842 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (5 ms) 2024-09-14T11:25:24.842 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:25:24.842 INFO:tasks.workunit.client.0.smithi116.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:25:24.848 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:25:24.849 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:25:24.850 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:24.850 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:25:24.850 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:24.850 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:25:24.850 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:25:24.851 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:24.851 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:25:24.852 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:24.852 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:25:24.852 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:25:24.853 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:25:24.853 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:25:24.854 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:25:24.854 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-14T11:25:24.854 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:25:25.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2024-09-14T11:25:25.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:25:25.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:25:25.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:25:25.027 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:25:25.028 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:25:25.029 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:25:25.036 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:25:25.037 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:25:25.040 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:25:25.042 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:25:25.045 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:25:25.046 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:25:25.046 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:25:25.047 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:25:25.048 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:25:25.048 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:25:25.049 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:25:25.051 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:25:25.051 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:25:25.051 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:25:25.051 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:25:25.051 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:25.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:25.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:25.053+0000 7f15c7b3c8c0 -1 shutting down 2024-09-14T11:25:25.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:25.054+0000 7f149fb0f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64416, si_uid : 1000, si_addr0x3e80000fba0, si_status0 2024-09-14T11:25:54.749 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (29697 ms) 2024-09-14T11:25:54.749 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW (30318 ms total) 2024-09-14T11:25:54.750 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:25:54.750 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:54.750 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 24 tests from 1 test suite ran. (30318 ms total) 2024-09-14T11:25:54.750 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 24 tests. 2024-09-14T11:25:54.755 INFO:tasks.workunit.client.0.smithi116.stdout:phase 1.2 2024-09-14T11:25:54.778 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:25:54.779 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:54.779 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:25:54.779 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:54.787 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:54.787 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:55.167 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-14T11:25:55.168 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:25:55.169 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:25:55.169 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:55.169 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:25:55.170 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:25:55.171 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:55.172 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:55.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:55.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:55.170+0000 7fc6d13668c0 -1 shutting down 2024-09-14T11:25:55.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:25:55.172+0000 7fc5a9365640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65036, si_uid : 1000, si_addr0x3e80000fe0c, si_status0 2024-09-14T11:26:25.345 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30177 ms) 2024-09-14T11:26:25.345 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW (30567 ms total) 2024-09-14T11:26:25.345 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:26:25.345 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:25.346 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 24 tests from 1 test suite ran. (30567 ms total) 2024-09-14T11:26:25.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 24 tests. 2024-09-14T11:26:25.352 INFO:tasks.workunit.client.0.smithi116.stdout:phase 1.3 2024-09-14T11:26:25.375 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:26:25.375 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:25.375 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:26:25.375 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:25.385 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:25.385 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:25.571 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (196 ms) 2024-09-14T11:26:25.571 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:26:25.572 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:26:25.572 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:25.572 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:26:25.572 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:26:25.578 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-14T11:26:25.578 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETUP_DIRS1 (55 ms) 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:26:25.634 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:26:25.635 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:26:25.636 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:26:25.637 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:26:25.637 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:26:25.637 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:26:25.638 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:26:25.638 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:26:25.639 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:26:25.639 INFO:tasks.workunit.client.0.smithi116.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:26:25.639 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:26:25.640 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:26:25.640 INFO:tasks.workunit.client.0.smithi116.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:26:25.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:26:25.642 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:26:25.649 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:26:25.649 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:26:25.652 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:26:25.654 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:26:25.657 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:26:25.657 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:26:25.658 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:26:25.658 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:26:25.659 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:26:25.659 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:26:25.660 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:26:25.662 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:25.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:26:25.663+0000 7f94d83238c0 -1 shutting down 2024-09-14T11:26:25.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:26:25.664+0000 7f93af91a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65655, si_uid : 1000, si_addr0x3e800010077, si_status0 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30186 ms) 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 24 tests from LibRGW (30472 ms total) 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 24 tests from 1 test suite ran. (30472 ms total) 2024-09-14T11:26:55.848 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 24 tests. 2024-09-14T11:26:55.854 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2.1 2024-09-14T11:26:55.878 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:26:55.879 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:26:55.879 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:26:55.879 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:26:55.888 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:26:55.888 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:26:56.308 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (429 ms) 2024-09-14T11:26:56.308 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:26:56.308 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:26:56.308 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:26:56.323 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-14T11:26:56.323 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:26:56.323 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:26:56.323 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:26:56.334 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave0 2024-09-14T11:26:56.345 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave1 2024-09-14T11:26:56.356 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave2 2024-09-14T11:26:56.368 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave3 2024-09-14T11:26:56.378 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave4 2024-09-14T11:26:56.387 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave5 2024-09-14T11:26:56.401 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave6 2024-09-14T11:26:56.411 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave7 2024-09-14T11:26:56.421 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave8 2024-09-14T11:26:56.432 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave9 2024-09-14T11:26:56.432 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (108 ms) 2024-09-14T11:26:56.432 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:26:56.731 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (300 ms) 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:26:56.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:26:56.733+0000 7f65ab2878c0 -1 shutting down 2024-09-14T11:26:56.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:26:56.734+0000 7f6484fc4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66274, si_uid : 1000, si_addr0x3e8000102e2, si_status0 2024-09-14T11:27:26.549 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (29817 ms) 2024-09-14T11:27:26.550 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from LibRGW (30670 ms total) 2024-09-14T11:27:26.550 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:27:26.550 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:26.550 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 9 tests from 1 test suite ran. (30670 ms total) 2024-09-14T11:27:26.550 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 9 tests. 2024-09-14T11:27:26.555 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2.2 2024-09-14T11:27:26.580 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:27:26.580 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:26.580 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:27:26.580 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:26.589 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:27.004 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (425 ms) 2024-09-14T11:27:27.005 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:27.005 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:27.005 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:27.005 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:27:27.006 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:27.038 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-14T11:27:27.038 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:27:27.049 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave0 2024-09-14T11:27:27.059 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave1 2024-09-14T11:27:27.070 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave2 2024-09-14T11:27:27.083 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave3 2024-09-14T11:27:27.095 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave4 2024-09-14T11:27:27.109 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave5 2024-09-14T11:27:27.120 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave6 2024-09-14T11:27:27.130 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave7 2024-09-14T11:27:27.142 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave8 2024-09-14T11:27:27.153 INFO:tasks.workunit.client.0.smithi116.stdout:created: sorrydave9 2024-09-14T11:27:27.153 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (114 ms) 2024-09-14T11:27:27.153 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (299 ms) 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:27.452 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:27.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:27:27.454+0000 7f9a72d758c0 -1 shutting down 2024-09-14T11:27:27.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:27:27.455+0000 7f994cab4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66893, si_uid : 1000, si_addr0x3e80001054d, si_status0 2024-09-14T11:27:57.135 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (29684 ms) 2024-09-14T11:27:57.135 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 9 tests from LibRGW (30556 ms total) 2024-09-14T11:27:57.135 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:27:57.135 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:27:57.136 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 9 tests from 1 test suite ran. (30556 ms total) 2024-09-14T11:27:57.136 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 9 tests. 2024-09-14T11:27:57.141 INFO:tasks.workunit.client.0.smithi116.stdout:phase 3.1 2024-09-14T11:27:57.453 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:27:57.453 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:27:57.454 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:27:57.454 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:27:57.462 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:57.462 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:58.037 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (584 ms) 2024-09-14T11:27:58.037 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:27:58.038 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:27:58.038 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:27:58.048 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-14T11:27:58.048 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:27:58.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:27:58.052 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:27:58.054 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:27:58.054 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:27:58.104 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LARGE1 (50 ms) 2024-09-14T11:27:58.104 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LARGE2 (34 ms) 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:27:58.138 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:27:58.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:27:58.140+0000 7f68581358c0 -1 shutting down 2024-09-14T11:27:58.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:27:58.141+0000 7f6730019640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67512, si_uid : 1000, si_addr0x3e8000107b8, si_status0 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30190 ms) 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 13 tests from LibRGW (30875 ms total) 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 13 tests from 1 test suite ran. (30875 ms total) 2024-09-14T11:28:28.329 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 13 tests. 2024-09-14T11:28:28.336 INFO:tasks.workunit.client.0.smithi116.stdout:phase 3.2 2024-09-14T11:28:28.656 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:28:28.656 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:28:28.656 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:28:28.656 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:28:28.664 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:28.664 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:29.072 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (416 ms) 2024-09-14T11:28:29.072 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:28:29.072 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:28:29.072 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:28:29.072 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:28:29.073 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:28:29.078 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:28:29.078 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:28:29.081 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:28:29.081 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LARGE1 (58 ms) 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:28:29.140 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:28:29.144 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T11:28:29.144 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:28:29.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:28:29.174+0000 7f6af591f8c0 -1 shutting down 2024-09-14T11:28:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:28:29.176+0000 7f69cd865640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68131, si_uid : 1000, si_addr0x3e800010a23, si_status0 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30009 ms) 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 13 tests from LibRGW (30526 ms total) 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 13 tests from 1 test suite ran. (30526 ms total) 2024-09-14T11:28:59.182 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 13 tests. 2024-09-14T11:28:59.190 INFO:tasks.workunit.client.0.smithi116.stdout:phase 4.1 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:read i1: 64001 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:read s1: blunderbuss 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:28:59.217 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:28:59.228 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:59.228 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:59.405 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-14T11:28:59.405 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:28:59.406 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:28:59.406 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:28:59.425 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T11:28:59.425 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_0 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_1 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_2 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_3 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_4 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_5 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_6 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_7 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_8 2024-09-14T11:28:59.955 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_9 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_10 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_11 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_12 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_13 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_14 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_15 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_16 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_17 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_18 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_19 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_20 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_21 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_22 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_23 2024-09-14T11:28:59.956 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_24 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_25 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_26 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_27 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_28 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_29 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_30 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_31 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_32 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_33 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_34 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_35 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_36 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_37 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_38 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_39 2024-09-14T11:28:59.957 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_40 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_41 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_42 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_43 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_44 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_45 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_46 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_47 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_48 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_49 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_50 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_51 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_52 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_53 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_54 2024-09-14T11:28:59.958 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_55 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_56 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_57 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_58 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_59 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_60 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_61 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_62 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_63 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_64 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_65 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_66 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_67 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_68 2024-09-14T11:28:59.959 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_69 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_70 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_71 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_72 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_73 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_74 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_75 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_76 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_77 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_78 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_79 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_80 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_81 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_82 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_83 2024-09-14T11:28:59.960 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_84 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_85 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_86 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_87 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_88 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_89 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_90 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_91 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_92 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_93 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_94 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_95 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_96 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_97 2024-09-14T11:28:59.961 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_98 2024-09-14T11:28:59.962 INFO:tasks.workunit.client.0.smithi116.stdout:created: dmarker:f_99 2024-09-14T11:28:59.962 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (530 ms) 2024-09-14T11:28:59.962 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:28:59.963 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:28:59.964 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:28:59.965 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:28:59.965 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:28:59.965 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:28:59.965 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:28:59.966 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:28:59.967 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:28:59.968 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:28:59.969 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:28:59.970 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:28:59.971 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:28:59.972 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:28:59.973 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:28:59.974 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:28:59.975 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:28:59.976 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:28:59.977 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:28:59.978 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:28:59.961+0000 7fd938b218c0 -1 shutting down 2024-09-14T11:28:59.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:28:59.962+0000 7fd8109ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68752, si_uid : 1000, si_addr0x3e800010c90, si_status0 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (29698 ms) 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from LibRGW (30441 ms total) 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 11 tests from 1 test suite ran. (30441 ms total) 2024-09-14T11:29:29.658 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 11 tests. 2024-09-14T11:29:29.664 INFO:tasks.workunit.client.0.smithi116.stdout:phase 4.2 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:read i1: 64001 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:read s1: blunderbuss 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:29:29.688 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:29:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:29.696 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:29.913 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (224 ms) 2024-09-14T11:29:29.913 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:29:29.913 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:29:29.913 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:29:29.923 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-14T11:29:29.923 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:29:29.924 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:29:29.924 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:29:29.924 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:29:29.924 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:29:29.926 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:29:29.927 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:29:29.928 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:29:29.929 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:29:29.930 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:29:29.931 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:29:29.932 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:29:29.933 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:29:29.928+0000 7fe6f9d1f8c0 -1 shutting down 2024-09-14T11:29:29.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:29:29.929+0000 7fe5d1baa640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69371, si_uid : 1000, si_addr0x3e800010efb, si_status0 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30131 ms) 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 11 tests from LibRGW (30368 ms total) 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 11 tests from 1 test suite ran. (30369 ms total) 2024-09-14T11:30:00.057 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 11 tests. 2024-09-14T11:30:00.063 INFO:tasks.workunit.client.0.smithi116.stdout:phase 5.1 2024-09-14T11:30:00.096 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:30:00.096 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:30:00.096 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:30:00.097 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:30:00.107 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:00.107 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:00.321 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (225 ms) 2024-09-14T11:30:00.321 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:30:00.322 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:30:00.322 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:30:00.333 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-14T11:30:00.333 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:30:00.336 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:30:00.337 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:30:00.337 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:30:00.337 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:30:00.339 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:30:00.339 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:30:00.339 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:30:00.339 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:30:00.344 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T11:30:00.344 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:30:00.345 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:30:00.346 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:30:00.347+0000 7f15d46328c0 -1 shutting down 2024-09-14T11:30:00.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:30:00.348+0000 7f14a9d1f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69990, si_uid : 1000, si_addr0x3e800011166, si_status0 2024-09-14T11:30:30.566 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30220 ms) 2024-09-14T11:30:30.566 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 19 tests from LibRGW (30469 ms total) 2024-09-14T11:30:30.566 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:30:30.566 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:30:30.566 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 19 tests from 1 test suite ran. (30469 ms total) 2024-09-14T11:30:30.567 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 19 tests. 2024-09-14T11:30:30.572 INFO:tasks.workunit.client.0.smithi116.stdout:phase 5.2 2024-09-14T11:30:30.605 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:30:30.605 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:30:30.605 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:30:30.605 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:30:30.612 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:30.612 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:31.200 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (596 ms) 2024-09-14T11:30:31.201 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:30:31.201 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:30:31.202 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:30:31.202 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:30:31.202 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:30:31.208 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:30:31.209 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:30:31.213 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-14T11:30:31.213 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:30:31.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:30:31.246+0000 7faf09d418c0 -1 shutting down 2024-09-14T11:30:31.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:30:31.247+0000 7fade3a80640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70611, si_uid : 1000, si_addr0x3e8000113d3, si_status0 2024-09-14T11:31:01.609 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30365 ms) 2024-09-14T11:31:01.610 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 19 tests from LibRGW (31004 ms total) 2024-09-14T11:31:01.610 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:31:01.610 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:31:01.610 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 19 tests from 1 test suite ran. (31004 ms total) 2024-09-14T11:31:01.610 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 19 tests. 2024-09-14T11:31:01.615 INFO:tasks.workunit.client.0.smithi116.stdout:phase 6.1 2024-09-14T11:31:01.640 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:31:01.640 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment set-up. 2024-09-14T11:31:01.640 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:31:01.641 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:31:01.647 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:01.647 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:01.843 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.INIT (202 ms) 2024-09-14T11:31:01.843 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:31:01.843 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:31:01.843 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:31:01.864 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CREATE_BUCKETS (21 ms) 2024-09-14T11:31:01.864 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:31:01.872 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-14T11:31:01.872 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:31:01.890 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-14T11:31:01.891 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:31:01.912 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SUBDIR_RENAME (22 ms) 2024-09-14T11:31:01.912 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:31:01.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (22 ms) 2024-09-14T11:31:01.934 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:31:01.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:31:01.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:31:01.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:31:01.935 INFO:tasks.workunit.client.0.smithi116.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:31:01.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:01.936+0000 7f80078988c0 -1 shutting down 2024-09-14T11:31:01.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:01.937+0000 7f7ee15d7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71230, si_uid : 1000, si_addr0x3e80001163e, si_status0 2024-09-14T11:31:32.034 INFO:tasks.workunit.client.0.smithi116.stdout:[ OK ] LibRGW.SHUTDOWN (30099 ms) 2024-09-14T11:31:32.035 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] 10 tests from LibRGW (30393 ms total) 2024-09-14T11:31:32.035 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:31:32.035 INFO:tasks.workunit.client.0.smithi116.stdout:[----------] Global test environment tear-down 2024-09-14T11:31:32.035 INFO:tasks.workunit.client.0.smithi116.stdout:[==========] 10 tests from 1 test suite ran. (30393 ms total) 2024-09-14T11:31:32.035 INFO:tasks.workunit.client.0.smithi116.stdout:[ PASSED ] 10 tests. 2024-09-14T11:31:32.042 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:31:32.042 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:31:32.089 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:31:32.090 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:31:32.091 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -z ']' 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:31:32.126 INFO:tasks.workunit.client.0.smithi116.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:31:32.163 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:32.163 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:32.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.203+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 20 realm 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.204+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.205+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.205+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.205+0000 7f889a335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.205+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.206+0000 7f889a335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:32.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.206+0000 7f889a335800 20 searching for the correct realm 2024-09-14T11:31:32.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.209+0000 7f88958e3640 0 -- 172.21.15.116:0/1235179564 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f8890034040 msgr2=0x7f8890026930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.415+0000 7f88960e4640 0 -- 172.21.15.116:0/1235179564 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f88800b7b30 msgr2=0x7f888007c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:32.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.623+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 zone default found 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 4 Realm: () 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 zonegroup default 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 started sync module instance, tier type = 2024-09-14T11:31:32.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.624+0000 7f889a335800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:31:32.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=0 2024-09-14T11:31:32.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=1 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=2 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=3 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=4 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=5 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.634+0000 7f889a335800 20 add_watcher() i=6 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.635+0000 7f889a335800 20 add_watcher() i=7 2024-09-14T11:31:32.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.635+0000 7f889a335800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.637+0000 7f874cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.637+0000 7f889a335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.637+0000 7f889a335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.637+0000 7f889a335800 5 note: GC not initialized 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f86c77fe640 20 reqs_thread_entry: start 2024-09-14T11:31:32.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 20 Filter name: none 2024-09-14T11:31:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f86c57fa640 20 reqs_thread_entry: start 2024-09-14T11:31:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:31:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.638+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:31:32.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.639+0000 7f889a335800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:31:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f889a335800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:31:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f889a335800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:31:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f8779ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856709 cookie 94074387265680 notifier 5510 bl.length()=677 2024-09-14T11:31:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f8779ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:31:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.640+0000 7f8779ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:31:32.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.643+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:31:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.643+0000 7f889a335800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:31:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.643+0000 7f889a335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:31:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.644+0000 7f8779ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856716 cookie 94074387251328 notifier 5510 bl.length()=187 2024-09-14T11:31:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.644+0000 7f8779ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:31:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.644+0000 7f8779ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:31:32.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f889a335800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:31:32.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f889a335800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:31:32.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f889a335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:31:32.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f8779ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856717 cookie 94074387251328 notifier 5510 bl.length()=197 2024-09-14T11:31:32.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f8779ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:31:32.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.647+0000 7f8779ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "display_name": "maven test user", 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "email": "sigv4@example.com", 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "suspended": 0, 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "subusers": [], 2024-09-14T11:31:32.647 INFO:tasks.workunit.client.0.smithi116.stdout: "keys": [ 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: { 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "user": "ceph-test-maven", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "active": true, 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:31:32.640182Z" 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: ], 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "swift_keys": [], 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "caps": [], 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "default_placement": "", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:31:32.648 INFO:tasks.workunit.client.0.smithi116.stdout: "placement_tags": [], 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_quota": { 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "user_quota": { 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:31:32.649 INFO:tasks.workunit.client.0.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "type": "rgw", 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "account_id": "", 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "path": "/", 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:31:32.640166Z", 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "tags": [], 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: "group_ids": [] 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:31:32.650 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:31:32.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.650+0000 7f874cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.652+0000 7f889a335800 20 remove_watcher() i=0 2024-09-14T11:31:32.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.652+0000 7f889a335800 2 removed watcher, disabling cache 2024-09-14T11:31:32.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.653+0000 7f889a335800 20 remove_watcher() i=1 2024-09-14T11:31:32.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.654+0000 7f889a335800 20 remove_watcher() i=2 2024-09-14T11:31:32.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.656+0000 7f889a335800 20 remove_watcher() i=3 2024-09-14T11:31:32.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.657+0000 7f889a335800 20 remove_watcher() i=4 2024-09-14T11:31:32.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.658+0000 7f889a335800 20 remove_watcher() i=5 2024-09-14T11:31:32.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.659+0000 7f889a335800 20 remove_watcher() i=6 2024-09-14T11:31:32.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:31:32.660+0000 7f889a335800 20 remove_watcher() i=7 2024-09-14T11:31:32.669 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -z ']' 2024-09-14T11:31:32.669 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:31:32.669 INFO:tasks.workunit.client.0.smithi116.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:31:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi116.front.sepia.ceph.com:80 2024-09-14T11:31:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi116.front.sepia.ceph.com:80 2024-09-14T11:31:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:31:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:31:32.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ ./mvnw clean package 2024-09-14T11:31:32.763 INFO:tasks.workunit.client.0.smithi116.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:31:34.255 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Scanning for projects... 2024-09-14T11:31:34.409 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:31:34.489 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 69 kB/s) 2024-09-14T11:31:34.499 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:31:34.538 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:31:34.544 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:31:34.563 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] from pom.xml 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:31:34.588 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:31:34.602 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:31:34.608 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:31:34.623 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 707 kB/s) 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:31:34.640 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-14T11:31:34.645 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:31:34.660 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:31:34.671 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:31:34.686 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.4 MB/s) 2024-09-14T11:31:34.693 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:31:34.707 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:31:34.710 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:31:34.724 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:31:34.726 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:31:34.742 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-14T11:31:34.746 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:31:34.760 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:31:34.765 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:31:34.781 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-14T11:31:34.785 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:31:34.800 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 701 kB/s) 2024-09-14T11:31:34.805 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:31:34.822 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-14T11:31:34.827 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:31:34.842 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-14T11:31:34.845 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-14T11:31:34.863 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:31:34.878 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.3 MB/s) 2024-09-14T11:31:34.882 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:31:34.897 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.7 MB/s) 2024-09-14T11:31:34.902 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:31:34.917 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-14T11:31:34.922 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:31:34.938 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-09-14T11:31:34.946 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:31:34.961 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:31:34.964 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:31:34.978 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-14T11:31:34.981 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:31:34.997 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-14T11:31:34.998 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:31:35.013 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-14T11:31:35.017 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:31:35.031 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 2.0 MB/s) 2024-09-14T11:31:35.045 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:31:35.060 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:31:35.062 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:31:35.077 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.5 MB/s) 2024-09-14T11:31:35.083 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:31:35.098 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.5/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:31:35.109 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:31:35.124 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-14T11:31:35.127 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:31:35.142 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:31:35.144 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:31:35.158 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T11:31:35.163 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:31:35.178 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-14T11:31:35.184 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:31:35.200 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T11:31:35.205 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:31:35.221 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-14T11:31:35.225 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:31:35.239 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 120 kB/s) 2024-09-14T11:31:35.243 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:31:35.257 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-14T11:31:35.261 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:31:35.275 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T11:31:35.278 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:31:35.292 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:31:35.295 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:31:35.308 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:31:35.310 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:31:35.323 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:31:35.326 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:31:35.341 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:31:35.344 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:31:35.358 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 175 kB/s) 2024-09-14T11:31:35.362 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:31:35.376 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-14T11:31:35.380 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:31:35.394 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T11:31:35.397 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:31:35.412 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:31:35.436 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-14T11:31:35.439 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:31:35.456 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-14T11:31:35.458 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:31:35.473 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:31:35.476 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:31:35.490 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:31:35.494 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:31:35.508 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 467 kB/s) 2024-09-14T11:31:35.511 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:31:35.525 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-14T11:31:35.529 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:31:35.543 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-14T11:31:35.547 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:31:35.561 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-14T11:31:35.563 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:31:35.577 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:31:35.580 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:31:35.596 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 413 kB/s) 2024-09-14T11:31:35.598 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:31:35.612 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-14T11:31:35.614 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:31:35.628 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-14T11:31:35.631 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:31:35.645 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:31:35.663 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:31:35.665 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:31:35.678 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-14T11:31:35.682 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:31:35.696 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:31:35.713 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:31:35.719 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.2 MB/s) 2024-09-14T11:31:35.736 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:31:35.750 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:31:35.752 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:31:35.767 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.3 MB/s) 2024-09-14T11:31:35.771 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:31:35.785 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T11:31:35.788 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:31:35.803 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.4 MB/s) 2024-09-14T11:31:35.805 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:31:35.821 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 5.2 MB/s) 2024-09-14T11:31:35.826 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:31:35.840 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-14T11:31:35.842 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:31:35.856 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-14T11:31:35.858 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:31:35.872 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:31:35.874 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:31:35.888 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T11:31:35.890 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:31:35.905 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:31:35.907 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:31:35.920 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:31:35.923 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:31:35.937 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-14T11:31:35.939 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:31:35.954 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-14T11:31:35.956 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:31:35.970 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 246 kB/s) 2024-09-14T11:31:35.972 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:31:35.986 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:31:35.988 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:31:36.002 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:31:36.005 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:31:36.019 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:31:36.022 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:31:36.036 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:31:36.038 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:31:36.052 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:31:36.053 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:31:36.067 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:31:36.069 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:31:36.084 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:31:36.086 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:31:36.100 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-14T11:31:36.116 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:31:36.318 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 16 MB/s) 2024-09-14T11:31:36.319 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:31:36.319 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:31:36.319 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:31:36.320 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:31:36.320 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:31:36.337 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.7 MB/s) 2024-09-14T11:31:36.337 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:31:36.351 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 501 kB/s) 2024-09-14T11:31:36.351 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:31:36.370 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/35 kB Progress (2): 1.4/35 kB | 1.4/98 kB Progress (3): 1.4/35 kB | 1.4/98 kB | 1.4/16 kB Progress (3): 1.4/35 kB | 2.8/98 kB | 1.4/16 kB Progress (3): 1.4/35 kB | 2.8/98 kB | 2.8/16 kB Progress (3): 2.8/35 kB | 2.8/98 kB | 2.8/16 kB Progress (4): 2.8/35 kB | 2.8/98 kB | 2.8/16 kB | 1.4/49 kB Progress (4): 4.1/35 kB | 2.8/98 kB | 2.8/16 kB | 1.4/49 kB Progress (4): 4.1/35 kB | 2.8/98 kB | 4.1/16 kB | 1.4/49 kB Progress (4): 4.1/35 kB | 4.1/98 kB | 4.1/16 kB | 1.4/49 kB Progress (4): 5.5/35 kB | 4.1/98 kB | 4.1/16 kB | 1.4/49 kB Progress (4): 5.5/35 kB | 4.1/98 kB | 4.1/16 kB | 2.8/49 kB Progress (4): 6.9/35 kB | 4.1/98 kB | 4.1/16 kB | 2.8/49 kB Progress (4): 6.9/35 kB | 5.5/98 kB | 4.1/16 kB | 2.8/49 kB Progress (4): 6.9/35 kB | 5.5/98 kB | 5.5/16 kB | 2.8/49 kB Progress (4): 6.9/35 kB | 6.9/98 kB | 5.5/16 kB | 2.8/49 kB Progress (4): 8.3/35 kB | 6.9/98 kB | 5.5/16 kB | 2.8/49 kB Progress (4): 8.3/35 kB | 6.9/98 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 9.7/35 kB | 6.9/98 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 9.7/35 kB | 8.3/98 kB | 5.5/16 kB | 4.1/49 kB Progress (4): 9.7/35 kB | 8.3/98 kB | 6.9/16 kB | 4.1/49 kB Progress (4): 9.7/35 kB | 9.7/98 kB | 6.9/16 kB | 4.1/49 kB Progress (4): 11/35 kB | 9.7/98 kB | 6.9/16 kB | 4.1/49 kB Progress (4): 11/35 kB | 9.7/98 kB | 6.9/16 kB | 5.5/49 kB Progress (4): 12/35 kB | 9.7/98 kB | 6.9/16 kB | 5.5/49 kB Progress (4): 12/35 kB | 9.7/98 kB | 8.3/16 kB | 5.5/49 kB Progress (4): 12/35 kB | 11/98 kB | 8.3/16 kB | 5.5/49 kB Progress (4): 12/35 kB | 11/98 kB | 9.7/16 kB | 5.5/49 kB Progress (4): 14/35 kB | 11/98 kB | 9.7/16 kB | 5.5/49 kB Progress (4): 14/35 kB | 11/98 kB | 9.7/16 kB | 6.9/49 kB Progress (4): 15/35 kB | 11/98 kB | 9.7/16 kB | 6.9/49 kB Progress (4): 15/35 kB | 11/98 kB | 11/16 kB | 6.9/49 kB Progress (4): 15/35 kB | 12/98 kB | 11/16 kB | 6.9/49 kB Progress (4): 15/35 kB | 12/98 kB | 12/16 kB | 6.9/49 kB Progress (4): 15/35 kB | 14/98 kB | 12/16 kB | 6.9/49 kB Progress (5): 15/35 kB | 14/98 kB | 12/16 kB | 6.9/49 kB | 15/782 kB Progress (5): 16/35 kB | 14/98 kB | 12/16 kB | 6.9/49 kB | 15/782 kB Progress (5): 16/35 kB | 14/98 kB | 12/16 kB | 8.3/49 kB | 15/782 kB Progress (5): 18/35 kB | 14/98 kB | 12/16 kB | 8.3/49 kB | 15/782 kB Progress (5): 18/35 kB | 14/98 kB | 12/16 kB | 9.7/49 kB | 15/782 kB Progress (5): 18/35 kB | 15/98 kB | 12/16 kB | 9.7/49 kB | 15/782 kB Progress (5): 18/35 kB | 15/98 kB | 14/16 kB | 9.7/49 kB | 15/782 kB Progress (5): 18/35 kB | 15/98 kB | 14/16 kB | 11/49 kB | 15/782 kB Progress (5): 19/35 kB | 15/98 kB | 14/16 kB | 11/49 kB | 15/782 kB Progress (5): 19/35 kB | 15/98 kB | 14/16 kB | 11/49 kB | 31/782 kB Progress (5): 19/35 kB | 15/98 kB | 15/16 kB | 11/49 kB | 31/782 kB Progress (5): 19/35 kB | 16/98 kB | 15/16 kB | 11/49 kB | 31/782 kB Progress (5): 19/35 kB | 16/98 kB | 16 kB | 11/49 kB | 31/782 kB Progress (5): 21/35 kB | 16/98 kB | 16 kB | 11/49 kB | 31/782 kB Progress (5): 21/35 kB | 16/98 kB | 16 kB | 12/49 kB | 31/782 kB Progress (5): 22/35 kB | 16/98 kB | 16 kB | 12/49 kB | 31/782 kB Progress (5): 22/35 kB | 16/98 kB | 16 kB | 12/49 kB | 48/782 kB Progress (5): 22/35 kB | 18/98 kB | 16 kB | 12/49 kB | 48/782 kB Progress (5): 23/35 kB | 18/98 kB | 16 kB | 12/49 kB | 48/782 kB Progress (5): 23/35 kB | 18/98 kB | 16 kB | 14/49 kB | 48/782 kB Progress (5): 25/35 kB | 18/98 kB | 16 kB | 14/49 kB | 48/782 kB Progress (5): 25/35 kB | 18/98 kB | 16 kB | 15/49 kB | 48/782 kB Progress (5): 25/35 kB | 19/98 kB | 16 kB | 15/49 kB | 48/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-14T11:31:36.370 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 25/35 kB | 19/98 kB | 16/49 kB | 48/782 kB Progress (4): 26/35 kB | 19/98 kB | 16/49 kB | 48/782 kB Progress (4): 26/35 kB | 19/98 kB | 18/49 kB | 48/782 kB Progress (4): 26/35 kB | 19/98 kB | 18/49 kB | 64/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:31:36.378 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 26/35 kB | 21/98 kB | 18/49 kB | 64/782 kB Progress (4): 26/35 kB | 21/98 kB | 19/49 kB | 64/782 kB Progress (4): 27/35 kB | 21/98 kB | 19/49 kB | 64/782 kB Progress (4): 29/35 kB | 21/98 kB | 19/49 kB | 64/782 kB Progress (4): 29/35 kB | 21/98 kB | 21/49 kB | 64/782 kB Progress (4): 29/35 kB | 22/98 kB | 21/49 kB | 64/782 kB Progress (4): 29/35 kB | 22/98 kB | 22/49 kB | 64/782 kB Progress (4): 30/35 kB | 22/98 kB | 22/49 kB | 64/782 kB Progress (4): 30/35 kB | 22/98 kB | 23/49 kB | 64/782 kB Progress (4): 30/35 kB | 22/98 kB | 23/49 kB | 78/782 kB Progress (4): 30/35 kB | 23/98 kB | 23/49 kB | 78/782 kB Progress (4): 30/35 kB | 23/98 kB | 25/49 kB | 78/782 kB Progress (4): 30/35 kB | 25/98 kB | 25/49 kB | 78/782 kB Progress (4): 30/35 kB | 25/98 kB | 26/49 kB | 78/782 kB Progress (4): 30/35 kB | 26/98 kB | 26/49 kB | 78/782 kB Progress (4): 30/35 kB | 26/98 kB | 27/49 kB | 78/782 kB Progress (4): 30/35 kB | 27/98 kB | 27/49 kB | 78/782 kB Progress (4): 30/35 kB | 27/98 kB | 29/49 kB | 78/782 kB Progress (4): 30/35 kB | 29/98 kB | 29/49 kB | 78/782 kB Progress (4): 30/35 kB | 29/98 kB | 30/49 kB | 78/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 78/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 94/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 111/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 127/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 143/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 160/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 176/782 kB Progress (4): 30/35 kB | 30/98 kB | 30/49 kB | 192/782 kB Progress (4): 32/35 kB | 30/98 kB | 30/49 kB | 192/782 kB Progress (4): 32/35 kB | 32/98 kB | 30/49 kB | 192/782 kB Progress (4): 33/35 kB | 32/98 kB | 30/49 kB | 192/782 kB Progress (4): 33/35 kB | 33/98 kB | 30/49 kB | 192/782 kB Progress (4): 33/35 kB | 33/98 kB | 32/49 kB | 192/782 kB Progress (4): 33/35 kB | 34/98 kB | 32/49 kB | 192/782 kB Progress (4): 34/35 kB | 34/98 kB | 32/49 kB | 192/782 kB Progress (4): 34/35 kB | 36/98 kB | 32/49 kB | 192/782 kB Progress (4): 34/35 kB | 36/98 kB | 33/49 kB | 192/782 kB Progress (4): 34/35 kB | 37/98 kB | 33/49 kB | 192/782 kB Progress (4): 34/35 kB | 37/98 kB | 34/49 kB | 192/782 kB Progress (4): 35 kB | 37/98 kB | 34/49 kB | 192/782 kB Progress (4): 35 kB | 37/98 kB | 36/49 kB | 192/782 kB Progress (4): 35 kB | 38/98 kB | 36/49 kB | 192/782 kB Progress (4): 35 kB | 38/98 kB | 37/49 kB | 192/782 kB Progress (4): 35 kB | 40/98 kB | 37/49 kB | 192/782 kB Progress (4): 35 kB | 40/98 kB | 38/49 kB | 192/782 kB Progress (4): 35 kB | 40/98 kB | 40/49 kB | 192/782 kB Progress (4): 35 kB | 41/98 kB | 40/49 kB | 192/782 kB Progress (4): 35 kB | 41/98 kB | 41/49 kB | 192/782 kB Progress (4): 35 kB | 41/98 kB | 43/49 kB | 192/782 kB Progress (4): 35 kB | 41/98 kB | 44/49 kB | 192/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-14T11:31:36.378 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 41/98 kB | 45/49 kB | 192/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:31:36.379 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 43/98 kB | 45/49 kB | 192/782 kB Progress (3): 44/98 kB | 45/49 kB | 192/782 kB Progress (3): 45/98 kB | 45/49 kB | 192/782 kB Progress (3): 47/98 kB | 45/49 kB | 192/782 kB Progress (3): 47/98 kB | 45/49 kB | 209/782 kB Progress (3): 48/98 kB | 45/49 kB | 209/782 kB Progress (3): 49/98 kB | 45/49 kB | 209/782 kB Progress (3): 51/98 kB | 45/49 kB | 209/782 kB Progress (3): 51/98 kB | 45/49 kB | 225/782 kB Progress (3): 51/98 kB | 47/49 kB | 225/782 kB Progress (3): 52/98 kB | 47/49 kB | 225/782 kB Progress (3): 52/98 kB | 48/49 kB | 225/782 kB Progress (3): 53/98 kB | 48/49 kB | 225/782 kB Progress (3): 53/98 kB | 49 kB | 225/782 kB Progress (3): 55/98 kB | 49 kB | 225/782 kB Progress (3): 56/98 kB | 49 kB | 225/782 kB Progress (3): 56/98 kB | 49 kB | 242/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-14T11:31:36.379 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:31:36.382 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 56/98 kB | 258/782 kB Progress (2): 57/98 kB | 258/782 kB Progress (2): 59/98 kB | 258/782 kB Progress (2): 60/98 kB | 258/782 kB Progress (2): 62/98 kB | 258/782 kB Progress (2): 62/98 kB | 274/782 kB Progress (2): 62/98 kB | 291/782 kB Progress (2): 62/98 kB | 307/782 kB Progress (3): 62/98 kB | 307/782 kB | 1.4/11 kB Progress (3): 62/98 kB | 307/782 kB | 2.8/11 kB Progress (3): 62/98 kB | 307/782 kB | 4.1/11 kB Progress (3): 62/98 kB | 307/782 kB | 5.5/11 kB Progress (3): 62/98 kB | 307/782 kB | 6.9/11 kB Progress (3): 62/98 kB | 307/782 kB | 8.3/11 kB Progress (3): 62/98 kB | 307/782 kB | 9.7/11 kB Progress (3): 62/98 kB | 324/782 kB | 9.7/11 kB Progress (3): 62/98 kB | 324/782 kB | 11/11 kB Progress (3): 62/98 kB | 324/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 186 kB/s) 2024-09-14T11:31:36.382 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 62/98 kB | 340/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:31:36.388 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 62/98 kB | 352/782 kB Progress (2): 62/98 kB | 369/782 kB Progress (2): 62/98 kB | 385/782 kB Progress (2): 62/98 kB | 401/782 kB Progress (2): 62/98 kB | 418/782 kB Progress (2): 63/98 kB | 418/782 kB Progress (2): 79/98 kB | 418/782 kB Progress (2): 95/98 kB | 418/782 kB Progress (2): 98 kB | 418/782 kB Progress (2): 98 kB | 434/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-14T11:31:36.388 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:31:36.393 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 434/782 kB | 1.4/205 kB Progress (2): 450/782 kB | 1.4/205 kB Progress (2): 450/782 kB | 2.8/205 kB Progress (2): 450/782 kB | 4.1/205 kB Progress (2): 450/782 kB | 5.5/205 kB Progress (2): 450/782 kB | 6.9/205 kB Progress (2): 450/782 kB | 8.3/205 kB Progress (2): 450/782 kB | 9.7/205 kB Progress (2): 467/782 kB | 9.7/205 kB Progress (2): 467/782 kB | 11/205 kB Progress (2): 467/782 kB | 12/205 kB Progress (2): 467/782 kB | 14/205 kB Progress (2): 467/782 kB | 15/205 kB Progress (2): 483/782 kB | 15/205 kB Progress (2): 500/782 kB | 15/205 kB Progress (2): 516/782 kB | 15/205 kB Progress (3): 516/782 kB | 15/205 kB | 16/30 kB Progress (3): 532/782 kB | 15/205 kB | 16/30 kB Progress (3): 549/782 kB | 15/205 kB | 16/30 kB Progress (3): 549/782 kB | 15/205 kB | 30 kB Progress (3): 565/782 kB | 15/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 414 kB/s) 2024-09-14T11:31:36.393 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:31:36.405 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 582/782 kB | 15/205 kB Progress (3): 582/782 kB | 15/205 kB | 1.4/81 kB Progress (3): 598/782 kB | 15/205 kB | 1.4/81 kB Progress (3): 598/782 kB | 15/205 kB | 2.8/81 kB Progress (3): 598/782 kB | 15/205 kB | 4.1/81 kB Progress (3): 614/782 kB | 15/205 kB | 4.1/81 kB Progress (3): 614/782 kB | 15/205 kB | 5.5/81 kB Progress (3): 614/782 kB | 15/205 kB | 6.9/81 kB Progress (3): 614/782 kB | 15/205 kB | 8.3/81 kB Progress (3): 614/782 kB | 15/205 kB | 9.7/81 kB Progress (3): 631/782 kB | 15/205 kB | 9.7/81 kB Progress (3): 631/782 kB | 15/205 kB | 11/81 kB Progress (3): 631/782 kB | 15/205 kB | 12/81 kB Progress (3): 631/782 kB | 15/205 kB | 14/81 kB Progress (3): 631/782 kB | 15/205 kB | 15/81 kB Progress (3): 631/782 kB | 15/205 kB | 16/81 kB Progress (3): 647/782 kB | 15/205 kB | 16/81 kB Progress (3): 663/782 kB | 15/205 kB | 16/81 kB Progress (3): 663/782 kB | 31/205 kB | 16/81 kB Progress (3): 680/782 kB | 31/205 kB | 16/81 kB Progress (3): 696/782 kB | 31/205 kB | 16/81 kB Progress (3): 696/782 kB | 48/205 kB | 16/81 kB Progress (3): 713/782 kB | 48/205 kB | 16/81 kB Progress (4): 713/782 kB | 48/205 kB | 16/81 kB | 16/798 kB Progress (4): 713/782 kB | 64/205 kB | 16/81 kB | 16/798 kB Progress (4): 713/782 kB | 64/205 kB | 16/81 kB | 32/798 kB Progress (4): 729/782 kB | 64/205 kB | 16/81 kB | 32/798 kB Progress (4): 729/782 kB | 64/205 kB | 16/81 kB | 49/798 kB Progress (4): 729/782 kB | 77/205 kB | 16/81 kB | 49/798 kB Progress (4): 745/782 kB | 77/205 kB | 16/81 kB | 49/798 kB Progress (4): 762/782 kB | 77/205 kB | 16/81 kB | 49/798 kB Progress (4): 762/782 kB | 77/205 kB | 16/81 kB | 62/798 kB Progress (4): 762/782 kB | 94/205 kB | 16/81 kB | 62/798 kB Progress (4): 778/782 kB | 94/205 kB | 16/81 kB | 62/798 kB Progress (4): 782 kB | 94/205 kB | 16/81 kB | 62/798 kB Progress (4): 782 kB | 94/205 kB | 16/81 kB | 78/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.2 MB/s) 2024-09-14T11:31:36.405 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:31:36.408 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 110/205 kB | 16/81 kB | 78/798 kB Progress (3): 110/205 kB | 16/81 kB | 95/798 kB Progress (3): 127/205 kB | 16/81 kB | 95/798 kB Progress (3): 127/205 kB | 33/81 kB | 95/798 kB Progress (4): 127/205 kB | 33/81 kB | 95/798 kB | 13 kB Progress (4): 127/205 kB | 49/81 kB | 95/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-14T11:31:36.408 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:31:36.412 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 127/205 kB | 66/81 kB | 95/798 kB Progress (3): 127/205 kB | 81 kB | 95/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 893 kB/s) 2024-09-14T11:31:36.412 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:31:36.416 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 143/205 kB | 95/798 kB Progress (2): 159/205 kB | 95/798 kB Progress (2): 159/205 kB | 111/798 kB Progress (2): 159/205 kB | 128/798 kB Progress (2): 176/205 kB | 128/798 kB Progress (2): 192/205 kB | 128/798 kB Progress (2): 192/205 kB | 144/798 kB Progress (2): 205 kB | 144/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-14T11:31:36.416 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 160/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:31:36.427 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 177/798 kB Progress (1): 193/798 kB Progress (1): 209/798 kB Progress (1): 226/798 kB Progress (1): 242/798 kB Progress (1): 259/798 kB Progress (2): 259/798 kB | 16/182 kB Progress (2): 275/798 kB | 16/182 kB Progress (2): 291/798 kB | 16/182 kB Progress (2): 291/798 kB | 33/182 kB Progress (2): 291/798 kB | 49/182 kB Progress (2): 291/798 kB | 66/182 kB Progress (2): 291/798 kB | 82/182 kB Progress (3): 291/798 kB | 82/182 kB | 15/151 kB Progress (3): 291/798 kB | 98/182 kB | 15/151 kB Progress (3): 291/798 kB | 111/182 kB | 15/151 kB Progress (3): 291/798 kB | 127/182 kB | 15/151 kB Progress (3): 291/798 kB | 127/182 kB | 31/151 kB Progress (3): 291/798 kB | 143/182 kB | 31/151 kB Progress (3): 291/798 kB | 143/182 kB | 48/151 kB Progress (3): 308/798 kB | 143/182 kB | 48/151 kB Progress (3): 324/798 kB | 143/182 kB | 48/151 kB Progress (3): 324/798 kB | 160/182 kB | 48/151 kB Progress (4): 324/798 kB | 160/182 kB | 48/151 kB | 16/27 kB Progress (4): 341/798 kB | 160/182 kB | 48/151 kB | 16/27 kB Progress (4): 341/798 kB | 176/182 kB | 48/151 kB | 16/27 kB Progress (4): 341/798 kB | 176/182 kB | 48/151 kB | 27 kB Progress (4): 357/798 kB | 176/182 kB | 48/151 kB | 27 kB Progress (4): 357/798 kB | 182 kB | 48/151 kB | 27 kB Progress (4): 357/798 kB | 182 kB | 64/151 kB | 27 kB Progress (4): 373/798 kB | 182 kB | 64/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 260 kB/s) 2024-09-14T11:31:36.427 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:31:36.427 INFO:tasks.workunit.client.0.smithi116.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:31:36.427 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 390/798 kB | 64/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:31:36.430 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 406/798 kB | 64/151 kB Progress (2): 422/798 kB | 64/151 kB Progress (2): 439/798 kB | 64/151 kB Progress (2): 455/798 kB | 64/151 kB Progress (2): 472/798 kB | 64/151 kB Progress (2): 488/798 kB | 64/151 kB Progress (3): 488/798 kB | 64/151 kB | 16/30 kB Progress (3): 504/798 kB | 64/151 kB | 16/30 kB Progress (3): 504/798 kB | 64/151 kB | 30 kB Progress (3): 521/798 kB | 64/151 kB | 30 kB Progress (3): 537/798 kB | 64/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 276 kB/s) 2024-09-14T11:31:36.430 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:31:36.438 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 554/798 kB | 64/151 kB Progress (2): 570/798 kB | 64/151 kB Progress (2): 586/798 kB | 64/151 kB Progress (2): 603/798 kB | 64/151 kB Progress (2): 619/798 kB | 64/151 kB Progress (2): 635/798 kB | 64/151 kB Progress (2): 652/798 kB | 64/151 kB Progress (2): 668/798 kB | 64/151 kB Progress (2): 685/798 kB | 64/151 kB Progress (2): 701/798 kB | 64/151 kB Progress (2): 701/798 kB | 79/151 kB Progress (2): 701/798 kB | 95/151 kB Progress (2): 701/798 kB | 111/151 kB Progress (2): 701/798 kB | 128/151 kB Progress (2): 701/798 kB | 144/151 kB Progress (2): 717/798 kB | 144/151 kB Progress (2): 734/798 kB | 144/151 kB Progress (2): 734/798 kB | 151 kB Progress (2): 750/798 kB | 151 kB Progress (2): 766/798 kB | 151 kB Progress (2): 783/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-14T11:31:36.438 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:31:36.439 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.8 MB/s) 2024-09-14T11:31:36.439 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:31:36.441 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 13 kB Progress (2): 13 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-14T11:31:36.441 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:31:36.445 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (2): 65/385 kB | 16/75 kB Progress (2): 82/385 kB | 16/75 kB Progress (2): 82/385 kB | 33/75 kB Progress (2): 82/385 kB | 49/75 kB Progress (2): 82/385 kB | 66/75 kB Progress (2): 98/385 kB | 66/75 kB Progress (2): 98/385 kB | 75 kB Progress (2): 114/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 601 kB/s) 2024-09-14T11:31:36.445 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:31:36.460 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (2): 213/385 kB | 16/329 kB Progress (2): 229/385 kB | 16/329 kB Progress (2): 229/385 kB | 33/329 kB Progress (2): 245/385 kB | 33/329 kB Progress (2): 245/385 kB | 49/329 kB Progress (2): 245/385 kB | 66/329 kB Progress (3): 245/385 kB | 66/329 kB | 16/780 kB Progress (3): 245/385 kB | 81/329 kB | 16/780 kB Progress (3): 262/385 kB | 81/329 kB | 16/780 kB Progress (3): 262/385 kB | 81/329 kB | 33/780 kB Progress (3): 262/385 kB | 81/329 kB | 49/780 kB Progress (3): 262/385 kB | 81/329 kB | 66/780 kB Progress (3): 262/385 kB | 97/329 kB | 66/780 kB Progress (4): 262/385 kB | 97/329 kB | 66/780 kB | 16/501 kB Progress (4): 262/385 kB | 97/329 kB | 82/780 kB | 16/501 kB Progress (4): 278/385 kB | 97/329 kB | 82/780 kB | 16/501 kB Progress (4): 278/385 kB | 114/329 kB | 82/780 kB | 16/501 kB Progress (4): 278/385 kB | 114/329 kB | 98/780 kB | 16/501 kB Progress (4): 278/385 kB | 114/329 kB | 98/780 kB | 33/501 kB Progress (4): 278/385 kB | 130/329 kB | 98/780 kB | 33/501 kB Progress (4): 278/385 kB | 130/329 kB | 115/780 kB | 33/501 kB Progress (4): 295/385 kB | 130/329 kB | 115/780 kB | 33/501 kB Progress (4): 295/385 kB | 146/329 kB | 115/780 kB | 33/501 kB Progress (4): 295/385 kB | 146/329 kB | 131/780 kB | 33/501 kB Progress (4): 295/385 kB | 146/329 kB | 131/780 kB | 49/501 kB Progress (4): 311/385 kB | 146/329 kB | 131/780 kB | 49/501 kB Progress (4): 311/385 kB | 146/329 kB | 147/780 kB | 49/501 kB Progress (4): 311/385 kB | 163/329 kB | 147/780 kB | 49/501 kB Progress (4): 311/385 kB | 163/329 kB | 164/780 kB | 49/501 kB Progress (4): 311/385 kB | 179/329 kB | 164/780 kB | 49/501 kB Progress (4): 327/385 kB | 179/329 kB | 164/780 kB | 49/501 kB Progress (4): 327/385 kB | 179/329 kB | 164/780 kB | 63/501 kB Progress (4): 327/385 kB | 179/329 kB | 180/780 kB | 63/501 kB Progress (4): 327/385 kB | 179/329 kB | 197/780 kB | 63/501 kB Progress (4): 327/385 kB | 195/329 kB | 197/780 kB | 63/501 kB Progress (4): 327/385 kB | 195/329 kB | 213/780 kB | 63/501 kB Progress (4): 327/385 kB | 212/329 kB | 213/780 kB | 63/501 kB Progress (4): 344/385 kB | 212/329 kB | 213/780 kB | 63/501 kB Progress (4): 344/385 kB | 212/329 kB | 213/780 kB | 79/501 kB Progress (4): 344/385 kB | 212/329 kB | 229/780 kB | 79/501 kB Progress (4): 344/385 kB | 212/329 kB | 229/780 kB | 96/501 kB Progress (4): 344/385 kB | 212/329 kB | 246/780 kB | 96/501 kB Progress (4): 344/385 kB | 212/329 kB | 262/780 kB | 96/501 kB Progress (4): 360/385 kB | 212/329 kB | 262/780 kB | 96/501 kB Progress (4): 360/385 kB | 212/329 kB | 262/780 kB | 112/501 kB Progress (5): 360/385 kB | 212/329 kB | 262/780 kB | 112/501 kB | 16/354 kB Progress (5): 360/385 kB | 212/329 kB | 279/780 kB | 112/501 kB | 16/354 kB Progress (5): 376/385 kB | 212/329 kB | 279/780 kB | 112/501 kB | 16/354 kB Progress (5): 376/385 kB | 212/329 kB | 295/780 kB | 112/501 kB | 16/354 kB Progress (5): 376/385 kB | 212/329 kB | 295/780 kB | 112/501 kB | 33/354 kB Progress (5): 385 kB | 212/329 kB | 295/780 kB | 112/501 kB | 33/354 kB Progress (5): 385 kB | 212/329 kB | 311/780 kB | 112/501 kB | 33/354 kB Progress (5): 385 kB | 212/329 kB | 311/780 kB | 112/501 kB | 49/354 kB Progress (5): 385 kB | 212/329 kB | 328/780 kB | 112/501 kB | 49/354 kB Progress (5): 385 kB | 212/329 kB | 328/780 kB | 112/501 kB | 63/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.8 MB/s) 2024-09-14T11:31:36.460 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:31:36.467 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 212/329 kB | 344/780 kB | 112/501 kB | 63/354 kB Progress (4): 212/329 kB | 344/780 kB | 112/501 kB | 79/354 kB Progress (4): 212/329 kB | 360/780 kB | 112/501 kB | 79/354 kB Progress (4): 212/329 kB | 360/780 kB | 112/501 kB | 96/354 kB Progress (4): 212/329 kB | 377/780 kB | 112/501 kB | 96/354 kB Progress (4): 212/329 kB | 377/780 kB | 112/501 kB | 112/354 kB Progress (4): 212/329 kB | 393/780 kB | 112/501 kB | 112/354 kB Progress (4): 212/329 kB | 410/780 kB | 112/501 kB | 112/354 kB Progress (4): 212/329 kB | 410/780 kB | 112/501 kB | 128/354 kB Progress (4): 212/329 kB | 426/780 kB | 112/501 kB | 128/354 kB Progress (4): 212/329 kB | 426/780 kB | 112/501 kB | 145/354 kB Progress (4): 212/329 kB | 442/780 kB | 112/501 kB | 145/354 kB Progress (4): 212/329 kB | 459/780 kB | 112/501 kB | 145/354 kB Progress (4): 212/329 kB | 459/780 kB | 112/501 kB | 161/354 kB Progress (4): 212/329 kB | 475/780 kB | 112/501 kB | 161/354 kB Progress (4): 212/329 kB | 475/780 kB | 112/501 kB | 177/354 kB Progress (4): 212/329 kB | 492/780 kB | 112/501 kB | 177/354 kB Progress (4): 212/329 kB | 508/780 kB | 112/501 kB | 177/354 kB Progress (4): 212/329 kB | 508/780 kB | 112/501 kB | 194/354 kB Progress (4): 212/329 kB | 524/780 kB | 112/501 kB | 194/354 kB Progress (4): 212/329 kB | 524/780 kB | 112/501 kB | 210/354 kB Progress (4): 212/329 kB | 541/780 kB | 112/501 kB | 210/354 kB Progress (4): 212/329 kB | 557/780 kB | 112/501 kB | 210/354 kB Progress (4): 212/329 kB | 557/780 kB | 112/501 kB | 227/354 kB Progress (4): 212/329 kB | 573/780 kB | 112/501 kB | 227/354 kB Progress (4): 212/329 kB | 585/780 kB | 112/501 kB | 227/354 kB Progress (4): 212/329 kB | 585/780 kB | 112/501 kB | 243/354 kB Progress (4): 228/329 kB | 585/780 kB | 112/501 kB | 243/354 kB Progress (4): 228/329 kB | 601/780 kB | 112/501 kB | 243/354 kB Progress (4): 245/329 kB | 601/780 kB | 112/501 kB | 243/354 kB Progress (4): 245/329 kB | 601/780 kB | 112/501 kB | 259/354 kB Progress (4): 245/329 kB | 617/780 kB | 112/501 kB | 259/354 kB Progress (4): 261/329 kB | 617/780 kB | 112/501 kB | 259/354 kB Progress (4): 261/329 kB | 634/780 kB | 112/501 kB | 259/354 kB Progress (4): 277/329 kB | 634/780 kB | 112/501 kB | 259/354 kB Progress (4): 277/329 kB | 650/780 kB | 112/501 kB | 259/354 kB Progress (4): 277/329 kB | 667/780 kB | 112/501 kB | 259/354 kB Progress (4): 294/329 kB | 667/780 kB | 112/501 kB | 259/354 kB Progress (4): 294/329 kB | 683/780 kB | 112/501 kB | 259/354 kB Progress (4): 310/329 kB | 683/780 kB | 112/501 kB | 259/354 kB Progress (4): 310/329 kB | 699/780 kB | 112/501 kB | 259/354 kB Progress (4): 326/329 kB | 699/780 kB | 112/501 kB | 259/354 kB Progress (4): 326/329 kB | 716/780 kB | 112/501 kB | 259/354 kB Progress (4): 329 kB | 716/780 kB | 112/501 kB | 259/354 kB Progress (4): 329 kB | 716/780 kB | 128/501 kB | 259/354 kB Progress (4): 329 kB | 732/780 kB | 128/501 kB | 259/354 kB Progress (4): 329 kB | 749/780 kB | 128/501 kB | 259/354 kB Progress (4): 329 kB | 749/780 kB | 145/501 kB | 259/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-14T11:31:36.467 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 765/780 kB | 145/501 kB | 259/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:31:36.467 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 780 kB | 145/501 kB | 259/354 kB Progress (3): 780 kB | 161/501 kB | 259/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.3 MB/s) 2024-09-14T11:31:36.467 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:31:36.472 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 177/501 kB | 259/354 kB Progress (2): 194/501 kB | 259/354 kB Progress (2): 210/501 kB | 259/354 kB Progress (2): 227/501 kB | 259/354 kB Progress (2): 243/501 kB | 259/354 kB Progress (2): 243/501 kB | 276/354 kB Progress (2): 259/501 kB | 276/354 kB Progress (2): 259/501 kB | 292/354 kB Progress (2): 259/501 kB | 309/354 kB Progress (2): 276/501 kB | 309/354 kB Progress (2): 276/501 kB | 325/354 kB Progress (2): 292/501 kB | 325/354 kB Progress (2): 292/501 kB | 341/354 kB Progress (2): 292/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-14T11:31:36.472 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 309/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:31:36.475 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 309/501 kB | 16/41 kB Progress (2): 309/501 kB | 33/41 kB Progress (2): 309/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 271 kB/s) 2024-09-14T11:31:36.475 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:31:36.495 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 325/501 kB Progress (1): 341/501 kB Progress (1): 358/501 kB Progress (1): 374/501 kB Progress (2): 374/501 kB | 6.4 kB Progress (3): 374/501 kB | 6.4 kB | 14 kB Progress (4): 374/501 kB | 6.4 kB | 14 kB | 16/586 kB Progress (5): 374/501 kB | 6.4 kB | 14 kB | 16/586 kB | 16/211 kB Progress (5): 390/501 kB | 6.4 kB | 14 kB | 16/586 kB | 16/211 kB Progress (5): 390/501 kB | 6.4 kB | 14 kB | 33/586 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 84 kB/s) 2024-09-14T11:31:36.495 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 390/501 kB | 6.4 kB | 33/586 kB | 33/211 kB Progress (4): 407/501 kB | 6.4 kB | 33/586 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-14T11:31:36.495 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:31:36.495 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 407/501 kB | 49/586 kB | 33/211 kB Progress (3): 407/501 kB | 49/586 kB | 49/211 kB Progress (3): 423/501 kB | 49/586 kB | 49/211 kB Progress (3): 423/501 kB | 49/586 kB | 65/211 kB Progress (3): 423/501 kB | 66/586 kB | 65/211 kB Progress (3): 440/501 kB | 66/586 kB | 65/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:31:36.496 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 440/501 kB | 66/586 kB | 81/211 kB Progress (3): 440/501 kB | 82/586 kB | 81/211 kB Progress (3): 440/501 kB | 82/586 kB | 98/211 kB Progress (3): 456/501 kB | 82/586 kB | 98/211 kB Progress (3): 456/501 kB | 98/586 kB | 98/211 kB Progress (3): 456/501 kB | 98/586 kB | 114/211 kB Progress (3): 472/501 kB | 98/586 kB | 114/211 kB Progress (3): 472/501 kB | 98/586 kB | 131/211 kB Progress (3): 489/501 kB | 98/586 kB | 131/211 kB Progress (3): 489/501 kB | 115/586 kB | 131/211 kB Progress (3): 501 kB | 115/586 kB | 131/211 kB Progress (3): 501 kB | 115/586 kB | 147/211 kB Progress (3): 501 kB | 131/586 kB | 147/211 kB Progress (3): 501 kB | 131/586 kB | 163/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-14T11:31:36.496 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:31:36.496 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 147/586 kB | 163/211 kB Progress (2): 147/586 kB | 180/211 kB Progress (2): 147/586 kB | 196/211 kB Progress (2): 164/586 kB | 196/211 kB Progress (2): 164/586 kB | 211 kB Progress (2): 180/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:31:36.497 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:31:36.505 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 197/586 kB Progress (1): 213/586 kB Progress (1): 229/586 kB Progress (1): 246/586 kB Progress (1): 262/586 kB Progress (1): 279/586 kB Progress (1): 295/586 kB Progress (1): 311/586 kB Progress (1): 328/586 kB Progress (1): 344/586 kB Progress (1): 360/586 kB Progress (1): 377/586 kB Progress (1): 393/586 kB Progress (1): 410/586 kB Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (1): 459/586 kB Progress (1): 475/586 kB Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (1): 541/586 kB Progress (1): 557/586 kB Progress (1): 573/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:31:36.505 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:31:36.507 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/106 kB Progress (2): 16/106 kB | 6.8 kB Progress (2): 33/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-14T11:31:36.507 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:31:36.511 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 49/106 kB Progress (1): 65/106 kB Progress (2): 65/106 kB | 16/245 kB Progress (3): 65/106 kB | 16/245 kB | 15/205 kB Progress (3): 81/106 kB | 16/245 kB | 15/205 kB Progress (3): 81/106 kB | 16/245 kB | 31/205 kB Progress (3): 98/106 kB | 16/245 kB | 31/205 kB Progress (3): 98/106 kB | 16/245 kB | 48/205 kB Progress (3): 98/106 kB | 33/245 kB | 48/205 kB Progress (3): 98/106 kB | 33/245 kB | 64/205 kB Progress (3): 106 kB | 33/245 kB | 64/205 kB Progress (3): 106 kB | 33/245 kB | 81/205 kB Progress (3): 106 kB | 33/245 kB | 97/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 565 kB/s) 2024-09-14T11:31:36.511 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:31:36.513 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 33/245 kB | 113/205 kB Progress (2): 49/245 kB | 113/205 kB Progress (2): 49/245 kB | 126/205 kB Progress (2): 49/245 kB | 143/205 kB Progress (2): 49/245 kB | 159/205 kB Progress (2): 49/245 kB | 175/205 kB Progress (2): 66/245 kB | 175/205 kB Progress (2): 66/245 kB | 192/205 kB Progress (2): 66/245 kB | 205 kB Progress (2): 79/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:31:36.513 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:31:36.519 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (2): 145/245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 77 kB/s) 2024-09-14T11:31:36.519 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:31:36.521 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 145/245 kB | 16/16 kB Progress (2): 145/245 kB | 16 kB Progress (2): 161/245 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 83 kB/s) 2024-09-14T11:31:36.521 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:31:36.524 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (2): 210/245 kB | 6.4 kB Progress (2): 226/245 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-14T11:31:36.524 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:31:36.526 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 226/245 kB | 16/23 kB Progress (2): 243/245 kB | 16/23 kB Progress (2): 243/245 kB | 23 kB Progress (2): 245 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-14T11:31:36.527 INFO:tasks.workunit.client.0.smithi116.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 111 kB/s) 2024-09-14T11:31:36.535 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 114 kB/s) 2024-09-14T11:31:36.535 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-14T11:31:36.546 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 821 kB/s) 2024-09-14T11:31:36.563 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:36.563 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:31:36.569 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:31:36.583 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:31:36.585 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:31:36.599 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 392 kB/s) 2024-09-14T11:31:36.600 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:31:36.615 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-14T11:31:36.618 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:31:36.632 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:31:36.637 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:31:36.657 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 63/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.7 MB/s) 2024-09-14T11:31:36.657 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:31:36.680 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 9.3 MB/s) 2024-09-14T11:31:36.727 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:36.727 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:31:36.730 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:31:36.744 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:31:36.746 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:31:36.760 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:31:36.763 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:31:36.777 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:31:36.780 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:31:36.794 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:31:36.797 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:31:36.811 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:31:36.813 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:31:36.827 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-14T11:31:36.831 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:31:36.844 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:31:36.846 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:31:36.860 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:31:36.861 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:31:36.874 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T11:31:36.877 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:31:36.890 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 246 kB/s) 2024-09-14T11:31:36.892 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:31:36.905 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 643 kB/s) 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:31:36.921 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 643 kB/s) 2024-09-14T11:31:36.923 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:31:36.937 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:31:36.940 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:31:36.957 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:31:36.971 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-14T11:31:36.973 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:31:36.987 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:31:36.991 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:31:37.004 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 392 kB/s) 2024-09-14T11:31:37.008 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 192 kB/s) 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 16/55 kB | 16/269 kB | 8.5 kB Progress (3): 16/55 kB | 33/269 kB | 8.5 kB Progress (3): 33/55 kB | 33/269 kB | 8.5 kB Progress (3): 33/55 kB | 49/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 33/55 kB | 49/269 kB | 16/41 kB Progress (3): 33/55 kB | 66/269 kB | 16/41 kB Progress (3): 33/55 kB | 82/269 kB | 16/41 kB Progress (3): 49/55 kB | 82/269 kB | 16/41 kB Progress (3): 55 kB | 82/269 kB | 16/41 kB Progress (3): 55 kB | 96/269 kB | 16/41 kB Progress (3): 55 kB | 112/269 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-14T11:31:37.041 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 112/269 kB | 33/41 kB Progress (2): 112/269 kB | 41 kB Progress (2): 129/269 kB | 41 kB Progress (2): 145/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-14T11:31:37.042 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-14T11:31:37.056 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 64/327 kB | 16/587 kB Progress (2): 64/327 kB | 33/587 kB Progress (2): 81/327 kB | 33/587 kB Progress (2): 81/327 kB | 49/587 kB Progress (2): 97/327 kB | 49/587 kB Progress (2): 97/327 kB | 63/587 kB Progress (2): 113/327 kB | 63/587 kB Progress (2): 113/327 kB | 79/587 kB Progress (2): 130/327 kB | 79/587 kB Progress (2): 146/327 kB | 79/587 kB Progress (2): 146/327 kB | 96/587 kB Progress (2): 163/327 kB | 96/587 kB Progress (2): 163/327 kB | 112/587 kB Progress (2): 179/327 kB | 112/587 kB Progress (2): 179/327 kB | 128/587 kB Progress (2): 195/327 kB | 128/587 kB Progress (2): 195/327 kB | 145/587 kB Progress (2): 212/327 kB | 145/587 kB Progress (2): 228/327 kB | 145/587 kB Progress (2): 228/327 kB | 161/587 kB Progress (2): 245/327 kB | 161/587 kB Progress (2): 245/327 kB | 177/587 kB Progress (2): 261/327 kB | 177/587 kB Progress (2): 261/327 kB | 194/587 kB Progress (2): 277/327 kB | 194/587 kB Progress (2): 277/327 kB | 210/587 kB Progress (2): 294/327 kB | 210/587 kB Progress (2): 294/327 kB | 227/587 kB Progress (2): 310/327 kB | 227/587 kB Progress (2): 326/327 kB | 227/587 kB Progress (2): 326/327 kB | 243/587 kB Progress (2): 327 kB | 243/587 kB Progress (2): 327 kB | 259/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 11 MB/s) 2024-09-14T11:31:37.061 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 276/587 kB Progress (1): 292/587 kB Progress (1): 309/587 kB Progress (1): 325/587 kB Progress (1): 341/587 kB Progress (1): 358/587 kB Progress (1): 374/587 kB Progress (1): 390/587 kB Progress (1): 407/587 kB Progress (1): 423/587 kB Progress (1): 440/587 kB Progress (1): 456/587 kB Progress (1): 472/587 kB Progress (1): 489/587 kB Progress (1): 505/587 kB Progress (1): 522/587 kB Progress (1): 538/587 kB Progress (1): 554/587 kB Progress (1): 571/587 kB Progress (1): 583/587 kB Progress (1): 587/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 16 MB/s) 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:31:37.181 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:31:37.183 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:31:37.198 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-14T11:31:37.201 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:31:37.216 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-09-14T11:31:37.219 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:31:37.234 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T11:31:37.237 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 505 kB/s) 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:31:37.370 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-14T11:31:37.374 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:31:37.389 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-14T11:31:37.393 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:31:37.407 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:31:37.411 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:31:37.426 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-14T11:31:37.428 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:31:37.442 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:31:37.444 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:31:37.457 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.2/26 kB Progress (1): 15/26 kB Progress (1): 25/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:31:37.461 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:31:37.475 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:31:37.476 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:31:37.490 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T11:31:37.497 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:31:37.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 15/122 kB Progress (3): 4.2 kB | 15/122 kB | 16/55 kB Progress (3): 4.2 kB | 31/122 kB | 16/55 kB Progress (3): 4.2 kB | 31/122 kB | 33/55 kB Progress (4): 4.2 kB | 31/122 kB | 33/55 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 48/122 kB | 33/55 kB | 16/27 kB Progress (3): 48/122 kB | 49/55 kB | 16/27 kB Progress (3): 64/122 kB | 49/55 kB | 16/27 kB Progress (3): 64/122 kB | 55 kB | 16/27 kB Progress (3): 64/122 kB | 55 kB | 27 kB Progress (4): 64/122 kB | 55 kB | 27 kB | 16/334 kB Progress (4): 81/122 kB | 55 kB | 27 kB | 16/334 kB Progress (4): 97/122 kB | 55 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:31:37.528 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 113/122 kB | 16/334 kB Progress (2): 122 kB | 16/334 kB Progress (2): 122 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-14T11:31:37.541 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 49/334 kB Progress (1): 66/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (2): 180/334 kB | 16/267 kB Progress (3): 180/334 kB | 16/267 kB | 4.7 kB Progress (4): 180/334 kB | 16/267 kB | 4.7 kB | 16/23 kB Progress (4): 196/334 kB | 16/267 kB | 4.7 kB | 16/23 kB Progress (4): 196/334 kB | 33/267 kB | 4.7 kB | 16/23 kB Progress (4): 196/334 kB | 49/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-14T11:31:37.541 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 196/334 kB | 49/267 kB | 23 kB Progress (3): 196/334 kB | 63/267 kB | 23 kB Progress (3): 196/334 kB | 80/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-14T11:31:37.544 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 213/334 kB | 80/267 kB Progress (2): 213/334 kB | 96/267 kB Progress (2): 213/334 kB | 112/267 kB Progress (2): 213/334 kB | 129/267 kB Progress (2): 213/334 kB | 145/267 kB Progress (2): 229/334 kB | 145/267 kB Progress (2): 229/334 kB | 162/267 kB Progress (2): 229/334 kB | 178/267 kB Progress (2): 229/334 kB | 194/267 kB Progress (2): 229/334 kB | 211/267 kB Progress (2): 245/334 kB | 211/267 kB Progress (2): 245/334 kB | 227/267 kB Progress (2): 245/334 kB | 244/267 kB Progress (2): 245/334 kB | 260/267 kB Progress (2): 245/334 kB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 8.4 MB/s) 2024-09-14T11:31:37.599 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:31:37.600 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:31:38.163 INFO:tasks.workunit.client.0.smithi116.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:31:38.163 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:38.163 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:31:38.166 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:31:38.166 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:38.166 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:31:38.170 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:31:38.170 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:31:38.350 INFO:tasks.workunit.client.0.smithi116.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:31:38.350 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:38.350 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:31:38.356 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:31:38.370 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-14T11:31:38.374 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:31:38.389 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:31:38.394 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:31:38.407 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:31:38.410 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:31:38.425 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-14T11:31:38.428 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:31:38.442 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-14T11:31:38.445 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:31:38.459 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:31:38.462 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:31:38.476 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 136 kB/s) 2024-09-14T11:31:38.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:31:38.492 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-14T11:31:38.494 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:31:38.509 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:31:38.512 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:31:38.526 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:31:38.529 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:31:38.543 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:31:38.547 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:31:38.560 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:31:38.563 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:31:38.577 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:31:38.579 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:31:38.595 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.4/37 kB Progress (1): 20/37 kB Progress (1): 36/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-14T11:31:38.597 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:31:38.612 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:31:38.614 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:31:38.628 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:31:38.630 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:31:38.644 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-14T11:31:38.647 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:31:38.661 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:31:38.665 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:31:38.679 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:31:38.682 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:31:38.696 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:31:38.699 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:31:38.713 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:31:38.715 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:31:38.729 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:31:38.730 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:31:38.744 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:31:38.747 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:31:38.761 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-09-14T11:31:38.763 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:31:38.777 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 904 kB/s) 2024-09-14T11:31:38.781 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:31:38.794 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:31:38.796 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:31:38.809 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:31:38.811 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:31:38.825 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:31:38.827 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:31:38.841 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:31:38.844 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:31:38.858 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:31:38.862 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:31:38.876 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 233 kB/s) 2024-09-14T11:31:38.879 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:31:38.894 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T11:31:38.896 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:31:38.910 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-14T11:31:38.913 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:31:38.927 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:31:38.929 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:31:38.990 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 77 kB/s) 2024-09-14T11:31:38.993 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:31:39.006 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:31:39.009 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:31:39.024 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.0 MB/s) 2024-09-14T11:31:39.027 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:31:39.041 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:31:39.043 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:31:39.057 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-14T11:31:39.059 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:31:39.073 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-14T11:31:39.074 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:31:39.088 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-14T11:31:39.090 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:31:39.103 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:31:39.105 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:31:39.119 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 230 kB/s) 2024-09-14T11:31:39.121 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:31:39.134 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 327 kB/s) 2024-09-14T11:31:39.137 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:31:39.150 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 158 kB/s) 2024-09-14T11:31:39.153 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:31:39.166 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:31:39.169 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:31:39.182 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:31:39.184 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:31:39.198 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:31:39.200 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:31:39.214 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-14T11:31:39.216 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:31:39.230 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-14T11:31:39.232 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:31:39.245 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-14T11:31:39.247 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:31:39.260 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 564 kB/s) 2024-09-14T11:31:39.262 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:31:39.276 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-14T11:31:39.278 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:31:39.291 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T11:31:39.294 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:31:39.308 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:31:39.309 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:31:39.327 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-14T11:31:39.330 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:31:39.345 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-14T11:31:39.348 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:31:39.361 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T11:31:39.363 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:31:39.376 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 329 kB/s) 2024-09-14T11:31:39.378 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:31:39.391 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-14T11:31:39.393 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:31:39.407 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-14T11:31:39.410 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:31:39.423 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-14T11:31:39.429 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:31:39.466 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 8.3 MB/s) 2024-09-14T11:31:39.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:31:39.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:31:39.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:31:39.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:31:39.479 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:31:39.481 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/171 kB Progress (2): 14 kB | 33/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-14T11:31:39.482 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 33/171 kB | 8.2 kB Progress (3): 33/171 kB | 8.2 kB | 15/118 kB Progress (3): 49/171 kB | 8.2 kB | 15/118 kB Progress (4): 49/171 kB | 8.2 kB | 15/118 kB | 16/26 kB Progress (4): 49/171 kB | 8.2 kB | 31/118 kB | 16/26 kB Progress (4): 66/171 kB | 8.2 kB | 31/118 kB | 16/26 kB Progress (4): 66/171 kB | 8.2 kB | 31/118 kB | 26 kB Progress (4): 66/171 kB | 8.2 kB | 48/118 kB | 26 kB Progress (4): 82/171 kB | 8.2 kB | 48/118 kB | 26 kB Progress (4): 82/171 kB | 8.2 kB | 64/118 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:31:39.482 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 98/171 kB | 8.2 kB | 64/118 kB | 26 kB Progress (4): 98/171 kB | 8.2 kB | 80/118 kB | 26 kB Progress (4): 113/171 kB | 8.2 kB | 80/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 113/171 kB | 8.2 kB | 97/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 511 kB/s) 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 130/171 kB | 97/118 kB Progress (2): 130/171 kB | 113/118 kB Progress (2): 130/171 kB | 118 kB Progress (2): 146/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 163/171 kB Progress (1): 171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:31:39.484 INFO:tasks.workunit.client.0.smithi116.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.0 MB/s) 2024-09-14T11:31:39.485 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:31:39.501 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (2): 49/146 kB | 16/61 kB Progress (3): 49/146 kB | 16/61 kB | 16/501 kB Progress (3): 49/146 kB | 33/61 kB | 16/501 kB Progress (3): 49/146 kB | 33/61 kB | 33/501 kB Progress (3): 49/146 kB | 49/61 kB | 33/501 kB Progress (3): 49/146 kB | 49/61 kB | 49/501 kB Progress (3): 49/146 kB | 61 kB | 49/501 kB Progress (3): 49/146 kB | 61 kB | 66/501 kB Progress (3): 62/146 kB | 61 kB | 66/501 kB Progress (4): 62/146 kB | 61 kB | 66/501 kB | 15/136 kB Progress (4): 62/146 kB | 61 kB | 82/501 kB | 15/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-14T11:31:39.501 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:31:39.501 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 62/146 kB | 82/501 kB | 15/136 kB | 16/58 kB Progress (4): 62/146 kB | 97/501 kB | 15/136 kB | 16/58 kB Progress (4): 62/146 kB | 97/501 kB | 31/136 kB | 16/58 kB Progress (4): 62/146 kB | 114/501 kB | 31/136 kB | 16/58 kB Progress (4): 62/146 kB | 114/501 kB | 48/136 kB | 16/58 kB Progress (4): 79/146 kB | 114/501 kB | 48/136 kB | 16/58 kB Progress (4): 79/146 kB | 130/501 kB | 48/136 kB | 16/58 kB Progress (4): 79/146 kB | 130/501 kB | 64/136 kB | 16/58 kB Progress (4): 79/146 kB | 147/501 kB | 64/136 kB | 16/58 kB Progress (4): 79/146 kB | 147/501 kB | 77/136 kB | 16/58 kB Progress (4): 79/146 kB | 147/501 kB | 77/136 kB | 31/58 kB Progress (4): 79/146 kB | 163/501 kB | 77/136 kB | 31/58 kB Progress (4): 79/146 kB | 163/501 kB | 93/136 kB | 31/58 kB Progress (4): 95/146 kB | 163/501 kB | 93/136 kB | 31/58 kB Progress (4): 95/146 kB | 179/501 kB | 93/136 kB | 31/58 kB Progress (4): 95/146 kB | 179/501 kB | 110/136 kB | 31/58 kB Progress (4): 95/146 kB | 196/501 kB | 110/136 kB | 31/58 kB Progress (4): 95/146 kB | 196/501 kB | 126/136 kB | 31/58 kB Progress (4): 95/146 kB | 196/501 kB | 136 kB | 31/58 kB Progress (4): 95/146 kB | 212/501 kB | 136 kB | 31/58 kB Progress (4): 95/146 kB | 212/501 kB | 136 kB | 48/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-14T11:31:39.501 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:31:39.501 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 95/146 kB | 212/501 kB | 58 kB Progress (3): 95/146 kB | 229/501 kB | 58 kB Progress (3): 112/146 kB | 229/501 kB | 58 kB Progress (3): 112/146 kB | 245/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-14T11:31:39.502 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 112/146 kB | 261/501 kB Progress (2): 112/146 kB | 278/501 kB Progress (2): 128/146 kB | 278/501 kB Progress (2): 128/146 kB | 294/501 kB Progress (2): 128/146 kB | 310/501 kB Progress (2): 128/146 kB | 327/501 kB Progress (2): 144/146 kB | 327/501 kB Progress (2): 146 kB | 327/501 kB Progress (2): 146 kB | 343/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-09-14T11:31:39.504 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:31:39.513 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-14T11:31:39.703 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 10 MB/s) 2024-09-14T11:31:39.773 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:39.773 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:31:39.777 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:31:39.792 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-14T11:31:39.794 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:31:39.807 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 376 kB/s) 2024-09-14T11:31:39.809 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:31:39.825 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.7 MB/s) 2024-09-14T11:31:39.827 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:31:39.842 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T11:31:39.844 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:31:39.858 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-14T11:31:39.861 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:31:39.875 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-14T11:31:39.877 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:31:39.891 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:31:39.893 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:31:39.907 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:31:39.909 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:31:39.923 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:31:39.927 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:31:39.941 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:31:39.943 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:31:39.957 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:31:39.959 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:31:39.972 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 632 kB/s) 2024-09-14T11:31:39.974 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:31:39.989 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 5.5/25 kB Progress (1): 15/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-14T11:31:39.993 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:31:40.009 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-14T11:31:40.010 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:31:40.010 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:31:40.010 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:31:40.010 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:31:40.010 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 15/26 kB Progress (2): 15/26 kB | 16/58 kB Progress (3): 15/26 kB | 16/58 kB | 16/211 kB Progress (4): 15/26 kB | 16/58 kB | 16/211 kB | 16/79 kB Progress (5): 15/26 kB | 16/58 kB | 16/211 kB | 16/79 kB | 0/1.0 MB Progress (5): 26 kB | 16/58 kB | 16/211 kB | 16/79 kB | 0/1.0 MB Progress (5): 26 kB | 33/58 kB | 16/211 kB | 16/79 kB | 0/1.0 MB Progress (5): 26 kB | 33/58 kB | 33/211 kB | 16/79 kB | 0/1.0 MB Progress (5): 26 kB | 33/58 kB | 33/211 kB | 33/79 kB | 0/1.0 MB Progress (5): 26 kB | 33/58 kB | 33/211 kB | 33/79 kB | 0/1.0 MB Progress (5): 26 kB | 49/58 kB | 33/211 kB | 33/79 kB | 0/1.0 MB Progress (5): 26 kB | 49/58 kB | 49/211 kB | 33/79 kB | 0/1.0 MB Progress (5): 26 kB | 49/58 kB | 49/211 kB | 49/79 kB | 0/1.0 MB Progress (5): 26 kB | 49/58 kB | 49/211 kB | 49/79 kB | 0/1.0 MB Progress (5): 26 kB | 58 kB | 49/211 kB | 49/79 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.1 MB/s) 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 58 kB | 63/211 kB | 49/79 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (4): 58 kB | 63/211 kB | 66/79 kB | 0/1.0 MB Progress (4): 58 kB | 63/211 kB | 66/79 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.4 MB/s) 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 79/211 kB | 66/79 kB | 0.1/1.0 MB Progress (3): 79/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 79/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 95/211 kB | 79 kB | 0.1/1.0 MB Progress (3): 95/211 kB | 79 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 3.2 MB/s) 2024-09-14T11:31:40.037 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 7.8 MB/s) 2024-09-14T11:31:40.051 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (2): 0.3/1.0 MB | 16/267 kB Progress (2): 0.3/1.0 MB | 33/267 kB Progress (2): 0.3/1.0 MB | 33/267 kB Progress (2): 0.3/1.0 MB | 49/267 kB Progress (3): 0.3/1.0 MB | 49/267 kB | 16/116 kB Progress (3): 0.3/1.0 MB | 49/267 kB | 16/116 kB Progress (3): 0.3/1.0 MB | 49/267 kB | 32/116 kB Progress (3): 0.3/1.0 MB | 66/267 kB | 32/116 kB Progress (3): 0.3/1.0 MB | 66/267 kB | 49/116 kB Progress (3): 0.3/1.0 MB | 66/267 kB | 49/116 kB Progress (3): 0.3/1.0 MB | 82/267 kB | 49/116 kB Progress (3): 0.3/1.0 MB | 82/267 kB | 62/116 kB Progress (3): 0.3/1.0 MB | 98/267 kB | 62/116 kB Progress (3): 0.3/1.0 MB | 98/267 kB | 78/116 kB Progress (3): 0.3/1.0 MB | 112/267 kB | 78/116 kB Progress (3): 0.3/1.0 MB | 112/267 kB | 78/116 kB Progress (3): 0.3/1.0 MB | 112/267 kB | 95/116 kB Progress (3): 0.3/1.0 MB | 128/267 kB | 95/116 kB Progress (3): 0.3/1.0 MB | 128/267 kB | 111/116 kB Progress (3): 0.3/1.0 MB | 145/267 kB | 111/116 kB Progress (3): 0.3/1.0 MB | 145/267 kB | 116 kB Progress (3): 0.3/1.0 MB | 161/267 kB | 116 kB Progress (3): 0.3/1.0 MB | 178/267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 2.8 MB/s) 2024-09-14T11:31:40.052 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 0.4/1.0 MB | 178/267 kB Progress (2): 0.4/1.0 MB | 194/267 kB Progress (2): 0.4/1.0 MB | 210/267 kB Progress (2): 0.4/1.0 MB | 210/267 kB Progress (2): 0.4/1.0 MB | 227/267 kB Progress (2): 0.4/1.0 MB | 243/267 kB Progress (2): 0.4/1.0 MB | 243/267 kB Progress (2): 0.4/1.0 MB | 260/267 kB Progress (2): 0.4/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.4 MB/s) 2024-09-14T11:31:40.087 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 13 MB/s) 2024-09-14T11:31:40.221 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:31:40.245 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:31:40.245 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:31:40.245 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:31:40.246 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Total time: 6.021 s 2024-09-14T11:31:40.246 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Finished at: 2024-09-14T11:31:40Z 2024-09-14T11:31:40.246 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:31:40.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:31:40.277 INFO:tasks.workunit.client.0.smithi116.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:31:41.285 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Scanning for projects... 2024-09-14T11:31:41.375 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.375 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:31:41.375 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:31:41.375 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] from pom.xml 2024-09-14T11:31:41.375 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:31:41.627 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.627 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:31:41.716 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:31:41.717 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.717 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:31:41.803 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:31:41.803 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.803 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:31:41.805 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:31:41.805 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.805 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:31:41.809 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:31:41.809 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:41.809 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:31:41.982 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:31:42.195 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:31:42.384 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:31:42.393 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:31:42.410 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:31:42.415 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:31:42.432 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 176 kB/s) 2024-09-14T11:31:42.436 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:31:42.452 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 202 kB/s) 2024-09-14T11:31:42.454 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:31:42.469 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 213 kB/s) 2024-09-14T11:31:42.472 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:31:42.487 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:31:42.490 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:31:42.505 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 189 kB/s) 2024-09-14T11:31:42.510 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:31:42.531 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:31:42.533 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:31:42.534 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:31:42.534 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:31:42.534 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:31:42.534 INFO:tasks.workunit.client.0.smithi116.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:31:42.552 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 878 kB/s) 2024-09-14T11:31:42.588 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/189 kB Progress (3): 1.4/7.7 kB | 1.4/189 kB | 1.4/169 kB Progress (3): 1.4/7.7 kB | 2.8/189 kB | 1.4/169 kB Progress (3): 1.4/7.7 kB | 2.8/189 kB | 2.8/169 kB Progress (3): 2.8/7.7 kB | 2.8/189 kB | 2.8/169 kB Progress (4): 2.8/7.7 kB | 2.8/189 kB | 2.8/169 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 2.8/189 kB | 2.8/169 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 2.8/189 kB | 4.1/169 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/189 kB | 4.1/169 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/189 kB | 5.5/169 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 5.5/169 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 4.1/189 kB | 5.5/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 4.1/189 kB | 5.5/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 4.1/189 kB | 6.9/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 6.9/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 5.5/189 kB | 8.3/169 kB | 2.8/103 kB Progress (4): 7.7 kB | 5.5/189 kB | 8.3/169 kB | 2.8/103 kB Progress (4): 7.7 kB | 5.5/189 kB | 8.3/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 5.5/189 kB | 9.7/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/189 kB | 9.7/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/189 kB | 11/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/189 kB | 11/169 kB | 5.5/103 kB Progress (4): 7.7 kB | 6.9/189 kB | 12/169 kB | 5.5/103 kB Progress (4): 7.7 kB | 8.3/189 kB | 12/169 kB | 5.5/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 137 kB/s) 2024-09-14T11:31:42.619 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (3): 9.7/189 kB | 12/169 kB | 5.5/103 kB Progress (3): 9.7/189 kB | 14/169 kB | 5.5/103 kB Progress (3): 9.7/189 kB | 14/169 kB | 6.9/103 kB Progress (3): 9.7/189 kB | 15/169 kB | 6.9/103 kB Progress (3): 11/189 kB | 15/169 kB | 6.9/103 kB Progress (3): 11/189 kB | 16/169 kB | 6.9/103 kB Progress (3): 11/189 kB | 16/169 kB | 8.3/103 kB Progress (3): 12/189 kB | 16/169 kB | 8.3/103 kB Progress (3): 12/189 kB | 16/169 kB | 9.7/103 kB Progress (3): 14/189 kB | 16/169 kB | 9.7/103 kB Progress (3): 14/189 kB | 16/169 kB | 11/103 kB Progress (3): 15/189 kB | 16/169 kB | 11/103 kB Progress (3): 15/189 kB | 16/169 kB | 12/103 kB Progress (3): 16/189 kB | 16/169 kB | 12/103 kB Progress (3): 16/189 kB | 16/169 kB | 14/103 kB Progress (3): 16/189 kB | 33/169 kB | 14/103 kB Progress (3): 16/189 kB | 33/169 kB | 15/103 kB Progress (3): 18/189 kB | 33/169 kB | 15/103 kB Progress (3): 18/189 kB | 33/169 kB | 16/103 kB Progress (3): 19/189 kB | 33/169 kB | 16/103 kB Progress (3): 19/189 kB | 33/169 kB | 18/103 kB Progress (3): 19/189 kB | 49/169 kB | 18/103 kB Progress (3): 21/189 kB | 49/169 kB | 18/103 kB Progress (3): 21/189 kB | 49/169 kB | 19/103 kB Progress (3): 22/189 kB | 49/169 kB | 19/103 kB Progress (3): 22/189 kB | 49/169 kB | 21/103 kB Progress (3): 23/189 kB | 49/169 kB | 21/103 kB Progress (3): 23/189 kB | 49/169 kB | 22/103 kB Progress (3): 25/189 kB | 49/169 kB | 22/103 kB Progress (3): 25/189 kB | 49/169 kB | 23/103 kB Progress (3): 26/189 kB | 49/169 kB | 23/103 kB Progress (3): 26/189 kB | 49/169 kB | 25/103 kB Progress (3): 27/189 kB | 49/169 kB | 25/103 kB Progress (3): 27/189 kB | 49/169 kB | 26/103 kB Progress (3): 29/189 kB | 49/169 kB | 26/103 kB Progress (3): 29/189 kB | 49/169 kB | 27/103 kB Progress (3): 30/189 kB | 49/169 kB | 27/103 kB Progress (3): 30/189 kB | 49/169 kB | 29/103 kB Progress (3): 32/189 kB | 49/169 kB | 29/103 kB Progress (3): 32/189 kB | 49/169 kB | 30/103 kB Progress (3): 33/189 kB | 49/169 kB | 30/103 kB Progress (3): 33/189 kB | 49/169 kB | 32/103 kB Progress (3): 34/189 kB | 49/169 kB | 32/103 kB Progress (3): 34/189 kB | 49/169 kB | 33/103 kB Progress (3): 36/189 kB | 49/169 kB | 33/103 kB Progress (3): 36/189 kB | 49/169 kB | 34/103 kB Progress (3): 37/189 kB | 49/169 kB | 34/103 kB Progress (3): 37/189 kB | 49/169 kB | 36/103 kB Progress (3): 38/189 kB | 49/169 kB | 36/103 kB Progress (3): 38/189 kB | 49/169 kB | 37/103 kB Progress (3): 40/189 kB | 49/169 kB | 37/103 kB Progress (3): 40/189 kB | 49/169 kB | 38/103 kB Progress (3): 41/189 kB | 49/169 kB | 38/103 kB Progress (3): 41/189 kB | 49/169 kB | 40/103 kB Progress (3): 41/189 kB | 66/169 kB | 40/103 kB Progress (3): 41/189 kB | 66/169 kB | 41/103 kB Progress (3): 43/189 kB | 66/169 kB | 41/103 kB Progress (3): 43/189 kB | 66/169 kB | 43/103 kB Progress (3): 44/189 kB | 66/169 kB | 43/103 kB Progress (3): 44/189 kB | 78/169 kB | 43/103 kB Progress (3): 44/189 kB | 78/169 kB | 44/103 kB Progress (3): 45/189 kB | 78/169 kB | 44/103 kB Progress (3): 45/189 kB | 78/169 kB | 45/103 kB Progress (3): 47/189 kB | 78/169 kB | 45/103 kB Progress (3): 47/189 kB | 78/169 kB | 47/103 kB Progress (3): 47/189 kB | 94/169 kB | 47/103 kB Progress (3): 47/189 kB | 94/169 kB | 48/103 kB Progress (3): 48/189 kB | 94/169 kB | 48/103 kB Progress (3): 48/189 kB | 94/169 kB | 49/103 kB Progress (3): 49/189 kB | 94/169 kB | 49/103 kB Progress (3): 49/189 kB | 94/169 kB | 51/103 kB Progress (3): 49/189 kB | 111/169 kB | 51/103 kB Progress (3): 49/189 kB | 111/169 kB | 52/103 kB Progress (3): 51/189 kB | 111/169 kB | 52/103 kB Progress (3): 51/189 kB | 111/169 kB | 54/103 kB Progress (3): 52/189 kB | 111/169 kB | 54/103 kB Progress (3): 52/189 kB | 111/169 kB | 55/103 kB Progress (3): 52/189 kB | 127/169 kB | 55/103 kB Progress (3): 52/189 kB | 127/169 kB | 56/103 kB Progress (3): 54/189 kB | 127/169 kB | 56/103 kB Progress (3): 54/189 kB | 127/169 kB | 58/103 kB Progress (3): 55/189 kB | 127/169 kB | 58/103 kB Progress (3): 55/189 kB | 143/169 kB | 58/103 kB Progress (3): 55/189 kB | 143/169 kB | 59/103 kB Progress (3): 56/189 kB | 143/169 kB | 59/103 kB Progress (3): 56/189 kB | 143/169 kB | 61/103 kB Progress (3): 58/189 kB | 143/169 kB | 61/103 kB Progress (3): 58/189 kB | 143/169 kB | 62/103 kB Progress (3): 59/189 kB | 143/169 kB | 62/103 kB Progress (3): 59/189 kB | 143/169 kB | 62/103 kB Progress (3): 61/189 kB | 143/169 kB | 62/103 kB Progress (3): 62/189 kB | 143/169 kB | 62/103 kB Progress (3): 63/189 kB | 143/169 kB | 62/103 kB Progress (3): 63/189 kB | 143/169 kB | 79/103 kB Progress (3): 63/189 kB | 160/169 kB | 79/103 kB Progress (3): 79/189 kB | 160/169 kB | 79/103 kB Progress (3): 79/189 kB | 169 kB | 79/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-14T11:31:42.621 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (2): 79/189 kB | 95/103 kB Progress (2): 96/189 kB | 95/103 kB Progress (2): 96/189 kB | 103 kB Progress (2): 112/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:31:42.631 INFO:tasks.workunit.client.0.smithi116.stdout:Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.9 MB/s) 2024-09-14T11:31:42.650 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:31:42.650 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:31:42.650 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] T E S T S 2024-09-14T11:31:42.650 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:31:43.073 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:31:43.118 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjects.java: starting test run: 2024-09-14T11:31:43.118 INFO:tasks.workunit.client.0.smithi116.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:31:43.118 INFO:tasks.workunit.client.0.smithi116.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:31:43.119 INFO:tasks.workunit.client.0.smithi116.stdout: EndpointUrl=http://smithi116.front.sepia.ceph.com:80 2024-09-14T11:31:43.215 INFO:tasks.workunit.client.0.smithi116.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:31:43.315 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Environment Variables Read 2024-09-14T11:31:43.616 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:31:43.617 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.617 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.617 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.617 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.617 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.717 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.717 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generating File 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: File Generated 2024-09-14T11:31:43.718 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Generated Big Files 2024-09-14T11:31:43.973 INFO:tasks.workunit.client.0.smithi116.stdout:HeadBucketResponse() 2024-09-14T11:31:43.973 INFO:tasks.workunit.client.0.smithi116.stdout:sheik is ready 2024-09-14T11:31:43.973 INFO:tasks.workunit.client.0.smithi116.stdout:DEBUG: Test Bucket Created 2024-09-14T11:31:44.016 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:31:44.217 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:31:44.417 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:31:44.518 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:31:44.617 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:31:44.818 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:31:45.018 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:31:45.219 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:31:45.519 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:31:45.920 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:31:49.125 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:32:29.837 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-0b 2024-09-14T11:32:29.838 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-8b 2024-09-14T11:32:29.839 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-200b 2024-09-14T11:32:29.839 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-21983b 2024-09-14T11:32:29.841 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-5519b 2024-09-14T11:32:29.841 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-204329b 2024-09-14T11:32:29.842 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-256k 2024-09-14T11:32:29.843 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-1m 2024-09-14T11:32:29.844 INFO:tasks.workunit.client.0.smithi116.stdout:arg: file-1038757b 2024-09-14T11:32:29.873 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:32:29.973 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.074 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:32:30.074 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.174 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:32:30.174 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.274 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:32:30.355 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.374 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:32:30.474 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.574 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:32:30.627 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.674 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:32:30.774 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:30.875 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:32:31.074 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:31.175 INFO:tasks.workunit.client.0.smithi116.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:32:31.575 INFO:tasks.workunit.client.0.smithi116.stdout:PutObjectResponse 2024-09-14T11:32:31.776 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:32:33.177 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:32:35.579 INFO:tasks.workunit.client.0.smithi116.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:33:19.072 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 95.99 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:33:19.091 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:33:19.092 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Results: 2024-09-14T11:33:19.092 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:33:19.092 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:33:19.092 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] 2024-09-14T11:33:19.094 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:33:19.094 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:33:19.094 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:33:19.095 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Total time: 01:37 min 2024-09-14T11:33:19.095 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] Finished at: 2024-09-14T11:33:19Z 2024-09-14T11:33:19.095 INFO:tasks.workunit.client.0.smithi116.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:33:19.107 INFO:tasks.workunit.client.0.smithi116.stderr:+ exit 2024-09-14T11:33:19.107 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:33:19.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:33:19.185 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:33:19.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:33:19.557 DEBUG:teuthology.parallel:result is None 2024-09-14T11:33:19.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:19.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:19.597 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:33:19.666 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:33:19.666 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:33:19.677 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:33:19.677 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:33:19.677 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:33:19.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:33:19.734 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:33:19.735 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:33:19.803 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:33:19.804 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:33:19.872 INFO:tasks.workunit:timeout=3h 2024-09-14T11:33:19.872 INFO:tasks.workunit:cleanup=True 2024-09-14T11:33:19.872 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:33:19.941 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:34:16.211 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:34:16.212 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:34:16.213 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:34:16.213 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:34:16.279 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:34:16.282 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:34:16.282 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:34:16.330 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:34:16.380 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:34:16.419 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:34:16.421 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:34:16.421 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:34:16.460 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:34:16.463 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:34:16.463 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:34:16.533 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:34:16.535 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:34:16.535 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:34:16.608 INFO:tasks.workunit.client.0.smithi116.stdout:INFO: fully qualified domain name: smithi116.front.sepia.ceph.com 2024-09-14T11:34:16.608 INFO:tasks.workunit.client.0.smithi116.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:34:16.608 INFO:tasks.workunit.client.0.smithi116.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:34:19.148 INFO:tasks.workunit.client.0.smithi116.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:34:19.330 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting pip 2024-09-14T11:34:19.335 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:34:19.380 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: pip 2024-09-14T11:34:19.380 INFO:tasks.workunit.client.0.smithi116.stdout: Attempting uninstall: pip 2024-09-14T11:34:19.380 INFO:tasks.workunit.client.0.smithi116.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:34:19.533 INFO:tasks.workunit.client.0.smithi116.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:34:19.538 INFO:tasks.workunit.client.0.smithi116.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:34:20.256 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed pip-24.2 2024-09-14T11:34:21.069 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting boto3 2024-09-14T11:34:21.070 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:34:21.644 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:34:21.645 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:34:21.691 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:34:21.692 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:34:21.746 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:34:21.747 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:34:21.798 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:34:21.799 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:34:21.874 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:34:21.875 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:34:22.128 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:34:22.129 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:34:22.134 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:34:22.135 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:34:22.145 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:34:22.145 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:34:22.147 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:34:22.148 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:34:22.150 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:34:22.223 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:34:23.207 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:34:23.442 INFO:tasks.workunit.client.0.smithi116.stdout:INFO: creating user 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout:{ 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "user_id": "testid", 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "display_name": "M. Tester", 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "email": "tester@ceph.com", 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "suspended": 0, 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "subusers": [], 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "keys": [ 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: { 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "user": "testid", 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:34:23.760 INFO:tasks.workunit.client.0.smithi116.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "active": true, 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:34:23.752942Z" 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: } 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: ], 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "swift_keys": [], 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "caps": [], 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "default_placement": "", 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "placement_tags": [], 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "bucket_quota": { 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:23.761 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "user_quota": { 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "enabled": false, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: }, 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "type": "rgw", 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "account_id": "", 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "path": "/", 2024-09-14T11:34:23.762 INFO:tasks.workunit.client.0.smithi116.stdout: "create_date": "2024-09-14T11:34:23.752931Z", 2024-09-14T11:34:23.763 INFO:tasks.workunit.client.0.smithi116.stdout: "tags": [], 2024-09-14T11:34:23.763 INFO:tasks.workunit.client.0.smithi116.stdout: "group_ids": [] 2024-09-14T11:34:23.763 INFO:tasks.workunit.client.0.smithi116.stdout:} 2024-09-14T11:34:23.763 INFO:tasks.workunit.client.0.smithi116.stdout: 2024-09-14T11:34:24.072 INFO:tasks.workunit.client.0.smithi116.stderr:5+0 records in 2024-09-14T11:34:24.072 INFO:tasks.workunit.client.0.smithi116.stderr:5+0 records out 2024-09-14T11:34:24.072 INFO:tasks.workunit.client.0.smithi116.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0141694 s, 370 MB/s 2024-09-14T11:34:33.401 INFO:tasks.workunit.client.0.smithi116.stdout:bucket nams is reupload-bkt-107218 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:endpoint is http://smithi116.front.sepia.ceph.com:80 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:start UploadId=2~QOaHVUfEr8X_n6pWTdgDe1RLn-ZUfQN 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 1 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 1 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 2} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.402 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.403 INFO:tasks.workunit.client.0.smithi116.stdout:phase 2 uploaded part {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1} 2024-09-14T11:34:33.403 INFO:tasks.workunit.client.0.smithi116.stdout:aborting multipart upload, parts=[{'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 1}, {'ETag': '"0c4350e25356303345768be4aa4f6dc1"', 'PartNumber': 2}] 2024-09-14T11:34:34.212 INFO:tasks.workunit.client.0.smithi116.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:34:34.270 INFO:tasks.workunit.client.0.smithi116.stdout:rados ls: 2024-09-14T11:34:34.284 INFO:tasks.workunit.client.0.smithi116.stdout:== PASSED == 2024-09-14T11:34:34.284 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:34:34.284 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:34:34.363 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:34:34.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:34:34.741 DEBUG:teuthology.parallel:result is None 2024-09-14T11:34:34.741 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:34:34.780 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:34:34.780 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:34:34.849 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:34:34.849 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:34:34.866 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:34:34.866 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:34:34.866 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:34:34.866 DEBUG:teuthology.orchestra.run.smithi116:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:34:34.918 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:34:34.948 INFO:teuthology.orchestra.run.smithi116.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:34:34.948 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:34:34.949 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:34:34.949 DEBUG:teuthology.orchestra.run.smithi116:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:34:35.018 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:34:35.183 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:34:35.184 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:34:35.184 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key DVBPCTTZXORHSUJJLNIG --secret vRZaK0XDRl8nHPzBh6FAC4Su1TvCoZvBnm/K6SCzIBVBVC5K+VsUxg== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:34:35.290 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:35.290 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:35.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.325+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 realm 2024-09-14T11:34:35.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:35.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.529+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.531+0000 7fd193896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:35.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.531+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.531+0000 7fd193896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:35.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.531+0000 7fd193896800 20 searching for the correct realm 2024-09-14T11:34:35.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.534+0000 7fd191b81640 0 -- 172.21.15.116:0/4209249335 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fd188036b90 msgr2=0x7fd188021430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:35.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.538+0000 7fd191380640 0 -- 172.21.15.116:0/4209249335 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd188008930 msgr2=0x7fd1880403d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:34:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.744+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:35.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 zone default found 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 4 Realm: () 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 zonegroup default 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.745+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.746+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.746+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.746+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.746+0000 7fd193896800 20 started sync module instance, tier type = 2024-09-14T11:34:35.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.746+0000 7fd193896800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:34:35.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=0 2024-09-14T11:34:35.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=1 2024-09-14T11:34:35.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=2 2024-09-14T11:34:35.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=3 2024-09-14T11:34:35.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=4 2024-09-14T11:34:35.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=5 2024-09-14T11:34:35.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.757+0000 7fd193896800 20 add_watcher() i=6 2024-09-14T11:34:35.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.758+0000 7fd193896800 20 add_watcher() i=7 2024-09-14T11:34:35.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.758+0000 7fd193896800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.759+0000 7fd0477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.759+0000 7fd193896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.759+0000 7fd193896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.759+0000 7fd193896800 5 note: GC not initialized 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd0467e4640 20 reqs_thread_entry: start 2024-09-14T11:34:35.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:35.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 20 Filter name: none 2024-09-14T11:34:35.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fcfb7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:35.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:34:35.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.760+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:34:35.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 cache get: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG : miss 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG info.flags=0x0 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 adding default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG to cache LRU end 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 cache get: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG : hit (negative entry) 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.761+0000 7fd193896800 10 cache get: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG : hit (negative entry) 2024-09-14T11:34:35.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:34:35.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd193896800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:34:35.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd193896800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:34:35.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd074ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758615 cookie 93947324699120 notifier 6006 bl.length()=675 2024-09-14T11:34:35.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd074ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:34:35.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.763+0000 7fd074ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:34:35.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:34:35.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd193896800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:34:35.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd193896800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:34:35.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd074ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758606 cookie 93947324693712 notifier 6006 bl.length()=202 2024-09-14T11:34:35.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd074ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:34:35.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.766+0000 7fd074ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:34:35.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd193896800 10 cache put: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG info.flags=0x7 2024-09-14T11:34:35.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd193896800 10 moving default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG to cache LRU end 2024-09-14T11:34:35.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd193896800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:DVBPCTTZXORHSUJJLNIG, ofs0, ns] 2024-09-14T11:34:35.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd074ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758616 cookie 93947324686432 notifier 6006 bl.length()=190 2024-09-14T11:34:35.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd074ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG info.flags=0x7 2024-09-14T11:34:35.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.769+0000 7fd074ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DVBPCTTZXORHSUJJLNIG to cache LRU end 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "ragweed.client.0", 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "DVBPCTTZXORHSUJJLNIG", 2024-09-14T11:34:35.769 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "vRZaK0XDRl8nHPzBh6FAC4Su1TvCoZvBnm/K6SCzIBVBVC5K+VsUxg==", 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:34:35.762340Z" 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:35.770 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:34:35.762314Z", 2024-09-14T11:34:35.771 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.771+0000 7fd0477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.774+0000 7fd193896800 20 remove_watcher() i=0 2024-09-14T11:34:35.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.774+0000 7fd193896800 2 removed watcher, disabling cache 2024-09-14T11:34:35.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.775+0000 7fd193896800 20 remove_watcher() i=1 2024-09-14T11:34:35.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.776+0000 7fd193896800 20 remove_watcher() i=2 2024-09-14T11:34:35.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.778+0000 7fd193896800 20 remove_watcher() i=3 2024-09-14T11:34:35.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.779+0000 7fd193896800 20 remove_watcher() i=4 2024-09-14T11:34:35.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.780+0000 7fd193896800 20 remove_watcher() i=5 2024-09-14T11:34:35.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.781+0000 7fd193896800 20 remove_watcher() i=6 2024-09-14T11:34:35.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.782+0000 7fd193896800 20 remove_watcher() i=7 2024-09-14T11:34:35.791 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:34:35.791 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZHYJVNTGADHKJEJLSMCH --secret b8iHItSifeeqHxb/UfTC8sT/t8V3UwRn49SxK1q854vsE8hfqEUn3w== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:34:35.857 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:35.857 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:35.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.892+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 realm 2024-09-14T11:34:35.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:35.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:35.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.894+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.895+0000 7fdf54087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:35.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.895+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:35.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.895+0000 7fdf54087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:35.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.895+0000 7fdf54087800 20 searching for the correct realm 2024-09-14T11:34:35.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.899+0000 7fdf4bfff640 0 -- 172.21.15.116:0/2544638674 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x561b7c93f140 msgr2=0x561b7c941590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:35.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:35.902+0000 7fdf51b71640 0 -- 172.21.15.116:0/2544638674 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fdf3c0538e0 msgr2=0x7fdf3c0403a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.108+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 zone default found 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 4 Realm: () 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 zonegroup default 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.109+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.110+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.110+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.110+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.110+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.111+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.111+0000 7fdf54087800 20 started sync module instance, tier type = 2024-09-14T11:34:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.111+0000 7fdf54087800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:34:36.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=0 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=1 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=2 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=3 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=4 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=5 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.120+0000 7fdf54087800 20 add_watcher() i=6 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.121+0000 7fdf54087800 20 add_watcher() i=7 2024-09-14T11:34:36.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.121+0000 7fdf54087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fde03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fdf54087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fdf54087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fdf54087800 5 note: GC not initialized 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fde02ffd640 20 reqs_thread_entry: start 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fdf54087800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.123+0000 7fdf54087800 20 Filter name: none 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fde00ff9640 20 reqs_thread_entry: start 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:34:36.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 10 cache get: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH : miss 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.124+0000 7fdf54087800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.125+0000 7fdf54087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.125+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH info.flags=0x0 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.125+0000 7fdf54087800 10 adding default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH to cache LRU end 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.125+0000 7fdf54087800 10 cache get: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH : hit (negative entry) 2024-09-14T11:34:36.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.125+0000 7fdf54087800 10 cache get: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH : hit (negative entry) 2024-09-14T11:34:36.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:34:36.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fdf54087800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:34:36.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fdf54087800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:34:36.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fde357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758607 cookie 94676054192912 notifier 6024 bl.length()=675 2024-09-14T11:34:36.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fde357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:34:36.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.126+0000 7fde357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:34:36.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:34:36.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fdf54087800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:34:36.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fdf54087800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:34:36.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fde357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758617 cookie 94676054200320 notifier 6024 bl.length()=202 2024-09-14T11:34:36.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fde357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:34:36.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.129+0000 7fde357fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fdf54087800 10 cache put: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH info.flags=0x7 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fdf54087800 10 moving default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH to cache LRU end 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fdf54087800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ZHYJVNTGADHKJEJLSMCH, ofs0, ns] 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fde357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758608 cookie 94676054192912 notifier 6024 bl.length()=190 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fde357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH info.flags=0x7 2024-09-14T11:34:36.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.132+0000 7fde357fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZHYJVNTGADHKJEJLSMCH to cache LRU end 2024-09-14T11:34:36.131 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:34:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:34:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "sysuser.client.0", 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "ZHYJVNTGADHKJEJLSMCH", 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "b8iHItSifeeqHxb/UfTC8sT/t8V3UwRn49SxK1q854vsE8hfqEUn3w==", 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:34:36.125881Z" 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:34:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "system": true, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:34:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:34:36.125872Z", 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:34:36.134 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:34:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:34:36.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.134+0000 7fde03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:36.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.137+0000 7fdf54087800 20 remove_watcher() i=0 2024-09-14T11:34:36.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.137+0000 7fdf54087800 2 removed watcher, disabling cache 2024-09-14T11:34:36.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.138+0000 7fdf54087800 20 remove_watcher() i=1 2024-09-14T11:34:36.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.139+0000 7fdf54087800 20 remove_watcher() i=2 2024-09-14T11:34:36.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.140+0000 7fdf54087800 20 remove_watcher() i=3 2024-09-14T11:34:36.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.141+0000 7fdf54087800 20 remove_watcher() i=4 2024-09-14T11:34:36.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.142+0000 7fdf54087800 20 remove_watcher() i=5 2024-09-14T11:34:36.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.143+0000 7fdf54087800 20 remove_watcher() i=6 2024-09-14T11:34:36.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:34:36.144+0000 7fdf54087800 20 remove_watcher() i=7 2024-09-14T11:34:36.153 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:34:36.153 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:34:36.153 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:34:36.181 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:34:36.182 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:34:36.182 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:34:36.250 DEBUG:teuthology.orchestra.run.smithi116:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:34:36.616 INFO:teuthology.orchestra.run.smithi116.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:34:36.779 INFO:teuthology.orchestra.run.smithi116.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:34:37.328 INFO:teuthology.orchestra.run.smithi116.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:34:43.480 INFO:teuthology.orchestra.run.smithi116.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:34:46.829 INFO:teuthology.orchestra.run.smithi116.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d5a1a3c34d3345302584a5c0df8eef4577e28b7800581d5974864ec26d3542b7,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:34:46.829 INFO:teuthology.orchestra.run.smithi116.stdout:py run-test-pre: PYTHONHASHSEED='3694091333' 2024-09-14T11:34:46.829 INFO:teuthology.orchestra.run.smithi116.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:34:47.030 INFO:teuthology.orchestra.run.smithi116.stdout:============================= test session starts ============================== 2024-09-14T11:34:47.030 INFO:teuthology.orchestra.run.smithi116.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:34:47.030 INFO:teuthology.orchestra.run.smithi116.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:34:47.030 INFO:teuthology.orchestra.run.smithi116.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:34:47.030 INFO:teuthology.orchestra.run.smithi116.stdout:configfile: pytest.ini 2024-09-14T11:34:47.126 INFO:teuthology.orchestra.run.smithi116.stdout:collecting ... collected 9 items 2024-09-14T11:34:47.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:34:49.272 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:34:51.316 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:34:53.378 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:34:56.997 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:34:59.100 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:35:06.805 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:35:11.245 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:35:15.402 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout:=============================== warnings summary =============================== 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: import imp 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:35:24.125 INFO:teuthology.orchestra.run.smithi116.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:35:24.126 INFO:teuthology.orchestra.run.smithi116.stdout:======================== 9 passed, 1 warning in 37.10s ========================= 2024-09-14T11:35:24.156 INFO:teuthology.orchestra.run.smithi116.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:35:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: py: commands succeeded 2024-09-14T11:35:24.156 INFO:teuthology.orchestra.run.smithi116.stdout: congratulations :) 2024-09-14T11:35:24.174 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:35:24.175 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:35:24.204 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:35:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:24.301 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:24.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.336+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.337+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.337+0000 7f2ae2131800 20 realm 2024-09-14T11:35:24.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.337+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.338+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.338+0000 7f2ae2131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.338+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.338+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.338+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.339+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.339+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.339+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:24.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.339+0000 7f2ae2131800 20 searching for the correct realm 2024-09-14T11:35:24.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.343+0000 7f2add675640 0 -- 172.21.15.116:0/2990550501 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55bdc7a68ea0 msgr2=0x55bdc7a6b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.347+0000 7f2add675640 0 -- 172.21.15.116:0/2990550501 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f2ad008f060 msgr2=0x7f2ad00e33b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:35:24.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:24.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:24.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:35:24.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:24.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:24.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.351+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:24.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 zone default found 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 4 Realm: () 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 zonegroup default 2024-09-14T11:35:24.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.352+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.353+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.353+0000 7f2ae2131800 20 started sync module instance, tier type = 2024-09-14T11:35:24.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.353+0000 7f2ae2131800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:35:24.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=0 2024-09-14T11:35:24.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=1 2024-09-14T11:35:24.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=2 2024-09-14T11:35:24.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=3 2024-09-14T11:35:24.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=4 2024-09-14T11:35:24.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=5 2024-09-14T11:35:24.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.362+0000 7f2ae2131800 20 add_watcher() i=6 2024-09-14T11:35:24.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.363+0000 7f2ae2131800 20 add_watcher() i=7 2024-09-14T11:35:24.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.363+0000 7f2ae2131800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:24.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.365+0000 7f298f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:24.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.365+0000 7f2ae2131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:24.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.365+0000 7f2ae2131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:24.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.401+0000 7f298e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:24.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.401+0000 7f2ae2131800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:24.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.401+0000 7f2ae2131800 20 Filter name: none 2024-09-14T11:35:24.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f28fffff640 20 reqs_thread_entry: start 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.402+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 : miss 2024-09-14T11:35:24.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 info.flags=0x17 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 to cache LRU end 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.403+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.404+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.405+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:35:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.405+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:35:24.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.405+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:35:24.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.405+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:35:24.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.405+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:35:24.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.406+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:35:24.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.407+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:35:24.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.407+0000 7f2ae2131800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:35:24.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.408+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bdc7b33518 s->prefetch_data=0 2024-09-14T11:35:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.409+0000 7f2ae2131800 10 manifest: total_size = 5051 2024-09-14T11:35:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.409+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.401965015911291936 2024-09-14T11:35:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.409+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bdc7b33518 s->prefetch_data=0 2024-09-14T11:35:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.409+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b33518 2024-09-14T11:35:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.409+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.1 2024-09-14T11:35:24.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5051 stripe_ofs=5051 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.401965015911291936 2024-09-14T11:35:24.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.FMnWZK_52bK0I9AKwT6vkq--9a6lBlO_0 2024-09-14T11:35:24.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:35:24.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.411+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.401965015911291936 2024-09-14T11:35:24.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.412+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:35:24.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.413+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bdc7b32d88 s->prefetch_data=0 2024-09-14T11:35:24.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.414+0000 7f2ae2131800 10 manifest: total_size = 12812 2024-09-14T11:35:24.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.414+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10418199150723411620 2024-09-14T11:35:24.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.414+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bdc7b32d88 s->prefetch_data=0 2024-09-14T11:35:24.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.414+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32d88 2024-09-14T11:35:24.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.414+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.2 2024-09-14T11:35:24.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=12812 stripe_ofs=12812 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10418199150723411620 2024-09-14T11:35:24.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.cWKLKsGm8JyQWHdLNn9UsGSgSkHXbtB_0 2024-09-14T11:35:24.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.416+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10418199150723411620 2024-09-14T11:35:24.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.417+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:35:24.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bdc7b32cd8 s->prefetch_data=0 2024-09-14T11:35:24.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 10 manifest: total_size = 7692 2024-09-14T11:35:24.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16689403257411088182 2024-09-14T11:35:24.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bdc7b32cd8 s->prefetch_data=0 2024-09-14T11:35:24.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32cd8 2024-09-14T11:35:24.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.418+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.2 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=7692 stripe_ofs=7692 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16689403257411088182 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.A__X9RmrWPOSpZAetHLdU4zzP87whJ__0 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.421+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16689403257411088182 2024-09-14T11:35:24.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.422+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:35:24.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.422+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.423+0000 7f2ae2131800 10 manifest: total_size = 13087 2024-09-14T11:35:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.423+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2345506808929211863 2024-09-14T11:35:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.423+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4026a50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.423+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.423+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.3 2024-09-14T11:35:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=13087 stripe_ofs=13087 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2345506808929211863 2024-09-14T11:35:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.AVdlQzqgj3SOlS0QbWLraEISUe0-nry_0 2024-09-14T11:35:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.425+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2345506808929211863 2024-09-14T11:35:24.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.426+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33cc0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.426+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.427+0000 7f2ae2131800 10 manifest: total_size = 7649 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.427+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13647679975582309030 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.427+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33cc0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.427+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.427+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.4 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=7649 stripe_ofs=7649 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13647679975582309030 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.DLU7K34pMzT9Zi1NLkVdfHwMZeP9GFi_0 2024-09-14T11:35:24.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.429+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13647679975582309030 2024-09-14T11:35:24.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.430+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:35:24.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.430+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4370 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.431+0000 7f2ae2131800 10 manifest: total_size = 4947 2024-09-14T11:35:24.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.431+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14150917670420073028 2024-09-14T11:35:24.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.431+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4370 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.431+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.431+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.4 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4947 stripe_ofs=4947 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14150917670420073028 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.sqi5yWUEW3scFOGvKokGspKmxZp0LNg_0 2024-09-14T11:35:24.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.433+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14150917670420073028 2024-09-14T11:35:24.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.434+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:35:24.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.434+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4370 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.435+0000 7f2ae2131800 10 manifest: total_size = 4870 2024-09-14T11:35:24.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.435+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2621080930486492875 2024-09-14T11:35:24.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.435+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4370 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.435+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.435+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.5 2024-09-14T11:35:24.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4870 stripe_ofs=4870 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2621080930486492875 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.r3FQnoWcDtFsfxIj5H0P9-0OrfHgBuy_0 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.437+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2621080930486492875 2024-09-14T11:35:24.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.438+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.438+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.439+0000 7f2ae2131800 10 manifest: total_size = 5393 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.439+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16405708541132821089 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.439+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.439+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.439+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.7 2024-09-14T11:35:24.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5393 stripe_ofs=5393 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16405708541132821089 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.ws4K4Fqds3TlYCMrifLbw_lFc8H63C3_0 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.441+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16405708541132821089 2024-09-14T11:35:24.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.442+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00c32a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 10 manifest: total_size = 5374 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12978238226944810239 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00c32a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bdc7b32c28 s->prefetch_data=0 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7b32c28 2024-09-14T11:35:24.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.443+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4.8 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5374 stripe_ofs=5374 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12978238226944810239 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.qNn4TGq6EovLYW9XbXPyTV4NtwW7GOf_0 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:35:24.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.445+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12978238226944810239 2024-09-14T11:35:24.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.446+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:35:24.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.446+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.446+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.447+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.447+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.447+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.447+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.447+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.449+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:35:24.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.449+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.449+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:35:24.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.449+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:35:24.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.449+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:35:24.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.450+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:35:24.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.450+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:35:24.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.451+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94273586767472 notifier 5660 bl.length()=162 2024-09-14T11:35:24.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.454+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 from cache 2024-09-14T11:35:24.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.454+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4, ofs0, ns] 2024-09-14T11:35:24.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.454+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94273586816304 notifier 5660 bl.length()=219 2024-09-14T11:35:24.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.458+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 : miss 2024-09-14T11:35:24.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.458+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.458+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.458+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 info.flags=0x0 2024-09-14T11:35:24.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.458+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4 to cache LRU end 2024-09-14T11:35:24.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.460+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 : miss 2024-09-14T11:35:24.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.460+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 info.flags=0x17 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 to cache LRU end 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.461+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abc920 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bdc7ab6c98 s->prefetch_data=0 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 10 manifest: total_size = 26082 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5043628950949224762 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abc920 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bdc7ab6c98 s->prefetch_data=0 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ab6c98 2024-09-14T11:35:24.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.465+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11.10 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7672 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7672 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4209647 part_ofs=15343 rule->part_size=7672 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=23015 stripe_ofs=23015 part_ofs=23015 rule->part_size=3067 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4217319 part_ofs=23015 rule->part_size=3067 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=26082 stripe_ofs=26082 part_ofs=26082 rule->part_size=3067 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5043628950949224762 2024-09-14T11:35:24.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.1 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.2 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.3 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.4 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.467+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5043628950949224762 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.468+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.468+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.469+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.471+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:35:24.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.471+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.471+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:35:24.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.471+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:35:24.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.471+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:35:24.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.473+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:35:24.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.473+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:35:24.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.473+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562417 cookie 94273586812656 notifier 5660 bl.length()=191 2024-09-14T11:35:24.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.475+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 from cache 2024-09-14T11:35:24.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.475+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11, ofs0, ns] 2024-09-14T11:35:24.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.476+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94273586767472 notifier 5660 bl.length()=249 2024-09-14T11:35:24.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.481+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 : miss 2024-09-14T11:35:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.481+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.481+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.481+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 info.flags=0x0 2024-09-14T11:35:24.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.481+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11 to cache LRU end 2024-09-14T11:35:24.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 : miss 2024-09-14T11:35:24.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 info.flags=0x17 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 to cache LRU end 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.484+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 2024-09-14T11:35:24.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.488+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.488+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad80752a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bdc7921dc8 s->prefetch_data=0 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.489+0000 7f2ae2131800 10 manifest: total_size = 74198 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.489+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6955681760137817235 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.489+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad80752a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bdc7921dc8 s->prefetch_data=0 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.489+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7921dc8 2024-09-14T11:35:24.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.489+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12.10 2024-09-14T11:35:24.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6955681760137817235 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.1 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:35:24.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.2 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.3 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.4 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.491+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6955681760137817235 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.492+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.492+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.492+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.493+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.493+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.493+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.493+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.493+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.495+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:35:24.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.495+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.495+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:35:24.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.495+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:35:24.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.495+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:35:24.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.496+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:35:24.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.496+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:35:24.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.497+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94273586816304 notifier 5660 bl.length()=198 2024-09-14T11:35:24.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.500+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 from cache 2024-09-14T11:35:24.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.500+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12, ofs0, ns] 2024-09-14T11:35:24.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.500+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94273586827264 notifier 5660 bl.length()=256 2024-09-14T11:35:24.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.508+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 : miss 2024-09-14T11:35:24.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.508+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.508+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.508+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 info.flags=0x0 2024-09-14T11:35:24.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.508+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12 to cache LRU end 2024-09-14T11:35:24.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.510+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 : miss 2024-09-14T11:35:24.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.510+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 info.flags=0x17 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 to cache LRU end 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.511+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo[E6ElKEqKmzMG9vOd02.wHC6mpdwYs0O] 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b35070 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55bdc7921dc8 s->prefetch_data=0 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 2dku3ncqqq4v8vdgpy66a23spvsdpy16 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 20 get_obj_state_impl: setting s->olh_tag to 2w38ichu24iqa6wdh064st2rngo4qr4x 2024-09-14T11:35:24.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.515+0000 7f2ae2131800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2w38ichu24iqa6wdh064st2rngo4qr4x 2024-09-14T11:35:24.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.516+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:35:24.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 olh_log_entry: epoch=3 op=3 key=foo[E6ElKEqKmzMG9vOd02.wHC6mpdwYs0O] 2024-09-14T11:35:24.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b35070 obj=test-client.0-r-test-multipart-index-versioning.1:_:E6ElKEqKmzMG9vOd02.wHC6mpdwYs0O_foo state=0x55bdc7ad1708 s->prefetch_data=0 2024-09-14T11:35:24.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 10 manifest: total_size = 886297 2024-09-14T11:35:24.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625968665515299749 2024-09-14T11:35:24.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b35070 obj=test-client.0-r-test-multipart-index-versioning.1:_:E6ElKEqKmzMG9vOd02.wHC6mpdwYs0O_foo state=0x55bdc7ad1708 s->prefetch_data=0 2024-09-14T11:35:24.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ad1708 2024-09-14T11:35:24.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.518+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-14T11:35:24.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625968665515299749 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.1 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.2 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.3 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.4 2024-09-14T11:35:24.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:35:24.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.520+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625968665515299749 2024-09-14T11:35:24.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.521+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo[E6ElKEqKmzMG9vOd02.wHC6mpdwYs0O] 2024-09-14T11:35:24.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.523+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b35070 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55bdc7921dc8 s->prefetch_data=0 2024-09-14T11:35:24.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.524+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.525+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10.10 2024-09-14T11:35:24.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.525+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.525+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.525+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.526+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.526+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.526+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.526+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.527+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:35:24.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.527+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.528+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:35:24.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.528+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:35:24.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.528+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:35:24.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.529+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:35:24.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.529+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:35:24.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.529+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94273586816304 notifier 5660 bl.length()=193 2024-09-14T11:35:24.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.531+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 from cache 2024-09-14T11:35:24.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.531+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10, ofs0, ns] 2024-09-14T11:35:24.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.532+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94273586818624 notifier 5660 bl.length()=251 2024-09-14T11:35:24.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.535+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 : miss 2024-09-14T11:35:24.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.535+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.535+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.535+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 info.flags=0x0 2024-09-14T11:35:24.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.535+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10 to cache LRU end 2024-09-14T11:35:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.537+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 : miss 2024-09-14T11:35:24.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.537+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 info.flags=0x17 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 to cache LRU end 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.539+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.542+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.542+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7aca910 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.543+0000 7f2ae2131800 10 manifest: total_size = 74198 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.543+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17972684688721312415 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.543+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7aca910 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.543+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.543+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9.10 2024-09-14T11:35:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:35:24.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17972684688721312415 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.1 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-14T11:35:24.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.2 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.3 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.4 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.545+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17972684688721312415 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.546+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.546+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.546+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.547+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.547+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.547+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.547+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.547+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.549+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:35:24.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.549+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.549+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:35:24.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.549+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:35:24.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.549+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:35:24.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.550+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:35:24.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.550+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:35:24.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.550+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94273586821344 notifier 5660 bl.length()=183 2024-09-14T11:35:24.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.553+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 from cache 2024-09-14T11:35:24.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.553+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9, ofs0, ns] 2024-09-14T11:35:24.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.553+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94273586767472 notifier 5660 bl.length()=240 2024-09-14T11:35:24.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.556+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 : miss 2024-09-14T11:35:24.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.556+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.557+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.557+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 info.flags=0x0 2024-09-14T11:35:24.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.557+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9 to cache LRU end 2024-09-14T11:35:24.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 : miss 2024-09-14T11:35:24.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 info.flags=0x17 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 to cache LRU end 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.559+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.560+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:35:24.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.560+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:35:24.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.560+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:35:24.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.561+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:35:24.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.561+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:35:24.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.561+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:35:24.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.562+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:35:24.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.562+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:35:24.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.562+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:35:24.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.562+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:35:24.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.562+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:35:24.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:35:24.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bdc7abf1d8 s->prefetch_data=0 2024-09-14T11:35:24.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 10 manifest: total_size = 2044 2024-09-14T11:35:24.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _9B7sGTLuiWiOuCJCvR9YV8yOtHy9v92 2024-09-14T11:35:24.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bdc7abf1d8 s->prefetch_data=0 2024-09-14T11:35:24.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7abf1d8 2024-09-14T11:35:24.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.563+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.0 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _9B7sGTLuiWiOuCJCvR9YV8yOtHy9v92 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.ZyyeJSEKehfK4YolKGdQ1CI0Ei_wvq8_0 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.566+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _9B7sGTLuiWiOuCJCvR9YV8yOtHy9v92 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bdc7abf1d8 s->prefetch_data=0 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _eK_ZW85mt9-e6Et0OTTp36NGK5D7Pe2 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bdc7abf1d8 s->prefetch_data=0 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7abf1d8 2024-09-14T11:35:24.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.567+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.2 2024-09-14T11:35:24.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _eK_ZW85mt9-e6Et0OTTp36NGK5D7Pe2 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.dJ2I4ew0kWOdqe6zu1hAlZv0Y0K_BZ6_0 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.dJ2I4ew0kWOdqe6zu1hAlZv0Y0K_BZ6_1 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.569+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _eK_ZW85mt9-e6Et0OTTp36NGK5D7Pe2 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.570+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.570+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ac0b90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.571+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.571+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12284550966261413596 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.571+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ac0b90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.571+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.571+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.3 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12284550966261413596 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_0 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:35:24.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_1 2024-09-14T11:35:24.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:35:24.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.573+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12284550966261413596 2024-09-14T11:35:24.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.574+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:35:24.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.574+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abcd90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.575+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.575+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _HNXvjI4rU8QgsXV9Ck0Ff-pWsY_nGvw 2024-09-14T11:35:24.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.575+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abcd90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.575+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.575+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.5 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _HNXvjI4rU8QgsXV9Ck0Ff-pWsY_nGvw 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.7UBj6myz72h_QpVp__HVG8IgW2hwLNJ_0 2024-09-14T11:35:24.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.7UBj6myz72h_QpVp__HVG8IgW2hwLNJ_1 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _HNXvjI4rU8QgsXV9Ck0Ff-pWsY_nGvw 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.577+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:35:24.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _Cl_ZScq-SE4DzkaVaRWMPTcNIDc7EJT 2024-09-14T11:35:24.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.578+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.5 2024-09-14T11:35:24.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _Cl_ZScq-SE4DzkaVaRWMPTcNIDc7EJT 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.4KM0RRA-_MbZdY4UJFTk4s-SEKwD9dC_0 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.4KM0RRA-_MbZdY4UJFTk4s-SEKwD9dC_1 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.580+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _Cl_ZScq-SE4DzkaVaRWMPTcNIDc7EJT 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 10 manifest: total_size = 2044 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18367135338552031517 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.582+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.5 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18367135338552031517 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.rQfw0BgcEZ13Grbrg_ugnmjmefMEi-U_0 2024-09-14T11:35:24.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:35:24.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.584+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18367135338552031517 2024-09-14T11:35:24.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.585+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:35:24.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.585+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.586+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.586+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _1JW7FxgzBb-1p0sAQ0I14HZASltIcDT 2024-09-14T11:35:24.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.586+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.586+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.586+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.7 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _1JW7FxgzBb-1p0sAQ0I14HZASltIcDT 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.lXI-zbqkesnrJmEbyds2R5y46ZBoEhL_0 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.lXI-zbqkesnrJmEbyds2R5y46ZBoEhL_1 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.587+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.588+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _1JW7FxgzBb-1p0sAQ0I14HZASltIcDT 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1827293423044024457 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.589+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.7 2024-09-14T11:35:24.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1827293423044024457 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_0 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_1 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.591+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1827293423044024457 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.592+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.592+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33040 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.593+0000 7f2ae2131800 10 manifest: total_size = 2044 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.593+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10250765165431647465 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.593+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33040 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.593+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.593+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.7 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10250765165431647465 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.rQfw0BgcEZ13Grbrg_ugnmjmefMEi-U_0 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.595+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10250765165431647465 2024-09-14T11:35:24.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:35:24.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6088725132656354335 2024-09-14T11:35:24.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.596+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.8 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6088725132656354335 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_0 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_1 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.599+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6088725132656354335 2024-09-14T11:35:24.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:35:24.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 10 manifest: total_size = 2044 2024-09-14T11:35:24.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _a7xYstjH7-ahfAnW2P6kxDFPFGEilFp 2024-09-14T11:35:24.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00aa4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.600+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.8 2024-09-14T11:35:24.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _a7xYstjH7-ahfAnW2P6kxDFPFGEilFp 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.FjFrMCaYPFdbT2Uzj8vAeKyNAbK3cKp_0 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.602+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _a7xYstjH7-ahfAnW2P6kxDFPFGEilFp 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 10 manifest: total_size = 5242880 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10991639449276702834 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.604+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15.9 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10991639449276702834 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_0 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_1 2024-09-14T11:35:24.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:35:24.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.606+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10991639449276702834 2024-09-14T11:35:24.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.607+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.608+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.610+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:35:24.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.610+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.611+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:35:24.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.611+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:35:24.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.611+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:35:24.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.612+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:35:24.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.612+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:35:24.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.612+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94273586816304 notifier 5660 bl.length()=189 2024-09-14T11:35:24.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.614+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 from cache 2024-09-14T11:35:24.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.614+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15, ofs0, ns] 2024-09-14T11:35:24.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.615+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94273586818624 notifier 5660 bl.length()=247 2024-09-14T11:35:24.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.618+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 : miss 2024-09-14T11:35:24.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.618+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.618+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.618+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 info.flags=0x0 2024-09-14T11:35:24.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.618+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15 to cache LRU end 2024-09-14T11:35:24.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 : miss 2024-09-14T11:35:24.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 info.flags=0x17 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 to cache LRU end 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.620+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.621+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:35:24.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.622+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:35:24.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.622+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:35:24.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.623+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:35:24.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.623+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:35:24.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.623+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:35:24.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.624+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:35:24.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.624+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:35:24.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.624+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:35:24.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.624+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:35:24.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.624+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:35:24.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:35:24.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b32fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _ChZcAu8xrWQc-aQYOZ2H1jYU0ZqmYo5 2024-09-14T11:35:24.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b32fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.625+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.0 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _ChZcAu8xrWQc-aQYOZ2H1jYU0ZqmYo5 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_0 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:35:24.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_1 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_2 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.627+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _ChZcAu8xrWQc-aQYOZ2H1jYU0ZqmYo5 2024-09-14T11:35:24.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.628+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _1PL6gciAn7X3McXXt9zQyEEQhcya-ED 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.629+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.2 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _1PL6gciAn7X3McXXt9zQyEEQhcya-ED 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_0 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_1 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_2 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.632+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _1PL6gciAn7X3McXXt9zQyEEQhcya-ED 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8984518682680850059 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.633+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.3 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8984518682680850059 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1_1 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2_1 2024-09-14T11:35:24.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.3 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.635+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8984518682680850059 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _v2JIM0fdWN7ReUGlbBKNm-Vnjie8xlQ 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ab4cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.637+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.5 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _v2JIM0fdWN7ReUGlbBKNm-Vnjie8xlQ 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_0 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_1 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_2 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.639+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _v2JIM0fdWN7ReUGlbBKNm-Vnjie8xlQ 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _77GuXfpn5rVJchr_e-TERGyHAIuO_xf 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.640+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.5 2024-09-14T11:35:24.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _77GuXfpn5rVJchr_e-TERGyHAIuO_xf 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_0 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_1 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_2 2024-09-14T11:35:24.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:35:24.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.642+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _77GuXfpn5rVJchr_e-TERGyHAIuO_xf 2024-09-14T11:35:24.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.643+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:35:24.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4034f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7377678731143434958 2024-09-14T11:35:24.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4034f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.644+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.5 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7377678731143434958 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1_1 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2_1 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-14T11:35:24.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.3 2024-09-14T11:35:24.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-14T11:35:24.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.646+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7377678731143434958 2024-09-14T11:35:24.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.647+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:35:24.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.647+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.648+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.648+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _NwuLCy0OpChmLmZSZvlHChyQwQubVRT 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.648+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.648+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.648+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.7 2024-09-14T11:35:24.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _NwuLCy0OpChmLmZSZvlHChyQwQubVRT 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_0 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_1 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:35:24.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_2 2024-09-14T11:35:24.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:35:24.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.650+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _NwuLCy0OpChmLmZSZvlHChyQwQubVRT 2024-09-14T11:35:24.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4034f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16541480387486248753 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4034f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.651+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.7 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16541480387486248753 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1_1 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:35:24.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2_1 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.3 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.654+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16541480387486248753 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adb2c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18329699399830399958 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adb2c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.655+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.7 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18329699399830399958 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:35:24.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1_1 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2_1 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.3 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.658+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18329699399830399958 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7921670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11514220080130881703 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7921670 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.659+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.8 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11514220080130881703 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1_1 2024-09-14T11:35:24.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2_1 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.3 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.662+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11514220080130881703 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ac0d40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to _muO1H4O0xZVFbQwrg9VRuXvkPP43I0Z 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ac0d40 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.663+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.8 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: _muO1H4O0xZVFbQwrg9VRuXvkPP43I0Z 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_0 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_1 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_2 2024-09-14T11:35:24.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.665+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _muO1H4O0xZVFbQwrg9VRuXvkPP43I0Z 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13514958335792485688 2024-09-14T11:35:24.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bdc7ac8438 s->prefetch_data=0 2024-09-14T11:35:24.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac8438 2024-09-14T11:35:24.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.667+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16.9 2024-09-14T11:35:24.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13514958335792485688 2024-09-14T11:35:24.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1_1 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2_1 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.3 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.669+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13514958335792485688 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.670+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.670+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.670+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.671+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.671+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.671+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.671+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.671+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.673+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:35:24.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.673+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.673+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:35:24.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.673+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:35:24.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.673+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:35:24.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.674+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:35:24.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.674+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:35:24.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.675+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 94273586818624 notifier 5660 bl.length()=199 2024-09-14T11:35:24.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.677+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 from cache 2024-09-14T11:35:24.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.677+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16, ofs0, ns] 2024-09-14T11:35:24.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.678+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94273586830928 notifier 5660 bl.length()=257 2024-09-14T11:35:24.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.681+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 : miss 2024-09-14T11:35:24.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.681+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.681+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.681+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 info.flags=0x0 2024-09-14T11:35:24.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.681+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16 to cache LRU end 2024-09-14T11:35:24.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 : miss 2024-09-14T11:35:24.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 info.flags=0x17 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 to cache LRU end 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.683+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 2024-09-14T11:35:24.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.685+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:35:24.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.685+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:35:24.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.686+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:35:24.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.687+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adade0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.688+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.688+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18109497673359411239 2024-09-14T11:35:24.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.688+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adade0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.688+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.688+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14.3 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18109497673359411239 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.1 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.1_1 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:35:24.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.2 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.2_1 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.3 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.690+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18109497673359411239 2024-09-14T11:35:24.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.691+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.691+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad805db40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.692+0000 7f2ae2131800 10 manifest: total_size = 1087 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.692+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13202332529917145666 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.692+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad805db40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.692+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.692+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14.5 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13202332529917145666 2024-09-14T11:35:24.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.1 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.2 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.3 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.693+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13202332529917145666 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.694+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf030 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 10 manifest: total_size = 11534336 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1651983449775389086 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf030 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.695+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14.7 2024-09-14T11:35:24.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1651983449775389086 2024-09-14T11:35:24.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.1 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.1_1 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.2 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.2_1 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.3 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.697+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1651983449775389086 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.698+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.698+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.698+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.699+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.699+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.699+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.699+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.699+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.701+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:35:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.701+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.701+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:35:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.701+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:35:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.701+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:35:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.702+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:35:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.702+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:35:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.703+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94273586827264 notifier 5660 bl.length()=194 2024-09-14T11:35:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.705+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 from cache 2024-09-14T11:35:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.705+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14, ofs0, ns] 2024-09-14T11:35:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.706+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94273586830928 notifier 5660 bl.length()=252 2024-09-14T11:35:24.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.709+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 : miss 2024-09-14T11:35:24.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.709+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.710+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.710+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 info.flags=0x0 2024-09-14T11:35:24.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.710+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14 to cache LRU end 2024-09-14T11:35:24.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 : miss 2024-09-14T11:35:24.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 info.flags=0x17 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 to cache LRU end 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.712+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 2024-09-14T11:35:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.714+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:35:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.714+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:35:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.715+0000 7f2ae2131800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00c32a0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 10 manifest: total_size = 10485760 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10258439071468374122 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad00c32a0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ab85b8 2024-09-14T11:35:24.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.716+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13.3 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10258439071468374122 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_0 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_1 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_2 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.718+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10258439071468374122 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 10 manifest: total_size = 3309 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12233156021189354671 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad009f4a0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ab85b8 2024-09-14T11:35:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.720+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13.5 2024-09-14T11:35:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=3309 stripe_ofs=3309 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12233156021189354671 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.FwO5cIcgM67q8LWCLohEZYqcMSaR5kt_0 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.722+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12233156021189354671 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.723+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 10 manifest: total_size = 10485760 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6078791145602745158 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 20 get_obj_state: octx=0x7f2ad4048e60 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bdc7ab85b8 s->prefetch_data=0 2024-09-14T11:35:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ab85b8 2024-09-14T11:35:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.724+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13.7 2024-09-14T11:35:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6078791145602745158 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_0 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_1 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_2 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.726+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6078791145602745158 2024-09-14T11:35:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.727+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:35:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.727+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.727+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.728+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.728+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.728+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.728+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.728+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.730+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:35:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.730+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.730+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:35:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.730+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:35:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.730+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:35:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.732+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:35:24.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.732+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:35:24.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.732+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94273586816304 notifier 5660 bl.length()=184 2024-09-14T11:35:24.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.734+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 from cache 2024-09-14T11:35:24.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.734+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13, ofs0, ns] 2024-09-14T11:35:24.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.735+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94273586827264 notifier 5660 bl.length()=242 2024-09-14T11:35:24.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.739+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 : miss 2024-09-14T11:35:24.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.739+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.739+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.739+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 info.flags=0x0 2024-09-14T11:35:24.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.739+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13 to cache LRU end 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 : miss 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 info.flags=0x17 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 to cache LRU end 2024-09-14T11:35:24.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.741+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 2024-09-14T11:35:24.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.742+0000 7f2ae2131800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:35:24.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.743+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:35:24.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.744+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:35:24.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.744+0000 7f2ae2131800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:35:24.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.745+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bdc7acfff8 s->prefetch_data=0 2024-09-14T11:35:24.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.746+0000 7f2ae2131800 10 manifest: total_size = 0 2024-09-14T11:35:24.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.746+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.165422432354823678 2024-09-14T11:35:24.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.746+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bdc7acfff8 s->prefetch_data=0 2024-09-14T11:35:24.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.746+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7acfff8 2024-09-14T11:35:24.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.746+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6.2 2024-09-14T11:35:24.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 10 manifest: total_size = 0 2024-09-14T11:35:24.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13478446054195743471 2024-09-14T11:35:24.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ade758 2024-09-14T11:35:24.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.748+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6.3 2024-09-14T11:35:24.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.749+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:35:24.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.750+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.751+0000 7f2ae2131800 10 manifest: total_size = 0 2024-09-14T11:35:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.751+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3389893770021702762 2024-09-14T11:35:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.751+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7abf5a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.751+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ade758 2024-09-14T11:35:24.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.751+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6.6 2024-09-14T11:35:24.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.752+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:35:24.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33210 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 10 manifest: total_size = 0 2024-09-14T11:35:24.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14093608406020077433 2024-09-14T11:35:24.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7b33210 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bdc7ade758 s->prefetch_data=0 2024-09-14T11:35:24.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ade758 2024-09-14T11:35:24.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.753+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6.8 2024-09-14T11:35:24.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.754+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:35:24.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.755+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.755+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.757+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.758+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:35:24.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.758+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.759+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:35:24.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.759+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:35:24.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.759+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:35:24.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.760+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:35:24.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.760+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:35:24.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.760+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562418 cookie 94273586812656 notifier 5660 bl.length()=181 2024-09-14T11:35:24.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.763+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 from cache 2024-09-14T11:35:24.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.763+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6, ofs0, ns] 2024-09-14T11:35:24.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.763+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94273586827264 notifier 5660 bl.length()=238 2024-09-14T11:35:24.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.766+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 : miss 2024-09-14T11:35:24.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.766+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.766+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.766+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 info.flags=0x0 2024-09-14T11:35:24.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.766+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6 to cache LRU end 2024-09-14T11:35:24.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.768+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 : miss 2024-09-14T11:35:24.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.768+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 info.flags=0x17 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 to cache LRU end 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.769+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 2024-09-14T11:35:24.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.770+0000 7f2ae2131800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:35:24.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.770+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:35:24.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.771+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:35:24.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.772+0000 7f2ae2131800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:35:24.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 10 manifest: total_size = 524288 2024-09-14T11:35:24.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1508267662088255927 2024-09-14T11:35:24.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7acff28 2024-09-14T11:35:24.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.773+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7.2 2024-09-14T11:35:24.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1508267662088255927 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.JCvpKMUrfpt4mhGHnOneSPjMKHTQw-2_0 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.775+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1508267662088255927 2024-09-14T11:35:24.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.776+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 10 manifest: total_size = 24595 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1004780058327775414 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7acff28 2024-09-14T11:35:24.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.777+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7.3 2024-09-14T11:35:24.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1004780058327775414 2024-09-14T11:35:24.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.3NPfFBrAcyk_izSmC8tqYhPKVC3qXYH_0 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.779+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1004780058327775414 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.780+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:35:24.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.780+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.781+0000 7f2ae2131800 10 manifest: total_size = 2078 2024-09-14T11:35:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.781+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5975564655731529690 2024-09-14T11:35:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.781+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.781+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7acff28 2024-09-14T11:35:24.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.781+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7.6 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5975564655731529690 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.yU33_YOsUQyfGnuTGVJ8uO4JO8fx0j7_0 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.783+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5975564655731529690 2024-09-14T11:35:24.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:35:24.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 10 manifest: total_size = 38 2024-09-14T11:35:24.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.214946395574594600 2024-09-14T11:35:24.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7ad2570 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bdc7acff28 s->prefetch_data=0 2024-09-14T11:35:24.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7acff28 2024-09-14T11:35:24.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.784+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7.8 2024-09-14T11:35:24.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.214946395574594600 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.ZjBkyyw7UocnpzEDXad60BztEryp9b1_0 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.786+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.214946395574594600 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.788+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.790+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:35:24.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.790+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.790+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:35:24.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.790+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:35:24.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.790+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:35:24.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.791+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:35:24.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.791+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:35:24.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.792+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562419 cookie 94273586812656 notifier 5660 bl.length()=181 2024-09-14T11:35:24.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.794+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 from cache 2024-09-14T11:35:24.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.794+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7, ofs0, ns] 2024-09-14T11:35:24.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.794+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94273586827264 notifier 5660 bl.length()=238 2024-09-14T11:35:24.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.798+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 : miss 2024-09-14T11:35:24.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.798+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.798+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.798+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 info.flags=0x0 2024-09-14T11:35:24.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.798+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7 to cache LRU end 2024-09-14T11:35:24.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.800+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 : miss 2024-09-14T11:35:24.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.800+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 info.flags=0x17 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 to cache LRU end 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:35:24.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.801+0000 7f2ae2131800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 2024-09-14T11:35:24.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.802+0000 7f2ae2131800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:35:24.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.802+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:35:24.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.803+0000 7f2ae2131800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:35:24.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.804+0000 7f2ae2131800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:35:24.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 10 manifest: total_size = 1048576 2024-09-14T11:35:24.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5145098834842279007 2024-09-14T11:35:24.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.805+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8.2 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5145098834842279007 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.6G08GSXLPGUareECt96nlfXLVMmYLRF_0 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.807+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5145098834842279007 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.808+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.808+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.809+0000 7f2ae2131800 10 manifest: total_size = 1048576 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.809+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7225582234890446546 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.809+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.809+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.809+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8.3 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7225582234890446546 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.zeXAgi8BKGq9lXKE0KsGSC_0oRt9va6_0 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.811+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7225582234890446546 2024-09-14T11:35:24.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:35:24.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 10 manifest: total_size = 1035 2024-09-14T11:35:24.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7068912226249922409 2024-09-14T11:35:24.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.812+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8.6 2024-09-14T11:35:24.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7068912226249922409 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.bxmUQKU3cpAm-synEPM5xTywMSMahlz_0 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.814+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7068912226249922409 2024-09-14T11:35:24.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.815+0000 7f29c0ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 10 manifest: total_size = 55 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8125609123799863426 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 20 get_obj_state: octx=0x55bdc7adafa0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bdc7ac5a08 s->prefetch_data=0 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 20 prepare_atomic_modification: state is not atomic. state=0x55bdc7ac5a08 2024-09-14T11:35:24.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.816+0000 7f2ae2131800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8.8 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8125609123799863426 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.SzKUo6hgKjous9YZNPXBrsFG5Y_lear_0 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:35:24.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.818+0000 7f2ae2131800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8125609123799863426 2024-09-14T11:35:24.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.819+0000 7f29c17fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:35:24.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.819+0000 7f2ae2131800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:35:24.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.819+0000 7f2ae2131800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:35:24.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.820+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:35:24.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.820+0000 7f2ae2131800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:35:24.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.820+0000 7f2ae2131800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:35:24.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.820+0000 7f2ae2131800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:35:24.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.820+0000 7f2ae2131800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:35:24.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.821+0000 7f2ae2131800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:35:24.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.822+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.822+0000 7f2ae2131800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:35:24.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.822+0000 7f2ae2131800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:35:24.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.822+0000 7f2ae2131800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:35:24.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.823+0000 7f2ae2131800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:35:24.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.823+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:35:24.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.823+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562420 cookie 94273586812656 notifier 5660 bl.length()=181 2024-09-14T11:35:24.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.826+0000 7f2ae2131800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 from cache 2024-09-14T11:35:24.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.826+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8, ofs0, ns] 2024-09-14T11:35:24.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.826+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94273586827264 notifier 5660 bl.length()=238 2024-09-14T11:35:24.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.829+0000 7f2ae2131800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 : miss 2024-09-14T11:35:24.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.829+0000 7f2ae2131800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.829+0000 7f2ae2131800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.830+0000 7f2ae2131800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 info.flags=0x0 2024-09-14T11:35:24.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.830+0000 7f2ae2131800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8 to cache LRU end 2024-09-14T11:35:24.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.831+0000 7f2ae2131800 10 removing key index: DVBPCTTZXORHSUJJLNIG 2024-09-14T11:35:24.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.833+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:DVBPCTTZXORHSUJJLNIG, ofs0, ns] 2024-09-14T11:35:24.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.833+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94273586767472 notifier 5660 bl.length()=170 2024-09-14T11:35:24.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.834+0000 7f2ae2131800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:35:24.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.835+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:35:24.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.835+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94273586816304 notifier 5660 bl.length()=182 2024-09-14T11:35:24.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.837+0000 7f2ae2131800 10 removing user buckets index 2024-09-14T11:35:24.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.838+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:35:24.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.838+0000 7f29c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94273586827264 notifier 5660 bl.length()=173 2024-09-14T11:35:24.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.839+0000 7f2ae2131800 10 removing user index: ragweed.client.0 2024-09-14T11:35:24.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.840+0000 7f2ae2131800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:35:24.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.840+0000 7f2ae2131800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:35:24.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.841+0000 7f29c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 94273586821344 notifier 5660 bl.length()=165 2024-09-14T11:35:24.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.844+0000 7f298f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:24.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.847+0000 7f2ae2131800 20 remove_watcher() i=0 2024-09-14T11:35:24.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.847+0000 7f2ae2131800 2 removed watcher, disabling cache 2024-09-14T11:35:24.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.848+0000 7f2ae2131800 20 remove_watcher() i=1 2024-09-14T11:35:24.846 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.848+0000 7f2ae2131800 20 remove_watcher() i=2 2024-09-14T11:35:24.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.849+0000 7f2ae2131800 20 remove_watcher() i=3 2024-09-14T11:35:24.848 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.850+0000 7f2ae2131800 20 remove_watcher() i=4 2024-09-14T11:35:24.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.851+0000 7f2ae2131800 20 remove_watcher() i=5 2024-09-14T11:35:24.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.852+0000 7f2ae2131800 20 remove_watcher() i=6 2024-09-14T11:35:24.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.853+0000 7f2ae2131800 20 remove_watcher() i=7 2024-09-14T11:35:24.862 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:35:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:24.959 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:24.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.994+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 20 realm 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.995+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.996+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.996+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.996+0000 7f3623e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.996+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.997+0000 7f3623e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:24.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:24.997+0000 7f3623e0f800 20 searching for the correct realm 2024-09-14T11:35:25.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.201+0000 7f36210f8640 0 -- 172.21.15.116:0/2207150388 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5597cc683600 msgr2=0x5597cc6859f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:25.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.205+0000 7f36218f9640 0 -- 172.21.15.116:0/2207150388 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f360c014be0 msgr2=0x7f360c028400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:25.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.209+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 zone default found 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 4 Realm: () 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 zonegroup default 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.210+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.211+0000 7f3623e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.211+0000 7f3623e0f800 20 started sync module instance, tier type = 2024-09-14T11:35:25.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.211+0000 7f3623e0f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:35:25.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=0 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=1 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=2 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=3 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=4 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=5 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.219+0000 7f3623e0f800 20 add_watcher() i=6 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.220+0000 7f3623e0f800 20 add_watcher() i=7 2024-09-14T11:35:25.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.220+0000 7f3623e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:25.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.222+0000 7f34d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.222+0000 7f3623e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:25.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.222+0000 7f3623e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:25.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f34d2ffd640 20 reqs_thread_entry: start 2024-09-14T11:35:25.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f3623e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f3623e0f800 20 Filter name: none 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f34d0ff9640 20 reqs_thread_entry: start 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f3623e0f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.256+0000 7f3623e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.257+0000 7f3623e0f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:35:25.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.257+0000 7f3623e0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:35:25.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.257+0000 7f3623e0f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:35:25.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.257+0000 7f3623e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:25.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.257+0000 7f3623e0f800 10 removing key index: ZHYJVNTGADHKJEJLSMCH 2024-09-14T11:35:25.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.258+0000 7f3623e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:ZHYJVNTGADHKJEJLSMCH, ofs0, ns] 2024-09-14T11:35:25.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.259+0000 7f35057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94110457816608 notifier 6081 bl.length()=170 2024-09-14T11:35:25.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.260+0000 7f3623e0f800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:35:25.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.261+0000 7f3623e0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:35:25.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.261+0000 7f35057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94110457820176 notifier 6081 bl.length()=182 2024-09-14T11:35:25.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.263+0000 7f3623e0f800 10 removing user buckets index 2024-09-14T11:35:25.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.264+0000 7f3623e0f800 10 removing user index: sysuser.client.0 2024-09-14T11:35:25.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.265+0000 7f3623e0f800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:35:25.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.265+0000 7f3623e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:35:25.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.265+0000 7f3504ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94110457816608 notifier 6081 bl.length()=165 2024-09-14T11:35:25.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.267+0000 7f34d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.269+0000 7f3623e0f800 20 remove_watcher() i=0 2024-09-14T11:35:25.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.269+0000 7f3623e0f800 2 removed watcher, disabling cache 2024-09-14T11:35:25.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.270+0000 7f3623e0f800 20 remove_watcher() i=1 2024-09-14T11:35:25.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.271+0000 7f3623e0f800 20 remove_watcher() i=2 2024-09-14T11:35:25.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.272+0000 7f3623e0f800 20 remove_watcher() i=3 2024-09-14T11:35:25.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.273+0000 7f3623e0f800 20 remove_watcher() i=4 2024-09-14T11:35:25.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.274+0000 7f3623e0f800 20 remove_watcher() i=5 2024-09-14T11:35:25.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.275+0000 7f3623e0f800 20 remove_watcher() i=6 2024-09-14T11:35:25.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:35:25.276+0000 7f3623e0f800 20 remove_watcher() i=7 2024-09-14T11:35:25.284 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:35:25.284 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:35:25.365 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:35:25.376 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:35:25.376 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:35:25.376 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:25.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:35:25.405 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:35:25.405 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:25.473 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:25.473 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:35:25.541 INFO:tasks.workunit:timeout=3h 2024-09-14T11:35:25.541 INFO:tasks.workunit:cleanup=True 2024-09-14T11:35:25.542 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:35:25.611 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:36:21.683 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:21.685 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:36:21.686 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:36:21.756 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:36:21.758 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:36:21.758 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:36:21.806 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:36:21.854 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:36:21.893 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:36:21.895 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:36:21.895 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:36:21.933 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:36:21.936 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:36:21.936 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:36:22.006 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:36:22.007 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:36:22.007 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi116.stderr:+ ulimit -c 0 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi116.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:36:22.080 INFO:tasks.workunit.client.0.smithi116.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:22.081 INFO:tasks.workunit.client.0.smithi116.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:24.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ deactivate nondestructive 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:36:24.404 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:36:24.405 INFO:tasks.workunit.client.0.smithi116.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:24.405 INFO:tasks.workunit.client.0.smithi116.stderr:++ export VIRTUAL_ENV 2024-09-14T11:36:24.405 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PATH 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ PS1='(rgw) ' 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PS1 2024-09-14T11:36:24.406 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:24.407 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T11:36:24.407 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install pip --upgrade 2024-09-14T11:36:24.629 INFO:tasks.workunit.client.0.smithi116.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:36:24.812 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting pip 2024-09-14T11:36:24.817 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:36:24.860 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: pip 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi116.stdout: Attempting uninstall: pip 2024-09-14T11:36:24.861 INFO:tasks.workunit.client.0.smithi116.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:36:25.011 INFO:tasks.workunit.client.0.smithi116.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:36:25.016 INFO:tasks.workunit.client.0.smithi116.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:36:25.738 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed pip-24.2 2024-09-14T11:36:25.786 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install boto3 2024-09-14T11:36:26.554 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting boto3 2024-09-14T11:36:26.556 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:36:27.131 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:36:27.132 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:36:27.191 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:36:27.192 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:36:27.246 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:36:27.247 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:36:27.297 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:36:27.298 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:36:27.373 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:36:27.375 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:36:27.553 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:36:27.554 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:36:27.558 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:36:27.560 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:36:27.569 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:36:27.570 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:36:27.572 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:36:27.573 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:36:27.574 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:36:27.649 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:36:28.633 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:36:28.747 INFO:tasks.workunit.client.0.smithi116.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:36:28.870 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:36:28.904 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:28.904 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:28.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.942+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 realm 2024-09-14T11:36:28.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:28.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.944+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.945+0000 7f69f1c92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:28.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.945+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.945+0000 7f69f1c92800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:28.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:28.945+0000 7f69f1c92800 20 searching for the correct realm 2024-09-14T11:36:29.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.151+0000 7f69eef7b640 0 -- 172.21.15.116:0/877390037 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x556527a2fe80 msgr2=0x556527a32340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:29.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.155+0000 7f69ef77c640 0 -- 172.21.15.116:0/877390037 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f69e4067730 msgr2=0x7f69e4069750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:29.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:29.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:29.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.160+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:29.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 zone default found 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 4 Realm: () 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 zonegroup default 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 started sync module instance, tier type = 2024-09-14T11:36:29.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.161+0000 7f69f1c92800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=0 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=1 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=2 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=3 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=4 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=5 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.171+0000 7f69f1c92800 20 add_watcher() i=6 2024-09-14T11:36:29.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.172+0000 7f69f1c92800 20 add_watcher() i=7 2024-09-14T11:36:29.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.172+0000 7f69f1c92800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.174+0000 7f68a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.174+0000 7f69f1c92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.174+0000 7f69f1c92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 5 note: GC not initialized 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f68a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 20 Filter name: none 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f681e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.175+0000 7f69f1c92800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.176+0000 7f69f1c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.176+0000 7f69f1c92800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.176+0000 7f69f1c92800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.176+0000 7f69f1c92800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:36:29.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.176+0000 7f69f1c92800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f69f1c92800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f69f1c92800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f69f1c92800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f68d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93892945075712 notifier 6099 bl.length()=569 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f68d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:36:29.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.177+0000 7f68d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.180+0000 7f69f1c92800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.180+0000 7f69f1c92800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.180+0000 7f69f1c92800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.180+0000 7f68d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93892945068032 notifier 6099 bl.length()=180 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.181+0000 7f68d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:36:29.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.181+0000 7f68d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:36:29.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.182+0000 7f68a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.185+0000 7f69f1c92800 20 remove_watcher() i=0 2024-09-14T11:36:29.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.185+0000 7f69f1c92800 2 removed watcher, disabling cache 2024-09-14T11:36:29.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.186+0000 7f69f1c92800 20 remove_watcher() i=1 2024-09-14T11:36:29.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.187+0000 7f69f1c92800 20 remove_watcher() i=2 2024-09-14T11:36:29.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.189+0000 7f69f1c92800 20 remove_watcher() i=3 2024-09-14T11:36:29.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.190+0000 7f69f1c92800 20 remove_watcher() i=4 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.191+0000 7f69f1c92800 20 remove_watcher() i=5 2024-09-14T11:36:29.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.192+0000 7f69f1c92800 20 remove_watcher() i=6 2024-09-14T11:36:29.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.193+0000 7f69f1c92800 20 remove_watcher() i=7 2024-09-14T11:36:29.558 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard add 2024-09-14T11:36:29.558 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:29.560 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:29.588 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:29.588 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:29.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.627+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 20 realm 2024-09-14T11:36:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.627 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:29.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.628+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.629+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.629+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.628 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.630+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:29.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.630+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.630+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:29.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.630+0000 7fe25a01d800 20 searching for the correct realm 2024-09-14T11:36:29.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.633+0000 7fe254fea640 0 -- 172.21.15.116:0/2598947243 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55f9f433f610 msgr2=0x55f9f4341a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:29.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.637+0000 7fe2557eb640 0 -- 172.21.15.116:0/2598947243 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe24c04a080 msgr2=0x7fe24c04e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:29.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:29.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.641+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 zone default found 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 4 Realm: () 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 zonegroup default 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.642+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.643+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.643+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.643+0000 7fe25a01d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.643+0000 7fe25a01d800 20 started sync module instance, tier type = 2024-09-14T11:36:29.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.643+0000 7fe25a01d800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=0 2024-09-14T11:36:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=1 2024-09-14T11:36:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=2 2024-09-14T11:36:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=3 2024-09-14T11:36:29.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=4 2024-09-14T11:36:29.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=5 2024-09-14T11:36:29.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.652+0000 7fe25a01d800 20 add_watcher() i=6 2024-09-14T11:36:29.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.653+0000 7fe25a01d800 20 add_watcher() i=7 2024-09-14T11:36:29.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.653+0000 7fe25a01d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:29.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.654+0000 7fe10b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:29.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:29.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 5 note: GC not initialized 2024-09-14T11:36:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe10a7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 20 Filter name: none 2024-09-14T11:36:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe07bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:29.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.655+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.656+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.656+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.656+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.656+0000 7fe25a01d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:29.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.656+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.657+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:29.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.657+0000 7fe25a01d800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.657+0000 7fe25a01d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:29.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.657+0000 7fe25a01d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:29.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.659+0000 7fe10b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.661+0000 7fe25a01d800 20 remove_watcher() i=0 2024-09-14T11:36:29.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.661+0000 7fe25a01d800 2 removed watcher, disabling cache 2024-09-14T11:36:29.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.662+0000 7fe25a01d800 20 remove_watcher() i=1 2024-09-14T11:36:29.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.663+0000 7fe25a01d800 20 remove_watcher() i=2 2024-09-14T11:36:29.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.664+0000 7fe25a01d800 20 remove_watcher() i=3 2024-09-14T11:36:29.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.665+0000 7fe25a01d800 20 remove_watcher() i=4 2024-09-14T11:36:29.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.666+0000 7fe25a01d800 20 remove_watcher() i=5 2024-09-14T11:36:29.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.667+0000 7fe25a01d800 20 remove_watcher() i=6 2024-09-14T11:36:29.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.668+0000 7fe25a01d800 20 remove_watcher() i=7 2024-09-14T11:36:29.677 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:29.677 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:36:29.677 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:29.678 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:36:29.709 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:29.709 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:29.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.748+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.749+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.749+0000 7f595a00e800 20 realm 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.749+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.750+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.750+0000 7f595a00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.750+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.750+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.750+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.751+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:29.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.751+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.751+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:29.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.751+0000 7f595a00e800 20 searching for the correct realm 2024-09-14T11:36:29.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.754+0000 7f5954fbb640 0 -- 172.21.15.116:0/3002505037 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5948025040 msgr2=0x7f5948071570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:29.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.758+0000 7f59557bc640 0 -- 172.21.15.116:0/3002505037 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f594c07c1d0 msgr2=0x7f594c092100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.965+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 zone default found 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 4 Realm: () 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 zonegroup default 2024-09-14T11:36:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.966+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.967+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.967+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.967+0000 7f595a00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.967+0000 7f595a00e800 20 started sync module instance, tier type = 2024-09-14T11:36:29.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.967+0000 7f595a00e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.976+0000 7f595a00e800 20 add_watcher() i=0 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=1 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=2 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=3 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=4 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=5 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=6 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 20 add_watcher() i=7 2024-09-14T11:36:29.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.977+0000 7f595a00e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.979+0000 7f580b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.979+0000 7f595a00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.979+0000 7f595a00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.979+0000 7f595a00e800 5 note: GC not initialized 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f580a7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 20 Filter name: none 2024-09-14T11:36:29.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f577bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:29.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:29.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.980+0000 7f595a00e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.981+0000 7f595a00e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:29.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.983+0000 7f580b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:29.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.985+0000 7f595a00e800 20 remove_watcher() i=0 2024-09-14T11:36:29.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.985+0000 7f595a00e800 2 removed watcher, disabling cache 2024-09-14T11:36:29.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.986+0000 7f595a00e800 20 remove_watcher() i=1 2024-09-14T11:36:29.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.987+0000 7f595a00e800 20 remove_watcher() i=2 2024-09-14T11:36:29.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.989+0000 7f595a00e800 20 remove_watcher() i=3 2024-09-14T11:36:29.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.990+0000 7f595a00e800 20 remove_watcher() i=4 2024-09-14T11:36:29.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.991+0000 7f595a00e800 20 remove_watcher() i=5 2024-09-14T11:36:29.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.992+0000 7f595a00e800 20 remove_watcher() i=6 2024-09-14T11:36:29.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:29.993+0000 7f595a00e800 20 remove_watcher() i=7 2024-09-14T11:36:30.002 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard list 2024-09-14T11:36:30.028 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:30.029 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:30.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.068+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 20 realm 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.069+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.070+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.070+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.070+0000 7fe5a6122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.070+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.071+0000 7fe5a6122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.071+0000 7fe5a6122800 20 searching for the correct realm 2024-09-14T11:36:30.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.074+0000 7fe5a25d3640 0 -- 172.21.15.116:0/356918285 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55f14daebeb0 msgr2=0x55f14daee300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:30.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.077+0000 7fe5a1dd2640 0 -- 172.21.15.116:0/356918285 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe58c00b440 msgr2=0x7fe58c022030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:30.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:30.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:30.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:30.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:30.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.081+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 zone default found 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 4 Realm: () 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 zonegroup default 2024-09-14T11:36:30.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.082+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 started sync module instance, tier type = 2024-09-14T11:36:30.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.083+0000 7fe5a6122800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=0 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=1 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=2 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=3 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=4 2024-09-14T11:36:30.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=5 2024-09-14T11:36:30.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.093+0000 7fe5a6122800 20 add_watcher() i=6 2024-09-14T11:36:30.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.094+0000 7fe5a6122800 20 add_watcher() i=7 2024-09-14T11:36:30.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.094+0000 7fe5a6122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.095+0000 7fe4537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe5a6122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe5a6122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe5a6122800 5 note: GC not initialized 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe4527fc640 20 reqs_thread_entry: start 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe5a6122800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe5a6122800 20 Filter name: none 2024-09-14T11:36:30.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.096+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:30.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.102+0000 7fe4537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:30.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.104+0000 7fe5a6122800 20 remove_watcher() i=0 2024-09-14T11:36:30.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.104+0000 7fe5a6122800 2 removed watcher, disabling cache 2024-09-14T11:36:30.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.105+0000 7fe5a6122800 20 remove_watcher() i=1 2024-09-14T11:36:30.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.106+0000 7fe5a6122800 20 remove_watcher() i=2 2024-09-14T11:36:30.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.107+0000 7fe5a6122800 20 remove_watcher() i=3 2024-09-14T11:36:30.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.108+0000 7fe5a6122800 20 remove_watcher() i=4 2024-09-14T11:36:30.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.109+0000 7fe5a6122800 20 remove_watcher() i=5 2024-09-14T11:36:30.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.110+0000 7fe5a6122800 20 remove_watcher() i=6 2024-09-14T11:36:30.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.111+0000 7fe5a6122800 20 remove_watcher() i=7 2024-09-14T11:36:30.120 INFO:tasks.workunit.client.0.smithi116.stderr:bucket name a-bucket 2024-09-14T11:36:30.120 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard process 2024-09-14T11:36:30.121 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:30.122 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard process 2024-09-14T11:36:30.148 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:30.148 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:30.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.187+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 realm 2024-09-14T11:36:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.189+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.190+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:30.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.190+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.190+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:30.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.190+0000 7fc781746800 20 searching for the correct realm 2024-09-14T11:36:30.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.193+0000 7fc77fa38640 0 -- 172.21.15.116:0/2115580876 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fc77406b020 msgr2=0x7fc7740a4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:30.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.197+0000 7fc77f237640 0 -- 172.21.15.116:0/2115580876 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc7740bb7c0 msgr2=0x7fc7740a3c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.403+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.404+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.404+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.404+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.404+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 zone default found 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 4 Realm: () 2024-09-14T11:36:30.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 zonegroup default 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.405+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.406+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.406+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.406+0000 7fc781746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.406+0000 7fc781746800 20 started sync module instance, tier type = 2024-09-14T11:36:30.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.406+0000 7fc781746800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=0 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=1 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=2 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=3 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=4 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=5 2024-09-14T11:36:30.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=6 2024-09-14T11:36:30.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 20 add_watcher() i=7 2024-09-14T11:36:30.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.416+0000 7fc781746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:30.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.418+0000 7fc635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.418+0000 7fc781746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.418+0000 7fc781746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.418+0000 7fc781746800 5 note: GC not initialized 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.418+0000 7fc634fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.419+0000 7fc781746800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.419+0000 7fc781746800 20 Filter name: none 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.419+0000 7fc5ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:30.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.419+0000 7fc781746800 20 processing logshard = reshard.0000000000 2024-09-14T11:36:30.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.421+0000 7fc781746800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:36:30.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.421+0000 7fc781746800 20 processing logshard = reshard.0000000001 2024-09-14T11:36:30.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.424+0000 7fc781746800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:36:30.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.424+0000 7fc781746800 20 processing logshard = reshard.0000000002 2024-09-14T11:36:30.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.426+0000 7fc781746800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:36:30.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.426+0000 7fc781746800 20 processing logshard = reshard.0000000003 2024-09-14T11:36:30.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.428+0000 7fc781746800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:36:30.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.428+0000 7fc781746800 20 processing logshard = reshard.0000000004 2024-09-14T11:36:30.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.431+0000 7fc781746800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:36:30.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.431+0000 7fc781746800 20 processing logshard = reshard.0000000005 2024-09-14T11:36:30.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.433+0000 7fc781746800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:36:30.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.433+0000 7fc781746800 20 processing logshard = reshard.0000000006 2024-09-14T11:36:30.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.434+0000 7fc781746800 20 process_entry resharding a-bucket 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.434+0000 7fc781746800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.434+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:30.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.435+0000 7fc781746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:30.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.442+0000 7fc781746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.442+0000 7fc781746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.442+0000 7fc781746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.442+0000 7fc781746800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.443+0000 7fc6627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94102646926944 notifier 5768 bl.length()=827 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.443+0000 7fc6627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.443+0000 7fc6627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.443+0000 7fc6627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.445+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:30.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.445+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:30.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.445+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:30.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.445+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:30.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:30.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:30.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:30.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:30.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:30.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.449+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.0 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.450+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1 2024-09-14T11:36:30.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.450+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.451+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.451+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.4 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.451+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.5 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.452+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.6 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.453+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.7 2024-09-14T11:36:30.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.453+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.8 2024-09-14T11:36:30.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.454+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.9 2024-09-14T11:36:30.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.454+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.10 2024-09-14T11:36:30.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.455+0000 7fc781746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:30.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.455+0000 7fc781746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc781746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc781746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc781746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc781746800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:30.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc662ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94102646926944 notifier 5768 bl.length()=827 2024-09-14T11:36:30.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc662ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc662ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.457+0000 7fc662ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.459+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:30.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.459+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:30.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.459+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:30.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.459+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:30.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.462+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.0 2024-09-14T11:36:30.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.462+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1 2024-09-14T11:36:30.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.462+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2 2024-09-14T11:36:30.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.463+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3 2024-09-14T11:36:30.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.463+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.4 2024-09-14T11:36:30.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.463+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.5 2024-09-14T11:36:30.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.463+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.6 2024-09-14T11:36:30.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.464+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.7 2024-09-14T11:36:30.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.464+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.8 2024-09-14T11:36:30.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.465+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.9 2024-09-14T11:36:30.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.465+0000 7fc781746800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.10 2024-09-14T11:36:30.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.465+0000 7fc781746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:30.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.465+0000 7fc781746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.467+0000 7fc781746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.467+0000 7fc781746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.467+0000 7fc781746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.467+0000 7fc781746800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.468+0000 7fc6627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94102646926944 notifier 5768 bl.length()=795 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.468+0000 7fc6627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.468+0000 7fc6627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:30.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.468+0000 7fc6627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:30.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.469+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:30.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.469+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:30.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.469+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:30.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.469+0000 7fc781746800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:30.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.473+0000 7fc781746800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:30.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.476+0000 7fc781746800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:36:30.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.478+0000 7fc781746800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:36:30.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.478+0000 7fc781746800 20 processing logshard = reshard.0000000007 2024-09-14T11:36:30.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.481+0000 7fc781746800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:36:30.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.481+0000 7fc781746800 20 processing logshard = reshard.0000000008 2024-09-14T11:36:30.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.484+0000 7fc781746800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:36:30.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.484+0000 7fc781746800 20 processing logshard = reshard.0000000009 2024-09-14T11:36:30.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.486+0000 7fc781746800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:36:30.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.486+0000 7fc781746800 20 processing logshard = reshard.0000000010 2024-09-14T11:36:30.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.488+0000 7fc781746800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:36:30.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.488+0000 7fc781746800 20 processing logshard = reshard.0000000011 2024-09-14T11:36:30.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.491+0000 7fc781746800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:36:30.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.491+0000 7fc781746800 20 processing logshard = reshard.0000000012 2024-09-14T11:36:30.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.493+0000 7fc781746800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:36:30.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.493+0000 7fc781746800 20 processing logshard = reshard.0000000013 2024-09-14T11:36:30.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.496+0000 7fc781746800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:36:30.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.496+0000 7fc781746800 20 processing logshard = reshard.0000000014 2024-09-14T11:36:30.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.498+0000 7fc781746800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:36:30.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.498+0000 7fc781746800 20 processing logshard = reshard.0000000015 2024-09-14T11:36:30.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.501+0000 7fc781746800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:36:30.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.502+0000 7fc635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:30.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.504+0000 7fc781746800 20 remove_watcher() i=0 2024-09-14T11:36:30.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.504+0000 7fc781746800 2 removed watcher, disabling cache 2024-09-14T11:36:30.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.505+0000 7fc781746800 20 remove_watcher() i=1 2024-09-14T11:36:30.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.506+0000 7fc781746800 20 remove_watcher() i=2 2024-09-14T11:36:30.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.507+0000 7fc781746800 20 remove_watcher() i=3 2024-09-14T11:36:30.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.507+0000 7fc781746800 20 remove_watcher() i=4 2024-09-14T11:36:30.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.508+0000 7fc781746800 20 remove_watcher() i=5 2024-09-14T11:36:30.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.509+0000 7fc781746800 20 remove_watcher() i=6 2024-09-14T11:36:30.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:30.510+0000 7fc781746800 20 remove_watcher() i=7 2024-09-14T11:36:35.526 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:35.558 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:35.558 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.605+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.607+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.607+0000 7f4e0cf73800 20 realm 2024-09-14T11:36:35.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.607+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.608+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.608+0000 7f4e0cf73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.608+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.608+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.608+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.610+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:35.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.610+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.611+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:35.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.611+0000 7f4e0cf73800 20 searching for the correct realm 2024-09-14T11:36:35.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.615+0000 7f4e0b25e640 0 -- 172.21.15.116:0/1248351063 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x556db30bdd20 msgr2=0x556db30c01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:35.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.619+0000 7f4e0aa5d640 0 -- 172.21.15.116:0/1248351063 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f4e00059bc0 msgr2=0x7f4e000c3a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:35.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:35.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.623+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 zone default found 2024-09-14T11:36:35.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 4 Realm: () 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 zonegroup default 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.624+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.625+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.625+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.625+0000 7f4e0cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.625+0000 7f4e0cf73800 20 started sync module instance, tier type = 2024-09-14T11:36:35.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.625+0000 7f4e0cf73800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:35.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=0 2024-09-14T11:36:35.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=1 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=2 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=3 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=4 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=5 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.634+0000 7f4e0cf73800 20 add_watcher() i=6 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.635+0000 7f4e0cf73800 20 add_watcher() i=7 2024-09-14T11:36:35.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.635+0000 7f4e0cf73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:35.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.637+0000 7f4cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:35.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:35.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:35.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 5 note: GC not initialized 2024-09-14T11:36:35.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4c3bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:35.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:35.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 20 Filter name: none 2024-09-14T11:36:35.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4c39ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:35.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.638+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.639+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.639+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.639+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.639+0000 7f4e0cf73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.639+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.640+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.640+0000 7f4e0cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.640+0000 7f4e0cf73800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:35.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.640+0000 7f4e0cf73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:35.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.642+0000 7f4cc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:35.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.644+0000 7f4e0cf73800 20 remove_watcher() i=0 2024-09-14T11:36:35.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.644+0000 7f4e0cf73800 2 removed watcher, disabling cache 2024-09-14T11:36:35.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.646+0000 7f4e0cf73800 20 remove_watcher() i=1 2024-09-14T11:36:35.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.647+0000 7f4e0cf73800 20 remove_watcher() i=2 2024-09-14T11:36:35.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.648+0000 7f4e0cf73800 20 remove_watcher() i=3 2024-09-14T11:36:35.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.649+0000 7f4e0cf73800 20 remove_watcher() i=4 2024-09-14T11:36:35.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.650+0000 7f4e0cf73800 20 remove_watcher() i=5 2024-09-14T11:36:35.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.651+0000 7f4e0cf73800 20 remove_watcher() i=6 2024-09-14T11:36:35.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:35.652+0000 7f4e0cf73800 20 remove_watcher() i=7 2024-09-14T11:36:35.661 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:35.661 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:35.661 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:36:35.661 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:35.662 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard add non empty bucket 2024-09-14T11:36:35.662 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:35.989 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:35.989 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:36.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.028+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 20 realm 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.030+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.031+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.031+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.031+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:36.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.031+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.032+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:36.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.032+0000 7f462bc1b800 20 searching for the correct realm 2024-09-14T11:36:36.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.035+0000 7f4627bec640 0 -- 172.21.15.116:0/3184011122 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f4610085930 msgr2=0x7f461007a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:36.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.039+0000 7f46273eb640 0 -- 172.21.15.116:0/3184011122 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f4610064430 msgr2=0x7f4610064890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:36.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:36.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:36.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.246+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 zone default found 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 4 Realm: () 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:36.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 zonegroup default 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.247+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.248+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.248+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.248+0000 7f462bc1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.248+0000 7f462bc1b800 20 started sync module instance, tier type = 2024-09-14T11:36:36.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.248+0000 7f462bc1b800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=0 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=1 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=2 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=3 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=4 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=5 2024-09-14T11:36:36.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.257+0000 7f462bc1b800 20 add_watcher() i=6 2024-09-14T11:36:36.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.258+0000 7f462bc1b800 20 add_watcher() i=7 2024-09-14T11:36:36.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.258+0000 7f462bc1b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:36.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.260+0000 7f44ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:36.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:36.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 5 note: GC not initialized 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f44dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 20 Filter name: none 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f44567fc640 20 reqs_thread_entry: start 2024-09-14T11:36:36.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.261+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.262+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.262+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.262+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.262+0000 7f462bc1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.262+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.263+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.263+0000 7f462bc1b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.263+0000 7f462bc1b800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:36.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.263+0000 7f462bc1b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:36.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.265+0000 7f44ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:36.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.267+0000 7f462bc1b800 20 remove_watcher() i=0 2024-09-14T11:36:36.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.267+0000 7f462bc1b800 2 removed watcher, disabling cache 2024-09-14T11:36:36.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.268+0000 7f462bc1b800 20 remove_watcher() i=1 2024-09-14T11:36:36.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.270+0000 7f462bc1b800 20 remove_watcher() i=2 2024-09-14T11:36:36.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.271+0000 7f462bc1b800 20 remove_watcher() i=3 2024-09-14T11:36:36.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.272+0000 7f462bc1b800 20 remove_watcher() i=4 2024-09-14T11:36:36.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.273+0000 7f462bc1b800 20 remove_watcher() i=5 2024-09-14T11:36:36.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.274+0000 7f462bc1b800 20 remove_watcher() i=6 2024-09-14T11:36:36.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.274+0000 7f462bc1b800 20 remove_watcher() i=7 2024-09-14T11:36:36.283 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:36.283 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:36.283 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:36:36.283 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:36.284 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:36:36.315 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:36.316 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:36.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.355+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 realm 2024-09-14T11:36:36.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:36.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.356+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.357+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:36.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.357+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.358+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:36.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.358+0000 7f5b98946800 20 searching for the correct realm 2024-09-14T11:36:36.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.361+0000 7f5b95c36640 0 -- 172.21.15.116:0/2711847310 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x556bbed498b0 msgr2=0x556bbed4bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:36.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.566+0000 7f5b96437640 0 -- 172.21.15.116:0/2711847310 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5b8c037960 msgr2=0x7f5b8c0133e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.973+0000 7f5b98946800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.974+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 zone default found 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 4 Realm: () 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 zonegroup default 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.975+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.976+0000 7f5b98946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.976+0000 7f5b98946800 20 started sync module instance, tier type = 2024-09-14T11:36:36.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.976+0000 7f5b98946800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=0 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=1 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=2 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=3 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=4 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=5 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=6 2024-09-14T11:36:36.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 20 add_watcher() i=7 2024-09-14T11:36:36.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.986+0000 7f5b98946800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:36.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.988+0000 7f5a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:36.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:36.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:36.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 5 note: GC not initialized 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f59c77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 20 Filter name: none 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f59c57fa640 20 reqs_thread_entry: start 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.989+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:36:36.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 20 rados->read ofs=0 len=0 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:36.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.990+0000 7f5b98946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:36.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.992+0000 7f5a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:36.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.996+0000 7f5b98946800 20 remove_watcher() i=0 2024-09-14T11:36:36.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.996+0000 7f5b98946800 2 removed watcher, disabling cache 2024-09-14T11:36:36.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.997+0000 7f5b98946800 20 remove_watcher() i=1 2024-09-14T11:36:36.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.998+0000 7f5b98946800 20 remove_watcher() i=2 2024-09-14T11:36:36.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:36.999+0000 7f5b98946800 20 remove_watcher() i=3 2024-09-14T11:36:36.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.000+0000 7f5b98946800 20 remove_watcher() i=4 2024-09-14T11:36:36.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.001+0000 7f5b98946800 20 remove_watcher() i=5 2024-09-14T11:36:37.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.003+0000 7f5b98946800 20 remove_watcher() i=6 2024-09-14T11:36:37.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.003+0000 7f5b98946800 20 remove_watcher() i=7 2024-09-14T11:36:37.014 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard list 2024-09-14T11:36:37.040 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:37.040 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:37.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.078+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 20 realm 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.080+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.081+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.081+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.082+0000 7f0488014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.082+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.082+0000 7f0488014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:37.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.082+0000 7f0488014800 20 searching for the correct realm 2024-09-14T11:36:37.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.085+0000 7f0482eca640 0 -- 172.21.15.116:0/1354725432 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f047403c040 msgr2=0x7f0474058930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:37.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.088+0000 7f04836cb640 0 -- 172.21.15.116:0/1354725432 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f04780bd0b0 msgr2=0x7f04780ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:37.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:37.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:37.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.294+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 zone default found 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 4 Realm: () 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 zonegroup default 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.295+0000 7f0488014800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.296+0000 7f0488014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.296+0000 7f0488014800 20 started sync module instance, tier type = 2024-09-14T11:36:37.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.296+0000 7f0488014800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=0 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=1 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=2 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=3 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=4 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=5 2024-09-14T11:36:37.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.306+0000 7f0488014800 20 add_watcher() i=6 2024-09-14T11:36:37.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.307+0000 7f0488014800 20 add_watcher() i=7 2024-09-14T11:36:37.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.307+0000 7f0488014800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:37.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0488014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:37.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0488014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:37.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0488014800 5 note: GC not initialized 2024-09-14T11:36:37.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0338fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:37.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0488014800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:37.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f0488014800 20 Filter name: none 2024-09-14T11:36:37.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.309+0000 7f02b27fc640 20 reqs_thread_entry: start 2024-09-14T11:36:37.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.316+0000 7f0339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.318+0000 7f0488014800 20 remove_watcher() i=0 2024-09-14T11:36:37.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.318+0000 7f0488014800 2 removed watcher, disabling cache 2024-09-14T11:36:37.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.319+0000 7f0488014800 20 remove_watcher() i=1 2024-09-14T11:36:37.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.321+0000 7f0488014800 20 remove_watcher() i=2 2024-09-14T11:36:37.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.322+0000 7f0488014800 20 remove_watcher() i=3 2024-09-14T11:36:37.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.323+0000 7f0488014800 20 remove_watcher() i=4 2024-09-14T11:36:37.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.324+0000 7f0488014800 20 remove_watcher() i=5 2024-09-14T11:36:37.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.325+0000 7f0488014800 20 remove_watcher() i=6 2024-09-14T11:36:37.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.326+0000 7f0488014800 20 remove_watcher() i=7 2024-09-14T11:36:37.334 INFO:tasks.workunit.client.0.smithi116.stderr:bucket name a-bucket 2024-09-14T11:36:37.335 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard process non empty bucket 2024-09-14T11:36:37.335 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:37.336 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshard process 2024-09-14T11:36:37.362 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:37.362 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:37.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.401+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 realm 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.403+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.404+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.404+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.404+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:37.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.404+0000 7fc1e3739800 20 searching for the correct realm 2024-09-14T11:36:37.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.408+0000 7fc1dfbc8640 0 -- 172.21.15.116:0/3004370004 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x557fcbafb0d0 msgr2=0x557fcbafd540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:37.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.412+0000 7fc1df3c7640 0 -- 172.21.15.116:0/3004370004 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc1d404fd90 msgr2=0x7fc1d407b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 zone default found 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 4 Realm: () 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 zonegroup default 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.416+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 started sync module instance, tier type = 2024-09-14T11:36:37.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.417+0000 7fc1e3739800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:37.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=0 2024-09-14T11:36:37.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=1 2024-09-14T11:36:37.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=2 2024-09-14T11:36:37.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=3 2024-09-14T11:36:37.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=4 2024-09-14T11:36:37.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=5 2024-09-14T11:36:37.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.426+0000 7fc1e3739800 20 add_watcher() i=6 2024-09-14T11:36:37.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.427+0000 7fc1e3739800 20 add_watcher() i=7 2024-09-14T11:36:37.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.427+0000 7fc1e3739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:37.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.428+0000 7fc095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:37.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:37.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 5 note: GC not initialized 2024-09-14T11:36:37.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc094fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:37.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:37.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 20 Filter name: none 2024-09-14T11:36:37.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc00e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:37.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.429+0000 7fc1e3739800 20 processing logshard = reshard.0000000000 2024-09-14T11:36:37.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.432+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:36:37.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.432+0000 7fc1e3739800 20 processing logshard = reshard.0000000001 2024-09-14T11:36:37.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.434+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:36:37.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.434+0000 7fc1e3739800 20 processing logshard = reshard.0000000002 2024-09-14T11:36:37.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.437+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:36:37.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.437+0000 7fc1e3739800 20 processing logshard = reshard.0000000003 2024-09-14T11:36:37.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.439+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:36:37.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.439+0000 7fc1e3739800 20 processing logshard = reshard.0000000004 2024-09-14T11:36:37.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.442+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:36:37.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.442+0000 7fc1e3739800 20 processing logshard = reshard.0000000005 2024-09-14T11:36:37.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.444+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:36:37.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.444+0000 7fc1e3739800 20 processing logshard = reshard.0000000006 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 20 process_entry resharding a-bucket 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:36:37.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.446+0000 7fc1e3739800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.447+0000 7fc1e3739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc1e3739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc1e3739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc1e3739800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc1e3739800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc0c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94007366502256 notifier 6273 bl.length()=827 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc0c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc0c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.453+0000 7fc0c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.455+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:37.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.455+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:37.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.455+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:37.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.455+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:37.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:36:37.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:36:37.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:36:37.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:36:37.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:37.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.460+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.461+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.461+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.461+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.461+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:37.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.462+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.463+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.463+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.463+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.463+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:37.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.464+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.465+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:37.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.465+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:37.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.467+0000 7fc1e3739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:37.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.467+0000 7fc1e3739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:37.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.468+0000 7fc1e3739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.468+0000 7fc1e3739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.468+0000 7fc1e3739800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.468+0000 7fc1e3739800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.469+0000 7fc0c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94007366502256 notifier 6273 bl.length()=827 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.469+0000 7fc0c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.469+0000 7fc0c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.469+0000 7fc0c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.470+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:37.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.470+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:37.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.470+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:37.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.470+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:37.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:37.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.0 2024-09-14T11:36:37.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:37.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.1 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.473+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.2 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.3 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.4 2024-09-14T11:36:37.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:37.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.5 2024-09-14T11:36:37.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:37.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.474+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.6 2024-09-14T11:36:37.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.7 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.8 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.475+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.9 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.10 2024-09-14T11:36:37.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:37.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.1.11 2024-09-14T11:36:37.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:37.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.476+0000 7fc1e3739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:36:37.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc1e3739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc1e3739800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc1e3739800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc1e3739800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:36:37.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc0c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94007366502256 notifier 6273 bl.length()=795 2024-09-14T11:36:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc0c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:36:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc0c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:36:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.478+0000 7fc0c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.480+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:36:37.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.480+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:36:37.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.480+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:36:37.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.480+0000 7fc1e3739800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:36:37.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.482+0000 7fc1e3739800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:36:37.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.483+0000 7fc1e3739800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:36:37.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.485+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:36:37.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.485+0000 7fc1e3739800 20 processing logshard = reshard.0000000007 2024-09-14T11:36:37.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.487+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:36:37.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.487+0000 7fc1e3739800 20 processing logshard = reshard.0000000008 2024-09-14T11:36:37.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.489+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:36:37.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.489+0000 7fc1e3739800 20 processing logshard = reshard.0000000009 2024-09-14T11:36:37.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.492+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:36:37.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.492+0000 7fc1e3739800 20 processing logshard = reshard.0000000010 2024-09-14T11:36:37.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.494+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:36:37.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.494+0000 7fc1e3739800 20 processing logshard = reshard.0000000011 2024-09-14T11:36:37.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.497+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:36:37.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.497+0000 7fc1e3739800 20 processing logshard = reshard.0000000012 2024-09-14T11:36:37.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.499+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:36:37.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.499+0000 7fc1e3739800 20 processing logshard = reshard.0000000013 2024-09-14T11:36:37.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.502+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:36:37.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.502+0000 7fc1e3739800 20 processing logshard = reshard.0000000014 2024-09-14T11:36:37.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.504+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:36:37.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.504+0000 7fc1e3739800 20 processing logshard = reshard.0000000015 2024-09-14T11:36:37.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.506+0000 7fc1e3739800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:36:37.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.507+0000 7fc095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.509+0000 7fc1e3739800 20 remove_watcher() i=0 2024-09-14T11:36:37.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.509+0000 7fc1e3739800 2 removed watcher, disabling cache 2024-09-14T11:36:37.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.510+0000 7fc1e3739800 20 remove_watcher() i=1 2024-09-14T11:36:37.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.511+0000 7fc1e3739800 20 remove_watcher() i=2 2024-09-14T11:36:37.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.513+0000 7fc1e3739800 20 remove_watcher() i=3 2024-09-14T11:36:37.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.514+0000 7fc1e3739800 20 remove_watcher() i=4 2024-09-14T11:36:37.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.514+0000 7fc1e3739800 20 remove_watcher() i=5 2024-09-14T11:36:37.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.515+0000 7fc1e3739800 20 remove_watcher() i=6 2024-09-14T11:36:37.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.517+0000 7fc1e3739800 20 remove_watcher() i=7 2024-09-14T11:36:37.526 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:37.555 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:37.555 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:37.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.594+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 20 realm 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.595+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.596+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.596+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.596+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.596+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.597+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:37.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.597+0000 7fbe0b336800 20 searching for the correct realm 2024-09-14T11:36:37.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.599+0000 7fbdfe8b6640 0 -- 172.21.15.116:0/365637761 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fbdf8009250 msgr2=0x7fbdf80722c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:37.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.604+0000 7fbe070b7640 0 -- 172.21.15.116:0/365637761 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fbdf0077690 msgr2=0x7fbdf00870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.810+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 zone default found 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 4 Realm: () 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 zonegroup default 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.811+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:37.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 started sync module instance, tier type = 2024-09-14T11:36:37.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.812+0000 7fbe0b336800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:37.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=0 2024-09-14T11:36:37.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=1 2024-09-14T11:36:37.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=2 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=3 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=4 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=5 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.821+0000 7fbe0b336800 20 add_watcher() i=6 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.822+0000 7fbe0b336800 20 add_watcher() i=7 2024-09-14T11:36:37.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.822+0000 7fbe0b336800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:37.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbcbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbe0b336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:37.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbe0b336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:37.822 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbe0b336800 5 note: GC not initialized 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbcbcfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbe0b336800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.824+0000 7fbe0b336800 20 Filter name: none 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.825+0000 7fbc367fc640 20 reqs_thread_entry: start 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.825+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.825+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:37.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.825+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:37.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:37.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:37.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 rados->read ofs=0 len=0 2024-09-14T11:36:37.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:36:37.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.826+0000 7fbe0b336800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:37.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.828+0000 7fbcbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:37.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.830+0000 7fbe0b336800 20 remove_watcher() i=0 2024-09-14T11:36:37.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.830+0000 7fbe0b336800 2 removed watcher, disabling cache 2024-09-14T11:36:37.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.831+0000 7fbe0b336800 20 remove_watcher() i=1 2024-09-14T11:36:37.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.832+0000 7fbe0b336800 20 remove_watcher() i=2 2024-09-14T11:36:37.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.833+0000 7fbe0b336800 20 remove_watcher() i=3 2024-09-14T11:36:37.832 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.834+0000 7fbe0b336800 20 remove_watcher() i=4 2024-09-14T11:36:37.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.835+0000 7fbe0b336800 20 remove_watcher() i=5 2024-09-14T11:36:37.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.836+0000 7fbe0b336800 20 remove_watcher() i=6 2024-09-14T11:36:37.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:37.837+0000 7fbe0b336800 20 remove_watcher() i=7 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:36:37.845 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:38.659 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:36:38.688 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:38.688 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:38.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.726+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 realm 2024-09-14T11:36:38.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.728+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.729+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:38.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.729+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.730+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:38.728 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.730+0000 7f303560e800 20 searching for the correct realm 2024-09-14T11:36:38.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.732+0000 7f302bfff640 0 -- 172.21.15.116:0/2039264619 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f302406ac90 msgr2=0x7f3024080300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:38.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:38.938+0000 7f3030c59640 0 -- 172.21.15.116:0/2039264619 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f301c0a5960 msgr2=0x7f301c0a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:39.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:39.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:39.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:39.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:39.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:39.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.143 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.144+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 zone default found 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 4 Realm: () 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:39.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 zonegroup default 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.145+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.146+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.146+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.146+0000 7f303560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.146+0000 7f303560e800 20 started sync module instance, tier type = 2024-09-14T11:36:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.146+0000 7f303560e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=0 2024-09-14T11:36:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=1 2024-09-14T11:36:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=2 2024-09-14T11:36:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=3 2024-09-14T11:36:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=4 2024-09-14T11:36:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=5 2024-09-14T11:36:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.155+0000 7f303560e800 20 add_watcher() i=6 2024-09-14T11:36:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.156+0000 7f303560e800 20 add_watcher() i=7 2024-09-14T11:36:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.156+0000 7f303560e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:39.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f2ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f303560e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f303560e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f303560e800 5 note: GC not initialized 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f2ee5fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f303560e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.158+0000 7f303560e800 20 Filter name: none 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.159+0000 7f2e577fe640 20 reqs_thread_entry: start 2024-09-14T11:36:39.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.159+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.159+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:39.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.159+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.160+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:39.158 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.160+0000 7f303560e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.160+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.160+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:39.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.160+0000 7f303560e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.161+0000 7f303560e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:39.159 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.161+0000 7f303560e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.163+0000 7f2ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.165+0000 7f303560e800 20 remove_watcher() i=0 2024-09-14T11:36:39.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.165+0000 7f303560e800 2 removed watcher, disabling cache 2024-09-14T11:36:39.164 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.166+0000 7f303560e800 20 remove_watcher() i=1 2024-09-14T11:36:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.167+0000 7f303560e800 20 remove_watcher() i=2 2024-09-14T11:36:39.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.168+0000 7f303560e800 20 remove_watcher() i=3 2024-09-14T11:36:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.169+0000 7f303560e800 20 remove_watcher() i=4 2024-09-14T11:36:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.171+0000 7f303560e800 20 remove_watcher() i=5 2024-09-14T11:36:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.172+0000 7f303560e800 20 remove_watcher() i=6 2024-09-14T11:36:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.173+0000 7f303560e800 20 remove_watcher() i=7 2024-09-14T11:36:39.181 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:39.181 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:39.181 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-init-index id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:39.181 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:39.182 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:36:39.216 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:39.217 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.256+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 realm 2024-09-14T11:36:39.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.257+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.258+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.258+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.259+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:39.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.259+0000 7f3fa8f75800 20 searching for the correct realm 2024-09-14T11:36:39.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.263+0000 7f3fa7260640 0 -- 172.21.15.116:0/1961520326 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f3f9c067160 msgr2=0x7f3f9c0820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.468+0000 7f3fa7260640 0 -- 172.21.15.116:0/1961520326 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f3f9c067160 msgr2=0x7f3f9c0820c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:39.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:39.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:39.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:39.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:39.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:39.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.472+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 zone default found 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 4 Realm: () 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:39.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 zonegroup default 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.473+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.474+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.474+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.474+0000 7f3fa8f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.474+0000 7f3fa8f75800 20 started sync module instance, tier type = 2024-09-14T11:36:39.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.474+0000 7f3fa8f75800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.483+0000 7f3fa8f75800 20 add_watcher() i=0 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.483+0000 7f3fa8f75800 20 add_watcher() i=1 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.483+0000 7f3fa8f75800 20 add_watcher() i=2 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 20 add_watcher() i=3 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 20 add_watcher() i=4 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 20 add_watcher() i=5 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 20 add_watcher() i=6 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 20 add_watcher() i=7 2024-09-14T11:36:39.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.484+0000 7f3fa8f75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:39.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.486+0000 7f3e5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:39.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:39.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 5 note: GC not initialized 2024-09-14T11:36:39.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3dd7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:39.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:39.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 20 Filter name: none 2024-09-14T11:36:39.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3dd5ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:39.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:36:39.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.487+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 : miss 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:39.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.488+0000 7f3fa8f75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 2024-09-14T11:36:39.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.490+0000 7f3fa8f75800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:36:39.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.490+0000 7f3fa8f75800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:36:39.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.492+0000 7f3e5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.494+0000 7f3fa8f75800 20 remove_watcher() i=0 2024-09-14T11:36:39.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.494+0000 7f3fa8f75800 2 removed watcher, disabling cache 2024-09-14T11:36:39.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.495+0000 7f3fa8f75800 20 remove_watcher() i=1 2024-09-14T11:36:39.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.496+0000 7f3fa8f75800 20 remove_watcher() i=2 2024-09-14T11:36:39.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.498+0000 7f3fa8f75800 20 remove_watcher() i=3 2024-09-14T11:36:39.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.499+0000 7f3fa8f75800 20 remove_watcher() i=4 2024-09-14T11:36:39.498 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.500+0000 7f3fa8f75800 20 remove_watcher() i=5 2024-09-14T11:36:39.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.501+0000 7f3fa8f75800 20 remove_watcher() i=6 2024-09-14T11:36:39.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.502+0000 7f3fa8f75800 20 remove_watcher() i=7 2024-09-14T11:36:39.511 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:36:39.540 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:39.540 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:39.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.578+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.579+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.579+0000 7f53ef412800 20 realm 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.579+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.580+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.580+0000 7f53ef412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.580+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.580+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.580+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.581+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.581+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.581+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:39.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.581+0000 7f53ef412800 20 searching for the correct realm 2024-09-14T11:36:39.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.584+0000 7f53eb2cc640 0 -- 172.21.15.116:0/2679530161 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f53d407d040 msgr2=0x7f53d408a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.588+0000 7f53eaacb640 0 -- 172.21.15.116:0/2679530161 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f53d407d420 msgr2=0x7f53d407d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.795+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.796+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.796+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.796+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.796+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:39.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 zone default found 2024-09-14T11:36:39.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 4 Realm: () 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 zonegroup default 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 started sync module instance, tier type = 2024-09-14T11:36:39.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.797+0000 7f53ef412800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=0 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=1 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=2 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=3 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=4 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=5 2024-09-14T11:36:39.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.807+0000 7f53ef412800 20 add_watcher() i=6 2024-09-14T11:36:39.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.808+0000 7f53ef412800 20 add_watcher() i=7 2024-09-14T11:36:39.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.808+0000 7f53ef412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:39.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f52a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f53ef412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f53ef412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f53ef412800 5 note: GC not initialized 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f52a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f53ef412800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f53ef412800 20 Filter name: none 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.810+0000 7f5299ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:39.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.811+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.811+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.811+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.811+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:39.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:39.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.812+0000 7f53ef412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.814+0000 7f52a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.816+0000 7f53ef412800 20 remove_watcher() i=0 2024-09-14T11:36:39.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.816+0000 7f53ef412800 2 removed watcher, disabling cache 2024-09-14T11:36:39.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.818+0000 7f53ef412800 20 remove_watcher() i=1 2024-09-14T11:36:39.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.819+0000 7f53ef412800 20 remove_watcher() i=2 2024-09-14T11:36:39.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.820+0000 7f53ef412800 20 remove_watcher() i=3 2024-09-14T11:36:39.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.821+0000 7f53ef412800 20 remove_watcher() i=4 2024-09-14T11:36:39.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.822+0000 7f53ef412800 20 remove_watcher() i=5 2024-09-14T11:36:39.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.823+0000 7f53ef412800 20 remove_watcher() i=6 2024-09-14T11:36:39.821 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.823+0000 7f53ef412800 20 remove_watcher() i=7 2024-09-14T11:36:39.832 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:39.832 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:39.832 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-init-index id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:39.832 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:39.922 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:39.953 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:39.953 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:39.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.993+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 realm 2024-09-14T11:36:39.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.994+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.995+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.995+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.995+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:39.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.996+0000 7fdfd5040800 20 searching for the correct realm 2024-09-14T11:36:39.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:39.999+0000 7fdfd332b640 0 -- 172.21.15.116:0/321115698 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fdfbc01a040 msgr2=0x7fdfbc0299c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.002+0000 7fdfd2b2a640 0 -- 172.21.15.116:0/321115698 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fdfbc008410 msgr2=0x7fdfbc008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:40.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.208+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 zone default found 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 4 Realm: () 2024-09-14T11:36:40.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 zonegroup default 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.209+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.210+0000 7fdfd5040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.210+0000 7fdfd5040800 20 started sync module instance, tier type = 2024-09-14T11:36:40.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.210+0000 7fdfd5040800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=0 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=1 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=2 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=3 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=4 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=5 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.220+0000 7fdfd5040800 20 add_watcher() i=6 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.221+0000 7fdfd5040800 20 add_watcher() i=7 2024-09-14T11:36:40.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.221+0000 7fdfd5040800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:40.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.222+0000 7fde897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.222+0000 7fdfd5040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.222+0000 7fdfd5040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fdfd5040800 5 note: GC not initialized 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fde03fff640 20 reqs_thread_entry: start 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fdfd5040800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:40.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fdfd5040800 20 Filter name: none 2024-09-14T11:36:40.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fde01ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:40.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fdfd5040800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:36:40.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.223+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 : miss 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.224+0000 7fdfd5040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 2024-09-14T11:36:40.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.229+0000 7fdfd5040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.229+0000 7fdfd5040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.229+0000 7fdfd5040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.229+0000 7fdfd5040800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19, ofs0, ns] 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.230+0000 7fdeb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94387846352656 notifier 6378 bl.length()=911 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.230+0000 7fdeb5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.230+0000 7fdeb5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.230+0000 7fdeb5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.231+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_sources= new_sources= 2024-09-14T11:36:40.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.231+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential sources added=[] removed=[] 2024-09-14T11:36:40.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.231+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_dests= new_dests= 2024-09-14T11:36:40.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.231+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential dests added=[] removed=[] 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.0 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.0 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.1 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.1 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.2 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.2 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.3 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.3 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.4 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.4 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.5 2024-09-14T11:36:40.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.5 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.6 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.6 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.7 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.7 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.8 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.8 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.9 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.9 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.10 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.10 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.11 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1.11 2024-09-14T11:36:40.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.236+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.0 2024-09-14T11:36:40.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.237+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1 2024-09-14T11:36:40.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.237+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.2 2024-09-14T11:36:40.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.238+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.3 2024-09-14T11:36:40.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.238+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.4 2024-09-14T11:36:40.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.239+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.5 2024-09-14T11:36:40.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.240+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.6 2024-09-14T11:36:40.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.240+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.7 2024-09-14T11:36:40.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.240+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.8 2024-09-14T11:36:40.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.241+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.9 2024-09-14T11:36:40.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.242+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.10 2024-09-14T11:36:40.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.245+0000 7fdfd5040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:40.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.245+0000 7fdfd5040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 2024-09-14T11:36:40.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.246+0000 7fdfd5040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.246+0000 7fdfd5040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.246+0000 7fdfd5040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.246+0000 7fdfd5040800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19, ofs0, ns] 2024-09-14T11:36:40.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.247+0000 7fdeb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94387846352656 notifier 6378 bl.length()=911 2024-09-14T11:36:40.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.247+0000 7fdeb5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.247+0000 7fdeb5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.247+0000 7fdeb5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.249+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_sources= new_sources= 2024-09-14T11:36:40.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.249+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential sources added=[] removed=[] 2024-09-14T11:36:40.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.249+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_dests= new_dests= 2024-09-14T11:36:40.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.249+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential dests added=[] removed=[] 2024-09-14T11:36:40.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.251+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.0 2024-09-14T11:36:40.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.251+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.1 2024-09-14T11:36:40.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.252+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.2 2024-09-14T11:36:40.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.252+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.3 2024-09-14T11:36:40.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.252+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.4 2024-09-14T11:36:40.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.253+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.5 2024-09-14T11:36:40.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.253+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.6 2024-09-14T11:36:40.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.253+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.7 2024-09-14T11:36:40.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.253+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.8 2024-09-14T11:36:40.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.254+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.9 2024-09-14T11:36:40.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.254+0000 7fdfd5040800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19.10 2024-09-14T11:36:40.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.255+0000 7fdfd5040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:40.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.255+0000 7fdfd5040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 2024-09-14T11:36:40.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdfd5040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdfd5040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdfd5040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdfd5040800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19, ofs0, ns] 2024-09-14T11:36:40.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdeb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94387846352656 notifier 6378 bl.length()=879 2024-09-14T11:36:40.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdeb5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 info.flags=0x17 2024-09-14T11:36:40.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdeb5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 to cache LRU end 2024-09-14T11:36:40.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.256+0000 7fdeb5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:40.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.258+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_sources= new_sources= 2024-09-14T11:36:40.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.258+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential sources added=[] removed=[] 2024-09-14T11:36:40.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.258+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): orig_dests= new_dests= 2024-09-14T11:36:40.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.258+0000 7fdfd5040800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19]): potential dests added=[] removed=[] 2024-09-14T11:36:40.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.260+0000 7fdfd5040800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:40.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.262+0000 7fde897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.264+0000 7fdfd5040800 20 remove_watcher() i=0 2024-09-14T11:36:40.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.264+0000 7fdfd5040800 2 removed watcher, disabling cache 2024-09-14T11:36:40.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.265+0000 7fdfd5040800 20 remove_watcher() i=1 2024-09-14T11:36:40.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.266+0000 7fdfd5040800 20 remove_watcher() i=2 2024-09-14T11:36:40.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.267+0000 7fdfd5040800 20 remove_watcher() i=3 2024-09-14T11:36:40.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.268+0000 7fdfd5040800 20 remove_watcher() i=4 2024-09-14T11:36:40.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.269+0000 7fdfd5040800 20 remove_watcher() i=5 2024-09-14T11:36:40.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.270+0000 7fdfd5040800 20 remove_watcher() i=6 2024-09-14T11:36:40.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.271+0000 7fdfd5040800 20 remove_watcher() i=7 2024-09-14T11:36:40.282 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:36:40.310 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:40.310 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:40.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.349+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 realm 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:40.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.351+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.352+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.352+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.352+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:40.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.352+0000 7fdb45735800 20 searching for the correct realm 2024-09-14T11:36:40.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.356+0000 7fdb3bfff640 0 -- 172.21.15.116:0/944571578 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fdb340a0920 msgr2=0x7fdb3407b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.359+0000 7fdb3bfff640 0 -- 172.21.15.116:0/944571578 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fda0c0870d0 msgr2=0x7fda0c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:40.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:40.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:40.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:40.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:40.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:40.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:40.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.363+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 zone default found 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 4 Realm: () 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 zonegroup default 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.364+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.365+0000 7fdb45735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.365+0000 7fdb45735800 20 started sync module instance, tier type = 2024-09-14T11:36:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.365+0000 7fdb45735800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=0 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=1 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=2 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=3 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=4 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=5 2024-09-14T11:36:40.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.374+0000 7fdb45735800 20 add_watcher() i=6 2024-09-14T11:36:40.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.375+0000 7fdb45735800 20 add_watcher() i=7 2024-09-14T11:36:40.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.375+0000 7fdb45735800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:40.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.376+0000 7fd9f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:40.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:40.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 5 note: GC not initialized 2024-09-14T11:36:40.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fd9f6fe5640 20 reqs_thread_entry: start 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 20 Filter name: none 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fd9f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.377+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.378+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:40.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.378+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:40.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.379+0000 7fdb45735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:40.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.381+0000 7fd9f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:40.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.383+0000 7fdb45735800 20 remove_watcher() i=0 2024-09-14T11:36:40.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.383+0000 7fdb45735800 2 removed watcher, disabling cache 2024-09-14T11:36:40.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.384+0000 7fdb45735800 20 remove_watcher() i=1 2024-09-14T11:36:40.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.385+0000 7fdb45735800 20 remove_watcher() i=2 2024-09-14T11:36:40.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.386+0000 7fdb45735800 20 remove_watcher() i=3 2024-09-14T11:36:40.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.387+0000 7fdb45735800 20 remove_watcher() i=4 2024-09-14T11:36:40.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.388+0000 7fdb45735800 20 remove_watcher() i=5 2024-09-14T11:36:40.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.389+0000 7fdb45735800 20 remove_watcher() i=6 2024-09-14T11:36:40.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:40.390+0000 7fdb45735800 20 remove_watcher() i=7 2024-09-14T11:36:40.398 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:40.398 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:40.398 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-init-index id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:40.398 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:40.779 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:36:40.779 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:41.580 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:36:41.609 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:41.609 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:41.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.648+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.649+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.649+0000 7fa9e70bb800 20 realm 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.649+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.650+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.650+0000 7fa9e70bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.650+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.650+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.650+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.651+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.651+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.651+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:41.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.651+0000 7fa9e70bb800 20 searching for the correct realm 2024-09-14T11:36:41.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.655+0000 7fa9e53a6640 0 -- 172.21.15.116:0/3912168260 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55a0f4707350 msgr2=0x55a0f4709740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.658+0000 7fa9dffff640 0 -- 172.21.15.116:0/3912168260 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa9d8047040 msgr2=0x7fa9d8047930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 zone default found 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 4 Realm: () 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 zonegroup default 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.662+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 started sync module instance, tier type = 2024-09-14T11:36:41.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.663+0000 7fa9e70bb800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=0 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=1 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=2 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=3 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=4 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=5 2024-09-14T11:36:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=6 2024-09-14T11:36:41.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 20 add_watcher() i=7 2024-09-14T11:36:41.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.673+0000 7fa9e70bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.675+0000 7fa89b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.675+0000 7fa9e70bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.675+0000 7fa9e70bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.675+0000 7fa9e70bb800 5 note: GC not initialized 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.675+0000 7fa89a7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.676+0000 7fa9e70bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.676+0000 7fa9e70bb800 20 Filter name: none 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.676+0000 7fa8937fe640 20 reqs_thread_entry: start 2024-09-14T11:36:41.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.676+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.677+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:41.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.677+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.677+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.677+0000 7fa9e70bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.677+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.678+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.678+0000 7fa9e70bb800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.678+0000 7fa9e70bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:41.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.678+0000 7fa9e70bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:41.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.680+0000 7fa89b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.682+0000 7fa9e70bb800 20 remove_watcher() i=0 2024-09-14T11:36:41.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.682+0000 7fa9e70bb800 2 removed watcher, disabling cache 2024-09-14T11:36:41.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.683+0000 7fa9e70bb800 20 remove_watcher() i=1 2024-09-14T11:36:41.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.685+0000 7fa9e70bb800 20 remove_watcher() i=2 2024-09-14T11:36:41.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.686+0000 7fa9e70bb800 20 remove_watcher() i=3 2024-09-14T11:36:41.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.687+0000 7fa9e70bb800 20 remove_watcher() i=4 2024-09-14T11:36:41.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.689+0000 7fa9e70bb800 20 remove_watcher() i=5 2024-09-14T11:36:41.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.689+0000 7fa9e70bb800 20 remove_watcher() i=6 2024-09-14T11:36:41.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.690+0000 7fa9e70bb800 20 remove_watcher() i=7 2024-09-14T11:36:41.699 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:41.699 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:41.699 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-init-index id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:41.699 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:41.700 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:36:41.735 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:41.736 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:41.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.775+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.775+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.775+0000 7f53c1498800 20 realm 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.775+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.776+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.776+0000 7f53c1498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.776+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.776+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.776+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.777+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.777+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.777+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:41.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.777+0000 7f53c1498800 20 searching for the correct realm 2024-09-14T11:36:41.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.780+0000 7f53be781640 0 -- 172.21.15.116:0/1834660327 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f53b00ca020 msgr2=0x7f53b005a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.784+0000 7f53bef82640 0 -- 172.21.15.116:0/1834660327 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f53b401e400 msgr2=0x7f53b401e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:41.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:41.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.990+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 zone default found 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 4 Realm: () 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 zonegroup default 2024-09-14T11:36:41.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 started sync module instance, tier type = 2024-09-14T11:36:41.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:41.991+0000 7f53c1498800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:41.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=0 2024-09-14T11:36:41.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=1 2024-09-14T11:36:41.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=2 2024-09-14T11:36:41.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=3 2024-09-14T11:36:42.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=4 2024-09-14T11:36:42.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=5 2024-09-14T11:36:42.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.001+0000 7f53c1498800 20 add_watcher() i=6 2024-09-14T11:36:42.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.003+0000 7f53c1498800 20 add_watcher() i=7 2024-09-14T11:36:42.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.003+0000 7f53c1498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:42.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f52757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:42.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 5 note: GC not initialized 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f51effff640 20 reqs_thread_entry: start 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 20 Filter name: none 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f51edffb640 20 reqs_thread_entry: start 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:36:42.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.005+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 : miss 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 info.flags=0x17 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 to cache LRU end 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:42.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.006+0000 7f53c1498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 2024-09-14T11:36:42.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.007+0000 7f53c1498800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:36:42.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.007+0000 7f53c1498800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.011+0000 7f53c1498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 info.flags=0x17 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.011+0000 7f53c1498800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 to cache LRU end 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.011+0000 7f53c1498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.011+0000 7f53c1498800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20, ofs0, ns] 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.012+0000 7f52a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93911701930080 notifier 5990 bl.length()=911 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.012+0000 7f52a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 info.flags=0x17 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.012+0000 7f52a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 to cache LRU end 2024-09-14T11:36:42.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.012+0000 7f52a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:42.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.014+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): orig_sources= new_sources= 2024-09-14T11:36:42.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.014+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): potential sources added=[] removed=[] 2024-09-14T11:36:42.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.014+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): orig_dests= new_dests= 2024-09-14T11:36:42.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.014+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): potential dests added=[] removed=[] 2024-09-14T11:36:42.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.0 2024-09-14T11:36:42.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.0 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.1 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.1 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.2 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.2 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.3 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.3 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.4 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.4 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.5 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.5 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.6 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.6 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.7 2024-09-14T11:36:42.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.7 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.8 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.8 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.9 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.9 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.10 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.10 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.11 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1.11 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.0 2024-09-14T11:36:42.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.016+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.1 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.017+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.2 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.017+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.3 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.018+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.4 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.018+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.5 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.019+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.6 2024-09-14T11:36:42.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.019+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.7 2024-09-14T11:36:42.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.020+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.8 2024-09-14T11:36:42.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.021+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.9 2024-09-14T11:36:42.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.021+0000 7f53c1498800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20.10 2024-09-14T11:36:42.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.024+0000 7f53c1498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:42.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.024+0000 7f53c1498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 2024-09-14T11:36:42.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f53c1498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 info.flags=0x17 2024-09-14T11:36:42.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f53c1498800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 to cache LRU end 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f53c1498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f53c1498800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20, ofs0, ns] 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f52a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93911701930080 notifier 5990 bl.length()=879 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f52a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 info.flags=0x17 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f52a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 to cache LRU end 2024-09-14T11:36:42.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.025+0000 7f52a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:42.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.027+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): orig_sources= new_sources= 2024-09-14T11:36:42.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.027+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): potential sources added=[] removed=[] 2024-09-14T11:36:42.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.027+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): orig_dests= new_dests= 2024-09-14T11:36:42.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.027+0000 7f53c1498800 20 handle_bi_update(): bucket=:error-at-init-index[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20]): potential dests added=[] removed=[] 2024-09-14T11:36:42.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.030+0000 7f53c1498800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:42.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.032+0000 7f52757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.035+0000 7f53c1498800 20 remove_watcher() i=0 2024-09-14T11:36:42.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.035+0000 7f53c1498800 2 removed watcher, disabling cache 2024-09-14T11:36:42.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.036+0000 7f53c1498800 20 remove_watcher() i=1 2024-09-14T11:36:42.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.037+0000 7f53c1498800 20 remove_watcher() i=2 2024-09-14T11:36:42.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.039+0000 7f53c1498800 20 remove_watcher() i=3 2024-09-14T11:36:42.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.040+0000 7f53c1498800 20 remove_watcher() i=4 2024-09-14T11:36:42.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.041+0000 7f53c1498800 20 remove_watcher() i=5 2024-09-14T11:36:42.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.042+0000 7f53c1498800 20 remove_watcher() i=6 2024-09-14T11:36:42.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.043+0000 7f53c1498800 20 remove_watcher() i=7 2024-09-14T11:36:42.052 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:36:42.081 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.081 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.120+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 realm 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.122+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.123+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.123+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.124+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.124+0000 7fa1aa328800 20 searching for the correct realm 2024-09-14T11:36:42.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.125+0000 7fa1a60d6640 0 -- 172.21.15.116:0/95438613 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7fa1a0033040 msgr2=0x7fa1a0018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:42.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.330+0000 7fa1a68d7640 0 -- 172.21.15.116:0/95438613 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa19c06dbe0 msgr2=0x7fa19c0d9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:42.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:42.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.335+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 zone default found 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 4 Realm: () 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 zonegroup default 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 started sync module instance, tier type = 2024-09-14T11:36:42.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.336+0000 7fa1aa328800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=0 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=1 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=2 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=3 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=4 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=5 2024-09-14T11:36:42.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.345+0000 7fa1aa328800 20 add_watcher() i=6 2024-09-14T11:36:42.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.346+0000 7fa1aa328800 20 add_watcher() i=7 2024-09-14T11:36:42.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.346+0000 7fa1aa328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:42.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.347+0000 7fa05cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 5 note: GC not initialized 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7f9fd77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 20 Filter name: none 2024-09-14T11:36:42.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7f9fd57fa640 20 reqs_thread_entry: start 2024-09-14T11:36:42.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.348+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.349+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:42.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.349+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.349+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.349+0000 7fa1aa328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.349+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.350+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.350+0000 7fa1aa328800 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.350+0000 7fa1aa328800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:36:42.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.350+0000 7fa1aa328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:42.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.352+0000 7fa05cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.354+0000 7fa1aa328800 20 remove_watcher() i=0 2024-09-14T11:36:42.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.354+0000 7fa1aa328800 2 removed watcher, disabling cache 2024-09-14T11:36:42.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.355+0000 7fa1aa328800 20 remove_watcher() i=1 2024-09-14T11:36:42.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.356+0000 7fa1aa328800 20 remove_watcher() i=2 2024-09-14T11:36:42.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.357+0000 7fa1aa328800 20 remove_watcher() i=3 2024-09-14T11:36:42.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.358+0000 7fa1aa328800 20 remove_watcher() i=4 2024-09-14T11:36:42.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.359+0000 7fa1aa328800 20 remove_watcher() i=5 2024-09-14T11:36:42.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.360+0000 7fa1aa328800 20 remove_watcher() i=6 2024-09-14T11:36:42.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:42.361+0000 7fa1aa328800 20 remove_watcher() i=7 2024-09-14T11:36:42.369 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:42.369 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:42.369 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-init-index id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:36:42.370 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:42.744 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:36:42.744 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.540 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:36:43.568 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.568 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:43.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.609+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 realm 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.611+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.612+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.612+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.612+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:43.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.612+0000 7f7d9d12e800 20 searching for the correct realm 2024-09-14T11:36:43.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.615+0000 7f7d906dc640 0 -- 172.21.15.116:0/1128181736 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f7d8803fae0 msgr2=0x7f7d880778b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.619+0000 7f7d98edd640 0 -- 172.21.15.116:0/1128181736 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f7d800a0900 msgr2=0x7f7d8009e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:43.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.825+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 zone default found 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 4 Realm: () 2024-09-14T11:36:43.825 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 zonegroup default 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.826+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.827+0000 7f7d9d12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.827+0000 7f7d9d12e800 20 started sync module instance, tier type = 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.827+0000 7f7d9d12e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:43.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=0 2024-09-14T11:36:43.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=1 2024-09-14T11:36:43.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=2 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=3 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=4 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=5 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.835+0000 7f7d9d12e800 20 add_watcher() i=6 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.836+0000 7f7d9d12e800 20 add_watcher() i=7 2024-09-14T11:36:43.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.836+0000 7f7d9d12e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.838+0000 7f7c4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.838+0000 7f7d9d12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.838+0000 7f7d9d12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.838+0000 7f7d9d12e800 5 note: GC not initialized 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.839+0000 7f7c4dfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.839+0000 7f7d9d12e800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.839+0000 7f7d9d12e800 20 Filter name: none 2024-09-14T11:36:43.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.839+0000 7f7bbf7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:43.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.839+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.840+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:43.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.840+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:43.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:43.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.841+0000 7f7d9d12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.843+0000 7f7c4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.845+0000 7f7d9d12e800 20 remove_watcher() i=0 2024-09-14T11:36:43.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.845+0000 7f7d9d12e800 2 removed watcher, disabling cache 2024-09-14T11:36:43.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.846+0000 7f7d9d12e800 20 remove_watcher() i=1 2024-09-14T11:36:43.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.847+0000 7f7d9d12e800 20 remove_watcher() i=2 2024-09-14T11:36:43.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.848+0000 7f7d9d12e800 20 remove_watcher() i=3 2024-09-14T11:36:43.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.849+0000 7f7d9d12e800 20 remove_watcher() i=4 2024-09-14T11:36:43.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.850+0000 7f7d9d12e800 20 remove_watcher() i=5 2024-09-14T11:36:43.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.851+0000 7f7d9d12e800 20 remove_watcher() i=6 2024-09-14T11:36:43.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.851+0000 7f7d9d12e800 20 remove_watcher() i=7 2024-09-14T11:36:43.860 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.860 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:43.860 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-init-indext id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:43.860 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.861 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:36:43.895 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.895 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:43.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.933+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 realm 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:43.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.936+0000 7fd5d0346800 20 searching for the correct realm 2024-09-14T11:36:43.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.940+0000 7fd5cd62f640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b6d85f85f0 msgr2=0x55b6d85fa9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.943+0000 7fd5cde30640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd5b8098b10 msgr2=0x7fd5b806d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:43.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zone default found 2024-09-14T11:36:43.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Realm: () 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zonegroup default 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started sync module instance, tier type = 2024-09-14T11:36:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=0 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=1 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=2 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=3 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=4 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=5 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=6 2024-09-14T11:36:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=7 2024-09-14T11:36:43.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.957+0000 7fd5d0346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.959+0000 7fd47f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.959+0000 7fd5d0346800 5 note: GC not initialized 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd47e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 20 Filter name: none 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd3effff640 20 reqs_thread_entry: start 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : miss 2024-09-14T11:36:43.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.961+0000 7fd5d0346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:36:43.960 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5d0346800 time 2024-09-14T11:36:43.963489+0000 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5d398c76a] 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.963+0000 7fd5d0346800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5d0346800 time 2024-09-14T11:36:43.963489+0000 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5d398c76a] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:43.962 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:43.963 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fd5d0346800 thread_name:radosgw-admin 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5d263e6f0] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5d268b99c] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5d398c7c4] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:36:43.977 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:43.964+0000 7fd5d0346800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fd5d0346800 thread_name:radosgw-admin 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5d263e6f0] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5d268b99c] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5d398c7c4] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:36:43.978 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d83952e0 auth_method 0 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.979 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_done global_id 6029 payload 274 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 1 monclient: found mon.noname-c 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: dump: 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.980 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: _finish_auth 0 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:36:43.916+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: dump: 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.981 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:36:43.916+0000 7fd5d0346800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:36:43.916+0000 7fd5d0346800 4 set_mon_vals no callback set 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: shutdown 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 asok(0x55b6d82eb270) unregister_commands rotate-key 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:36:43.917+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:43.982 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.983 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: starting msgr at 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: starting objecter 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests hook 0x55b6d85109b0 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: setting wanted keys 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: calling monclient init 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:43.984 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:43.985 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key hook 0x55b6d850b5d8 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d83952e0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d83b8970 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d850fb50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.524738s 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d83b8970 auth_method 0 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.986 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d850fb50 auth_method 0 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d83952e0 auth_method 0 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.987 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:36:43.919+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:36:43.919+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6489 payload 824 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:36:43.919+0000 7fd5ce631640 1 monclient: found mon.noname-a 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: dump: 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.988 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: _finish_auth 0 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: dump: 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.989 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:36:43.919+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6489 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:36:43.919+0000 7fd4bbe07640 4 set_mon_vals no callback set 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:36:43.919+0000 7fd5d0346800 1 librados: init done 2024-09-14T11:36:43.990 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:36:43.921+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd4b4077260 auth_method 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:36:43.921+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d85355f0 auth_method 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:36:43.922+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d8559010 auth_method 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:36:43.923+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d855e2d0 auth_method 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:36:43.924+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.992 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:36:43.924+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests cmddesc objecter_requests hook 0x55b6d8565ce0 EEXIST 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.993 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:36:43.925+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:36:43.925+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:36:43.925+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x55b6d85613f0 EEXIST 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:43.994 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85899d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d858bca0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85881a0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.531481s 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d85899d0 auth_method 0 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d858bca0 auth_method 0 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:43.995 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_done global_id 6492 payload 824 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient: _finish_hunting 0 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:36:43.925+0000 7fd5cde30640 1 monclient: found mon.noname-a 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.996 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: dump: 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: dump: 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:36:43.926+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6492 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:43.998 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:36:43.926+0000 7fd5cee32640 4 set_mon_vals no callback set 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:36:43.928+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd4a8077140 auth_method 0 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: get_monmap_and_config 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:36:43.928+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:43.999 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.000 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:36:43.928+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.001 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:36:43.929+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:36:43.929+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:36:43.929+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x7fff461ce718 EEXIST 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:44.002 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85de010 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85ade20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d85d93d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.535371s 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d85d93d0 auth_method 0 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d85ade20 auth_method 0 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.003 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:36:43.929+0000 7fd5ce631640 1 monclient: found mon.noname-c 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: dump: 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.004 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:36:43.929+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:36:43.929+0000 7fd5d0346800 4 set_mon_vals no callback set 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.005 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: dump: 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: shutdown 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:44.006 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.007 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:36:43.930+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: starting msgr at 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: starting objecter 2024-09-14T11:36:44.008 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests cmddesc objecter_requests hook 0x55b6d85abd60 EEXIST 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: setting wanted keys 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: calling monclient init 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.009 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:36:43.931+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:36:43.931+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:36:43.931+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x55b6d85a18c8 EEXIST 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85ade20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85d93d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d85de010 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.010 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.537494s 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d85ade20 auth_method 0 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d85de010 auth_method 0 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.011 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d85d93d0 auth_method 0 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6041 payload 824 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:36:43.931+0000 7fd5ce631640 1 monclient: found mon.noname-c 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: dump: 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.012 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: dump: 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.013 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:36:43.932+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6041 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:36:43.932+0000 7fd4b17fa640 4 set_mon_vals no callback set 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:36:43.932+0000 7fd5d0346800 1 librados: init done 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:36:43.932+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cr dump hook 0x55b6d85d6e58 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:36:43.933+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.014 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:36:43.934+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd498077230 auth_method 0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:36:43.934+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d85f85f0 auth_method 0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 realm 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:36:43.935+0000 7fd5d0346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:36:43.936+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d85fc780 auth_method 0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 searching for the correct realm 2024-09-14T11:36:44.015 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:36:43.936+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d8601640 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:36:43.937+0000 7fd5ce631640 10 monclient: get_auth_request con 0x7fd5b8088040 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:36:43.938+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd5c0074650 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:36:43.938+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd5c8072bd0 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:36:43.940+0000 7fd5cd62f640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b6d85f85f0 msgr2=0x55b6d85fa9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 1 client.6041.objecter ms_handle_reset 0x55b6d85f85f0 session 0x55b6d85f7f70 osd.1 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 10 monclient: _renew_subs 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:36:43.940+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd4980870d0 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:36:43.940+0000 7fd5ce631640 10 monclient: get_auth_request con 0x7fd5b806d040 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:36:43.942+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd5b8098b10 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:36:43.943+0000 7fd5cde30640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd5b8098b10 msgr2=0x7fd5b806d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:36:43.943+0000 7fd49f7fe640 1 client.6041.objecter ms_handle_reset 0x7fd5b8098b10 session 0x7fd5b8098490 osd.0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:36:43.943+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d85f85f0 auth_method 0 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:44.016 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zone default found 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Realm: () 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:36:43.948+0000 7fd5d0346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.017 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zonegroup default 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started sync module instance, tier type = 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=0 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=1 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=2 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=3 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=4 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=5 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=6 2024-09-14T11:36:44.018 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=7 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:36:43.957+0000 7fd5d0346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:36:43.959+0000 7fd47f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.019 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:36:43.959+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache list hook 0x55b6d85cb4b0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache inspect hook 0x55b6d85cb4b0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache erase hook 0x55b6d85cb4b0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache zap hook 0x55b6d85cb4b0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 note: GC not initialized 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:36:43.960+0000 7fd47e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace show hook 0x7fd5c80042f0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace history hook 0x7fd5c80042f0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace active hook 0x7fd5c80042f0 2024-09-14T11:36:44.020 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace active_short hook 0x7fd5c80042f0 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 Filter name: none 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:36:43.960+0000 7fd3effff640 20 reqs_thread_entry: start 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : miss 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:36:43.961+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:44.021 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:36:43.963+0000 7fd5d0346800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5d0346800 time 2024-09-14T11:36:43.963489+0000 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5d398c76a] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:36:43.964+0000 7fd5d0346800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fd5d0346800 thread_name:radosgw-admin 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5d263e6f0] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5d268b99c] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5d398c7c4] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:36:44.023 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:36:44.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:36:44.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:44.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:36:44.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:44.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:44.029 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd3effff640 / http_manager 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd47e7fc640 / http_manager 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd47f7fe640 / rgw_dt_lg_renew 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd49f7fe640 / ms_dispatch 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4b17fa640 / io_context_pool 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4b37fe640 / ms_dispatch 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4ba604640 / ms_dispatch 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4bbe07640 / io_context_pool 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cd62f640 / msgr-worker-2 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cde30640 / msgr-worker-1 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5ce631640 / msgr-worker-0 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cee32640 / io_context_pool 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5d0346800 / radosgw-admin 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:36:44.030 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.90744.log 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:36:43.916+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d83952e0 auth_method 0 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:36:43.916+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_done global_id 6029 payload 274 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 1 monclient: found mon.noname-c 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:36:43.916+0000 7fd5cd62f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.031 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: dump: 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:36:43.916+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:36:44.032 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:36:43.916+0000 7fd4bbe07640 10 monclient: dump: 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:36:43.916+0000 7fd5d0346800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:36:43.916+0000 7fd5d0346800 4 set_mon_vals no callback set 2024-09-14T11:36:44.033 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: shutdown 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 asok(0x55b6d82eb270) unregister_commands rotate-key 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:36:43.917+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:36:43.917+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:44.034 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding auth protocol: cephx 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: crc 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:36:43.917+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8510fc0) adding con mode: secure 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: starting msgr at 2024-09-14T11:36:44.035 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: starting objecter 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests hook 0x55b6d85109b0 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: setting wanted keys 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:36:43.918+0000 7fd5d0346800 1 librados: calling monclient init 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding auth protocol: cephx 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.036 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: crc 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 AuthRegistry(0x55b6d850b490) adding con mode: secure 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:36:43.918+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:36:43.918+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key hook 0x55b6d850b5d8 2024-09-14T11:36:44.037 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d83952e0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d83b8970 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d850fb50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:36:43.918+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.524738s 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d83b8970 auth_method 0 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.038 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d850fb50 auth_method 0 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d83952e0 auth_method 0 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:36:43.918+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.039 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:36:43.918+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:36:43.918+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:36:43.919+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:36:43.919+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6489 payload 824 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:36:43.919+0000 7fd5ce631640 1 monclient: found mon.noname-a 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:36:43.919+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: dump: 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.040 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.041 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:36:43.919+0000 7fd4ba604640 10 monclient: dump: 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:36:43.919+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6489 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:36:43.919+0000 7fd4bbe07640 4 set_mon_vals no callback set 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:36:43.919+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:36:43.919+0000 7fd5d0346800 1 librados: init done 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:36:43.921+0000 7fd4ba604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:36:43.921+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd4b4077260 auth_method 0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:36:43.921+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d85355f0 auth_method 0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:36:43.922+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d8559010 auth_method 0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:36:43.923+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d855e2d0 auth_method 0 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:44.043 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:36:43.924+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding auth protocol: cephx 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: crc 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d8562310) adding con mode: secure 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:36:43.924+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests cmddesc objecter_requests hook 0x55b6d8565ce0 EEXIST 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:36:43.924+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding auth protocol: cephx 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: crc 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:36:43.924+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85612a8) adding con mode: secure 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:36:43.925+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:36:43.925+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:36:43.925+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x55b6d85613f0 EEXIST 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85899d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d858bca0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85881a0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.047 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:36:43.925+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.531481s 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d85899d0 auth_method 0 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d858bca0 auth_method 0 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.048 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:36:43.925+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient(hunting): handle_auth_done global_id 6492 payload 824 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:36:43.925+0000 7fd5cde30640 1 monclient: found mon.noname-a 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:36:43.925+0000 7fd5cde30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: dump: 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:36:43.926+0000 7fd4b37fe640 10 monclient: dump: 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:36:43.926+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6492 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:36:43.926+0000 7fd5cee32640 4 set_mon_vals no callback set 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:36:43.926+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:36:43.928+0000 7fd4b37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.051 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:36:43.928+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd4a8077140 auth_method 0 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: get_monmap_and_config 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:36:43.928+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.052 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding auth protocol: cephx 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.053 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: crc 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a9930) adding con mode: secure 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:36:43.928+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:36:43.928+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding auth protocol: cephx 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.054 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: crc 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:36:43.928+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ce5d0) adding con mode: secure 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:36:43.929+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:36:43.929+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:36:43.929+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x7fff461ce718 EEXIST 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.055 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85de010 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85ade20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d85d93d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.535371s 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d85d93d0 auth_method 0 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.056 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d85ade20 auth_method 0 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:36:43.929+0000 7fd5cd62f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6038 payload 274 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.057 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:36:43.929+0000 7fd5ce631640 1 monclient: found mon.noname-c 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:36:43.929+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: dump: 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.058 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:36:43.929+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:36:43.929+0000 7fd5d0346800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:36:43.929+0000 7fd5d0346800 4 set_mon_vals no callback set 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:36:43.929+0000 7fd4b17fa640 10 monclient: dump: 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.059 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: shutdown 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: build_initial_monmap 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 build_initial for_mkfs: 0 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: monmap: 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:36:44.060 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding auth protocol: cephx 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.061 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: crc 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85d9880) adding con mode: secure 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:36:43.930+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: starting msgr at 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: starting objecter 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command objecter_requests cmddesc objecter_requests hook 0x55b6d85abd60 EEXIST 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: setting wanted keys 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:36:43.930+0000 7fd5d0346800 1 librados: calling monclient init 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:36:43.930+0000 7fd5d0346800 10 monclient: init 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding auth protocol: cephx 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.062 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: crc 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:36:43.930+0000 7fd5d0346800 5 AuthRegistry(0x55b6d85a1780) adding con mode: secure 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:36:43.931+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:36:43.931+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:36:43.931+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command rotate-key cmddesc rotate-key hook 0x55b6d85a18c8 EEXIST 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:44.063 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-a con 0x55b6d85ade20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-b con 0x55b6d85d93d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): picked mon.noname-c con 0x55b6d85de010 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:36:43.931+0000 7fd5d0346800 10 monclient(hunting): authenticate will time out at 2001.537494s 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): get_auth_request con 0x55b6d85ade20 auth_method 0 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): get_auth_request con 0x55b6d85de010 auth_method 0 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.064 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:36:43.931+0000 7fd5cde30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request con 0x55b6d85d93d0 auth_method 0 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:36:43.931+0000 7fd5cd62f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient(hunting): handle_auth_done global_id 6041 payload 824 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient: _finish_hunting 0 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:36:43.931+0000 7fd5ce631640 1 monclient: found mon.noname-c 2024-09-14T11:36:44.065 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:36:43.931+0000 7fd5ce631640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: dump: 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:44.066 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:36:43.932+0000 7fd49f7fe640 10 monclient: dump: 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:36:43.932+0000 7fd5d0346800 5 monclient: authenticate success, global_id 6041 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:36:43.932+0000 7fd4b17fa640 4 set_mon_vals no callback set 2024-09-14T11:36:44.067 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _renew_subs 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:36:43.932+0000 7fd5d0346800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:36:43.932+0000 7fd5d0346800 1 librados: init done 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:36:43.932+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cr dump hook 0x55b6d85d6e58 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:36:43.933+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:36:43.934+0000 7fd49f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:36:43.934+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd498077230 auth_method 0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:36:43.934+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d85f85f0 auth_method 0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 realm 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.068 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:36:43.935+0000 7fd5d0346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:36:43.935+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:36:43.936+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d85fc780 auth_method 0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:36:43.936+0000 7fd5d0346800 20 searching for the correct realm 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:36:43.936+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x55b6d8601640 auth_method 0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:36:43.937+0000 7fd5ce631640 10 monclient: get_auth_request con 0x7fd5b8088040 auth_method 0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:36:43.938+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd5c0074650 auth_method 0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:36:43.938+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd5c8072bd0 auth_method 0 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:36:43.940+0000 7fd5cd62f640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b6d85f85f0 msgr2=0x55b6d85fa9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.069 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 1 client.6041.objecter ms_handle_reset 0x55b6d85f85f0 session 0x55b6d85f7f70 osd.1 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 10 monclient: _renew_subs 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:36:43.940+0000 7fd49f7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:36:43.940+0000 7fd5cd62f640 10 monclient: get_auth_request con 0x7fd4980870d0 auth_method 0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:36:43.940+0000 7fd5ce631640 10 monclient: get_auth_request con 0x7fd5b806d040 auth_method 0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:36:43.942+0000 7fd5cde30640 10 monclient: get_auth_request con 0x7fd5b8098b10 auth_method 0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:36:43.943+0000 7fd5cde30640 0 -- 172.21.15.116:0/4226754898 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd5b8098b10 msgr2=0x7fd5b806d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:36:43.943+0000 7fd49f7fe640 1 client.6041.objecter ms_handle_reset 0x7fd5b8098b10 session 0x7fd5b8098490 osd.0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:36:43.943+0000 7fd5cde30640 10 monclient: get_auth_request con 0x55b6d85f85f0 auth_method 0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.070 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:36:43.947+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zone default found 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Realm: () 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:36:43.948+0000 7fd5d0346800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:36:43.948+0000 7fd5d0346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 zonegroup default 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.071 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started sync module instance, tier type = 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:36:43.948+0000 7fd5d0346800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=0 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=1 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=2 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=3 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=4 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=5 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=6 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:36:43.957+0000 7fd5d0346800 20 add_watcher() i=7 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:36:43.957+0000 7fd5d0346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding auth protocol: cephx 2024-09-14T11:36:44.072 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:36:43.959+0000 7fd47f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: crc 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 AuthRegistry(0x7fff461ceab0) adding con mode: secure 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:36:43.959+0000 7fd5d0346800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.073 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:36:43.959+0000 7fd5d0346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache list hook 0x55b6d85cb4b0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache inspect hook 0x55b6d85cb4b0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache erase hook 0x55b6d85cb4b0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command cache zap hook 0x55b6d85cb4b0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:36:43.959+0000 7fd5d0346800 5 note: GC not initialized 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:36:43.960+0000 7fd47e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace show hook 0x7fd5c80042f0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace history hook 0x7fd5c80042f0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace active hook 0x7fd5c80042f0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:36:43.960+0000 7fd5d0346800 5 asok(0x55b6d82eb270) register_command sync trace active_short hook 0x7fd5c80042f0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 Filter name: none 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:36:43.960+0000 7fd3effff640 20 reqs_thread_entry: start 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.074 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:36:43.960+0000 7fd5d0346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : miss 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:36:43.960+0000 7fd5d0346800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:36:43.961+0000 7fd5d0346800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:36:43.961+0000 7fd5d0346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:36:44.075 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:36:43.963+0000 7fd5d0346800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd5d0346800 time 2024-09-14T11:36:43.963489+0000 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd5d398c76a] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:36:43.964+0000 7fd5d0346800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:44.076 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fd5d0346800 thread_name:radosgw-admin 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd5d263e6f0] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd5d268b99c] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd5d398c7c4] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd5d398c928] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6d643a0b1] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd882d4) [0x55b6d694d2d4] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b6d6449efd] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd5d2629590] 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:36:44.077 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:36:44.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:36:44.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:44.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:36:44.081 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:36:44.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:44.083 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd3effff640 / http_manager 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd47e7fc640 / http_manager 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd47f7fe640 / rgw_dt_lg_renew 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd49f7fe640 / ms_dispatch 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4b17fa640 / io_context_pool 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4b37fe640 / ms_dispatch 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4ba604640 / ms_dispatch 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd4bbe07640 / io_context_pool 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cd62f640 / msgr-worker-2 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cde30640 / msgr-worker-1 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5ce631640 / msgr-worker-0 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5cee32640 / io_context_pool 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd5d0346800 / radosgw-admin 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:36:44.084 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:36:44.085 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:43.965133Z_f853bca1-5242-46c3-b4a8-30bc4b47430d/log 2024-09-14T11:36:44.085 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:36:44.085 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.038+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 realm 2024-09-14T11:36:44.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.040+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.041+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.041+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.041+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.041+0000 7f53f5d75800 20 searching for the correct realm 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.044+0000 7f53f305e640 0 -- 172.21.15.116:0/4076932510 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f53e406f040 msgr2=0x7f53e4057400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.047+0000 7f53f385f640 0 -- 172.21.15.116:0/4076932510 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f53dc03f410 msgr2=0x7f53dc03f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 zone default found 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 4 Realm: () 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 zonegroup default 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.253+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 started sync module instance, tier type = 2024-09-14T11:36:44.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.254+0000 7f53f5d75800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=0 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=1 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=2 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=3 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=4 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=5 2024-09-14T11:36:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=6 2024-09-14T11:36:44.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 20 add_watcher() i=7 2024-09-14T11:36:44.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.263+0000 7f53f5d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.265+0000 7f52a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.265+0000 7f53f5d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.265+0000 7f53f5d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.265+0000 7f53f5d75800 5 note: GC not initialized 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.265+0000 7f52a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 Filter name: none 2024-09-14T11:36:44.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f52227fc640 20 reqs_thread_entry: start 2024-09-14T11:36:44.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:44.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.266+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.267+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.267+0000 7f53f5d75800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.267+0000 7f53f5d75800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:44.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.267+0000 7f53f5d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.269+0000 7f52a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.271+0000 7f53f5d75800 20 remove_watcher() i=0 2024-09-14T11:36:44.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.271+0000 7f53f5d75800 2 removed watcher, disabling cache 2024-09-14T11:36:44.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.272+0000 7f53f5d75800 20 remove_watcher() i=1 2024-09-14T11:36:44.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.273+0000 7f53f5d75800 20 remove_watcher() i=2 2024-09-14T11:36:44.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.274+0000 7f53f5d75800 20 remove_watcher() i=3 2024-09-14T11:36:44.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.275+0000 7f53f5d75800 20 remove_watcher() i=4 2024-09-14T11:36:44.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.276+0000 7f53f5d75800 20 remove_watcher() i=5 2024-09-14T11:36:44.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.277+0000 7f53f5d75800 20 remove_watcher() i=6 2024-09-14T11:36:44.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.277+0000 7f53f5d75800 20 remove_watcher() i=7 2024-09-14T11:36:44.286 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.286 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:36:44.286 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-init-indext id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:44.286 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:36:44.375 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:44.405 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:44.405 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:44.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.445+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 realm 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.446+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.447+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.447+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.448+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.448+0000 7fa059d0c800 20 searching for the correct realm 2024-09-14T11:36:44.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.451+0000 7fa057ff7640 0 -- 172.21.15.116:0/2388519514 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa04c040070 msgr2=0x7fa04c041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.454+0000 7fa0577f6640 0 -- 172.21.15.116:0/2388519514 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa04c041400 msgr2=0x7fa04c041880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:36:44.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.660+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 zone default found 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 4 Realm: () 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 zonegroup default 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.661+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.662+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.662+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.662+0000 7fa059d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.662+0000 7fa059d0c800 20 started sync module instance, tier type = 2024-09-14T11:36:44.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.662+0000 7fa059d0c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:36:44.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=0 2024-09-14T11:36:44.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=1 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=2 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=3 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=4 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=5 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.671+0000 7fa059d0c800 20 add_watcher() i=6 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.672+0000 7fa059d0c800 20 add_watcher() i=7 2024-09-14T11:36:44.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.672+0000 7fa059d0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.674+0000 7f9f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.674+0000 7fa059d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.674+0000 7fa059d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.674+0000 7fa059d0c800 5 note: GC not initialized 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.674+0000 7f9f0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 Filter name: none 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7f9e867fc640 20 reqs_thread_entry: start 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:36:44.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:36:44.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:36:44.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:36:44.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : miss 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.675+0000 7fa059d0c800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.676+0000 7fa059d0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.676+0000 7fa059d0c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.676+0000 7fa059d0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.676+0000 7fa059d0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.676+0000 7fa059d0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:36:44.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.677+0000 7fa059d0c800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to be held by another RGW process; skipping for now 2024-09-14T11:36:44.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.677+0000 7f9f0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.680+0000 7fa059d0c800 20 remove_watcher() i=0 2024-09-14T11:36:44.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.680+0000 7fa059d0c800 2 removed watcher, disabling cache 2024-09-14T11:36:44.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.681+0000 7fa059d0c800 20 remove_watcher() i=1 2024-09-14T11:36:44.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.682+0000 7fa059d0c800 20 remove_watcher() i=2 2024-09-14T11:36:44.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.683+0000 7fa059d0c800 20 remove_watcher() i=3 2024-09-14T11:36:44.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.684+0000 7fa059d0c800 20 remove_watcher() i=4 2024-09-14T11:36:44.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.685+0000 7fa059d0c800 20 remove_watcher() i=5 2024-09-14T11:36:44.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.686+0000 7fa059d0c800 20 remove_watcher() i=6 2024-09-14T11:36:44.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:36:44.687+0000 7fa059d0c800 20 remove_watcher() i=7 2024-09-14T11:36:44.695 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:37:14.725 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:14.760 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:14.760 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:14.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.804+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 realm 2024-09-14T11:37:14.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.806+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.807+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:14.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.807+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.808+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:14.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.808+0000 7fd402020800 20 searching for the correct realm 2024-09-14T11:37:14.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.811+0000 7fd400312640 0 -- 172.21.15.116:0/1172052241 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fd3e8049060 msgr2=0x7fd3e806b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:14.813 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:14.815+0000 7fd3ffb11640 0 -- 172.21.15.116:0/1172052241 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd3e806ce80 msgr2=0x7fd3e80a50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:15.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:15.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:15.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:15.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:15.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.022+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:15.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 20 zone default found 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 4 Realm: () 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.023+0000 7fd402020800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 zonegroup default 2024-09-14T11:37:15.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 started sync module instance, tier type = 2024-09-14T11:37:15.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.024+0000 7fd402020800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=0 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=1 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=2 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=3 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=4 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=5 2024-09-14T11:37:15.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.035+0000 7fd402020800 20 add_watcher() i=6 2024-09-14T11:37:15.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.036+0000 7fd402020800 20 add_watcher() i=7 2024-09-14T11:37:15.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.036+0000 7fd402020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:15.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.037+0000 7fd2b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:15.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:15.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 5 note: GC not initialized 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd2b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 20 Filter name: none 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd22e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:37:15.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.038+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : miss 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:15.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.039+0000 7fd402020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:37:15.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.044+0000 7fd402020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.044+0000 7fd402020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.044+0000 7fd402020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.044+0000 7fd402020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21, ofs0, ns] 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.045+0000 7fd2de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94173131446592 notifier 6555 bl.length()=913 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.045+0000 7fd2de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.045+0000 7fd2de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.045+0000 7fd2de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.047+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_sources= new_sources= 2024-09-14T11:37:15.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.047+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential sources added=[] removed=[] 2024-09-14T11:37:15.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.047+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_dests= new_dests= 2024-09-14T11:37:15.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.047+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential dests added=[] removed=[] 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.0 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.0 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.1 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.1 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.2 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.2 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.3 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.3 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.4 2024-09-14T11:37:15.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.4 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.5 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.5 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.6 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.6 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.7 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.7 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.8 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.8 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.9 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.9 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.10 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.10 2024-09-14T11:37:15.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.11 2024-09-14T11:37:15.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1.11 2024-09-14T11:37:15.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.0 2024-09-14T11:37:15.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.053+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.054+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.2 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.054+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.3 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.055+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.4 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.055+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.5 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.056+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.6 2024-09-14T11:37:15.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.057+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.7 2024-09-14T11:37:15.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.057+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.8 2024-09-14T11:37:15.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.058+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.9 2024-09-14T11:37:15.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.058+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.10 2024-09-14T11:37:15.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.062+0000 7fd402020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:15.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.062+0000 7fd402020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:37:15.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd402020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd402020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd402020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd402020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21, ofs0, ns] 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd2deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94173131446592 notifier 6555 bl.length()=913 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd2deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd2deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.063+0000 7fd2deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.065+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_sources= new_sources= 2024-09-14T11:37:15.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.065+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential sources added=[] removed=[] 2024-09-14T11:37:15.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.065+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_dests= new_dests= 2024-09-14T11:37:15.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.065+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential dests added=[] removed=[] 2024-09-14T11:37:15.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.068+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.0 2024-09-14T11:37:15.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.068+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.1 2024-09-14T11:37:15.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.068+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.2 2024-09-14T11:37:15.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.069+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.3 2024-09-14T11:37:15.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.069+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.4 2024-09-14T11:37:15.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.069+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.5 2024-09-14T11:37:15.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.070+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.6 2024-09-14T11:37:15.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.070+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.7 2024-09-14T11:37:15.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.070+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.8 2024-09-14T11:37:15.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.071+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.9 2024-09-14T11:37:15.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.071+0000 7fd402020800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21.10 2024-09-14T11:37:15.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.071+0000 7fd402020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:15.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.071+0000 7fd402020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 2024-09-14T11:37:15.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd402020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd402020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd402020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd402020800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21, ofs0, ns] 2024-09-14T11:37:15.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd2deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94173131446592 notifier 6555 bl.length()=881 2024-09-14T11:37:15.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd2deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 info.flags=0x17 2024-09-14T11:37:15.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd2deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 to cache LRU end 2024-09-14T11:37:15.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.073+0000 7fd2deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:15.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.075+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_sources= new_sources= 2024-09-14T11:37:15.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.075+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential sources added=[] removed=[] 2024-09-14T11:37:15.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.075+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): orig_dests= new_dests= 2024-09-14T11:37:15.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.075+0000 7fd402020800 20 handle_bi_update(): bucket=:abort-at-init-indext[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21]): potential dests added=[] removed=[] 2024-09-14T11:37:15.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.078+0000 7fd402020800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:15.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.080+0000 7fd2b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:15.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.082+0000 7fd402020800 20 remove_watcher() i=0 2024-09-14T11:37:15.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.082+0000 7fd402020800 2 removed watcher, disabling cache 2024-09-14T11:37:15.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.083+0000 7fd402020800 20 remove_watcher() i=1 2024-09-14T11:37:15.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.084+0000 7fd402020800 20 remove_watcher() i=2 2024-09-14T11:37:15.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.086+0000 7fd402020800 20 remove_watcher() i=3 2024-09-14T11:37:15.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.087+0000 7fd402020800 20 remove_watcher() i=4 2024-09-14T11:37:15.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.088+0000 7fd402020800 20 remove_watcher() i=5 2024-09-14T11:37:15.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.088+0000 7fd402020800 20 remove_watcher() i=6 2024-09-14T11:37:15.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.089+0000 7fd402020800 20 remove_watcher() i=7 2024-09-14T11:37:15.100 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:37:15.129 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:15.129 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:15.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.167+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 realm 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.169+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.170+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:15.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.170+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.171+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:15.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.171+0000 7f661f175800 20 searching for the correct realm 2024-09-14T11:37:15.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.173+0000 7f6617fff640 0 -- 172.21.15.116:0/4110778839 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f661000e040 msgr2=0x7f661007d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:15.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.379+0000 7f661cc5f640 0 -- 172.21.15.116:0/4110778839 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f66080bc8b0 msgr2=0x7f66080db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.586+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:15.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 zone default found 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 4 Realm: () 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 zonegroup default 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.587+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.588+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.588+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.588+0000 7f661f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:15.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.588+0000 7f661f175800 20 started sync module instance, tier type = 2024-09-14T11:37:15.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.588+0000 7f661f175800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=0 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=1 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=2 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=3 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=4 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=5 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.598+0000 7f661f175800 20 add_watcher() i=6 2024-09-14T11:37:15.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.599+0000 7f661f175800 20 add_watcher() i=7 2024-09-14T11:37:15.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.599+0000 7f661f175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:15.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.600+0000 7f64d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 5 note: GC not initialized 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f64d27e4640 20 reqs_thread_entry: start 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:15.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 20 Filter name: none 2024-09-14T11:37:15.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f64cbfff640 20 reqs_thread_entry: start 2024-09-14T11:37:15.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.601+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.602+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.602+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.602+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.602+0000 7f661f175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.602+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.603+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.603+0000 7f661f175800 20 rados->read ofs=0 len=0 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.603+0000 7f661f175800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:37:15.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.603+0000 7f661f175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:15.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.605+0000 7f64d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:15.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.607+0000 7f661f175800 20 remove_watcher() i=0 2024-09-14T11:37:15.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.607+0000 7f661f175800 2 removed watcher, disabling cache 2024-09-14T11:37:15.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.608+0000 7f661f175800 20 remove_watcher() i=1 2024-09-14T11:37:15.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.609+0000 7f661f175800 20 remove_watcher() i=2 2024-09-14T11:37:15.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.610+0000 7f661f175800 20 remove_watcher() i=3 2024-09-14T11:37:15.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.611+0000 7f661f175800 20 remove_watcher() i=4 2024-09-14T11:37:15.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.612+0000 7f661f175800 20 remove_watcher() i=5 2024-09-14T11:37:15.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.613+0000 7f661f175800 20 remove_watcher() i=6 2024-09-14T11:37:15.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:15.614+0000 7f661f175800 20 remove_watcher() i=7 2024-09-14T11:37:15.623 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:15.623 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:15.623 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-init-indext id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:15.623 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:15.991 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:37:15.992 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:16.799 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:37:16.827 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:16.827 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:16.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.866+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.867+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.867+0000 7effd9e98800 20 realm 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.867+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.868+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.868+0000 7effd9e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.868+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.868+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.868+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.869+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:16.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.869+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.869+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:16.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.869+0000 7effd9e98800 20 searching for the correct realm 2024-09-14T11:37:16.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.873+0000 7effd818a640 0 -- 172.21.15.116:0/2151372719 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55bb73f408e0 msgr2=0x55bb73f42d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:16.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.876+0000 7effcf188640 0 -- 172.21.15.116:0/2151372719 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7effc8029070 msgr2=0x7effc806b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:16.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 zone default found 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 4 Realm: () 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 zonegroup default 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.881+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 started sync module instance, tier type = 2024-09-14T11:37:16.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.882+0000 7effd9e98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:16.889 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=0 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=1 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=2 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=3 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=4 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=5 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=6 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 20 add_watcher() i=7 2024-09-14T11:37:16.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.892+0000 7effd9e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:16.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7efe8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7effd9e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7effd9e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7effd9e98800 5 note: GC not initialized 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7efe8cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.894+0000 7effd9e98800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.895+0000 7effd9e98800 20 Filter name: none 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.895+0000 7efe067fc640 20 reqs_thread_entry: start 2024-09-14T11:37:16.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.895+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.895+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:16.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.895+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:16.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:16.894 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:16.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:16.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.896+0000 7effd9e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:16.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.898+0000 7efe8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:16.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.900+0000 7effd9e98800 20 remove_watcher() i=0 2024-09-14T11:37:16.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.900+0000 7effd9e98800 2 removed watcher, disabling cache 2024-09-14T11:37:16.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.901+0000 7effd9e98800 20 remove_watcher() i=1 2024-09-14T11:37:16.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.902+0000 7effd9e98800 20 remove_watcher() i=2 2024-09-14T11:37:16.901 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.903+0000 7effd9e98800 20 remove_watcher() i=3 2024-09-14T11:37:16.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.904+0000 7effd9e98800 20 remove_watcher() i=4 2024-09-14T11:37:16.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.905+0000 7effd9e98800 20 remove_watcher() i=5 2024-09-14T11:37:16.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.906+0000 7effd9e98800 20 remove_watcher() i=6 2024-09-14T11:37:16.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.907+0000 7effd9e98800 20 remove_watcher() i=7 2024-09-14T11:37:16.915 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:16.915 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:16.915 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:16.915 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:16.916 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:37:16.950 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:16.950 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:16.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.989+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 realm 2024-09-14T11:37:16.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:16.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:16.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.991+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.992+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:16.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.992+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:16.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.992+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:16.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.992+0000 7f0ea4840800 20 searching for the correct realm 2024-09-14T11:37:16.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:16.996+0000 7f0ea1b29640 0 -- 172.21.15.116:0/3818947879 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f0e9406d060 msgr2=0x7f0e940abb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:16.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.000+0000 7f0ea1b29640 0 -- 172.21.15.116:0/3818947879 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f0d6c0870d0 msgr2=0x7f0d6c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:17.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:17.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:17.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:17.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.003+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 zone default found 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 4 Realm: () 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 zonegroup default 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.004+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.005+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.005+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.005+0000 7f0ea4840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.005+0000 7f0ea4840800 20 started sync module instance, tier type = 2024-09-14T11:37:17.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.005+0000 7f0ea4840800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=0 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=1 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=2 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=3 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=4 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=5 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.014+0000 7f0ea4840800 20 add_watcher() i=6 2024-09-14T11:37:17.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.015+0000 7f0ea4840800 20 add_watcher() i=7 2024-09-14T11:37:17.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.015+0000 7f0ea4840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:17.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.016+0000 7f0d58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.016+0000 7f0ea4840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:17.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.016+0000 7f0ea4840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:17.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.016+0000 7f0ea4840800 5 note: GC not initialized 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0cd37fe640 20 reqs_thread_entry: start 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 20 Filter name: none 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0cd17fa640 20 reqs_thread_entry: start 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 : miss 2024-09-14T11:37:17.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.017+0000 7f0ea4840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.018+0000 7f0ea4840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 2024-09-14T11:37:17.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.022+0000 7f0ea4840800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:37:17.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.022+0000 7f0ea4840800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:37:17.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.026+0000 7f0d58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.028+0000 7f0ea4840800 20 remove_watcher() i=0 2024-09-14T11:37:17.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.028+0000 7f0ea4840800 2 removed watcher, disabling cache 2024-09-14T11:37:17.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.029+0000 7f0ea4840800 20 remove_watcher() i=1 2024-09-14T11:37:17.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.030+0000 7f0ea4840800 20 remove_watcher() i=2 2024-09-14T11:37:17.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.031+0000 7f0ea4840800 20 remove_watcher() i=3 2024-09-14T11:37:17.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.032+0000 7f0ea4840800 20 remove_watcher() i=4 2024-09-14T11:37:17.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.033+0000 7f0ea4840800 20 remove_watcher() i=5 2024-09-14T11:37:17.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.034+0000 7f0ea4840800 20 remove_watcher() i=6 2024-09-14T11:37:17.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.035+0000 7f0ea4840800 20 remove_watcher() i=7 2024-09-14T11:37:17.045 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:37:17.073 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:17.074 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:17.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.112+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 realm 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:17.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.114+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.115+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.115+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.115+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:17.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.115+0000 7f56fe812800 20 searching for the correct realm 2024-09-14T11:37:17.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.118+0000 7f56f17df640 0 -- 172.21.15.116:0/2811001157 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f56ec018070 msgr2=0x7f56ec067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.324+0000 7f56f9fe0640 0 -- 172.21.15.116:0/2811001157 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f56e4061400 msgr2=0x7f56e4061860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:17.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:17.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.530+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 zone default found 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 4 Realm: () 2024-09-14T11:37:17.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 zonegroup default 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.531+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.532+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.532+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.532+0000 7f56fe812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.532+0000 7f56fe812800 20 started sync module instance, tier type = 2024-09-14T11:37:17.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.532+0000 7f56fe812800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=0 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=1 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=2 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=3 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=4 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=5 2024-09-14T11:37:17.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.541+0000 7f56fe812800 20 add_watcher() i=6 2024-09-14T11:37:17.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.542+0000 7f56fe812800 20 add_watcher() i=7 2024-09-14T11:37:17.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.542+0000 7f56fe812800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:17.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f55ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:17.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 5 note: GC not initialized 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f55aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 20 Filter name: none 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f551bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:17.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.544+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:17.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.545+0000 7f56fe812800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.546+0000 7f56fe812800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:17.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.546+0000 7f56fe812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:17.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.547+0000 7f55ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.550+0000 7f56fe812800 20 remove_watcher() i=0 2024-09-14T11:37:17.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.550+0000 7f56fe812800 2 removed watcher, disabling cache 2024-09-14T11:37:17.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.551+0000 7f56fe812800 20 remove_watcher() i=1 2024-09-14T11:37:17.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.552+0000 7f56fe812800 20 remove_watcher() i=2 2024-09-14T11:37:17.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.553+0000 7f56fe812800 20 remove_watcher() i=3 2024-09-14T11:37:17.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.554+0000 7f56fe812800 20 remove_watcher() i=4 2024-09-14T11:37:17.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.555+0000 7f56fe812800 20 remove_watcher() i=5 2024-09-14T11:37:17.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.556+0000 7f56fe812800 20 remove_watcher() i=6 2024-09-14T11:37:17.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.557+0000 7f56fe812800 20 remove_watcher() i=7 2024-09-14T11:37:17.566 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:17.566 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:17.566 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:17.566 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:17.655 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.724+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 realm 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.726+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.727+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.727+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.727+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:17.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.727+0000 7fbe48f2e800 20 searching for the correct realm 2024-09-14T11:37:17.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.731+0000 7fbe45365640 0 -- 172.21.15.116:0/5275876 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fbe2c067610 msgr2=0x7fbe2c0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:17.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.938+0000 7fbe44b64640 0 -- 172.21.15.116:0/5275876 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x561137467940 msgr2=0x561137469d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:17.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:17.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:17.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.941+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 zone default found 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 4 Realm: () 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:17.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 zonegroup default 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.942+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.943+0000 7fbe48f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:17.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.943+0000 7fbe48f2e800 20 started sync module instance, tier type = 2024-09-14T11:37:17.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.943+0000 7fbe48f2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:17.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=0 2024-09-14T11:37:17.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=1 2024-09-14T11:37:17.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=2 2024-09-14T11:37:17.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=3 2024-09-14T11:37:17.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=4 2024-09-14T11:37:17.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=5 2024-09-14T11:37:17.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.952+0000 7fbe48f2e800 20 add_watcher() i=6 2024-09-14T11:37:17.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.953+0000 7fbe48f2e800 20 add_watcher() i=7 2024-09-14T11:37:17.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.953+0000 7fbe48f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:17.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.955+0000 7fbcfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.955+0000 7fbe48f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.955+0000 7fbe48f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.955+0000 7fbe48f2e800 5 note: GC not initialized 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.955+0000 7fbcfa7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 Filter name: none 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbcf3fff640 20 reqs_thread_entry: start 2024-09-14T11:37:17.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 : miss 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:17.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:17.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:17.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.956+0000 7fbe48f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 2024-09-14T11:37:17.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.962+0000 7fbe48f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbe48f2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbe48f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbe48f2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22, ofs0, ns] 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbd1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94631941802800 notifier 6645 bl.length()=925 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbd1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbd1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.963+0000 7fbd1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.965+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_sources= new_sources= 2024-09-14T11:37:17.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.965+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential sources added=[] removed=[] 2024-09-14T11:37:17.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.965+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_dests= new_dests= 2024-09-14T11:37:17.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.965+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential dests added=[] removed=[] 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.0 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.0 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.1 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.1 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.2 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.2 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.3 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.3 2024-09-14T11:37:17.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.4 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.4 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.5 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.5 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.6 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.6 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.7 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.7 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.8 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.8 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.9 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.9 2024-09-14T11:37:17.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.10 2024-09-14T11:37:17.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.10 2024-09-14T11:37:17.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.11 2024-09-14T11:37:17.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1.11 2024-09-14T11:37:17.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.969+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.0 2024-09-14T11:37:17.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.970+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1 2024-09-14T11:37:17.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.970+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.2 2024-09-14T11:37:17.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.971+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.3 2024-09-14T11:37:17.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.971+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.4 2024-09-14T11:37:17.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.972+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.5 2024-09-14T11:37:17.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.973+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.6 2024-09-14T11:37:17.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.973+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.7 2024-09-14T11:37:17.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.974+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.8 2024-09-14T11:37:17.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.974+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.9 2024-09-14T11:37:17.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.975+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.10 2024-09-14T11:37:17.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.978+0000 7fbe48f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:17.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.978+0000 7fbe48f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbe48f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbe48f2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbe48f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbe48f2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22, ofs0, ns] 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbd1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94631941802800 notifier 6645 bl.length()=925 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbd1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbd1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.980+0000 7fbd1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.982+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_sources= new_sources= 2024-09-14T11:37:17.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.982+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential sources added=[] removed=[] 2024-09-14T11:37:17.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.982+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_dests= new_dests= 2024-09-14T11:37:17.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.982+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential dests added=[] removed=[] 2024-09-14T11:37:17.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.984+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.0 2024-09-14T11:37:17.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.984+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.1 2024-09-14T11:37:17.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.985+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.2 2024-09-14T11:37:17.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.985+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.3 2024-09-14T11:37:17.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.985+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.4 2024-09-14T11:37:17.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.985+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.5 2024-09-14T11:37:17.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.986+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.6 2024-09-14T11:37:17.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.986+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.7 2024-09-14T11:37:17.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.986+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.8 2024-09-14T11:37:17.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.987+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.9 2024-09-14T11:37:17.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.987+0000 7fbe48f2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22.10 2024-09-14T11:37:17.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.987+0000 7fbe48f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:17.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.987+0000 7fbe48f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 2024-09-14T11:37:17.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbe48f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbe48f2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbe48f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbe48f2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22, ofs0, ns] 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbd1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94631941802800 notifier 6645 bl.length()=893 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbd1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 info.flags=0x17 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbd1b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 to cache LRU end 2024-09-14T11:37:17.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.989+0000 7fbd1b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:17.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.991+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_sources= new_sources= 2024-09-14T11:37:17.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.991+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential sources added=[] removed=[] 2024-09-14T11:37:17.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.991+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): orig_dests= new_dests= 2024-09-14T11:37:17.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.991+0000 7fbe48f2e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22]): potential dests added=[] removed=[] 2024-09-14T11:37:17.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.993+0000 7fbe48f2e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:17.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.995+0000 7fbcfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:17.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.997+0000 7fbe48f2e800 20 remove_watcher() i=0 2024-09-14T11:37:17.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.997+0000 7fbe48f2e800 2 removed watcher, disabling cache 2024-09-14T11:37:17.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.998+0000 7fbe48f2e800 20 remove_watcher() i=1 2024-09-14T11:37:17.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:17.999+0000 7fbe48f2e800 20 remove_watcher() i=2 2024-09-14T11:37:17.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.000+0000 7fbe48f2e800 20 remove_watcher() i=3 2024-09-14T11:37:17.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.001+0000 7fbe48f2e800 20 remove_watcher() i=4 2024-09-14T11:37:18.000 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.002+0000 7fbe48f2e800 20 remove_watcher() i=5 2024-09-14T11:37:18.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.003+0000 7fbe48f2e800 20 remove_watcher() i=6 2024-09-14T11:37:18.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.004+0000 7fbe48f2e800 20 remove_watcher() i=7 2024-09-14T11:37:18.014 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:37:18.042 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:18.042 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:18.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.081+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 realm 2024-09-14T11:37:18.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:18.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.285+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.286+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.286+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.286+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:18.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.287+0000 7f6e65298800 20 searching for the correct realm 2024-09-14T11:37:18.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.290+0000 7f6e6358a640 0 -- 172.21.15.116:0/909282081 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6e4c039070 msgr2=0x7f6e4c06ba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.294+0000 7f6e62d89640 0 -- 172.21.15.116:0/909282081 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6e4c0761a0 msgr2=0x7f6e4c072910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.298+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 zone default found 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 4 Realm: () 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 zonegroup default 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.299+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.300+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.300+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.300+0000 7f6e65298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:18.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.300+0000 7f6e65298800 20 started sync module instance, tier type = 2024-09-14T11:37:18.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.300+0000 7f6e65298800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=0 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=1 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=2 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=3 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=4 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=5 2024-09-14T11:37:18.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.309+0000 7f6e65298800 20 add_watcher() i=6 2024-09-14T11:37:18.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.310+0000 7f6e65298800 20 add_watcher() i=7 2024-09-14T11:37:18.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.310+0000 7f6e65298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:18.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.312+0000 7f6d197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.312+0000 7f6e65298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.312+0000 7f6e65298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.312+0000 7f6e65298800 5 note: GC not initialized 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.312+0000 7f6c93fff640 20 reqs_thread_entry: start 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6e65298800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:18.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6e65298800 20 Filter name: none 2024-09-14T11:37:18.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6c91ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:18.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:18.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.313+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 rados->read ofs=0 len=0 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:18.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.314+0000 7f6e65298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:18.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.316+0000 7f6d197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:18.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.318+0000 7f6e65298800 20 remove_watcher() i=0 2024-09-14T11:37:18.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.318+0000 7f6e65298800 2 removed watcher, disabling cache 2024-09-14T11:37:18.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.320+0000 7f6e65298800 20 remove_watcher() i=1 2024-09-14T11:37:18.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.321+0000 7f6e65298800 20 remove_watcher() i=2 2024-09-14T11:37:18.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.322+0000 7f6e65298800 20 remove_watcher() i=3 2024-09-14T11:37:18.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.323+0000 7f6e65298800 20 remove_watcher() i=4 2024-09-14T11:37:18.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.324+0000 7f6e65298800 20 remove_watcher() i=5 2024-09-14T11:37:18.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.325+0000 7f6e65298800 20 remove_watcher() i=6 2024-09-14T11:37:18.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:18.326+0000 7f6e65298800 20 remove_watcher() i=7 2024-09-14T11:37:18.334 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:18.334 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:18.334 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:18.334 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:18.714 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:37:18.714 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:19.511 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:37:19.538 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.539 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.577+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.578+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.578+0000 7f19a8887800 20 realm 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.578+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.579+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.579+0000 7f19a8887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.579+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.579+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.579+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.580+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.580+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.580+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.580+0000 7f19a8887800 20 searching for the correct realm 2024-09-14T11:37:19.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.583+0000 7f19a6b79640 0 -- 172.21.15.116:0/174571489 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x56512347b410 msgr2=0x56512347d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.586+0000 7f19a6378640 0 -- 172.21.15.116:0/174571489 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f199c06a820 msgr2=0x7f199c08f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:19.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:19.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.590+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 zone default found 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 4 Realm: () 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:19.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 zonegroup default 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.591+0000 7f19a8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.592+0000 7f19a8887800 20 started sync module instance, tier type = 2024-09-14T11:37:19.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.592+0000 7f19a8887800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=0 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=1 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=2 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=3 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=4 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=5 2024-09-14T11:37:19.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.600+0000 7f19a8887800 20 add_watcher() i=6 2024-09-14T11:37:19.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.601+0000 7f19a8887800 20 add_watcher() i=7 2024-09-14T11:37:19.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.601+0000 7f19a8887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:19.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.602+0000 7f185cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 5 note: GC not initialized 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f17d77fe640 20 reqs_thread_entry: start 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 20 Filter name: none 2024-09-14T11:37:19.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f17d57fa640 20 reqs_thread_entry: start 2024-09-14T11:37:19.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.603+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.604+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:19.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.604+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.604+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.604+0000 7f19a8887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.604+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.605+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.605+0000 7f19a8887800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.605+0000 7f19a8887800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:19.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.605+0000 7f19a8887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:19.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.607+0000 7f185cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.609+0000 7f19a8887800 20 remove_watcher() i=0 2024-09-14T11:37:19.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.609+0000 7f19a8887800 2 removed watcher, disabling cache 2024-09-14T11:37:19.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.610+0000 7f19a8887800 20 remove_watcher() i=1 2024-09-14T11:37:19.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.611+0000 7f19a8887800 20 remove_watcher() i=2 2024-09-14T11:37:19.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.612+0000 7f19a8887800 20 remove_watcher() i=3 2024-09-14T11:37:19.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.613+0000 7f19a8887800 20 remove_watcher() i=4 2024-09-14T11:37:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.614+0000 7f19a8887800 20 remove_watcher() i=5 2024-09-14T11:37:19.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.615+0000 7f19a8887800 20 remove_watcher() i=6 2024-09-14T11:37:19.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.615+0000 7f19a8887800 20 remove_watcher() i=7 2024-09-14T11:37:19.624 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:19.624 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:19.624 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:19.624 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:19.626 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:37:19.661 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.661 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.700+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 realm 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.702+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.703+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.703+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.703+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.703+0000 7f8fb9f28800 20 searching for the correct realm 2024-09-14T11:37:19.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.706+0000 7f8fb544a640 0 -- 172.21.15.116:0/746279623 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55cf9fa735c0 msgr2=0x55cf9fa75a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.710+0000 7f8fb5c4b640 0 -- 172.21.15.116:0/746279623 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8fac017040 msgr2=0x7f8fac049a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.713+0000 7f8fb9f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 zone default found 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 4 Realm: () 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 zonegroup default 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.714+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.715+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.715+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.715+0000 7f8fb9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.715+0000 7f8fb9f28800 20 started sync module instance, tier type = 2024-09-14T11:37:19.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.715+0000 7f8fb9f28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=0 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=1 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=2 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=3 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=4 2024-09-14T11:37:19.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=5 2024-09-14T11:37:19.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.723+0000 7f8fb9f28800 20 add_watcher() i=6 2024-09-14T11:37:19.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.724+0000 7f8fb9f28800 20 add_watcher() i=7 2024-09-14T11:37:19.722 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.724+0000 7f8fb9f28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:19.723 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8e677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.724 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8fb9f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8fb9f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8fb9f28800 5 note: GC not initialized 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8e667fc640 20 reqs_thread_entry: start 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8fb9f28800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8fb9f28800 20 Filter name: none 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.726+0000 7f8dd7fff640 20 reqs_thread_entry: start 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:37:19.725 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 : miss 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:19.726 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:19.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.727+0000 7f8fb9f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 2024-09-14T11:37:19.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.732+0000 7f8fb9f28800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:37:19.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8fb9f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8fb9f28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8fb9f28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8fb9f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23, ofs0, ns] 2024-09-14T11:37:19.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8e997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94350225132784 notifier 6702 bl.length()=925 2024-09-14T11:37:19.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8e997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8e997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.733+0000 7f8e997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.735+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_sources= new_sources= 2024-09-14T11:37:19.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.735+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential sources added=[] removed=[] 2024-09-14T11:37:19.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.735+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_dests= new_dests= 2024-09-14T11:37:19.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.735+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential dests added=[] removed=[] 2024-09-14T11:37:19.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.0 2024-09-14T11:37:19.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.0 2024-09-14T11:37:19.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.1 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.1 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.2 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.2 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.3 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.3 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.4 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.4 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.5 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.5 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.6 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.6 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.7 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.7 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.8 2024-09-14T11:37:19.738 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.8 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.9 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.9 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.10 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.10 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.11 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1.11 2024-09-14T11:37:19.739 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.739+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.0 2024-09-14T11:37:19.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.740+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1 2024-09-14T11:37:19.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.740+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.2 2024-09-14T11:37:19.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.741+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.3 2024-09-14T11:37:19.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.741+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.4 2024-09-14T11:37:19.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.741+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.5 2024-09-14T11:37:19.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.742+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.6 2024-09-14T11:37:19.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.742+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.7 2024-09-14T11:37:19.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.743+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.8 2024-09-14T11:37:19.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.743+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.9 2024-09-14T11:37:19.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.744+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.10 2024-09-14T11:37:19.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.747+0000 7f8fb9f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:19.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.747+0000 7f8fb9f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.748+0000 7f8fb9f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.748+0000 7f8fb9f28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.748+0000 7f8fb9f28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.748+0000 7f8fb9f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23, ofs0, ns] 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.749+0000 7f8e997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94350225132784 notifier 6702 bl.length()=925 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.749+0000 7f8e997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.749+0000 7f8e997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.749+0000 7f8e997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.750+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_sources= new_sources= 2024-09-14T11:37:19.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.750+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential sources added=[] removed=[] 2024-09-14T11:37:19.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.750+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_dests= new_dests= 2024-09-14T11:37:19.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.750+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential dests added=[] removed=[] 2024-09-14T11:37:19.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.753+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.0 2024-09-14T11:37:19.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.753+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.1 2024-09-14T11:37:19.751 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.753+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.2 2024-09-14T11:37:19.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.754+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.3 2024-09-14T11:37:19.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.754+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.4 2024-09-14T11:37:19.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.754+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.5 2024-09-14T11:37:19.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.755+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.6 2024-09-14T11:37:19.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.755+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.7 2024-09-14T11:37:19.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.755+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.8 2024-09-14T11:37:19.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.756+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.9 2024-09-14T11:37:19.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.756+0000 7f8fb9f28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23.10 2024-09-14T11:37:19.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.756+0000 7f8fb9f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:19.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.756+0000 7f8fb9f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.757+0000 7f8fb9f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.757+0000 7f8fb9f28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.757+0000 7f8fb9f28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.757+0000 7f8fb9f28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23, ofs0, ns] 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.758+0000 7f8e997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94350225132784 notifier 6702 bl.length()=893 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.758+0000 7f8e997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 info.flags=0x17 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.758+0000 7f8e997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 to cache LRU end 2024-09-14T11:37:19.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.758+0000 7f8e997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:19.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.760+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_sources= new_sources= 2024-09-14T11:37:19.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.760+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential sources added=[] removed=[] 2024-09-14T11:37:19.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.760+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): orig_dests= new_dests= 2024-09-14T11:37:19.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.760+0000 7f8fb9f28800 20 handle_bi_update(): bucket=:error-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23]): potential dests added=[] removed=[] 2024-09-14T11:37:19.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.762+0000 7f8fb9f28800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:19.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.764+0000 7f8e677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.766+0000 7f8fb9f28800 20 remove_watcher() i=0 2024-09-14T11:37:19.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.766+0000 7f8fb9f28800 2 removed watcher, disabling cache 2024-09-14T11:37:19.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.767+0000 7f8fb9f28800 20 remove_watcher() i=1 2024-09-14T11:37:19.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.768+0000 7f8fb9f28800 20 remove_watcher() i=2 2024-09-14T11:37:19.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.769+0000 7f8fb9f28800 20 remove_watcher() i=3 2024-09-14T11:37:19.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.770+0000 7f8fb9f28800 20 remove_watcher() i=4 2024-09-14T11:37:19.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.771+0000 7f8fb9f28800 20 remove_watcher() i=5 2024-09-14T11:37:19.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.772+0000 7f8fb9f28800 20 remove_watcher() i=6 2024-09-14T11:37:19.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.773+0000 7f8fb9f28800 20 remove_watcher() i=7 2024-09-14T11:37:19.783 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:37:19.812 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.812 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.851+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.852+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.852+0000 7f12d7339800 20 realm 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.852+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.853+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.853+0000 7f12d7339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.853+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.853+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.853+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.854+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.854+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.854+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.854+0000 7f12d7339800 20 searching for the correct realm 2024-09-14T11:37:19.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:19.855+0000 7f12d2fc7640 0 -- 172.21.15.116:0/648404516 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f12cc0bb070 msgr2=0x7f12cc0a76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.060+0000 7f12d37c8640 0 -- 172.21.15.116:0/648404516 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f12c8060b70 msgr2=0x7f12c8067a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:20.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:20.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.065+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 zone default found 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 4 Realm: () 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:20.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 zonegroup default 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.066+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.067+0000 7f12d7339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.067+0000 7f12d7339800 20 started sync module instance, tier type = 2024-09-14T11:37:20.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.067+0000 7f12d7339800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=0 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=1 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=2 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=3 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=4 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=5 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.076+0000 7f12d7339800 20 add_watcher() i=6 2024-09-14T11:37:20.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.077+0000 7f12d7339800 20 add_watcher() i=7 2024-09-14T11:37:20.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.077+0000 7f12d7339800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.078+0000 7f11897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 5 note: GC not initialized 2024-09-14T11:37:20.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f1103fff640 20 reqs_thread_entry: start 2024-09-14T11:37:20.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:20.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 20 Filter name: none 2024-09-14T11:37:20.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f1101ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:20.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.079+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.080+0000 7f12d7339800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.081+0000 7f12d7339800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:20.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.081+0000 7f12d7339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.082+0000 7f11897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.084+0000 7f12d7339800 20 remove_watcher() i=0 2024-09-14T11:37:20.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.084+0000 7f12d7339800 2 removed watcher, disabling cache 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.085+0000 7f12d7339800 20 remove_watcher() i=1 2024-09-14T11:37:20.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.086+0000 7f12d7339800 20 remove_watcher() i=2 2024-09-14T11:37:20.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.088+0000 7f12d7339800 20 remove_watcher() i=3 2024-09-14T11:37:20.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.089+0000 7f12d7339800 20 remove_watcher() i=4 2024-09-14T11:37:20.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.090+0000 7f12d7339800 20 remove_watcher() i=5 2024-09-14T11:37:20.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.091+0000 7f12d7339800 20 remove_watcher() i=6 2024-09-14T11:37:20.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:20.091+0000 7f12d7339800 20 remove_watcher() i=7 2024-09-14T11:37:20.100 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:20.101 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:20.101 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:37:20.101 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:37:20.465 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.272 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:37:21.300 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.300 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.338+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.340+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.340+0000 7ff348d73800 20 realm 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.340+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.341+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.341+0000 7ff348d73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.341+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.341+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.341+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.342+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.342+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.342+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.342+0000 7ff348d73800 20 searching for the correct realm 2024-09-14T11:37:21.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.346+0000 7ff33e05c640 0 -- 172.21.15.116:0/2761144468 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7ff338034040 msgr2=0x7ff338077630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.348+0000 7ff33e05c640 0 -- 172.21.15.116:0/2761144468 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7ff2100870d0 msgr2=0x7ff210089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.352+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 zone default found 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 4 Realm: () 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 zonegroup default 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.353+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.354+0000 7ff348d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.354+0000 7ff348d73800 20 started sync module instance, tier type = 2024-09-14T11:37:21.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.354+0000 7ff348d73800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:21.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=0 2024-09-14T11:37:21.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=1 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=2 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=3 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=4 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=5 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.362+0000 7ff348d73800 20 add_watcher() i=6 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.363+0000 7ff348d73800 20 add_watcher() i=7 2024-09-14T11:37:21.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.363+0000 7ff348d73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff1fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff348d73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff348d73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff348d73800 5 note: GC not initialized 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff177fff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff348d73800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.365+0000 7ff348d73800 20 Filter name: none 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.366+0000 7ff175ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.366+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.366+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.366+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.367+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.367+0000 7ff348d73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.367+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.367+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.367+0000 7ff348d73800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.368+0000 7ff348d73800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.368+0000 7ff348d73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.369+0000 7ff1fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.371+0000 7ff348d73800 20 remove_watcher() i=0 2024-09-14T11:37:21.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.371+0000 7ff348d73800 2 removed watcher, disabling cache 2024-09-14T11:37:21.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.372+0000 7ff348d73800 20 remove_watcher() i=1 2024-09-14T11:37:21.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.373+0000 7ff348d73800 20 remove_watcher() i=2 2024-09-14T11:37:21.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.374+0000 7ff348d73800 20 remove_watcher() i=3 2024-09-14T11:37:21.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.375+0000 7ff348d73800 20 remove_watcher() i=4 2024-09-14T11:37:21.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.376+0000 7ff348d73800 20 remove_watcher() i=5 2024-09-14T11:37:21.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.377+0000 7ff348d73800 20 remove_watcher() i=6 2024-09-14T11:37:21.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.377+0000 7ff348d73800 20 remove_watcher() i=7 2024-09-14T11:37:21.386 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.386 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:21.386 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:21.386 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.387 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:37:21.421 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.421 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.460+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 realm 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 searching for the correct realm 2024-09-14T11:37:21.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.465+0000 7fa7af2dc640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa7a8074070 msgr2=0x7fa7a803c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.469+0000 7fa7b7add640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa7a00a3450 msgr2=0x7fa7a00a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zone default found 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Realm: () 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zonegroup default 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started sync module instance, tier type = 2024-09-14T11:37:21.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=0 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=1 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=2 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=3 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=4 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=5 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=6 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.687+0000 7fa7bbd2e800 20 add_watcher() i=7 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.687+0000 7fa7bbd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 note: GC not initialized 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa66cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 Filter name: none 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa5e67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:37:21.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:37:21.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : miss 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7bbd2e800 time 2024-09-14T11:37:21.696238+0000 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7bd58c76a] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.696+0000 7fa7bbd2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7bbd2e800 time 2024-09-14T11:37:21.696238+0000 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7bd58c76a] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa7bbd2e800 thread_name:radosgw-admin 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bc23e6f0] 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7bc28b99c] 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7bd58c7c4] 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.719 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.697+0000 7fa7bbd2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa7bbd2e800 thread_name:radosgw-admin 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bc23e6f0] 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7bc28b99c] 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:21.720 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7bd58c7c4] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.721 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:37:21.442+0000 7fa7b82de640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:37:21.442+0000 7fa7b82de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: dump: 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.722 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: dump: 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.723 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6747 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 4 set_mon_vals no callback set 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: shutdown 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) unregister_commands rotate-key 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.724 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.725 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.726 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: starting msgr at 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: starting objecter 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests hook 0x55d7dbe42d30 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: setting wanted keys 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: calling monclient init 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.727 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.728 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key hook 0x55d7dbe3b8c8 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:21.729 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbcade70 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbced910 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbd81240 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.050972s 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbcade70 auth_method 0 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.730 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbced910 auth_method 0 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.731 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbd81240 auth_method 0 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.732 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:37:21.445+0000 7fa7b7add640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: dump: 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.733 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.734 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: dump: 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.735 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6272 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:37:21.445+0000 7fa6a5e0b640 4 set_mon_vals no callback set 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 1 librados: init done 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.736 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:37:21.447+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa6a0077230 auth_method 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:37:21.447+0000 7fa7b82de640 10 monclient: get_auth_request con 0x55d7dbe64830 auth_method 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:37:21.448+0000 7fa7b7add640 10 monclient: get_auth_request con 0x55d7dbe87730 auth_method 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:37:21.449+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x55d7dbe8c7c0 auth_method 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.737 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.738 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests cmddesc objecter_requests hook 0x55d7dbe93c30 EEXIST 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.739 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.740 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x55d7dbe8f840 EEXIST 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbeb7f50 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbeb8330 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbeb6c60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.057501s 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbeb7f50 auth_method 0 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbeb6c60 auth_method 0 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.742 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbeb8330 auth_method 0 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_done global_id 6753 payload 824 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:37:21.451+0000 7fa7b82de640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.743 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: dump: 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.744 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: dump: 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.745 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6753 2024-09-14T11:37:21.746 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:37:21.452+0000 7fa7b8adf640 4 set_mon_vals no callback set 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:37:21.454+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa690077140 auth_method 0 2024-09-14T11:37:21.747 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.748 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.749 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.750 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.751 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x7ffefe57cd78 EEXIST 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbf0c1e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.752 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbefcb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbf07610 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.061608s 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbf0c1e0 auth_method 0 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbefcb30 auth_method 0 2024-09-14T11:37:21.753 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbf07610 auth_method 0 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.754 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6756 payload 274 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:37:21.455+0000 7fa7b7add640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: dump: 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.755 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: dump: 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.756 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6756 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 4 set_mon_vals no callback set 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: shutdown 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.757 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.758 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.759 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: starting msgr at 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: starting objecter 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests cmddesc objecter_requests hook 0x55d7dbeb9da0 EEXIST 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: setting wanted keys 2024-09-14T11:37:21.760 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: calling monclient init 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.761 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x55d7dbecc958 EEXIST 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbefcb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbf07610 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbf0c1e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.762 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.063805s 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbefcb30 auth_method 0 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbf0c1e0 auth_method 0 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.763 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbf07610 auth_method 0 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:37:21.458+0000 7fa7b7add640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.764 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: dump: 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.765 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: dump: 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.766 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:37:21.458+0000 7fa696ffd640 4 set_mon_vals no callback set 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 1 librados: init done 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cr dump hook 0x55d7dbf08128 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:37:21.460+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.767 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:37:21.460+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa680077260 auth_method 0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:37:21.461+0000 7fa7b82de640 10 monclient: get_auth_request con 0x55d7dbf260b0 auth_method 0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 realm 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:37:21.462+0000 7fa7b7add640 10 monclient: get_auth_request con 0x55d7dbf2a2a0 auth_method 0 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.768 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 searching for the correct realm 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:37:21.463+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x55d7dbf2f500 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:37:21.464+0000 7fa7b82de640 10 monclient: get_auth_request con 0x7fa7a0084410 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:37:21.464+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7b006f720 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa7a8074070 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa7a8074070 msgr2=0x7fa7a803c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:37:21.465+0000 7fa6957fa640 1 client.6281.objecter ms_handle_reset 0x7fa7a8074070 session 0x7fa7a8012070 osd.4 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:37:21.465+0000 7fa6957fa640 10 monclient: _renew_subs 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:37:21.465+0000 7fa6957fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa680087160 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:37:21.467+0000 7fa7b82de640 10 monclient: get_auth_request con 0x7fa7a0094040 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:37:21.469+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7a00a3450 auth_method 0 2024-09-14T11:37:21.769 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:37:21.469+0000 7fa7b7add640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa7a00a3450 msgr2=0x7fa7a00a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:37:21.671+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7a00a3450 auth_method 0 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.770 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zone default found 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Realm: () 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zonegroup default 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.771 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started sync module instance, tier type = 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=0 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=1 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=2 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=3 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=4 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=5 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=6 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:37:21.687+0000 7fa7bbd2e800 20 add_watcher() i=7 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:37:21.687+0000 7fa7bbd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.772 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:37:21.689+0000 7fa66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.773 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache list hook 0x55d7dbf046b0 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache inspect hook 0x55d7dbf046b0 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache erase hook 0x55d7dbf046b0 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache zap hook 0x55d7dbf046b0 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 note: GC not initialized 2024-09-14T11:37:21.774 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:37:21.689+0000 7fa66cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace show hook 0x7fa7a0004aa0 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace history hook 0x7fa7a0004aa0 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace active hook 0x7fa7a0004aa0 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace active_short hook 0x7fa7a0004aa0 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 Filter name: none 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:37:21.690+0000 7fa5e67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : miss 2024-09-14T11:37:21.775 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:37:21.696+0000 7fa7bbd2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7bbd2e800 time 2024-09-14T11:37:21.696238+0000 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7bd58c76a] 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.776 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:37:21.697+0000 7fa7bbd2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa7bbd2e800 thread_name:radosgw-admin 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bc23e6f0] 2024-09-14T11:37:21.777 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7bc28b99c] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7bd58c7c4] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.778 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:37:21.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:37:21.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:21.785 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa5e67fc640 / http_manager 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa66cfe1640 / http_manager 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa66dfe3640 / rgw_dt_lg_renew 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa6957fa640 / ms_dispatch 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa696ffd640 / io_context_pool 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa69d7fa640 / ms_dispatch 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa69ffff640 / ms_dispatch 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa6a5e0b640 / io_context_pool 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7af2dc640 / msgr-worker-2 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b7add640 / msgr-worker-1 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b82de640 / msgr-worker-0 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b8adf640 / io_context_pool 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7bbd2e800 / radosgw-admin 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.98991.log 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:37:21.442+0000 7fa7b82de640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:37:21.442+0000 7fa7b82de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: dump: 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.787 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.788 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:37:21.443+0000 7fa6a5e0b640 10 monclient: dump: 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6747 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.789 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 4 set_mon_vals no callback set 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: shutdown 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) unregister_commands rotate-key 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:37:21.443+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding auth protocol: cephx 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.791 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: crc 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe412a0) adding con mode: secure 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: starting msgr at 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: starting objecter 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests hook 0x55d7dbe42d30 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: setting wanted keys 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 1 librados: calling monclient init 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.792 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding auth protocol: cephx 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: crc 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe3b780) adding con mode: secure 2024-09-14T11:37:21.793 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key hook 0x55d7dbe3b8c8 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbcade70 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbced910 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbd81240 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:37:21.444+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.050972s 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbcade70 auth_method 0 2024-09-14T11:37:21.794 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbced910 auth_method 0 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:37:21.445+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbd81240 auth_method 0 2024-09-14T11:37:21.795 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:37:21.445+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:37:21.445+0000 7fa7b7add640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:37:21.445+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: dump: 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.796 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.797 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:37:21.445+0000 7fa69ffff640 10 monclient: dump: 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6272 2024-09-14T11:37:21.798 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:37:21.445+0000 7fa6a5e0b640 4 set_mon_vals no callback set 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:37:21.445+0000 7fa7bbd2e800 1 librados: init done 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:37:21.447+0000 7fa69ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:37:21.447+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa6a0077230 auth_method 0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:37:21.447+0000 7fa7b82de640 10 monclient: get_auth_request con 0x55d7dbe64830 auth_method 0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:37:21.448+0000 7fa7b7add640 10 monclient: get_auth_request con 0x55d7dbe87730 auth_method 0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:37:21.449+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x55d7dbe8c7c0 auth_method 0 2024-09-14T11:37:21.799 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.800 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding auth protocol: cephx 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.801 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: crc 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe90740) adding con mode: secure 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests cmddesc objecter_requests hook 0x55d7dbe93c30 EEXIST 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding auth protocol: cephx 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.802 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: crc 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:37:21.450+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbe8f6f8) adding con mode: secure 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x55d7dbe8f840 EEXIST 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbeb7f50 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.803 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbeb8330 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbeb6c60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:37:21.451+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.057501s 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbeb7f50 auth_method 0 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbeb6c60 auth_method 0 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.804 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:37:21.451+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbeb8330 auth_method 0 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:37:21.451+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient(hunting): handle_auth_done global_id 6753 payload 824 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.805 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:37:21.451+0000 7fa7b82de640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:37:21.451+0000 7fa7b82de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: dump: 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.806 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:37:21.452+0000 7fa69d7fa640 10 monclient: dump: 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.807 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6753 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:37:21.452+0000 7fa7b8adf640 4 set_mon_vals no callback set 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:37:21.452+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.808 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:37:21.454+0000 7fa69d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:37:21.454+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa690077140 auth_method 0 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.809 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding auth protocol: cephx 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.810 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: crc 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbed7c20) adding con mode: secure 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:37:21.454+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding auth protocol: cephx 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.811 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: crc 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57cc30) adding con mode: secure 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x7ffefe57cd78 EEXIST 2024-09-14T11:37:21.812 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbf0c1e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbefcb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbf07610 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:37:21.455+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.061608s 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbf0c1e0 auth_method 0 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbefcb30 auth_method 0 2024-09-14T11:37:21.813 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:37:21.455+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbf07610 auth_method 0 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.814 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:37:21.455+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6756 payload 274 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:37:21.455+0000 7fa7b7add640 1 monclient: found mon.noname-a 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:37:21.455+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: dump: 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.815 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:37:21.456+0000 7fa696ffd640 10 monclient: dump: 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.816 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6756 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 4 set_mon_vals no callback set 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: shutdown 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: build_initial_monmap 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 1 build_initial for_mkfs: 0 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 10 monclient: monmap: 2024-09-14T11:37:21.817 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding auth protocol: cephx 2024-09-14T11:37:21.818 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: crc 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:37:21.456+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbedb740) adding con mode: secure 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.819 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: starting msgr at 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: starting objecter 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command objecter_requests cmddesc objecter_requests hook 0x55d7dbeb9da0 EEXIST 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: setting wanted keys 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 1 librados: calling monclient init 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: init 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding auth protocol: cephx 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.820 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: crc 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 AuthRegistry(0x55d7dbecc810) adding con mode: secure 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command rotate-key cmddesc rotate-key hook 0x55d7dbecc958 EEXIST 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:37:21.821 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-c con 0x55d7dbefcb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-b con 0x55d7dbf07610 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): picked mon.noname-a con 0x55d7dbf0c1e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:37:21.457+0000 7fa7bbd2e800 10 monclient(hunting): authenticate will time out at 2039.063805s 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): get_auth_request con 0x55d7dbefcb30 auth_method 0 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): get_auth_request con 0x55d7dbf0c1e0 auth_method 0 2024-09-14T11:37:21.822 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:37:21.457+0000 7fa7b7add640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:37:21.457+0000 7fa7b82de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request con 0x55d7dbf07610 auth_method 0 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:37:21.457+0000 7fa7af2dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:21.823 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:37:21.458+0000 7fa7af2dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient: _finish_hunting 0 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:37:21.458+0000 7fa7b7add640 1 monclient: found mon.noname-c 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:37:21.458+0000 7fa7b7add640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: dump: 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.824 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:21.825 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:37:21.458+0000 7fa6957fa640 10 monclient: dump: 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:37:21.458+0000 7fa696ffd640 4 set_mon_vals no callback set 2024-09-14T11:37:21.826 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _renew_subs 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 1 librados: init done 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:37:21.458+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cr dump hook 0x55d7dbf08128 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:37:21.460+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:37:21.460+0000 7fa6957fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:37:21.460+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa680077260 auth_method 0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:37:21.461+0000 7fa7b82de640 10 monclient: get_auth_request con 0x55d7dbf260b0 auth_method 0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 realm 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.827 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:37:21.461+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:37:21.462+0000 7fa7b7add640 10 monclient: get_auth_request con 0x55d7dbf2a2a0 auth_method 0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:37:21.462+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:37:21.463+0000 7fa7bbd2e800 20 searching for the correct realm 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:37:21.463+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x55d7dbf2f500 auth_method 0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:37:21.464+0000 7fa7b82de640 10 monclient: get_auth_request con 0x7fa7a0084410 auth_method 0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:37:21.464+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7b006f720 auth_method 0 2024-09-14T11:37:21.828 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa7a8074070 auth_method 0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa7a8074070 msgr2=0x7fa7a803c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:37:21.465+0000 7fa6957fa640 1 client.6281.objecter ms_handle_reset 0x7fa7a8074070 session 0x7fa7a8012070 osd.4 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:37:21.465+0000 7fa6957fa640 10 monclient: _renew_subs 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:37:21.465+0000 7fa6957fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:37:21.465+0000 7fa7af2dc640 10 monclient: get_auth_request con 0x7fa680087160 auth_method 0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:37:21.467+0000 7fa7b82de640 10 monclient: get_auth_request con 0x7fa7a0094040 auth_method 0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:37:21.469+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7a00a3450 auth_method 0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:37:21.469+0000 7fa7b7add640 0 -- 172.21.15.116:0/3098107603 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa7a00a3450 msgr2=0x7fa7a00a38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:37:21.671+0000 7fa7b7add640 10 monclient: get_auth_request con 0x7fa7a00a3450 auth_method 0 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.829 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:37:21.676+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zone default found 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Realm: () 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 zonegroup default 2024-09-14T11:37:21.830 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:37:21.677+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started sync module instance, tier type = 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:37:21.678+0000 7fa7bbd2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=0 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=1 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=2 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=3 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=4 2024-09-14T11:37:21.831 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=5 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:37:21.686+0000 7fa7bbd2e800 20 add_watcher() i=6 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:37:21.687+0000 7fa7bbd2e800 20 add_watcher() i=7 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:37:21.687+0000 7fa7bbd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding auth protocol: cephx 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.832 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:37:21.689+0000 7fa66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: crc 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 AuthRegistry(0x7ffefe57d110) adding con mode: secure 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache list hook 0x55d7dbf046b0 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache inspect hook 0x55d7dbf046b0 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache erase hook 0x55d7dbf046b0 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command cache zap hook 0x55d7dbf046b0 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 note: GC not initialized 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:37:21.689+0000 7fa66cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.833 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace show hook 0x7fa7a0004aa0 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace history hook 0x7fa7a0004aa0 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace active hook 0x7fa7a0004aa0 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 5 asok(0x55d7dbc19270) register_command sync trace active_short hook 0x7fa7a0004aa0 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:37:21.689+0000 7fa7bbd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 Filter name: none 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:37:21.690+0000 7fa5e67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : miss 2024-09-14T11:37:21.834 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:37:21.690+0000 7fa7bbd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:37:21.691+0000 7fa7bbd2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:37:21.696+0000 7fa7bbd2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7bbd2e800 time 2024-09-14T11:37:21.696238+0000 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7bd58c76a] 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.835 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:37:21.697+0000 7fa7bbd2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa7bbd2e800 thread_name:radosgw-admin 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7bc23e6f0] 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7bc28b99c] 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:21.836 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7bd58c7c4] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa7bd58c928] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d7d9fa90b1] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd88418) [0x55d7da4bc418] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d7d9fb8efd] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa7bc229590] 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:37:21.837 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:37:21.838 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:37:21.839 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:21.840 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:37:21.841 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:21.842 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:37:21.843 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa5e67fc640 / http_manager 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa66cfe1640 / http_manager 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa66dfe3640 / rgw_dt_lg_renew 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa6957fa640 / ms_dispatch 2024-09-14T11:37:21.844 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa696ffd640 / io_context_pool 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa69d7fa640 / ms_dispatch 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa69ffff640 / ms_dispatch 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa6a5e0b640 / io_context_pool 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7af2dc640 / msgr-worker-2 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b7add640 / msgr-worker-1 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b82de640 / msgr-worker-0 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7b8adf640 / io_context_pool 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa7bbd2e800 / radosgw-admin 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:21.697935Z_6049e360-3f31-4608-b83a-ae1cc0ff53c5/log 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:37:21.845 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:37:21.850 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.850 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.773+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 realm 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.775+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.776+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.776+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.776+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.776+0000 7f793d523800 20 searching for the correct realm 2024-09-14T11:37:21.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.780+0000 7f79399af640 0 -- 172.21.15.116:0/4123470042 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x559861741680 msgr2=0x559861743ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.782+0000 7f79309ad640 0 -- 172.21.15.116:0/4123470042 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f792c08f900 msgr2=0x7f792c03b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.786+0000 7f793d523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 zone default found 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 4 Realm: () 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 zonegroup default 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.787+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.788+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.788+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.788+0000 7f793d523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.788+0000 7f793d523800 20 started sync module instance, tier type = 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.788+0000 7f793d523800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=0 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=1 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=2 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=3 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=4 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=5 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.796+0000 7f793d523800 20 add_watcher() i=6 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.797+0000 7f793d523800 20 add_watcher() i=7 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.797+0000 7f793d523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f77ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f793d523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f793d523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f793d523800 5 note: GC not initialized 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f77ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.799+0000 7f793d523800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.800+0000 7f793d523800 20 Filter name: none 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.800+0000 7f775ffff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.800+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.800+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.800+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.801+0000 7f793d523800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.803+0000 7f77ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.805+0000 7f793d523800 20 remove_watcher() i=0 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.805+0000 7f793d523800 2 removed watcher, disabling cache 2024-09-14T11:37:21.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.806+0000 7f793d523800 20 remove_watcher() i=1 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.806+0000 7f793d523800 20 remove_watcher() i=2 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.807+0000 7f793d523800 20 remove_watcher() i=3 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.808+0000 7f793d523800 20 remove_watcher() i=4 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.809+0000 7f793d523800 20 remove_watcher() i=5 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.810+0000 7f793d523800 20 remove_watcher() i=6 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.811+0000 7f793d523800 20 remove_watcher() i=7 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:21.857 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:21.858 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:21.909 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:21.942 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.942 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.980+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 realm 2024-09-14T11:37:21.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.982+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.983+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.983+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.983+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.983+0000 7f770bb25800 20 searching for the correct realm 2024-09-14T11:37:21.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.987+0000 7f7706fb4640 0 -- 172.21.15.116:0/1001807726 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x563b975ed000 msgr2=0x563b975ef4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.990+0000 7f77077b5640 0 -- 172.21.15.116:0/1001807726 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f76f007b440 msgr2=0x7f76f007b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:21.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.994+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 zone default found 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 4 Realm: () 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 zonegroup default 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 started sync module instance, tier type = 2024-09-14T11:37:21.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:21.995+0000 7f770bb25800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=0 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=1 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=2 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=3 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=4 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.004+0000 7f770bb25800 20 add_watcher() i=5 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.005+0000 7f770bb25800 20 add_watcher() i=6 2024-09-14T11:37:22.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.005+0000 7f770bb25800 20 add_watcher() i=7 2024-09-14T11:37:22.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.005+0000 7f770bb25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.007+0000 7f75bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.007+0000 7f770bb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.007+0000 7f770bb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.007+0000 7f770bb25800 5 note: GC not initialized 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f75bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 20 Filter name: none 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f75367fc640 20 reqs_thread_entry: start 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:37:22.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : miss 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.008+0000 7f770bb25800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.009+0000 7f770bb25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:22.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.010+0000 7f770bb25800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to be held by another RGW process; skipping for now 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.011+0000 7f75bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.013+0000 7f770bb25800 20 remove_watcher() i=0 2024-09-14T11:37:22.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.013+0000 7f770bb25800 2 removed watcher, disabling cache 2024-09-14T11:37:22.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.013+0000 7f770bb25800 20 remove_watcher() i=1 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.015+0000 7f770bb25800 20 remove_watcher() i=2 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.016+0000 7f770bb25800 20 remove_watcher() i=3 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.017+0000 7f770bb25800 20 remove_watcher() i=4 2024-09-14T11:37:22.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.017+0000 7f770bb25800 20 remove_watcher() i=5 2024-09-14T11:37:22.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.018+0000 7f770bb25800 20 remove_watcher() i=6 2024-09-14T11:37:22.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:22.019+0000 7f770bb25800 20 remove_watcher() i=7 2024-09-14T11:37:22.027 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:37:52.052 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:52.087 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:52.087 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:52.129 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.131+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.130 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 realm 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.131 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.132+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.133+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:52.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.133+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.134+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:52.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.134+0000 7f12d0b2e800 20 searching for the correct realm 2024-09-14T11:37:52.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.138+0000 7f12ccf65640 0 -- 172.21.15.116:0/2681598479 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f12c0049920 msgr2=0x7f12c00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.346+0000 7f12cc764640 0 -- 172.21.15.116:0/2681598479 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x5555f59b9770 msgr2=0x5555f59bbb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:52.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.349+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 zone default found 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 4 Realm: () 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 zonegroup default 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.350+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.351+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.351+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.351+0000 7f12d0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.351+0000 7f12d0b2e800 20 started sync module instance, tier type = 2024-09-14T11:37:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.351+0000 7f12d0b2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:52.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=0 2024-09-14T11:37:52.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=1 2024-09-14T11:37:52.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=2 2024-09-14T11:37:52.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=3 2024-09-14T11:37:52.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=4 2024-09-14T11:37:52.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=5 2024-09-14T11:37:52.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.362+0000 7f12d0b2e800 20 add_watcher() i=6 2024-09-14T11:37:52.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.363+0000 7f12d0b2e800 20 add_watcher() i=7 2024-09-14T11:37:52.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.363+0000 7f12d0b2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:52.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.365+0000 7f1182fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:52.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f12d0b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:52.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f12d0b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:52.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f12d0b2e800 5 note: GC not initialized 2024-09-14T11:37:52.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f1181fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f12d0b2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f12d0b2e800 20 Filter name: none 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.366+0000 7f10f37fe640 20 reqs_thread_entry: start 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : miss 2024-09-14T11:37:52.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.367+0000 7f12d0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.368+0000 7f12d0b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:52.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.373+0000 7f12d0b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f12d0b2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f12d0b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f12d0b2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24, ofs0, ns] 2024-09-14T11:37:52.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f11a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 93827681240672 notifier 6332 bl.length()=925 2024-09-14T11:37:52.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f11a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f11a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.374+0000 7f11a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.376+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_sources= new_sources= 2024-09-14T11:37:52.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.376+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential sources added=[] removed=[] 2024-09-14T11:37:52.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.376+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_dests= new_dests= 2024-09-14T11:37:52.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.376+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential dests added=[] removed=[] 2024-09-14T11:37:52.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.0 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.0 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.1 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.1 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.2 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.2 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.3 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.3 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.4 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.4 2024-09-14T11:37:52.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.5 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.5 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.6 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.6 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.7 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.7 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.8 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.8 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.9 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.9 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.10 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.10 2024-09-14T11:37:52.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.11 2024-09-14T11:37:52.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1.11 2024-09-14T11:37:52.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.381+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.0 2024-09-14T11:37:52.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.382+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.382+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.2 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.383+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.3 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.383+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.4 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.384+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.5 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.384+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.6 2024-09-14T11:37:52.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.385+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.7 2024-09-14T11:37:52.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.385+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.8 2024-09-14T11:37:52.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.386+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.9 2024-09-14T11:37:52.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.386+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.10 2024-09-14T11:37:52.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.391+0000 7f12d0b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:52.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.391+0000 7f12d0b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.392+0000 7f12d0b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.392+0000 7f12d0b2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.392+0000 7f12d0b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.392+0000 7f12d0b2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24, ofs0, ns] 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.393+0000 7f11a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93827681240672 notifier 6332 bl.length()=925 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.393+0000 7f11a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.393+0000 7f11a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.393+0000 7f11a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.394+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_sources= new_sources= 2024-09-14T11:37:52.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.394+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential sources added=[] removed=[] 2024-09-14T11:37:52.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.394+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_dests= new_dests= 2024-09-14T11:37:52.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.394+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential dests added=[] removed=[] 2024-09-14T11:37:52.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.397+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.0 2024-09-14T11:37:52.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.397+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.1 2024-09-14T11:37:52.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.398+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.2 2024-09-14T11:37:52.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.398+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.3 2024-09-14T11:37:52.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.398+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.4 2024-09-14T11:37:52.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.399+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.5 2024-09-14T11:37:52.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.399+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.6 2024-09-14T11:37:52.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.400+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.7 2024-09-14T11:37:52.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.400+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.8 2024-09-14T11:37:52.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.400+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.9 2024-09-14T11:37:52.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.401+0000 7f12d0b2e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24.10 2024-09-14T11:37:52.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.401+0000 7f12d0b2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:52.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.401+0000 7f12d0b2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 2024-09-14T11:37:52.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f12d0b2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f12d0b2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f12d0b2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f12d0b2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24, ofs0, ns] 2024-09-14T11:37:52.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f11a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93827681240672 notifier 6332 bl.length()=893 2024-09-14T11:37:52.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f11a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 info.flags=0x17 2024-09-14T11:37:52.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f11a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 to cache LRU end 2024-09-14T11:37:52.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.403+0000 7f11a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:52.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.405+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_sources= new_sources= 2024-09-14T11:37:52.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.405+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential sources added=[] removed=[] 2024-09-14T11:37:52.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.405+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): orig_dests= new_dests= 2024-09-14T11:37:52.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.405+0000 7f12d0b2e800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24]): potential dests added=[] removed=[] 2024-09-14T11:37:52.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.407+0000 7f12d0b2e800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:52.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.409+0000 7f1182fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:52.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.411+0000 7f12d0b2e800 20 remove_watcher() i=0 2024-09-14T11:37:52.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.411+0000 7f12d0b2e800 2 removed watcher, disabling cache 2024-09-14T11:37:52.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.412+0000 7f12d0b2e800 20 remove_watcher() i=1 2024-09-14T11:37:52.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.414+0000 7f12d0b2e800 20 remove_watcher() i=2 2024-09-14T11:37:52.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.415+0000 7f12d0b2e800 20 remove_watcher() i=3 2024-09-14T11:37:52.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.416+0000 7f12d0b2e800 20 remove_watcher() i=4 2024-09-14T11:37:52.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.417+0000 7f12d0b2e800 20 remove_watcher() i=5 2024-09-14T11:37:52.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.418+0000 7f12d0b2e800 20 remove_watcher() i=6 2024-09-14T11:37:52.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.419+0000 7f12d0b2e800 20 remove_watcher() i=7 2024-09-14T11:37:52.430 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:37:52.460 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:52.460 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:52.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.499+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 realm 2024-09-14T11:37:52.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.501+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.502+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:52.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.502+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.503+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:52.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.503+0000 7ffb4521d800 20 searching for the correct realm 2024-09-14T11:37:52.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.507+0000 7ffb3bfff640 0 -- 172.21.15.116:0/23374756 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5577ef51f920 msgr2=0x5577ef521d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:52.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.510+0000 7ffb409eb640 0 -- 172.21.15.116:0/23374756 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ffb2c062940 msgr2=0x7ffb2c046910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:52.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:52.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:52.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:52.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:52.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.515+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:52.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 zone default found 2024-09-14T11:37:52.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 4 Realm: () 2024-09-14T11:37:52.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 zonegroup default 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.516+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.517+0000 7ffb4521d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.517+0000 7ffb4521d800 20 started sync module instance, tier type = 2024-09-14T11:37:52.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.517+0000 7ffb4521d800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:52.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=0 2024-09-14T11:37:52.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=1 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=2 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=3 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=4 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=5 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.525+0000 7ffb4521d800 20 add_watcher() i=6 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.526+0000 7ffb4521d800 20 add_watcher() i=7 2024-09-14T11:37:52.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.526+0000 7ffb4521d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:52.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ff9f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ffb4521d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ffb4521d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ffb4521d800 5 note: GC not initialized 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ff9f67e4640 20 reqs_thread_entry: start 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ffb4521d800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:52.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ffb4521d800 20 Filter name: none 2024-09-14T11:37:52.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.528+0000 7ff9effff640 20 reqs_thread_entry: start 2024-09-14T11:37:52.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.529+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.529+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:52.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.529+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:52.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:37:52.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.530+0000 7ffb4521d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:52.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.532+0000 7ff9f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:52.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.534+0000 7ffb4521d800 20 remove_watcher() i=0 2024-09-14T11:37:52.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.534+0000 7ffb4521d800 2 removed watcher, disabling cache 2024-09-14T11:37:52.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.535+0000 7ffb4521d800 20 remove_watcher() i=1 2024-09-14T11:37:52.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.536+0000 7ffb4521d800 20 remove_watcher() i=2 2024-09-14T11:37:52.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.537+0000 7ffb4521d800 20 remove_watcher() i=3 2024-09-14T11:37:52.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.538+0000 7ffb4521d800 20 remove_watcher() i=4 2024-09-14T11:37:52.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.539+0000 7ffb4521d800 20 remove_watcher() i=5 2024-09-14T11:37:52.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.540+0000 7ffb4521d800 20 remove_watcher() i=6 2024-09-14T11:37:52.538 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:52.540+0000 7ffb4521d800 20 remove_watcher() i=7 2024-09-14T11:37:52.549 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:52.549 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:52.549 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-set-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:52.549 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:52.916 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:37:52.916 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:53.708 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:37:53.736 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:53.736 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:53.772 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.774+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 20 realm 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.776+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.777+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.777+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.777+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.777+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.778+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.778+0000 7f524da10800 20 searching for the correct realm 2024-09-14T11:37:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.780+0000 7f52498cc640 0 -- 172.21.15.116:0/2452874089 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f523406cc20 msgr2=0x7f5234061dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.784+0000 7f52490cb640 0 -- 172.21.15.116:0/2452874089 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5234013030 msgr2=0x7f523406bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.989+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:53.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 zone default found 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 4 Realm: () 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 zonegroup default 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.990+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.991+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.991+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:53.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.991+0000 7f524da10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:53.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.991+0000 7f524da10800 20 started sync module instance, tier type = 2024-09-14T11:37:53.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:53.991+0000 7f524da10800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=0 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=1 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=2 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=3 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=4 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=5 2024-09-14T11:37:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.000+0000 7f524da10800 20 add_watcher() i=6 2024-09-14T11:37:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.001+0000 7f524da10800 20 add_watcher() i=7 2024-09-14T11:37:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.001+0000 7f524da10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.002+0000 7f50ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 5 note: GC not initialized 2024-09-14T11:37:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f50fe7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 20 Filter name: none 2024-09-14T11:37:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f506ffff640 20 reqs_thread_entry: start 2024-09-14T11:37:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.003+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.004+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.004+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.004+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.004+0000 7f524da10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.004+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.005+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.005+0000 7f524da10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.005+0000 7f524da10800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.005+0000 7f524da10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.007+0000 7f50ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.009+0000 7f524da10800 20 remove_watcher() i=0 2024-09-14T11:37:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.009+0000 7f524da10800 2 removed watcher, disabling cache 2024-09-14T11:37:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.010+0000 7f524da10800 20 remove_watcher() i=1 2024-09-14T11:37:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.011+0000 7f524da10800 20 remove_watcher() i=2 2024-09-14T11:37:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.012+0000 7f524da10800 20 remove_watcher() i=3 2024-09-14T11:37:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.013+0000 7f524da10800 20 remove_watcher() i=4 2024-09-14T11:37:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.014+0000 7f524da10800 20 remove_watcher() i=5 2024-09-14T11:37:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.014+0000 7f524da10800 20 remove_watcher() i=6 2024-09-14T11:37:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.015+0000 7f524da10800 20 remove_watcher() i=7 2024-09-14T11:37:54.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:54.023 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:54.023 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:54.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:37:54.059 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:54.059 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.098+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 20 realm 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.099+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.100+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.100+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.100+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.100+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.101+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.101+0000 7f6c05263800 20 searching for the correct realm 2024-09-14T11:37:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.102+0000 7f6c02d54640 0 -- 172.21.15.116:0/2403200695 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f6bfc069070 msgr2=0x7f6bfc0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.307+0000 7f6c03555640 0 -- 172.21.15.116:0/2403200695 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6bf8042040 msgr2=0x7f6bf801a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:54.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:54.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:54.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:54.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:54.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:54.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.312+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 zone default found 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 4 Realm: () 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:54.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 zonegroup default 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.313+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.314+0000 7f6c05263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.314+0000 7f6c05263800 20 started sync module instance, tier type = 2024-09-14T11:37:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.314+0000 7f6c05263800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=0 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=1 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=2 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=3 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=4 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=5 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.322+0000 7f6c05263800 20 add_watcher() i=6 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.323+0000 7f6c05263800 20 add_watcher() i=7 2024-09-14T11:37:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.323+0000 7f6c05263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.325+0000 7f6ab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 5 note: GC not initialized 2024-09-14T11:37:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6a33fff640 20 reqs_thread_entry: start 2024-09-14T11:37:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 20 Filter name: none 2024-09-14T11:37:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6a31ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:37:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.326+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 : miss 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.327+0000 7f6c05263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.331+0000 7f6c05263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.331+0000 7f6c05263800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.331+0000 7f6c05263800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.332+0000 7f6c05263800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25, ofs0, ns] 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.332+0000 7f6ae5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94314585428496 notifier 6383 bl.length()=939 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.332+0000 7f6ae5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.332+0000 7f6ae5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.332+0000 7f6ae5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:54.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_sources= new_sources= 2024-09-14T11:37:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential sources added=[] removed=[] 2024-09-14T11:37:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_dests= new_dests= 2024-09-14T11:37:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential dests added=[] removed=[] 2024-09-14T11:37:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:37:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.333+0000 7f6c05263800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:37:54.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.335+0000 7f6ab97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.337+0000 7f6c05263800 20 remove_watcher() i=0 2024-09-14T11:37:54.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.337+0000 7f6c05263800 2 removed watcher, disabling cache 2024-09-14T11:37:54.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.338+0000 7f6c05263800 20 remove_watcher() i=1 2024-09-14T11:37:54.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.339+0000 7f6c05263800 20 remove_watcher() i=2 2024-09-14T11:37:54.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.340+0000 7f6c05263800 20 remove_watcher() i=3 2024-09-14T11:37:54.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.341+0000 7f6c05263800 20 remove_watcher() i=4 2024-09-14T11:37:54.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.342+0000 7f6c05263800 20 remove_watcher() i=5 2024-09-14T11:37:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.343+0000 7f6c05263800 20 remove_watcher() i=6 2024-09-14T11:37:54.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.344+0000 7f6c05263800 20 remove_watcher() i=7 2024-09-14T11:37:54.353 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:37:54.382 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:54.382 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:54.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.420+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.421+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.421+0000 7f14cf32c800 20 realm 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.421+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.422+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.423+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:54.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.423+0000 7f14cf32c800 20 searching for the correct realm 2024-09-14T11:37:54.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.425+0000 7f14cb850640 0 -- 172.21.15.116:0/243920291 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f14c0020060 msgr2=0x7f14c006ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.428+0000 7f14cb04f640 0 -- 172.21.15.116:0/243920291 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f14c0098b70 msgr2=0x7f14c009a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.635+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 zone default found 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 4 Realm: () 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 zonegroup default 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 started sync module instance, tier type = 2024-09-14T11:37:54.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.636+0000 7f14cf32c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=0 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=1 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=2 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=3 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=4 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=5 2024-09-14T11:37:54.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.647+0000 7f14cf32c800 20 add_watcher() i=6 2024-09-14T11:37:54.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.648+0000 7f14cf32c800 20 add_watcher() i=7 2024-09-14T11:37:54.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.648+0000 7f14cf32c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:54.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.649+0000 7f1381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.649+0000 7f14cf32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.649+0000 7f14cf32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.649+0000 7f14cf32c800 5 note: GC not initialized 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f1380fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f14cf32c800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f14cf32c800 20 Filter name: none 2024-09-14T11:37:54.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f12fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:54.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.650+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.651+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.651+0000 7f14cf32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.651+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.651+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.651+0000 7f14cf32c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.652+0000 7f14cf32c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:54.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.652+0000 7f14cf32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:54.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.653+0000 7f1381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:54.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.655+0000 7f14cf32c800 20 remove_watcher() i=0 2024-09-14T11:37:54.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.655+0000 7f14cf32c800 2 removed watcher, disabling cache 2024-09-14T11:37:54.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.656+0000 7f14cf32c800 20 remove_watcher() i=1 2024-09-14T11:37:54.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.657+0000 7f14cf32c800 20 remove_watcher() i=2 2024-09-14T11:37:54.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.658+0000 7f14cf32c800 20 remove_watcher() i=3 2024-09-14T11:37:54.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.659+0000 7f14cf32c800 20 remove_watcher() i=4 2024-09-14T11:37:54.658 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.660+0000 7f14cf32c800 20 remove_watcher() i=5 2024-09-14T11:37:54.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.661+0000 7f14cf32c800 20 remove_watcher() i=6 2024-09-14T11:37:54.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.662+0000 7f14cf32c800 20 remove_watcher() i=7 2024-09-14T11:37:54.670 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:54.670 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:54.670 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:54.670 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:54.761 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:54.793 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:54.793 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:54.831 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.833+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 realm 2024-09-14T11:37:54.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.833 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.835+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.836+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.836+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:54.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.836+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:54.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.837+0000 7f4f63f40800 20 searching for the correct realm 2024-09-14T11:37:54.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.839+0000 7f4f57fff640 0 -- 172.21.15.116:0/1844384949 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f4f50047030 msgr2=0x7f4f5003e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:54.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:54.843+0000 7f4f5fc86640 0 -- 172.21.15.116:0/1844384949 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f4f480a2220 msgr2=0x7f4f4809a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.048+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 zone default found 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 4 Realm: () 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 zonegroup default 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.049+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 started sync module instance, tier type = 2024-09-14T11:37:55.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.050+0000 7f4f63f40800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:55.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=0 2024-09-14T11:37:55.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=1 2024-09-14T11:37:55.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=2 2024-09-14T11:37:55.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=3 2024-09-14T11:37:55.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=4 2024-09-14T11:37:55.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=5 2024-09-14T11:37:55.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.059+0000 7f4f63f40800 20 add_watcher() i=6 2024-09-14T11:37:55.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.060+0000 7f4f63f40800 20 add_watcher() i=7 2024-09-14T11:37:55.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.060+0000 7f4f63f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:55.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.061+0000 7f4e157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:55.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:55.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 5 note: GC not initialized 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4d8ffff640 20 reqs_thread_entry: start 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 20 Filter name: none 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4d8dffb640 20 reqs_thread_entry: start 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:37:55.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.062+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 : miss 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:55.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.063+0000 7f4f63f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 2024-09-14T11:37:55.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.064+0000 7f4f63f40800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:37:55.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.074+0000 7f4f63f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.074+0000 7f4f63f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.074+0000 7f4f63f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.074+0000 7f4f63f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25, ofs0, ns] 2024-09-14T11:37:55.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.075+0000 7f4e427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94223937837712 notifier 6416 bl.length()=939 2024-09-14T11:37:55.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.075+0000 7f4e427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.075+0000 7f4e427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.075+0000 7f4e427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.076+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_sources= new_sources= 2024-09-14T11:37:55.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.076+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential sources added=[] removed=[] 2024-09-14T11:37:55.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.076+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_dests= new_dests= 2024-09-14T11:37:55.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.076+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential dests added=[] removed=[] 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.0 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.0 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.1 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.1 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.2 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.2 2024-09-14T11:37:55.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.3 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.3 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.4 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.4 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.5 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.5 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.6 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.6 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.7 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.7 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.8 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.8 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.9 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.9 2024-09-14T11:37:55.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.10 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.10 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.11 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2.11 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.081+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.0 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.082+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.1 2024-09-14T11:37:55.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.082+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2 2024-09-14T11:37:55.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.083+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.3 2024-09-14T11:37:55.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.083+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.4 2024-09-14T11:37:55.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.084+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.5 2024-09-14T11:37:55.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.084+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.6 2024-09-14T11:37:55.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.084+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.7 2024-09-14T11:37:55.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.085+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.8 2024-09-14T11:37:55.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.085+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.9 2024-09-14T11:37:55.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.086+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.10 2024-09-14T11:37:55.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.089+0000 7f4f63f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:55.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.089+0000 7f4f63f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4f63f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4f63f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4f63f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4f63f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25, ofs0, ns] 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4e41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94223937837712 notifier 6416 bl.length()=939 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4e41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4e41ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.090+0000 7f4e41ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.092+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_sources= new_sources= 2024-09-14T11:37:55.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.092+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential sources added=[] removed=[] 2024-09-14T11:37:55.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.092+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_dests= new_dests= 2024-09-14T11:37:55.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.092+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential dests added=[] removed=[] 2024-09-14T11:37:55.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.094+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.0 2024-09-14T11:37:55.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.095+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.1 2024-09-14T11:37:55.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.095+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.2 2024-09-14T11:37:55.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.095+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.3 2024-09-14T11:37:55.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.096+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.4 2024-09-14T11:37:55.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.096+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.5 2024-09-14T11:37:55.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.096+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.6 2024-09-14T11:37:55.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.096+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.7 2024-09-14T11:37:55.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.097+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.8 2024-09-14T11:37:55.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.097+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.9 2024-09-14T11:37:55.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.097+0000 7f4f63f40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25.10 2024-09-14T11:37:55.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.098+0000 7f4f63f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:55.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.098+0000 7f4f63f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4f63f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4f63f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4f63f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4f63f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25, ofs0, ns] 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4e41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94223937837712 notifier 6416 bl.length()=907 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4e41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 info.flags=0x17 2024-09-14T11:37:55.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4e41ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 to cache LRU end 2024-09-14T11:37:55.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.099+0000 7f4e41ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:55.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.101+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_sources= new_sources= 2024-09-14T11:37:55.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.101+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential sources added=[] removed=[] 2024-09-14T11:37:55.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.101+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): orig_dests= new_dests= 2024-09-14T11:37:55.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.101+0000 7f4f63f40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25]): potential dests added=[] removed=[] 2024-09-14T11:37:55.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.103+0000 7f4f63f40800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:55.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.105+0000 7f4e157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.107+0000 7f4f63f40800 20 remove_watcher() i=0 2024-09-14T11:37:55.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.107+0000 7f4f63f40800 2 removed watcher, disabling cache 2024-09-14T11:37:55.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.108+0000 7f4f63f40800 20 remove_watcher() i=1 2024-09-14T11:37:55.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.109+0000 7f4f63f40800 20 remove_watcher() i=2 2024-09-14T11:37:55.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.110+0000 7f4f63f40800 20 remove_watcher() i=3 2024-09-14T11:37:55.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.111+0000 7f4f63f40800 20 remove_watcher() i=4 2024-09-14T11:37:55.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.112+0000 7f4f63f40800 20 remove_watcher() i=5 2024-09-14T11:37:55.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.113+0000 7f4f63f40800 20 remove_watcher() i=6 2024-09-14T11:37:55.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.114+0000 7f4f63f40800 20 remove_watcher() i=7 2024-09-14T11:37:55.124 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:37:55.152 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:55.153 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:55.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.191+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.192+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.192+0000 7f6ceb612800 20 realm 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.192+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.193+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.193+0000 7f6ceb612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.193+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.193+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.193+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.194+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.194+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.194+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:55.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.194+0000 7f6ceb612800 20 searching for the correct realm 2024-09-14T11:37:55.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.197+0000 7f6ce75e1640 0 -- 172.21.15.116:0/323524331 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6cdc03a040 msgr2=0x7f6cdc0772b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:55.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.200+0000 7f6ce6de0640 0 -- 172.21.15.116:0/323524331 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6cdc008070 msgr2=0x7f6cdc06f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:55.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:55.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:55.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:55.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:55.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:55.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:55.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.405+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 zone default found 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 4 Realm: () 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 zonegroup default 2024-09-14T11:37:55.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.406+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.407+0000 7f6ceb612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.407+0000 7f6ceb612800 20 started sync module instance, tier type = 2024-09-14T11:37:55.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.407+0000 7f6ceb612800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=0 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=1 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=2 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=3 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=4 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=5 2024-09-14T11:37:55.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.416+0000 7f6ceb612800 20 add_watcher() i=6 2024-09-14T11:37:55.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.417+0000 7f6ceb612800 20 add_watcher() i=7 2024-09-14T11:37:55.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.417+0000 7f6ceb612800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:55.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.418+0000 7f6b9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:55.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:55.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 5 note: GC not initialized 2024-09-14T11:37:55.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6b17fff640 20 reqs_thread_entry: start 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 20 Filter name: none 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6b15ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.419+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:55.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.420+0000 7f6ceb612800 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.421+0000 7f6ceb612800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:55.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.421+0000 7f6ceb612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:55.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.423+0000 7f6b9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:55.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.424+0000 7f6ceb612800 20 remove_watcher() i=0 2024-09-14T11:37:55.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.424+0000 7f6ceb612800 2 removed watcher, disabling cache 2024-09-14T11:37:55.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.425+0000 7f6ceb612800 20 remove_watcher() i=1 2024-09-14T11:37:55.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.426+0000 7f6ceb612800 20 remove_watcher() i=2 2024-09-14T11:37:55.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.427+0000 7f6ceb612800 20 remove_watcher() i=3 2024-09-14T11:37:55.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.429+0000 7f6ceb612800 20 remove_watcher() i=4 2024-09-14T11:37:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.430+0000 7f6ceb612800 20 remove_watcher() i=5 2024-09-14T11:37:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.430+0000 7f6ceb612800 20 remove_watcher() i=6 2024-09-14T11:37:55.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:55.431+0000 7f6ceb612800 20 remove_watcher() i=7 2024-09-14T11:37:55.439 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:55.439 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:55.440 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:55.440 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:55.831 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:37:55.831 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:56.661 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:37:56.690 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:56.690 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:56.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.729+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.730+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.730+0000 7feb88b46800 20 realm 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.730+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.731+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.731+0000 7feb88b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.731+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.731+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.731+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.732+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.732+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.732+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:56.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.732+0000 7feb88b46800 20 searching for the correct realm 2024-09-14T11:37:56.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.734+0000 7feb86637640 0 -- 172.21.15.116:0/1169965094 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7feb80067040 msgr2=0x7feb800a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:56.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.939+0000 7feb86e38640 0 -- 172.21.15.116:0/1169965094 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7feb7007a030 msgr2=0x7feb70061060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:56.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.944+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 zone default found 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 4 Realm: () 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 zonegroup default 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.945+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.946+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.946+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.946+0000 7feb88b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.946+0000 7feb88b46800 20 started sync module instance, tier type = 2024-09-14T11:37:56.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.946+0000 7feb88b46800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:56.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=0 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=1 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=2 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=3 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=4 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=5 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.954+0000 7feb88b46800 20 add_watcher() i=6 2024-09-14T11:37:56.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.955+0000 7feb88b46800 20 add_watcher() i=7 2024-09-14T11:37:56.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.955+0000 7feb88b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7fea3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7feb88b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7feb88b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7feb88b46800 5 note: GC not initialized 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7fe9b77fe640 20 reqs_thread_entry: start 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7feb88b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7feb88b46800 20 Filter name: none 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.957+0000 7fe9b57fa640 20 reqs_thread_entry: start 2024-09-14T11:37:56.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.958+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.958+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:56.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.958+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:56.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:56.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:56.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:56.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.959+0000 7feb88b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:56.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.961+0000 7fea3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.963+0000 7feb88b46800 20 remove_watcher() i=0 2024-09-14T11:37:56.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.963+0000 7feb88b46800 2 removed watcher, disabling cache 2024-09-14T11:37:56.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.964+0000 7feb88b46800 20 remove_watcher() i=1 2024-09-14T11:37:56.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.965+0000 7feb88b46800 20 remove_watcher() i=2 2024-09-14T11:37:56.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.966+0000 7feb88b46800 20 remove_watcher() i=3 2024-09-14T11:37:56.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.967+0000 7feb88b46800 20 remove_watcher() i=4 2024-09-14T11:37:56.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.968+0000 7feb88b46800 20 remove_watcher() i=5 2024-09-14T11:37:56.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.969+0000 7feb88b46800 20 remove_watcher() i=6 2024-09-14T11:37:56.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:56.969+0000 7feb88b46800 20 remove_watcher() i=7 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:56.977 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:56.978 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:56.979 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:37:57.019 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.019 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:57.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.064+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 20 realm 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.066+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.067+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.067+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.067+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.067+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.068+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:57.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.068+0000 7f86d6e63800 20 searching for the correct realm 2024-09-14T11:37:57.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.072+0000 7f86d5155640 0 -- 172.21.15.116:0/2683339728 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f86c004b950 msgr2=0x7f86c004a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.277+0000 7f86d5155640 0 -- 172.21.15.116:0/2683339728 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f86c004b950 msgr2=0x7f86c004a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:57.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:57.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.280+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:57.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 zone default found 2024-09-14T11:37:57.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 4 Realm: () 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 zonegroup default 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.281+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.282+0000 7f86d6e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.282+0000 7f86d6e63800 20 started sync module instance, tier type = 2024-09-14T11:37:57.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.282+0000 7f86d6e63800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:57.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=0 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=1 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=2 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=3 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=4 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=5 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.290+0000 7f86d6e63800 20 add_watcher() i=6 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.291+0000 7f86d6e63800 20 add_watcher() i=7 2024-09-14T11:37:57.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.291+0000 7f86d6e63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:57.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.294+0000 7f858b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.294+0000 7f86d6e63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.294+0000 7f86d6e63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 5 note: GC not initialized 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f858a7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:57.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 20 Filter name: none 2024-09-14T11:37:57.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f85837fe640 20 reqs_thread_entry: start 2024-09-14T11:37:57.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:37:57.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 : miss 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.295+0000 7f86d6e63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 info.flags=0x17 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 to cache LRU end 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:57.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.296+0000 7f86d6e63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 2024-09-14T11:37:57.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f86d6e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 info.flags=0x17 2024-09-14T11:37:57.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f86d6e63800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 to cache LRU end 2024-09-14T11:37:57.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f86d6e63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:57.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f86d6e63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26, ofs0, ns] 2024-09-14T11:37:57.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f85ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94528762111984 notifier 6969 bl.length()=939 2024-09-14T11:37:57.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f85ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 info.flags=0x17 2024-09-14T11:37:57.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f85ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 to cache LRU end 2024-09-14T11:37:57.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.301+0000 7f85ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): orig_sources= new_sources= 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): potential sources added=[] removed=[] 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): orig_dests= new_dests= 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): potential dests added=[] removed=[] 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:37:57.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.303+0000 7f86d6e63800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.0 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.0 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.1 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.1 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.2 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.2 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.3 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.3 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.4 2024-09-14T11:37:57.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.4 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.5 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.5 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.6 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.6 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.7 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.7 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.8 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.8 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.9 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.9 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.10 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.10 2024-09-14T11:37:57.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.11 2024-09-14T11:37:57.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1.11 2024-09-14T11:37:57.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.305+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.0 2024-09-14T11:37:57.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.306+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.1 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.306+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.2 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.307+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.3 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.307+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.4 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.308+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.5 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.308+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.6 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.309+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.7 2024-09-14T11:37:57.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.309+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.8 2024-09-14T11:37:57.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.310+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.9 2024-09-14T11:37:57.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.310+0000 7f86d6e63800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26.10 2024-09-14T11:37:57.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.313+0000 7f86d6e63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:57.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.313+0000 7f86d6e63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.314+0000 7f86d6e63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 info.flags=0x17 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.314+0000 7f86d6e63800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 to cache LRU end 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.314+0000 7f86d6e63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.314+0000 7f86d6e63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26, ofs0, ns] 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.315+0000 7f85ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 94528762111984 notifier 6969 bl.length()=907 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.315+0000 7f85ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 info.flags=0x17 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.315+0000 7f85ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 to cache LRU end 2024-09-14T11:37:57.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.315+0000 7f85ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:57.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.317+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): orig_sources= new_sources= 2024-09-14T11:37:57.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.317+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): potential sources added=[] removed=[] 2024-09-14T11:37:57.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.317+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): orig_dests= new_dests= 2024-09-14T11:37:57.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.317+0000 7f86d6e63800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26]): potential dests added=[] removed=[] 2024-09-14T11:37:57.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.319+0000 7f86d6e63800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:57.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.321+0000 7f858b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.323+0000 7f86d6e63800 20 remove_watcher() i=0 2024-09-14T11:37:57.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.323+0000 7f86d6e63800 2 removed watcher, disabling cache 2024-09-14T11:37:57.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.324+0000 7f86d6e63800 20 remove_watcher() i=1 2024-09-14T11:37:57.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.325+0000 7f86d6e63800 20 remove_watcher() i=2 2024-09-14T11:37:57.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.326+0000 7f86d6e63800 20 remove_watcher() i=3 2024-09-14T11:37:57.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.327+0000 7f86d6e63800 20 remove_watcher() i=4 2024-09-14T11:37:57.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.328+0000 7f86d6e63800 20 remove_watcher() i=5 2024-09-14T11:37:57.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.329+0000 7f86d6e63800 20 remove_watcher() i=6 2024-09-14T11:37:57.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.330+0000 7f86d6e63800 20 remove_watcher() i=7 2024-09-14T11:37:57.341 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:37:57.372 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.372 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:57.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.414+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 realm 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:57.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.416+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.417+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.417+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.417+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:57.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.417+0000 7f910b72e800 20 searching for the correct realm 2024-09-14T11:37:57.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.420+0000 7f9106cdc640 0 -- 172.21.15.116:0/286108297 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f90f806c070 msgr2=0x7f90f80b93b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.424+0000 7f91074dd640 0 -- 172.21.15.116:0/286108297 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f90fc00adb0 msgr2=0x7f90fc03c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.630+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 zone default found 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 4 Realm: () 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 zonegroup default 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.631+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.632+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.632+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.632+0000 7f910b72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.632+0000 7f910b72e800 20 started sync module instance, tier type = 2024-09-14T11:37:57.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.632+0000 7f910b72e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=0 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=1 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=2 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=3 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=4 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=5 2024-09-14T11:37:57.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.641+0000 7f910b72e800 20 add_watcher() i=6 2024-09-14T11:37:57.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.642+0000 7f910b72e800 20 add_watcher() i=7 2024-09-14T11:37:57.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.642+0000 7f910b72e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.643+0000 7f8fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 5 note: GC not initialized 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f8fbcfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 20 Filter name: none 2024-09-14T11:37:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f8f367fc640 20 reqs_thread_entry: start 2024-09-14T11:37:57.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.644+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:57.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.645+0000 7f910b72e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.646+0000 7f910b72e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:57.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.646+0000 7f910b72e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:57.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.647+0000 7f8fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.649+0000 7f910b72e800 20 remove_watcher() i=0 2024-09-14T11:37:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.649+0000 7f910b72e800 2 removed watcher, disabling cache 2024-09-14T11:37:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.650+0000 7f910b72e800 20 remove_watcher() i=1 2024-09-14T11:37:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.652+0000 7f910b72e800 20 remove_watcher() i=2 2024-09-14T11:37:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.653+0000 7f910b72e800 20 remove_watcher() i=3 2024-09-14T11:37:57.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.654+0000 7f910b72e800 20 remove_watcher() i=4 2024-09-14T11:37:57.652 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.655+0000 7f910b72e800 20 remove_watcher() i=5 2024-09-14T11:37:57.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.655+0000 7f910b72e800 20 remove_watcher() i=6 2024-09-14T11:37:57.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:57.656+0000 7f910b72e800 20 remove_watcher() i=7 2024-09-14T11:37:57.665 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:57.665 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:57.665 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:37:57.665 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:58.037 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:37:58.037 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:58.837 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:37:58.866 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:58.866 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:58.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.905+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.906+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.906+0000 7fa6b7925800 20 realm 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.906+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.907+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.907+0000 7fa6b7925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.907+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.907+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.907+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.908+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.908+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.908+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.908+0000 7fa6b7925800 20 searching for the correct realm 2024-09-14T11:37:58.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.911+0000 7fa6b3daf640 0 -- 172.21.15.116:0/3475464057 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa69c072600 msgr2=0x7fa69c067e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.914+0000 7fa6b35ae640 0 -- 172.21.15.116:0/3475464057 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa69c067580 msgr2=0x7fa69c08c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.918+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 zone default found 2024-09-14T11:37:58.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 4 Realm: () 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 zonegroup default 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.919+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.920+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.920+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.920+0000 7fa6b7925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.920+0000 7fa6b7925800 20 started sync module instance, tier type = 2024-09-14T11:37:58.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.920+0000 7fa6b7925800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=0 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=1 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=2 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=3 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=4 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=5 2024-09-14T11:37:58.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.929+0000 7fa6b7925800 20 add_watcher() i=6 2024-09-14T11:37:58.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.930+0000 7fa6b7925800 20 add_watcher() i=7 2024-09-14T11:37:58.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.930+0000 7fa6b7925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.931+0000 7fa569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 5 note: GC not initialized 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa568fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 20 Filter name: none 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa4e27fc640 20 reqs_thread_entry: start 2024-09-14T11:37:58.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.932+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.933+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:58.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.933+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.933+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:58.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.933+0000 7fa6b7925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:58.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.933+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.934+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:58.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.934+0000 7fa6b7925800 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.934+0000 7fa6b7925800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:58.932 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.934+0000 7fa6b7925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:58.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.936+0000 7fa569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.938+0000 7fa6b7925800 20 remove_watcher() i=0 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.938+0000 7fa6b7925800 2 removed watcher, disabling cache 2024-09-14T11:37:58.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.939+0000 7fa6b7925800 20 remove_watcher() i=1 2024-09-14T11:37:58.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.940+0000 7fa6b7925800 20 remove_watcher() i=2 2024-09-14T11:37:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.940+0000 7fa6b7925800 20 remove_watcher() i=3 2024-09-14T11:37:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.941+0000 7fa6b7925800 20 remove_watcher() i=4 2024-09-14T11:37:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.942+0000 7fa6b7925800 20 remove_watcher() i=5 2024-09-14T11:37:58.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.943+0000 7fa6b7925800 20 remove_watcher() i=6 2024-09-14T11:37:58.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:58.944+0000 7fa6b7925800 20 remove_watcher() i=7 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:58.952 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:37:58.987 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:58.988 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:59.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.027+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.028+0000 7fb5df734800 20 realm 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.029+0000 7fb5df734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.030+0000 7fb5df734800 20 searching for the correct realm 2024-09-14T11:37:59.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.033+0000 7fb5dbcb8640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x561a96eef190 msgr2=0x561a96ef15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.036+0000 7fb5dacb6640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fb5cc073a30 msgr2=0x7fb5cc073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:59.038 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 zone default found 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 4 Realm: () 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 zonegroup default 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.042+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.042+0000 7fb5df734800 20 started sync module instance, tier type = 2024-09-14T11:37:59.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.042+0000 7fb5df734800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=0 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=1 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=2 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=3 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=4 2024-09-14T11:37:59.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=5 2024-09-14T11:37:59.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=6 2024-09-14T11:37:59.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.051+0000 7fb5df734800 20 add_watcher() i=7 2024-09-14T11:37:59.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.051+0000 7fb5df734800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.052+0000 7fb491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 5 note: GC not initialized 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb490fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 20 Filter name: none 2024-09-14T11:37:59.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb40a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:37:59.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.053+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : miss 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.054+0000 7fb5df734800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:37:59.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb5df734800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb5df734800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:37:59.057 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94672201445904 notifier 7026 bl.length()=939 2024-09-14T11:37:59.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5df734800 time 2024-09-14T11:37:59.062251+0000 2024-09-14T11:37:59.059 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb5e0f8c76a] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:59.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.062+0000 7fb5df734800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5df734800 time 2024-09-14T11:37:59.062251+0000 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb5e0f8c76a] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.061 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:59.062 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:59.062 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.062 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:59.062 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fb5df734800 thread_name:radosgw-admin 2024-09-14T11:37:59.081 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb5dfc3e6f0] 2024-09-14T11:37:59.081 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb5dfc8b99c] 2024-09-14T11:37:59.081 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:59.081 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb5e0f8c7c4] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.063+0000 7fb5df734800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fb5df734800 thread_name:radosgw-admin 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb5dfc3e6f0] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb5dfc8b99c] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb5e0f8c7c4] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.083 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: dump: 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.084 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: dump: 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.085 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:37:59.009+0000 7fb5df734800 5 monclient: authenticate success, global_id 6503 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:37:59.009+0000 7fb5df734800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:37:59.009+0000 7fb5df734800 4 set_mon_vals no callback set 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: shutdown 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 asok(0x561a96be4270) unregister_commands rotate-key 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.086 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.087 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:37:59.010+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 librados: starting msgr at 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 librados: starting objecter 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests hook 0x561a96e2e0c0 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:37:59.011+0000 7fb5df734800 1 librados: setting wanted keys 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:37:59.011+0000 7fb5df734800 1 librados: calling monclient init 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.088 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:37:59.011+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:37:59.011+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key hook 0x561a96e03208 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:59.089 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96cafdf0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96cb05d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96cbc4c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.617657s 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96cafdf0 auth_method 0 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96cbc4c0 auth_method 0 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.090 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96cb05d0 auth_method 0 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_done global_id 6506 payload 824 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 1 monclient: found mon.noname-c 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.091 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: dump: 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.092 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:37:59.012+0000 7fb5df734800 5 monclient: authenticate success, global_id 6506 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: dump: 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.093 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:37:59.012+0000 7fb4c960a640 4 set_mon_vals no callback set 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:37:59.012+0000 7fb5df734800 1 librados: init done 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:37:59.014+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb4c0077260 auth_method 0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:37:59.014+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96e38130 auth_method 0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:37:59.015+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x561a96e4fc60 auth_method 0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:37:59.016+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96e54cf0 auth_method 0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:37:59.017+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:37:59.017+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.094 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:37:59.017+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.095 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:37:59.017+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests cmddesc objecter_requests hook 0x561a96e5c0d0 EEXIST 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.096 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:37:59.018+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.097 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:37:59.018+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x561a96e57d50 EEXIST 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96e803f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96e807d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96e7f100 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.624628s 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96e803f0 auth_method 0 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.098 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96e807d0 auth_method 0 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_done global_id 7020 payload 824 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.099 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: dump: 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.100 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: dump: 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:37:59.019+0000 7fb5df734800 5 monclient: authenticate success, global_id 7020 2024-09-14T11:37:59.101 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:37:59.019+0000 7fb5dc4b9640 4 set_mon_vals no callback set 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:37:59.021+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x7fb4b4077140 auth_method 0 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: get_monmap_and_config 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:37:59.021+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.102 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.103 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:37:59.021+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.104 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:37:59.022+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:37:59.022+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x7ffe4865f928 EEXIST 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96ed4900 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.105 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96ec5250 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96ecfd30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.628510s 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96ec5250 auth_method 0 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96ecfd30 auth_method 0 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.106 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_done global_id 7023 payload 274 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: dump: 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.107 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: dump: 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.108 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 monclient: authenticate success, global_id 7023 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:37:59.023+0000 7fb5df734800 4 set_mon_vals no callback set 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: shutdown 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:37:59.023+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.109 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.110 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: starting msgr at 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: starting objecter 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests cmddesc objecter_requests hook 0x561a96ea60a0 EEXIST 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: setting wanted keys 2024-09-14T11:37:59.111 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: calling monclient init 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.112 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x561a96e94df8 EEXIST 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96ec5250 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96ecfd30 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96ed4900 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.630853s 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96ecfd30 auth_method 0 2024-09-14T11:37:59.113 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96ed4900 auth_method 0 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96ec5250 auth_method 0 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.114 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: dump: 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.115 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: dump: 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.116 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:37:59.025+0000 7fb5df734800 5 monclient: authenticate success, global_id 7026 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:37:59.025+0000 7fb4beffd640 4 set_mon_vals no callback set 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:37:59.025+0000 7fb5df734800 1 librados: init done 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:37:59.025+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cr dump hook 0x561a96eca728 2024-09-14T11:37:59.117 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:37:59.027+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:37:59.028+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb4a4077260 auth_method 0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:37:59.028+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x561a96eef190 auth_method 0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 realm 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:37:59.029+0000 7fb5df734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:37:59.029+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x561a96ef3360 auth_method 0 2024-09-14T11:37:59.118 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 searching for the correct realm 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:37:59.030+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96ef85c0 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:37:59.031+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb5d006c380 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:37:59.031+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb5d40ae040 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:37:59.032+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x7fb5cc073a30 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:37:59.033+0000 7fb5dbcb8640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x561a96eef190 msgr2=0x561a96ef15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 1 client.7026.objecter ms_handle_reset 0x561a96eef190 session 0x561a96eeeb10 osd.1 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 10 monclient: _renew_subs 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:37:59.033+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb4a4087160 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:37:59.034+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb5d0075570 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:37:59.036+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb5d008fb90 auth_method 0 2024-09-14T11:37:59.119 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:37:59.036+0000 7fb5dacb6640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fb5cc073a30 msgr2=0x7fb5cc073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:37:59.036+0000 7fb4bd7fa640 1 client.7026.objecter ms_handle_reset 0x7fb5cc073a30 session 0x7fb5cc0a0bc0 osd.4 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:37:59.037+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96eef190 auth_method 0 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.120 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 zone default found 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 Realm: () 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:37:59.041+0000 7fb5df734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 zonegroup default 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 started sync module instance, tier type = 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=0 2024-09-14T11:37:59.121 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=1 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=2 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=3 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=4 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=5 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=6 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:37:59.051+0000 7fb5df734800 20 add_watcher() i=7 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:37:59.051+0000 7fb5df734800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.122 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:37:59.052+0000 7fb491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:37:59.053+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache list hook 0x561a96ec9490 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache inspect hook 0x561a96ec9490 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache erase hook 0x561a96ec9490 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache zap hook 0x561a96ec9490 2024-09-14T11:37:59.123 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 note: GC not initialized 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:37:59.053+0000 7fb490fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace show hook 0x7fb5d0004300 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace history hook 0x7fb5d0004300 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace active hook 0x7fb5d0004300 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace active_short hook 0x7fb5d0004300 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 Filter name: none 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:37:59.053+0000 7fb40a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:37:59.053+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:59.124 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : miss 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94672201445904 notifier 7026 bl.length()=939 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.125 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:37:59.062+0000 7fb5df734800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5df734800 time 2024-09-14T11:37:59.062251+0000 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb5e0f8c76a] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.126 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:37:59.063+0000 7fb5df734800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fb5df734800 thread_name:radosgw-admin 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb5dfc3e6f0] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb5dfc8b99c] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb5e0f8c7c4] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.127 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:37:59.128 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:59.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:37:59.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:37:59.131 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:59.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:37:59.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb40a7fc640 / http_manager 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb490fe1640 / http_manager 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb491fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4bd7fa640 / ms_dispatch 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4beffd640 / io_context_pool 2024-09-14T11:37:59.134 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c5602640 / ms_dispatch 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c7e07640 / ms_dispatch 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c960a640 / io_context_pool 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dacb6640 / msgr-worker-2 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5db4b7640 / msgr-worker-1 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dbcb8640 / msgr-worker-0 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dc4b9640 / io_context_pool 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5df734800 / radosgw-admin 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.107237.log 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:59.135 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: dump: 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.136 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:37:59.009+0000 7fb4c960a640 10 monclient: dump: 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:37:59.009+0000 7fb5df734800 5 monclient: authenticate success, global_id 6503 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:37:59.009+0000 7fb5df734800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:37:59.009+0000 7fb5df734800 4 set_mon_vals no callback set 2024-09-14T11:37:59.137 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: shutdown 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 asok(0x561a96be4270) unregister_commands rotate-key 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:37:59.010+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.138 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding auth protocol: cephx 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: crc 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:37:59.010+0000 7fb5df734800 5 AuthRegistry(0x561a96e08c90) adding con mode: secure 2024-09-14T11:37:59.139 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:37:59.010+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 librados: starting msgr at 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:37:59.010+0000 7fb5df734800 1 librados: starting objecter 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests hook 0x561a96e2e0c0 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:37:59.011+0000 7fb5df734800 1 librados: setting wanted keys 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:37:59.011+0000 7fb5df734800 1 librados: calling monclient init 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding auth protocol: cephx 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.140 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: crc 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 AuthRegistry(0x561a96e030c0) adding con mode: secure 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:37:59.011+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:37:59.011+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:37:59.011+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key hook 0x561a96e03208 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:59.141 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96cafdf0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96cb05d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96cbc4c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:37:59.011+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.617657s 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96cafdf0 auth_method 0 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96cbc4c0 auth_method 0 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.142 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:37:59.011+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96cb05d0 auth_method 0 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:37:59.011+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_done global_id 6506 payload 824 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 1 monclient: found mon.noname-c 2024-09-14T11:37:59.143 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:37:59.011+0000 7fb5dbcb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: dump: 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.144 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:37:59.012+0000 7fb5df734800 5 monclient: authenticate success, global_id 6506 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:37:59.012+0000 7fb4c7e07640 10 monclient: dump: 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.145 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:37:59.012+0000 7fb4c960a640 4 set_mon_vals no callback set 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:37:59.012+0000 7fb5df734800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:37:59.012+0000 7fb5df734800 1 librados: init done 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:37:59.014+0000 7fb4c7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:37:59.014+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb4c0077260 auth_method 0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:37:59.014+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96e38130 auth_method 0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:37:59.015+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x561a96e4fc60 auth_method 0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:37:59.016+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96e54cf0 auth_method 0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:37:59.017+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:37:59.017+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.146 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:37:59.017+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding auth protocol: cephx 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.147 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: crc 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:37:59.017+0000 7fb5df734800 5 AuthRegistry(0x561a96e58c00) adding con mode: secure 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:37:59.017+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests cmddesc objecter_requests hook 0x561a96e5c0d0 EEXIST 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.148 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding auth protocol: cephx 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: crc 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 AuthRegistry(0x561a96e57c08) adding con mode: secure 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:37:59.018+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.149 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:37:59.018+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:37:59.018+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x561a96e57d50 EEXIST 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96e803f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96e807d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96e7f100 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:37:59.018+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.624628s 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96e803f0 auth_method 0 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.150 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96e807d0 auth_method 0 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:37:59.018+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_done global_id 7020 payload 824 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:37:59.018+0000 7fb5db4b7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.151 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: dump: 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.152 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:37:59.019+0000 7fb4c5602640 10 monclient: dump: 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:37:59.019+0000 7fb5df734800 5 monclient: authenticate success, global_id 7020 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.153 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:37:59.019+0000 7fb5dc4b9640 4 set_mon_vals no callback set 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:37:59.019+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:37:59.021+0000 7fb4c5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:37:59.021+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x7fb4b4077140 auth_method 0 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: get_monmap_and_config 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:37:59.021+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.154 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding auth protocol: cephx 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.155 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: crc 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:37:59.021+0000 7fb5df734800 5 AuthRegistry(0x561a96ea0340) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:37:59.021+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:37:59.021+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding auth protocol: cephx 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.156 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: crc 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865f7e0) adding con mode: secure 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:37:59.022+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:37:59.022+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:37:59.022+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x7ffe4865f928 EEXIST 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96ed4900 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96ec5250 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96ecfd30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.157 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:37:59.022+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.628510s 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96ec5250 auth_method 0 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96ecfd30 auth_method 0 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.158 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:37:59.022+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_done global_id 7023 payload 274 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:37:59.022+0000 7fb5dacb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: dump: 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.159 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:37:59.023+0000 7fb4beffd640 10 monclient: dump: 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.160 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 monclient: authenticate success, global_id 7023 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: get_monmap_and_config success 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:37:59.023+0000 7fb5df734800 4 set_mon_vals no callback set 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: shutdown 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: build_initial_monmap 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:37:59.023+0000 7fb5df734800 1 build_initial for_mkfs: 0 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:37:59.023+0000 7fb5df734800 10 monclient: monmap: 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:37:59.161 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding auth protocol: cephx 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.162 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: crc 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:37:59.023+0000 7fb5df734800 5 AuthRegistry(0x561a96ea3e60) adding con mode: secure 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: starting msgr at 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: starting objecter 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 asok(0x561a96be4270) register_command objecter_requests cmddesc objecter_requests hook 0x561a96ea60a0 EEXIST 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: setting wanted keys 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:37:59.024+0000 7fb5df734800 1 librados: calling monclient init 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: init 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.163 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding auth protocol: cephx 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: crc 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 AuthRegistry(0x561a96e94cb0) adding con mode: secure 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:37:59.024+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.164 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:37:59.024+0000 7fb5df734800 5 asok(0x561a96be4270) register_command rotate-key cmddesc rotate-key hook 0x561a96e94df8 EEXIST 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: _reopen_session rank -1 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-b con 0x561a96ec5250 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-a con 0x561a96ecfd30 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): picked mon.noname-c con 0x561a96ed4900 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): _renew_subs 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:37:59.024+0000 7fb5df734800 10 monclient(hunting): authenticate will time out at 2076.630853s 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request con 0x561a96ecfd30 auth_method 0 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:37:59.024+0000 7fb5dacb6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request con 0x561a96ed4900 auth_method 0 2024-09-14T11:37:59.165 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:37:59.024+0000 7fb5dbcb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request con 0x561a96ec5250 auth_method 0 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:37:59.025+0000 7fb5dbcb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:59.166 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:37:59.025+0000 7fb5db4b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient: _finish_hunting 0 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 1 monclient: found mon.noname-a 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:37:59.025+0000 7fb5dacb6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: dump: 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.167 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:37:59.025+0000 7fb4bd7fa640 10 monclient: dump: 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:37:59.168 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:37:59.025+0000 7fb5df734800 5 monclient: authenticate success, global_id 7026 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:37:59.025+0000 7fb4beffd640 4 set_mon_vals no callback set 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _renew_subs 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:37:59.025+0000 7fb5df734800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:37:59.025+0000 7fb5df734800 1 librados: init done 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:37:59.025+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cr dump hook 0x561a96eca728 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:37:59.027+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:37:59.028+0000 7fb4bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:37:59.169 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:37:59.028+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb4a4077260 auth_method 0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:37:59.028+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x561a96eef190 auth_method 0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 realm 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:37:59.028+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:37:59.029+0000 7fb5df734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:37:59.029+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:37:59.029+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x561a96ef3360 auth_method 0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:37:59.030+0000 7fb5df734800 20 searching for the correct realm 2024-09-14T11:37:59.170 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:37:59.030+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96ef85c0 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:37:59.031+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb5d006c380 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:37:59.031+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb5d40ae040 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:37:59.032+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x7fb5cc073a30 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:37:59.033+0000 7fb5dbcb8640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x561a96eef190 msgr2=0x561a96ef15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 1 client.7026.objecter ms_handle_reset 0x561a96eef190 session 0x561a96eeeb10 osd.1 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 10 monclient: _renew_subs 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:37:59.033+0000 7fb4bd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:37:59.033+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb4a4087160 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:37:59.034+0000 7fb5dbcb8640 10 monclient: get_auth_request con 0x7fb5d0075570 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:37:59.036+0000 7fb5db4b7640 10 monclient: get_auth_request con 0x7fb5d008fb90 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:37:59.036+0000 7fb5dacb6640 0 -- 172.21.15.116:0/2699336718 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fb5cc073a30 msgr2=0x7fb5cc073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:37:59.036+0000 7fb4bd7fa640 1 client.7026.objecter ms_handle_reset 0x7fb5cc073a30 session 0x7fb5cc0a0bc0 osd.4 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:37:59.037+0000 7fb5dacb6640 10 monclient: get_auth_request con 0x561a96eef190 auth_method 0 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:59.171 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:37:59.040+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 zone default found 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 Realm: () 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:37:59.041+0000 7fb5df734800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:37:59.041+0000 7fb5df734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.172 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 zonegroup default 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:37:59.041+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 started sync module instance, tier type = 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:37:59.042+0000 7fb5df734800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=0 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=1 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=2 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=3 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=4 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=5 2024-09-14T11:37:59.173 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:37:59.050+0000 7fb5df734800 20 add_watcher() i=6 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:37:59.051+0000 7fb5df734800 20 add_watcher() i=7 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:37:59.051+0000 7fb5df734800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding auth protocol: cephx 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.174 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: crc 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:37:59.052+0000 7fb5df734800 5 AuthRegistry(0x7ffe4865fcc0) adding con mode: secure 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:37:59.052+0000 7fb491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:37:59.053+0000 7fb5df734800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache list hook 0x561a96ec9490 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache inspect hook 0x561a96ec9490 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache erase hook 0x561a96ec9490 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command cache zap hook 0x561a96ec9490 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 note: GC not initialized 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:37:59.053+0000 7fb490fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace show hook 0x7fb5d0004300 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace history hook 0x7fb5d0004300 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace active hook 0x7fb5d0004300 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:37:59.053+0000 7fb5df734800 5 asok(0x561a96be4270) register_command sync trace active_short hook 0x7fb5d0004300 2024-09-14T11:37:59.175 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 Filter name: none 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:37:59.053+0000 7fb40a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:37:59.053+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:37:59.053+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : miss 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:37:59.054+0000 7fb5df734800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.176 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:37:59.054+0000 7fb5df734800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:37:59.059+0000 7fb5df734800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94672201445904 notifier 7026 bl.length()=939 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:37:59.059+0000 7fb4beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:37:59.061+0000 7fb5df734800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:37:59.062+0000 7fb5df734800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5df734800 time 2024-09-14T11:37:59.062251+0000 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:59.177 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb5e0f8c76a] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:37:59.063+0000 7fb5df734800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fb5df734800 thread_name:radosgw-admin 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.178 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb5dfc3e6f0] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb5dfc8b99c] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb5e0f8c7c4] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb5e0f8c928] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561a95c890b1] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8900e) [0x561a9619d00e] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561a95c98efd] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb5dfc29590] 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.179 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:37:59.180 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:37:59.181 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:59.182 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:37:59.183 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:59.184 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb40a7fc640 / http_manager 2024-09-14T11:37:59.185 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb490fe1640 / http_manager 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb491fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4bd7fa640 / ms_dispatch 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4beffd640 / io_context_pool 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c5602640 / ms_dispatch 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c7e07640 / ms_dispatch 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb4c960a640 / io_context_pool 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dacb6640 / msgr-worker-2 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5db4b7640 / msgr-worker-1 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dbcb8640 / msgr-worker-0 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5dc4b9640 / io_context_pool 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: 7fb5df734800 / radosgw-admin 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:59.063956Z_a530cad2-50a5-4957-ac94-7e4dcabba22f/log 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:37:59.186 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.137+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.138+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.138+0000 7f8f21840800 20 realm 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.138+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.139+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.139+0000 7f8f21840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.139+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.139+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.139+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.140+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.140+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.140+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.140+0000 7f8f21840800 20 searching for the correct realm 2024-09-14T11:37:59.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.144+0000 7f8f1fb2b640 0 -- 172.21.15.116:0/1883172306 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f8f0803d260 msgr2=0x7f8f08043bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.350+0000 7f8f1f32a640 0 -- 172.21.15.116:0/1883172306 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x558c369ed030 msgr2=0x558c369ef4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.352+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 zone default found 2024-09-14T11:37:59.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 4 Realm: () 2024-09-14T11:37:59.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:59.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 zonegroup default 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.353+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.354+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.354+0000 7f8f21840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.354+0000 7f8f21840800 20 started sync module instance, tier type = 2024-09-14T11:37:59.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.354+0000 7f8f21840800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:59.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=0 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=1 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=2 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=3 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=4 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=5 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.362+0000 7f8f21840800 20 add_watcher() i=6 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.363+0000 7f8f21840800 20 add_watcher() i=7 2024-09-14T11:37:59.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.363+0000 7f8f21840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.365+0000 7f8dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 5 note: GC not initialized 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8dd4fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 20 Filter name: none 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8d4e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.366+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.367+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.367+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.367+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.367+0000 7f8f21840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.367+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.368+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.368+0000 7f8f21840800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.368+0000 7f8f21840800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:59.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.368+0000 7f8f21840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:59.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.370+0000 7f8dd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.372+0000 7f8f21840800 20 remove_watcher() i=0 2024-09-14T11:37:59.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.372+0000 7f8f21840800 2 removed watcher, disabling cache 2024-09-14T11:37:59.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.373+0000 7f8f21840800 20 remove_watcher() i=1 2024-09-14T11:37:59.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.374+0000 7f8f21840800 20 remove_watcher() i=2 2024-09-14T11:37:59.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.375+0000 7f8f21840800 20 remove_watcher() i=3 2024-09-14T11:37:59.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.376+0000 7f8f21840800 20 remove_watcher() i=4 2024-09-14T11:37:59.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.377+0000 7f8f21840800 20 remove_watcher() i=5 2024-09-14T11:37:59.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.378+0000 7f8f21840800 20 remove_watcher() i=6 2024-09-14T11:37:59.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.379+0000 7f8f21840800 20 remove_watcher() i=7 2024-09-14T11:37:59.387 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.387 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:37:59.387 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:59.387 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:37:59.476 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:59.507 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:59.507 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:59.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.546+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 20 realm 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.547+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.548+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.548+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.549+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.549+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.549+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:59.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.549+0000 7f9bb1096800 20 searching for the correct realm 2024-09-14T11:37:59.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.552+0000 7f9bae37f640 0 -- 172.21.15.116:0/92888361 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x556fcfabb2d0 msgr2=0x556fcfabd790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.556+0000 7f9baeb80640 0 -- 172.21.15.116:0/92888361 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9b980c6b70 msgr2=0x7f9b9809f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 zone default found 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 4 Realm: () 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 zonegroup default 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.560+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:59.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 started sync module instance, tier type = 2024-09-14T11:37:59.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.561+0000 7f9bb1096800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:37:59.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=0 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=1 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=2 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=3 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=4 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=5 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.571+0000 7f9bb1096800 20 add_watcher() i=6 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.572+0000 7f9bb1096800 20 add_watcher() i=7 2024-09-14T11:37:59.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.572+0000 7f9bb1096800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:59.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9a657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9bb1096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9bb1096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9bb1096800 5 note: GC not initialized 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f99dffff640 20 reqs_thread_entry: start 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9bb1096800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.574+0000 7f9bb1096800 20 Filter name: none 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f99ddffb640 20 reqs_thread_entry: start 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:37:59.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : miss 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 20 rados->read ofs=0 len=0 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:37:59.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:59.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:59.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.575+0000 7f9bb1096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:37:59.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.577+0000 7f9bb1096800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to be held by another RGW process; skipping for now 2024-09-14T11:37:59.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.577+0000 7f9a657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:59.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.579+0000 7f9bb1096800 20 remove_watcher() i=0 2024-09-14T11:37:59.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.579+0000 7f9bb1096800 2 removed watcher, disabling cache 2024-09-14T11:37:59.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.580+0000 7f9bb1096800 20 remove_watcher() i=1 2024-09-14T11:37:59.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.582+0000 7f9bb1096800 20 remove_watcher() i=2 2024-09-14T11:37:59.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.583+0000 7f9bb1096800 20 remove_watcher() i=3 2024-09-14T11:37:59.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.584+0000 7f9bb1096800 20 remove_watcher() i=4 2024-09-14T11:37:59.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.585+0000 7f9bb1096800 20 remove_watcher() i=5 2024-09-14T11:37:59.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.587+0000 7f9bb1096800 20 remove_watcher() i=6 2024-09-14T11:37:59.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:37:59.588+0000 7f9bb1096800 20 remove_watcher() i=7 2024-09-14T11:37:59.596 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:38:29.623 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:29.658 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:29.658 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:29.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.702+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.703+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.703+0000 7f349d728800 20 realm 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.703+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.704+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.704+0000 7f349d728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.704+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.704+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.704+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.705+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.705+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.705+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.705+0000 7f349d728800 20 searching for the correct realm 2024-09-14T11:38:29.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.709+0000 7f3499c70640 0 -- 172.21.15.116:0/3735940906 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f348402d050 msgr2=0x7f348402d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.713+0000 7f349946f640 0 -- 172.21.15.116:0/3735940906 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f3484020960 msgr2=0x7f348402a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.920+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 zone default found 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 4 Realm: () 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 zonegroup default 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.921+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 started sync module instance, tier type = 2024-09-14T11:38:29.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.922+0000 7f349d728800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=0 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=1 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=2 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=3 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=4 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=5 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.937+0000 7f349d728800 20 add_watcher() i=6 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.938+0000 7f349d728800 20 add_watcher() i=7 2024-09-14T11:38:29.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.938+0000 7f349d728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.939+0000 7f334ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 5 note: GC not initialized 2024-09-14T11:38:29.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f334efe5640 20 reqs_thread_entry: start 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 20 Filter name: none 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f334cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:38:29.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.940+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : miss 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.941+0000 7f349d728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:38:29.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.943+0000 7f349d728800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.949+0000 7f349d728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.949+0000 7f349d728800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.949+0000 7f349d728800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.949+0000 7f349d728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.950+0000 7f336bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 93889493214496 notifier 7083 bl.length()=939 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.950+0000 7f336bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.950+0000 7f336bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.950+0000 7f336bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.951+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:38:29.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.951+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.951+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:38:29.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.951+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.0 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.0 2024-09-14T11:38:29.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.1 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.1 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.2 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.2 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.3 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.3 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.4 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.4 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.5 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.5 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.6 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.6 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.7 2024-09-14T11:38:29.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.7 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.8 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.8 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.9 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.9 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.10 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.10 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.11 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2.11 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.0 2024-09-14T11:38:29.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.956+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.1 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.957+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.957+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.3 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.958+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.4 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.959+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.5 2024-09-14T11:38:29.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.959+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.6 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.959+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.7 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.960+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.8 2024-09-14T11:38:29.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.961+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.9 2024-09-14T11:38:29.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.961+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.10 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.964+0000 7f349d728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:29.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.964+0000 7f349d728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f349d728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f349d728800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f349d728800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f349d728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f337cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 93889493214496 notifier 7083 bl.length()=939 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f337cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f337cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.966+0000 7f337cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.968+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.968+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.968+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:38:29.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.968+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.970+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.0 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.970+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.1 2024-09-14T11:38:29.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.970+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.2 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.971+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.3 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.971+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.4 2024-09-14T11:38:29.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.971+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.5 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.972+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.6 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.972+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.7 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.972+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.8 2024-09-14T11:38:29.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.973+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.9 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.973+0000 7f349d728800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27.10 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.973+0000 7f349d728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:29.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.973+0000 7f349d728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f349d728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f349d728800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f349d728800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f349d728800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27, ofs0, ns] 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f337cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 93889493214496 notifier 7083 bl.length()=907 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f337cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 info.flags=0x17 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f337cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 to cache LRU end 2024-09-14T11:38:29.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.975+0000 7f337cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.976+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_sources= new_sources= 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.976+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential sources added=[] removed=[] 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.976+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): orig_dests= new_dests= 2024-09-14T11:38:29.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.976+0000 7f349d728800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27]): potential dests added=[] removed=[] 2024-09-14T11:38:29.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.978+0000 7f349d728800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:29.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.980+0000 7f334ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.982+0000 7f349d728800 20 remove_watcher() i=0 2024-09-14T11:38:29.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.982+0000 7f349d728800 2 removed watcher, disabling cache 2024-09-14T11:38:29.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.983+0000 7f349d728800 20 remove_watcher() i=1 2024-09-14T11:38:29.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.984+0000 7f349d728800 20 remove_watcher() i=2 2024-09-14T11:38:29.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.985+0000 7f349d728800 20 remove_watcher() i=3 2024-09-14T11:38:29.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.987+0000 7f349d728800 20 remove_watcher() i=4 2024-09-14T11:38:29.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.987+0000 7f349d728800 20 remove_watcher() i=5 2024-09-14T11:38:29.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.988+0000 7f349d728800 20 remove_watcher() i=6 2024-09-14T11:38:29.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:29.989+0000 7f349d728800 20 remove_watcher() i=7 2024-09-14T11:38:30.000 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.029 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.067+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 realm 2024-09-14T11:38:30.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.069+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.070+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.070+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.070+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.070+0000 7fa56ea63800 20 searching for the correct realm 2024-09-14T11:38:30.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.073+0000 7fa56cd55640 0 -- 172.21.15.116:0/1833127859 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa55401f060 msgr2=0x7fa55405fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:30.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.077+0000 7fa56c554640 0 -- 172.21.15.116:0/1833127859 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa55406a460 msgr2=0x7fa554065380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.684+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 zone default found 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 4 Realm: () 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 zonegroup default 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.685+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 started sync module instance, tier type = 2024-09-14T11:38:30.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.686+0000 7fa56ea63800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=0 2024-09-14T11:38:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=1 2024-09-14T11:38:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=2 2024-09-14T11:38:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=3 2024-09-14T11:38:30.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=4 2024-09-14T11:38:30.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=5 2024-09-14T11:38:30.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.696+0000 7fa56ea63800 20 add_watcher() i=6 2024-09-14T11:38:30.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.697+0000 7fa56ea63800 20 add_watcher() i=7 2024-09-14T11:38:30.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.697+0000 7fa56ea63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.699+0000 7fa422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 5 note: GC not initialized 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa421fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 20 Filter name: none 2024-09-14T11:38:30.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa3937fe640 20 reqs_thread_entry: start 2024-09-14T11:38:30.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.700+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.701+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:38:30.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.701+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.701+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:38:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.701+0000 7fa56ea63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.701+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.702+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:38:30.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.702+0000 7fa56ea63800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.702+0000 7fa56ea63800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:38:30.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.702+0000 7fa56ea63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:30.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.704+0000 7fa422fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.706+0000 7fa56ea63800 20 remove_watcher() i=0 2024-09-14T11:38:30.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.707+0000 7fa56ea63800 2 removed watcher, disabling cache 2024-09-14T11:38:30.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.708+0000 7fa56ea63800 20 remove_watcher() i=1 2024-09-14T11:38:30.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.709+0000 7fa56ea63800 20 remove_watcher() i=2 2024-09-14T11:38:30.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.710+0000 7fa56ea63800 20 remove_watcher() i=3 2024-09-14T11:38:30.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.711+0000 7fa56ea63800 20 remove_watcher() i=4 2024-09-14T11:38:30.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.712+0000 7fa56ea63800 20 remove_watcher() i=5 2024-09-14T11:38:30.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.713+0000 7fa56ea63800 20 remove_watcher() i=6 2024-09-14T11:38:30.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:30.714+0000 7fa56ea63800 20 remove_watcher() i=7 2024-09-14T11:38:30.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:30.723 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:30.723 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-trim-reshard-log-entries id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:30.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:31.088 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:38:31.088 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:31.893 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:38:31.921 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.921 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.959+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 realm 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.961+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.962+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.962+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.963+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.963+0000 7fe4e2e10800 20 searching for the correct realm 2024-09-14T11:38:31.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.966+0000 7fe4dedbd640 0 -- 172.21.15.116:0/3939348034 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fe4c808c040 msgr2=0x7fe4c8099410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:31.969+0000 7fe4de5bc640 0 -- 172.21.15.116:0/3939348034 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe4c808b410 msgr2=0x7fe4c808b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.175+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 zone default found 2024-09-14T11:38:32.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 4 Realm: () 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 zonegroup default 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.176+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.177+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.177+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.177+0000 7fe4e2e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.177+0000 7fe4e2e10800 20 started sync module instance, tier type = 2024-09-14T11:38:32.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.177+0000 7fe4e2e10800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=0 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=1 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=2 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=3 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=4 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=5 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.186+0000 7fe4e2e10800 20 add_watcher() i=6 2024-09-14T11:38:32.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.187+0000 7fe4e2e10800 20 add_watcher() i=7 2024-09-14T11:38:32.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.187+0000 7fe4e2e10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.188+0000 7fe394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.188+0000 7fe4e2e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.188+0000 7fe4e2e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.188+0000 7fe4e2e10800 5 note: GC not initialized 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe30f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe4e2e10800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe4e2e10800 20 Filter name: none 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe30d7fa640 20 reqs_thread_entry: start 2024-09-14T11:38:32.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:32.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.189+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.190+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:32.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.190+0000 7fe4e2e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:32.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.190+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.190+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:32.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.190+0000 7fe4e2e10800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.191+0000 7fe4e2e10800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:32.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.191+0000 7fe4e2e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:32.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.192+0000 7fe394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.194+0000 7fe4e2e10800 20 remove_watcher() i=0 2024-09-14T11:38:32.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.194+0000 7fe4e2e10800 2 removed watcher, disabling cache 2024-09-14T11:38:32.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.195+0000 7fe4e2e10800 20 remove_watcher() i=1 2024-09-14T11:38:32.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.196+0000 7fe4e2e10800 20 remove_watcher() i=2 2024-09-14T11:38:32.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.197+0000 7fe4e2e10800 20 remove_watcher() i=3 2024-09-14T11:38:32.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.199+0000 7fe4e2e10800 20 remove_watcher() i=4 2024-09-14T11:38:32.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.199+0000 7fe4e2e10800 20 remove_watcher() i=5 2024-09-14T11:38:32.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.200+0000 7fe4e2e10800 20 remove_watcher() i=6 2024-09-14T11:38:32.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.201+0000 7fe4e2e10800 20 remove_watcher() i=7 2024-09-14T11:38:32.210 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:32.210 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:32.210 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:32.210 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:32.211 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:38:32.246 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:32.246 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:32.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.285+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 realm 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.286+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.287+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.287+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.287+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:32.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.288+0000 7fe16c532800 20 searching for the correct realm 2024-09-14T11:38:32.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.290+0000 7fe1679bb640 0 -- 172.21.15.116:0/2005832645 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fe158087040 msgr2=0x7fe158096940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.294+0000 7fe1681bc640 0 -- 172.21.15.116:0/2005832645 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe150076710 msgr2=0x7fe150097990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.499 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 zone default found 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 4 Realm: () 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 zonegroup default 2024-09-14T11:38:32.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.501+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 started sync module instance, tier type = 2024-09-14T11:38:32.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.502+0000 7fe16c532800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=0 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=1 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=2 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=3 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=4 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=5 2024-09-14T11:38:32.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.511+0000 7fe16c532800 20 add_watcher() i=6 2024-09-14T11:38:32.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.512+0000 7fe16c532800 20 add_watcher() i=7 2024-09-14T11:38:32.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.512+0000 7fe16c532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:32.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.513+0000 7fe01efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:32.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:32.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 5 note: GC not initialized 2024-09-14T11:38:32.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe01dfdb640 20 reqs_thread_entry: start 2024-09-14T11:38:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 20 Filter name: none 2024-09-14T11:38:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fdf8f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:38:32.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.514+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : miss 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:32.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.515+0000 7fe16c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe16c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe16c532800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe16c532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe16c532800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe03effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94361107295584 notifier 6620 bl.length()=915 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe03effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe03effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.521+0000 7fe03effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.522+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:32.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.522+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:32.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.522+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:32.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.522+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.0 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.0 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.1 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.1 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.2 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.2 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.3 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.3 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.4 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.4 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.5 2024-09-14T11:38:32.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.5 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.6 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.6 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.7 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.7 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.8 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.8 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.9 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.9 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.10 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.10 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.11 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.11 2024-09-14T11:38:32.527 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.527+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.0 2024-09-14T11:38:32.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.528+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1 2024-09-14T11:38:32.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.528+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.2 2024-09-14T11:38:32.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.529+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.3 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.529+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.4 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.530+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.5 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.530+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.6 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.530+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.7 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.531+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.8 2024-09-14T11:38:32.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.531+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.9 2024-09-14T11:38:32.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.532+0000 7fe16c532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.10 2024-09-14T11:38:32.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.535+0000 7fe16c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:32.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.535+0000 7fe16c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe16c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe16c532800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe16c532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe16c532800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe03effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94361107295584 notifier 6620 bl.length()=915 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe03effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe03effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.537+0000 7fe03effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:38:32.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.539+0000 7fe16c532800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:38:32.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.544+0000 7fe16c532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:32.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.544+0000 7fe16c532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:32.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe16c532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe16c532800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe16c532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe16c532800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe03f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94361107295584 notifier 6620 bl.length()=883 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe03f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe03f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:32.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.545+0000 7fe03f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:32.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.547+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:32.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.547+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:32.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.547+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:32.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.547+0000 7fe16c532800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:32.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.551+0000 7fe16c532800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:38:32.551 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.553+0000 7fe01efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.555+0000 7fe16c532800 20 remove_watcher() i=0 2024-09-14T11:38:32.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.555+0000 7fe16c532800 2 removed watcher, disabling cache 2024-09-14T11:38:32.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.556+0000 7fe16c532800 20 remove_watcher() i=1 2024-09-14T11:38:32.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.557+0000 7fe16c532800 20 remove_watcher() i=2 2024-09-14T11:38:32.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.558+0000 7fe16c532800 20 remove_watcher() i=3 2024-09-14T11:38:32.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.559+0000 7fe16c532800 20 remove_watcher() i=4 2024-09-14T11:38:32.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.560+0000 7fe16c532800 20 remove_watcher() i=5 2024-09-14T11:38:32.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.561+0000 7fe16c532800 20 remove_watcher() i=6 2024-09-14T11:38:32.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.562+0000 7fe16c532800 20 remove_watcher() i=7 2024-09-14T11:38:32.571 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:38:32.601 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:32.601 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:32.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.639+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 realm 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.641+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.642+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.642+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.642+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:32.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.642+0000 7f436c4b7800 20 searching for the correct realm 2024-09-14T11:38:32.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.645+0000 7f436a7a2640 0 -- 172.21.15.116:0/1738698422 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f436004d040 msgr2=0x7f4360041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:32.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.648+0000 7f4369fa1640 0 -- 172.21.15.116:0/1738698422 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f4360041910 msgr2=0x7f4360036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:32.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 zone default found 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 4 Realm: () 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 zonegroup default 2024-09-14T11:38:32.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.854+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 started sync module instance, tier type = 2024-09-14T11:38:32.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.855+0000 7f436c4b7800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=0 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=1 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=2 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=3 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=4 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=5 2024-09-14T11:38:32.863 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.864+0000 7f436c4b7800 20 add_watcher() i=6 2024-09-14T11:38:32.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.865+0000 7f436c4b7800 20 add_watcher() i=7 2024-09-14T11:38:32.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.865+0000 7f436c4b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:32.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.867+0000 7f42137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.867+0000 7f436c4b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:32.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.867+0000 7f436c4b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.867+0000 7f436c4b7800 5 note: GC not initialized 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.867+0000 7f42127fc640 20 reqs_thread_entry: start 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f436c4b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f436c4b7800 20 Filter name: none 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f418bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:32.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.868+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.869+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.869+0000 7f436c4b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.869+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.869+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.869+0000 7f436c4b7800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.870+0000 7f436c4b7800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:32.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.870+0000 7f436c4b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:32.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.871+0000 7f42137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.873+0000 7f436c4b7800 20 remove_watcher() i=0 2024-09-14T11:38:32.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.873+0000 7f436c4b7800 2 removed watcher, disabling cache 2024-09-14T11:38:32.872 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.874+0000 7f436c4b7800 20 remove_watcher() i=1 2024-09-14T11:38:32.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.875+0000 7f436c4b7800 20 remove_watcher() i=2 2024-09-14T11:38:32.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.876+0000 7f436c4b7800 20 remove_watcher() i=3 2024-09-14T11:38:32.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.877+0000 7f436c4b7800 20 remove_watcher() i=4 2024-09-14T11:38:32.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.879+0000 7f436c4b7800 20 remove_watcher() i=5 2024-09-14T11:38:32.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.879+0000 7f436c4b7800 20 remove_watcher() i=6 2024-09-14T11:38:32.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:32.880+0000 7f436c4b7800 20 remove_watcher() i=7 2024-09-14T11:38:32.889 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:32.889 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:32.889 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:32.889 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:32.979 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:33.011 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.011 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.051+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.051+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.051+0000 7f9bd1b30800 20 realm 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.051+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.052+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.052+0000 7f9bd1b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.052+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.052+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.052+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.053+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.053+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.053+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.053+0000 7f9bd1b30800 20 searching for the correct realm 2024-09-14T11:38:33.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.056+0000 7f9bc4fbb640 0 -- 172.21.15.116:0/3316280834 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x560fd8c30ae0 msgr2=0x560fd8c32f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.058 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.060+0000 7f9bc4fbb640 0 -- 172.21.15.116:0/3316280834 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f9bc0026040 msgr2=0x7f9bc0069150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.063+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 zone default found 2024-09-14T11:38:33.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 4 Realm: () 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 zonegroup default 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.064+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.065+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.065+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.065+0000 7f9bd1b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.065+0000 7f9bd1b30800 20 started sync module instance, tier type = 2024-09-14T11:38:33.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.065+0000 7f9bd1b30800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:33.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=0 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=1 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=2 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=3 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=4 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=5 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.073+0000 7f9bd1b30800 20 add_watcher() i=6 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.074+0000 7f9bd1b30800 20 add_watcher() i=7 2024-09-14T11:38:33.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.074+0000 7f9bd1b30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9bd1b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9bd1b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9bd1b30800 5 note: GC not initialized 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9a827e4640 20 reqs_thread_entry: start 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9bd1b30800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.076+0000 7f9bd1b30800 20 Filter name: none 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f99f3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:38:33.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : miss 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.077+0000 7f9bd1b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:33.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.082+0000 7f9bd1b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9bd1b30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9bd1b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9bd1b30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9ab0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94626061224928 notifier 6650 bl.length()=915 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9ab0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9ab0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.083+0000 7f9ab0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.084+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:33.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.084+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:33.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.084+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:33.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.084+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.0 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.0 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.1 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.1 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.2 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.2 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.3 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.3 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.4 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.4 2024-09-14T11:38:33.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.5 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.5 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.6 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.6 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.7 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.7 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.8 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.8 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.9 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.9 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.10 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.10 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.11 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1.11 2024-09-14T11:38:33.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.0 2024-09-14T11:38:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.089+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1 2024-09-14T11:38:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.090+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.2 2024-09-14T11:38:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.090+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.3 2024-09-14T11:38:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.090+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.4 2024-09-14T11:38:33.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.091+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.5 2024-09-14T11:38:33.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.091+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.6 2024-09-14T11:38:33.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.092+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.7 2024-09-14T11:38:33.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.092+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.8 2024-09-14T11:38:33.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.093+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.9 2024-09-14T11:38:33.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.093+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.10 2024-09-14T11:38:33.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.096+0000 7f9bd1b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:33.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.096+0000 7f9bd1b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9bd1b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9bd1b30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9bd1b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9bd1b30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9a9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94626061224928 notifier 6650 bl.length()=915 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9a9ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9a9ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.097+0000 7f9a9ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.099+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:33.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.099+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:33.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.099+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:33.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.099+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:33.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.101+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.0 2024-09-14T11:38:33.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.101+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.1 2024-09-14T11:38:33.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.101+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.2 2024-09-14T11:38:33.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.102+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.3 2024-09-14T11:38:33.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.102+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.4 2024-09-14T11:38:33.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.102+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.5 2024-09-14T11:38:33.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.103+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.6 2024-09-14T11:38:33.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.103+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.7 2024-09-14T11:38:33.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.103+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.8 2024-09-14T11:38:33.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.104+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.9 2024-09-14T11:38:33.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.104+0000 7f9bd1b30800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28.10 2024-09-14T11:38:33.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.104+0000 7f9bd1b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:33.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.104+0000 7f9bd1b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9bd1b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9bd1b30800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9bd1b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9bd1b30800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28, ofs0, ns] 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9ab0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94626061224928 notifier 6650 bl.length()=883 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9ab0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 info.flags=0x17 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9ab0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 to cache LRU end 2024-09-14T11:38:33.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.106+0000 7f9ab0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:33.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.107+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_sources= new_sources= 2024-09-14T11:38:33.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.107+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential sources added=[] removed=[] 2024-09-14T11:38:33.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.107+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): orig_dests= new_dests= 2024-09-14T11:38:33.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.107+0000 7f9bd1b30800 20 handle_bi_update(): bucket=:error-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28]): potential dests added=[] removed=[] 2024-09-14T11:38:33.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.109+0000 7f9bd1b30800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:33.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.111+0000 7f9a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.113+0000 7f9bd1b30800 20 remove_watcher() i=0 2024-09-14T11:38:33.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.113+0000 7f9bd1b30800 2 removed watcher, disabling cache 2024-09-14T11:38:33.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.114+0000 7f9bd1b30800 20 remove_watcher() i=1 2024-09-14T11:38:33.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.115+0000 7f9bd1b30800 20 remove_watcher() i=2 2024-09-14T11:38:33.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.116+0000 7f9bd1b30800 20 remove_watcher() i=3 2024-09-14T11:38:33.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.117+0000 7f9bd1b30800 20 remove_watcher() i=4 2024-09-14T11:38:33.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.118+0000 7f9bd1b30800 20 remove_watcher() i=5 2024-09-14T11:38:33.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.119+0000 7f9bd1b30800 20 remove_watcher() i=6 2024-09-14T11:38:33.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.120+0000 7f9bd1b30800 20 remove_watcher() i=7 2024-09-14T11:38:33.129 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:38:33.158 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.158 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.196+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 20 realm 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.198+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.199+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.199+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.200+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.200+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.200+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.200+0000 7f2712296800 20 searching for the correct realm 2024-09-14T11:38:33.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.202+0000 7f270757f640 0 -- 172.21.15.116:0/1911629726 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f27000cf070 msgr2=0x7f27000ae3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.206+0000 7f270fd80640 0 -- 172.21.15.116:0/1911629726 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f26f805c3b0 msgr2=0x7f26f805c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:33.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.413+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 zone default found 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 4 Realm: () 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 zonegroup default 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.414+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.415+0000 7f2712296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.415+0000 7f2712296800 20 started sync module instance, tier type = 2024-09-14T11:38:33.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.415+0000 7f2712296800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:33.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=0 2024-09-14T11:38:33.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=1 2024-09-14T11:38:33.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=2 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=3 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=4 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=5 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.423+0000 7f2712296800 20 add_watcher() i=6 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.424+0000 7f2712296800 20 add_watcher() i=7 2024-09-14T11:38:33.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.424+0000 7f2712296800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f25c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f2712296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f2712296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f2712296800 5 note: GC not initialized 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f25c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f2712296800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.426+0000 7f2712296800 20 Filter name: none 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f253e7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:33.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.427+0000 7f2712296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:33.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.428+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.428+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:33.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.428+0000 7f2712296800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.428+0000 7f2712296800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:33.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.428+0000 7f2712296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:33.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.430+0000 7f25c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.432+0000 7f2712296800 20 remove_watcher() i=0 2024-09-14T11:38:33.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.432+0000 7f2712296800 2 removed watcher, disabling cache 2024-09-14T11:38:33.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.433+0000 7f2712296800 20 remove_watcher() i=1 2024-09-14T11:38:33.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.434+0000 7f2712296800 20 remove_watcher() i=2 2024-09-14T11:38:33.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.435+0000 7f2712296800 20 remove_watcher() i=3 2024-09-14T11:38:33.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.436+0000 7f2712296800 20 remove_watcher() i=4 2024-09-14T11:38:33.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.450+0000 7f2712296800 20 remove_watcher() i=5 2024-09-14T11:38:33.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.451+0000 7f2712296800 20 remove_watcher() i=6 2024-09-14T11:38:33.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:33.452+0000 7f2712296800 20 remove_watcher() i=7 2024-09-14T11:38:33.460 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:33.460 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:33.460 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:33.460 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:33.815 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:38:33.816 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:34.614 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:38:34.642 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.642 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.680+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 realm 2024-09-14T11:38:34.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.682+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.683+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.683+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.683+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.683+0000 7f76f2e0e800 20 searching for the correct realm 2024-09-14T11:38:34.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.686+0000 7f76eddbb640 0 -- 172.21.15.116:0/3272152782 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f76e0073070 msgr2=0x7f76e003cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:34.892+0000 7f76ee5bc640 0 -- 172.21.15.116:0/3272152782 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f76d80a1450 msgr2=0x7f76d80a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.098+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 zone default found 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 4 Realm: () 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 zonegroup default 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.099+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.100+0000 7f76f2e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.100+0000 7f76f2e0e800 20 started sync module instance, tier type = 2024-09-14T11:38:35.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.100+0000 7f76f2e0e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=0 2024-09-14T11:38:35.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=1 2024-09-14T11:38:35.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=2 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=3 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=4 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=5 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.109+0000 7f76f2e0e800 20 add_watcher() i=6 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.110+0000 7f76f2e0e800 20 add_watcher() i=7 2024-09-14T11:38:35.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.110+0000 7f76f2e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.112+0000 7f75a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.112+0000 7f76f2e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.112+0000 7f76f2e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.112+0000 7f76f2e0e800 5 note: GC not initialized 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.112+0000 7f751f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f76f2e0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f76f2e0e800 20 Filter name: none 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f751d7fa640 20 reqs_thread_entry: start 2024-09-14T11:38:35.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.113+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.114+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.114+0000 7f76f2e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.114+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.114+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.114+0000 7f76f2e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.115+0000 7f76f2e0e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:35.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.115+0000 7f76f2e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.117+0000 7f75a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.119+0000 7f76f2e0e800 20 remove_watcher() i=0 2024-09-14T11:38:35.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.119+0000 7f76f2e0e800 2 removed watcher, disabling cache 2024-09-14T11:38:35.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.120+0000 7f76f2e0e800 20 remove_watcher() i=1 2024-09-14T11:38:35.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.121+0000 7f76f2e0e800 20 remove_watcher() i=2 2024-09-14T11:38:35.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.122+0000 7f76f2e0e800 20 remove_watcher() i=3 2024-09-14T11:38:35.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.123+0000 7f76f2e0e800 20 remove_watcher() i=4 2024-09-14T11:38:35.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.124+0000 7f76f2e0e800 20 remove_watcher() i=5 2024-09-14T11:38:35.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.125+0000 7f76f2e0e800 20 remove_watcher() i=6 2024-09-14T11:38:35.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.126+0000 7f76f2e0e800 20 remove_watcher() i=7 2024-09-14T11:38:35.135 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:35.135 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.137 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.170 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.209+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.210+0000 7f52d8523800 20 realm 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.211+0000 7f52d8523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.212+0000 7f52d8523800 20 searching for the correct realm 2024-09-14T11:38:35.213 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.215+0000 7f52d4a0d640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f52bc07b030 msgr2=0x7f52bc0aaf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.218+0000 7f52d420c640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f52bc0e2b90 msgr2=0x7f52bc0553d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 zone default found 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 4 Realm: () 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 zonegroup default 2024-09-14T11:38:35.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.426+0000 7f52d8523800 20 started sync module instance, tier type = 2024-09-14T11:38:35.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.426+0000 7f52d8523800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=0 2024-09-14T11:38:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=1 2024-09-14T11:38:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=2 2024-09-14T11:38:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=3 2024-09-14T11:38:35.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=4 2024-09-14T11:38:35.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=5 2024-09-14T11:38:35.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=6 2024-09-14T11:38:35.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.436+0000 7f52d8523800 20 add_watcher() i=7 2024-09-14T11:38:35.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.436+0000 7f52d8523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f518afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f52d8523800 5 note: GC not initialized 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f5189fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f52d8523800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.438+0000 7f52d8523800 20 Filter name: none 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f50fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:38:35.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : miss 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:35.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.439+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.0 2024-09-14T11:38:35.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1 2024-09-14T11:38:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2 2024-09-14T11:38:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.3 2024-09-14T11:38:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.4 2024-09-14T11:38:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.5 2024-09-14T11:38:35.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.455+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.6 2024-09-14T11:38:35.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.456+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.7 2024-09-14T11:38:35.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.8 2024-09-14T11:38:35.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.9 2024-09-14T11:38:35.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.458+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.10 2024-09-14T11:38:35.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.461+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.461+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52d8523800 time 2024-09-14T11:38:35.464908+0000 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.462 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f52d9b8c76a] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.463 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.464+0000 7f52d8523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52d8523800 time 2024-09-14T11:38:35.464908+0000 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f52d9b8c76a] 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:38:35.464 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:38:35.465 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f52d8523800 thread_name:radosgw-admin 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52d883e6f0] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f52d888b99c] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f52d9b8c7c4] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.483 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.465+0000 7f52d8523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f52d8523800 thread_name:radosgw-admin 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52d883e6f0] 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f52d888b99c] 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:38:35.484 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f52d9b8c7c4] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.485 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.486 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:38:35.193+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:38:35.194+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:38:35.194+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key hook 0x55fecc21f308 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc0ab3f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc161ef0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc162330 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.487 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.800355s 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): get_auth_request con 0x55fecc0ab3f0 auth_method 0 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc162330 auth_method 0 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.488 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_done global_id 7227 payload 824 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:38:35.194+0000 7f52d420c640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: dump: 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.489 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: dump: 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.490 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:38:35.195+0000 7f52d8523800 5 monclient: authenticate success, global_id 7227 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:38:35.195+0000 7f51c260c640 4 set_mon_vals no callback set 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.491 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:38:35.195+0000 7f52d8523800 1 librados: init done 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:38:35.197+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f51bc077230 auth_method 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:38:35.197+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc25e280 auth_method 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:38:35.198+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc26ae60 auth_method 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:38:35.199+0000 7f52cba0b640 10 monclient: get_auth_request con 0x55fecc2703a0 auth_method 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:38:35.200+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.492 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.493 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:38:35.200+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 asok(0x55fecc000270) register_command objecter_requests cmddesc objecter_requests hook 0x55fecc277c20 EEXIST 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.494 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:38:35.201+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:38:35.201+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:38:35.201+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x55fecc2732e0 EEXIST 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.495 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc29b910 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc29dbe0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc29a0e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.807383s 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc29dbe0 auth_method 0 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc29a0e0 auth_method 0 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.496 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:38:35.201+0000 7f52cba0b640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:38:35.201+0000 7f51b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: dump: 2024-09-14T11:38:35.497 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: dump: 2024-09-14T11:38:35.498 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:38:35.202+0000 7f52d8523800 5 monclient: authenticate success, global_id 6698 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:38:35.202+0000 7f52d520e640 4 set_mon_vals no callback set 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.499 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:38:35.203+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f51ac077140 auth_method 0 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: get_monmap_and_config 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:38:35.204+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.500 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.501 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:38:35.204+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.502 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:38:35.204+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:38:35.205+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:38:35.205+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x7ffc8b32e698 EEXIST 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc2efd60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc2eb260 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc2e16d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.503 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.811162s 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc2eb260 auth_method 0 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc2e16d0 auth_method 0 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.504 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_done global_id 6701 payload 274 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:38:35.205+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc2efd60 auth_method 0 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.505 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: dump: 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.506 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:38:35.205+0000 7f52d8523800 5 monclient: authenticate success, global_id 6701 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:38:35.205+0000 7f52d8523800 4 set_mon_vals no callback set 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: dump: 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.507 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: shutdown 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.508 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.509 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:38:35.206+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: starting msgr at 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: starting objecter 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 asok(0x55fecc000270) register_command objecter_requests cmddesc objecter_requests hook 0x55fecc2bfe30 EEXIST 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: setting wanted keys 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: calling monclient init 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.510 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:38:35.207+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.511 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:38:35.207+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x55fecc2b3808 EEXIST 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc2e16d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc2eb260 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc2efd60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.813333s 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc2eb260 auth_method 0 2024-09-14T11:38:35.512 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): get_auth_request con 0x55fecc2e16d0 auth_method 0 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.513 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:38:35.207+0000 7f52d420c640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:38:35.207+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc2efd60 auth_method 0 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: dump: 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.514 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: dump: 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.515 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:38:35.207+0000 7f51ab7fe640 4 set_mon_vals no callback set 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:38:35.207+0000 7f52d8523800 1 librados: init done 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cr dump hook 0x55fecc2e54a8 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:38:35.209+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.516 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:38:35.210+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f519c077230 auth_method 0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:38:35.210+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc30a010 auth_method 0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 realm 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:38:35.211+0000 7f52d8523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:38:35.211+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc30e280 auth_method 0 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.517 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 searching for the correct realm 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:38:35.212+0000 7f52cba0b640 10 monclient: get_auth_request con 0x55fecc313510 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:38:35.213+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f52bc07b030 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:38:35.214+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52cc007c20 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:38:35.214+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f52c4029070 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:38:35.215+0000 7f52d4a0d640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f52bc07b030 msgr2=0x7f52bc0aaf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 1 client.6704.objecter ms_handle_reset 0x7f52bc07b030 session 0x7f52bc0b5e90 osd.7 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 10 monclient: _renew_subs 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:38:35.215+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f519c0870d0 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:38:35.216+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f52bc0b57b0 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:38:35.218+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52bc0e2b90 auth_method 0 2024-09-14T11:38:35.518 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:38:35.218+0000 7f52d420c640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f52bc0e2b90 msgr2=0x7f52bc0553d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:38:35.419+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52bc0e2b90 auth_method 0 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 zone default found 2024-09-14T11:38:35.519 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 Realm: () 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:38:35.425+0000 7f52d8523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 zonegroup default 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 started sync module instance, tier type = 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=0 2024-09-14T11:38:35.520 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=1 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=2 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=3 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=4 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=5 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=6 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:38:35.436+0000 7f52d8523800 20 add_watcher() i=7 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:38:35.436+0000 7f52d8523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.521 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:38:35.438+0000 7f518afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:38:35.438+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache list hook 0x55fecc2f9fa0 2024-09-14T11:38:35.522 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache inspect hook 0x55fecc2f9fa0 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache erase hook 0x55fecc2f9fa0 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache zap hook 0x55fecc2f9fa0 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 note: GC not initialized 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:38:35.438+0000 7f5189fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace show hook 0x7f52cc007580 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace history hook 0x7f52cc007580 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace active hook 0x7f52cc007580 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace active_short hook 0x7f52cc007580 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 Filter name: none 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:38:35.439+0000 7f50fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:38:35.523 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : miss 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.524 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.525 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.526 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.0 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.3 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.4 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.5 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:38:35.455+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.6 2024-09-14T11:38:35.527 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:38:35.456+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.7 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.8 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.9 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:38:35.458+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.10 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:38:35.461+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:38:35.461+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.528 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:38:35.464+0000 7f52d8523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52d8523800 time 2024-09-14T11:38:35.464908+0000 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f52d9b8c76a] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:38:35.529 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:38:35.465+0000 7f52d8523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f52d8523800 thread_name:radosgw-admin 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52d883e6f0] 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f52d888b99c] 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f52d9b8c7c4] 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.530 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:38:35.531 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:38:35.532 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:38:35.533 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:35.534 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:38:35.535 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:38:35.536 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:35.537 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f50fb7fe640 / http_manager 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5189fdb640 / http_manager 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f518afdd640 / rgw_dt_lg_renew 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51a9ffb640 / ms_dispatch 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51aaffd640 / io_context_pool 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51ab7fe640 / io_context_pool 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51b9ffb640 / ms_dispatch 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51c0e09640 / ms_dispatch 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51c260c640 / io_context_pool 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52cba0b640 / msgr-worker-2 2024-09-14T11:38:35.538 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d420c640 / msgr-worker-1 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d4a0d640 / msgr-worker-0 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d520e640 / io_context_pool 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d8523800 / radosgw-admin 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.113716.log 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding auth protocol: cephx 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.539 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: crc 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:38:35.193+0000 7f52d8523800 5 AuthRegistry(0x55fecc21f1c0) adding con mode: secure 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:38:35.193+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:38:35.194+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:38:35.194+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key hook 0x55fecc21f308 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.540 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc0ab3f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc161ef0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc162330 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:38:35.194+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.800355s 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): get_auth_request con 0x55fecc0ab3f0 auth_method 0 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc162330 auth_method 0 2024-09-14T11:38:35.541 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:38:35.194+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient(hunting): handle_auth_done global_id 7227 payload 824 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:38:35.194+0000 7f52d420c640 1 monclient: found mon.noname-a 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:38:35.194+0000 7f52d420c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.542 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: dump: 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.543 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:38:35.194+0000 7f51c0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:38:35.195+0000 7f51c0e09640 10 monclient: dump: 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.544 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:38:35.195+0000 7f52d8523800 5 monclient: authenticate success, global_id 7227 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:38:35.195+0000 7f51c260c640 4 set_mon_vals no callback set 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:38:35.195+0000 7f52d8523800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:38:35.195+0000 7f52d8523800 1 librados: init done 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:38:35.196+0000 7f51c0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:38:35.197+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f51bc077230 auth_method 0 2024-09-14T11:38:35.545 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:38:35.197+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc25e280 auth_method 0 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:38:35.198+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc26ae60 auth_method 0 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:38:35.199+0000 7f52cba0b640 10 monclient: get_auth_request con 0x55fecc2703a0 auth_method 0 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:38:35.200+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.546 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding auth protocol: cephx 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.547 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: crc 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc2742a0) adding con mode: secure 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:38:35.200+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 asok(0x55fecc000270) register_command objecter_requests cmddesc objecter_requests hook 0x55fecc277c20 EEXIST 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:38:35.200+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding auth protocol: cephx 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.548 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: crc 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:38:35.200+0000 7f52d8523800 5 AuthRegistry(0x55fecc273198) adding con mode: secure 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:38:35.201+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:38:35.201+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:38:35.201+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x55fecc2732e0 EEXIST 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:35.549 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc29b910 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc29dbe0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc29a0e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:38:35.201+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.807383s 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc29dbe0 auth_method 0 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc29a0e0 auth_method 0 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.550 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:38:35.201+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:38:35.201+0000 7f52cba0b640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:38:35.201+0000 7f52cba0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:38:35.201+0000 7f51b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.551 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: dump: 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.552 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:38:35.202+0000 7f51b9ffb640 10 monclient: dump: 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.553 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:38:35.202+0000 7f52d8523800 5 monclient: authenticate success, global_id 6698 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:38:35.202+0000 7f52d520e640 4 set_mon_vals no callback set 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:38:35.202+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:38:35.203+0000 7f51b9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:38:35.203+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f51ac077140 auth_method 0 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: get_monmap_and_config 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:38:35.204+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.554 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding auth protocol: cephx 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.555 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: crc 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x55fecc2bb730) adding con mode: secure 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:38:35.204+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:38:35.204+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.556 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding auth protocol: cephx 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: crc 2024-09-14T11:38:35.557 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:38:35.204+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32e550) adding con mode: secure 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:38:35.204+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:38:35.205+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:38:35.205+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x7ffc8b32e698 EEXIST 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc2efd60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc2eb260 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc2e16d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.811162s 2024-09-14T11:38:35.558 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc2eb260 auth_method 0 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request con 0x55fecc2e16d0 auth_method 0 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:38:35.205+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.559 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient(hunting): handle_auth_done global_id 6701 payload 274 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:38:35.205+0000 7f52d4a0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:38:35.205+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc2efd60 auth_method 0 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: dump: 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.560 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:38:35.205+0000 7f52d8523800 5 monclient: authenticate success, global_id 6701 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:38:35.205+0000 7f52d8523800 10 monclient: get_monmap_and_config success 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:38:35.205+0000 7f52d8523800 4 set_mon_vals no callback set 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:38:35.205+0000 7f51ab7fe640 10 monclient: dump: 2024-09-14T11:38:35.561 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: shutdown 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: build_initial_monmap 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 build_initial for_mkfs: 0 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: monmap: 2024-09-14T11:38:35.562 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding auth protocol: cephx 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.563 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: crc 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2e0400) adding con mode: secure 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:38:35.206+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: starting msgr at 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: starting objecter 2024-09-14T11:38:35.564 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 asok(0x55fecc000270) register_command objecter_requests cmddesc objecter_requests hook 0x55fecc2bfe30 EEXIST 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: setting wanted keys 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:38:35.206+0000 7f52d8523800 1 librados: calling monclient init 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:38:35.206+0000 7f52d8523800 10 monclient: init 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding auth protocol: cephx 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.565 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: crc 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:38:35.206+0000 7f52d8523800 5 AuthRegistry(0x55fecc2b36c0) adding con mode: secure 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:38:35.207+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:38:35.207+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 asok(0x55fecc000270) register_command rotate-key cmddesc rotate-key hook 0x55fecc2b3808 EEXIST 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _reopen_session rank -1 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-c con 0x55fecc2e16d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-a con 0x55fecc2eb260 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): picked mon.noname-b con 0x55fecc2efd60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.566 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): _renew_subs 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient(hunting): authenticate will time out at 2112.813333s 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): get_auth_request con 0x55fecc2eb260 auth_method 0 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): get_auth_request con 0x55fecc2e16d0 auth_method 0 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:38:35.207+0000 7f52cba0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.567 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient: _finish_hunting 0 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:38:35.207+0000 7f52d420c640 1 monclient: found mon.noname-c 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:38:35.207+0000 7f52d420c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:38:35.207+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc2efd60 auth_method 0 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: dump: 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.568 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:38:35.207+0000 7f51a9ffb640 10 monclient: dump: 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:38:35.569 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:38:35.207+0000 7f51ab7fe640 4 set_mon_vals no callback set 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _renew_subs 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:38:35.207+0000 7f52d8523800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.570 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:38:35.207+0000 7f52d8523800 1 librados: init done 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:38:35.207+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cr dump hook 0x55fecc2e54a8 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:38:35.209+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:38:35.209+0000 7f51a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:38:35.210+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f519c077230 auth_method 0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:38:35.210+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x55fecc30a010 auth_method 0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 realm 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:38:35.210+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.571 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:38:35.211+0000 7f52d8523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:38:35.211+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:38:35.211+0000 7f52d420c640 10 monclient: get_auth_request con 0x55fecc30e280 auth_method 0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:38:35.212+0000 7f52d8523800 20 searching for the correct realm 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:38:35.212+0000 7f52cba0b640 10 monclient: get_auth_request con 0x55fecc313510 auth_method 0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:38:35.213+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f52bc07b030 auth_method 0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:38:35.214+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52cc007c20 auth_method 0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:38:35.214+0000 7f52cba0b640 10 monclient: get_auth_request con 0x7f52c4029070 auth_method 0 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:38:35.215+0000 7f52d4a0d640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f52bc07b030 msgr2=0x7f52bc0aaf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.572 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 1 client.6704.objecter ms_handle_reset 0x7f52bc07b030 session 0x7f52bc0b5e90 osd.7 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 10 monclient: _renew_subs 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:38:35.215+0000 7f51a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:38:35.215+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f519c0870d0 auth_method 0 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:38:35.216+0000 7f52d4a0d640 10 monclient: get_auth_request con 0x7f52bc0b57b0 auth_method 0 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:38:35.218+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52bc0e2b90 auth_method 0 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:38:35.218+0000 7f52d420c640 0 -- 172.21.15.116:0/2836822667 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f52bc0e2b90 msgr2=0x7f52bc0553d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:38:35.419+0000 7f52d420c640 10 monclient: get_auth_request con 0x7f52bc0e2b90 auth_method 0 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.573 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:38:35.424+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 zone default found 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 Realm: () 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:38:35.425+0000 7f52d8523800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:38:35.425+0000 7f52d8523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 zonegroup default 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.574 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:38:35.425+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 started sync module instance, tier type = 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:38:35.426+0000 7f52d8523800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=0 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=1 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=2 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=3 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=4 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=5 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:38:35.435+0000 7f52d8523800 20 add_watcher() i=6 2024-09-14T11:38:35.575 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:38:35.436+0000 7f52d8523800 20 add_watcher() i=7 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:38:35.436+0000 7f52d8523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding auth protocol: cephx 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.576 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: crc 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 AuthRegistry(0x7ffc8b32ea30) adding con mode: secure 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:38:35.438+0000 7f518afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:38:35.438+0000 7f52d8523800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache list hook 0x55fecc2f9fa0 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache inspect hook 0x55fecc2f9fa0 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache erase hook 0x55fecc2f9fa0 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command cache zap hook 0x55fecc2f9fa0 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 note: GC not initialized 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:38:35.438+0000 7f5189fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace show hook 0x7f52cc007580 2024-09-14T11:38:35.577 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace history hook 0x7f52cc007580 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace active hook 0x7f52cc007580 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:38:35.438+0000 7f52d8523800 5 asok(0x55fecc000270) register_command sync trace active_short hook 0x7f52cc007580 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:38:35.438+0000 7f52d8523800 20 Filter name: none 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:38:35.439+0000 7f50fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : miss 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.578 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:38:35.439+0000 7f52d8523800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:38:35.439+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:38:35.445+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:38:35.445+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.579 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:38:35.447+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.0 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.1 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.2 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.3 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.580 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.4 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.5 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.6 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.7 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.8 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.9 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.10 2024-09-14T11:38:35.581 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:38:35.452+0000 7f52d8523800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1.11 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.0 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:38:35.452+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:38:35.453+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.3 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.4 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:38:35.454+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.5 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:38:35.455+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.6 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:38:35.456+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.7 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.8 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:38:35.457+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.9 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:38:35.458+0000 7f52d8523800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.10 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:38:35.461+0000 7f52d8523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:35.582 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:38:35.461+0000 7f52d8523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:38:35.462+0000 7f52d8523800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94552835864656 notifier 6704 bl.length()=915 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:38:35.462+0000 7f51aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:38:35.464+0000 7f52d8523800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:38:35.583 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:38:35.464+0000 7f52d8523800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52d8523800 time 2024-09-14T11:38:35.464908+0000 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f52d9b8c76a] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.584 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:38:35.465+0000 7f52d8523800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f52d8523800 thread_name:radosgw-admin 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f52d883e6f0] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f52d888b99c] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f52d9b8c7c4] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f52d9b8c928] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55feca1ff0b1] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55feca20e18e] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55feca20efc4] 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:38:35.585 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f52d8829590] 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:38:35.586 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:38:35.587 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:38:35.588 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:38:35.589 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:38:35.590 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:35.591 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:35.592 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f50fb7fe640 / http_manager 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5189fdb640 / http_manager 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f518afdd640 / rgw_dt_lg_renew 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51a9ffb640 / ms_dispatch 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51aaffd640 / io_context_pool 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51ab7fe640 / io_context_pool 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51b9ffb640 / ms_dispatch 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51c0e09640 / ms_dispatch 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f51c260c640 / io_context_pool 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52cba0b640 / msgr-worker-2 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d420c640 / msgr-worker-1 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d4a0d640 / msgr-worker-0 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d520e640 / io_context_pool 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: 7f52d8523800 / radosgw-admin 2024-09-14T11:38:35.593 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:38:35.594 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:38:35.594 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:38:35.466526Z_8b4003ed-7c9b-4fea-b7c5-b7be30ebea34/log 2024-09-14T11:38:35.594 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:38:35.594 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.540+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 realm 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.542+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.543+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.543+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.543+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.543+0000 7fd1b4011800 20 searching for the correct realm 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.546+0000 7fd1aff23640 0 -- 172.21.15.116:0/1197974454 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fd1980bb070 msgr2=0x7fd1980ae2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.550+0000 7fd1af722640 0 -- 172.21.15.116:0/1197974454 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd1980a3ce0 msgr2=0x7fd1980ac620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.554+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 zone default found 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 4 Realm: () 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 zonegroup default 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.555+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.556+0000 7fd1b4011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.556+0000 7fd1b4011800 20 started sync module instance, tier type = 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.556+0000 7fd1b4011800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=0 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=1 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=2 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=3 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=4 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=5 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.564+0000 7fd1b4011800 20 add_watcher() i=6 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.565+0000 7fd1b4011800 20 add_watcher() i=7 2024-09-14T11:38:35.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.565+0000 7fd1b4011800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.566+0000 7fd065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 5 note: GC not initialized 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd064fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 20 Filter name: none 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fcfde7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.567+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.568+0000 7fd1b4011800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.569+0000 7fd1b4011800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.569+0000 7fd1b4011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.570+0000 7fd065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.572+0000 7fd1b4011800 20 remove_watcher() i=0 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.572+0000 7fd1b4011800 2 removed watcher, disabling cache 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.574+0000 7fd1b4011800 20 remove_watcher() i=1 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.575+0000 7fd1b4011800 20 remove_watcher() i=2 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.576+0000 7fd1b4011800 20 remove_watcher() i=3 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.576+0000 7fd1b4011800 20 remove_watcher() i=4 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.577+0000 7fd1b4011800 20 remove_watcher() i=5 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.578+0000 7fd1b4011800 20 remove_watcher() i=6 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.579+0000 7fd1b4011800 20 remove_watcher() i=7 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.604 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:38:35.605 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:35.605 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:38:35.677 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:35.709 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.710 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.749+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 20 realm 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.750+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.751+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.751+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.751+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.751+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.752+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.750 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.752+0000 7f654b92c800 20 searching for the correct realm 2024-09-14T11:38:35.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.754+0000 7f6546d44640 0 -- 172.21.15.116:0/1648522172 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f6538076040 msgr2=0x7f65380a3910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.758+0000 7f6547545640 0 -- 172.21.15.116:0/1648522172 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6530092b60 msgr2=0x7f6530083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.964+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 zone default found 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 4 Realm: () 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 zonegroup default 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.965+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 started sync module instance, tier type = 2024-09-14T11:38:35.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.966+0000 7f654b92c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:38:35.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=0 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=1 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=2 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=3 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=4 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=5 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=6 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 20 add_watcher() i=7 2024-09-14T11:38:35.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.976+0000 7f654b92c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.978+0000 7f63fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.978+0000 7f654b92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.978+0000 7f654b92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 5 note: GC not initialized 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f63fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 20 Filter name: none 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f63767fc640 20 reqs_thread_entry: start 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : miss 2024-09-14T11:38:35.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.979+0000 7f654b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:35.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.980+0000 7f654b92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:38:35.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.981+0000 7f654b92c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to be held by another RGW process; skipping for now 2024-09-14T11:38:35.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.982+0000 7f63fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.985+0000 7f654b92c800 20 remove_watcher() i=0 2024-09-14T11:38:35.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.985+0000 7f654b92c800 2 removed watcher, disabling cache 2024-09-14T11:38:35.984 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.986+0000 7f654b92c800 20 remove_watcher() i=1 2024-09-14T11:38:35.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.987+0000 7f654b92c800 20 remove_watcher() i=2 2024-09-14T11:38:35.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.988+0000 7f654b92c800 20 remove_watcher() i=3 2024-09-14T11:38:35.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.989+0000 7f654b92c800 20 remove_watcher() i=4 2024-09-14T11:38:35.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.990+0000 7f654b92c800 20 remove_watcher() i=5 2024-09-14T11:38:35.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.991+0000 7f654b92c800 20 remove_watcher() i=6 2024-09-14T11:38:35.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:38:35.992+0000 7f654b92c800 20 remove_watcher() i=7 2024-09-14T11:38:36.000 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:39:06.028 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:06.065 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:06.065 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:06.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.108+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 realm 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:06.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.110+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.111+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.111+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.111+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:06.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.111+0000 7fa1ea00f800 20 searching for the correct realm 2024-09-14T11:39:06.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.114+0000 7fa1e4f91640 0 -- 172.21.15.116:0/2964479331 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa1d803b070 msgr2=0x7fa1d804a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.119+0000 7fa1e5792640 0 -- 172.21.15.116:0/2964479331 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa1dc04a460 msgr2=0x7fa1dc06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.326+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 zone default found 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 4 Realm: () 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 zonegroup default 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.327+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.328+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.328+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.328+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.328+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.329+0000 7fa1ea00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.329+0000 7fa1ea00f800 20 started sync module instance, tier type = 2024-09-14T11:39:06.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.329+0000 7fa1ea00f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=0 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=1 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=2 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=3 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=4 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=5 2024-09-14T11:39:06.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.339+0000 7fa1ea00f800 20 add_watcher() i=6 2024-09-14T11:39:06.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.340+0000 7fa1ea00f800 20 add_watcher() i=7 2024-09-14T11:39:06.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.340+0000 7fa1ea00f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:06.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa1ea00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa1ea00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa1ea00f800 5 note: GC not initialized 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa09afe5640 20 reqs_thread_entry: start 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa1ea00f800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.342+0000 7fa1ea00f800 20 Filter name: none 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa098fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:39:06.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : miss 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:06.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.343+0000 7fa1ea00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:39:06.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.345+0000 7fa1ea00f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:39:06.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa1ea00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa1ea00f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa1ea00f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa1ea00f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:39:06.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa0b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 93977751191632 notifier 6752 bl.length()=915 2024-09-14T11:39:06.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa0b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa0b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.351+0000 7fa0b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.353+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:39:06.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.353+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:39:06.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.353+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:39:06.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.353+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.358+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.0 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.358+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.0 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.1 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.1 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.2 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.2 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.3 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.3 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.4 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.4 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.5 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.5 2024-09-14T11:39:06.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.6 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.6 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.7 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.7 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.8 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.8 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.9 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.9 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.10 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.10 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.11 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2.11 2024-09-14T11:39:06.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.0 2024-09-14T11:39:06.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.359+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1 2024-09-14T11:39:06.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.360+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2 2024-09-14T11:39:06.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.360+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.3 2024-09-14T11:39:06.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.361+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.4 2024-09-14T11:39:06.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.362+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.5 2024-09-14T11:39:06.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.362+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.6 2024-09-14T11:39:06.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.363+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.7 2024-09-14T11:39:06.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.363+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.8 2024-09-14T11:39:06.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.364+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.9 2024-09-14T11:39:06.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.365+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.10 2024-09-14T11:39:06.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.368+0000 7fa1ea00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:06.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.368+0000 7fa1ea00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:39:06.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa1ea00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa1ea00f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa1ea00f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa1ea00f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:39:06.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa0b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93977751191632 notifier 6752 bl.length()=915 2024-09-14T11:39:06.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa0b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa0b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.369+0000 7fa0b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.371+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:39:06.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.371+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:39:06.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.371+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:39:06.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.371+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:39:06.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.373+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.0 2024-09-14T11:39:06.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.374+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.1 2024-09-14T11:39:06.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.374+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.2 2024-09-14T11:39:06.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.375+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.3 2024-09-14T11:39:06.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.375+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.4 2024-09-14T11:39:06.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.375+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.5 2024-09-14T11:39:06.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.375+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.6 2024-09-14T11:39:06.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.376+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.7 2024-09-14T11:39:06.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.376+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.8 2024-09-14T11:39:06.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.377+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.9 2024-09-14T11:39:06.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.377+0000 7fa1ea00f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29.10 2024-09-14T11:39:06.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.377+0000 7fa1ea00f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:06.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.377+0000 7fa1ea00f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa1ea00f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa1ea00f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa1ea00f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa1ea00f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29, ofs0, ns] 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa0c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 93977751191632 notifier 6752 bl.length()=883 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa0c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 info.flags=0x17 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa0c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 to cache LRU end 2024-09-14T11:39:06.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.379+0000 7fa0c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:06.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.380+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_sources= new_sources= 2024-09-14T11:39:06.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.380+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential sources added=[] removed=[] 2024-09-14T11:39:06.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.380+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): orig_dests= new_dests= 2024-09-14T11:39:06.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.380+0000 7fa1ea00f800 20 handle_bi_update(): bucket=:abort-at-block-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29]): potential dests added=[] removed=[] 2024-09-14T11:39:06.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.383+0000 7fa1ea00f800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:06.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.386+0000 7fa09bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.388+0000 7fa1ea00f800 20 remove_watcher() i=0 2024-09-14T11:39:06.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.388+0000 7fa1ea00f800 2 removed watcher, disabling cache 2024-09-14T11:39:06.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.389+0000 7fa1ea00f800 20 remove_watcher() i=1 2024-09-14T11:39:06.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.390+0000 7fa1ea00f800 20 remove_watcher() i=2 2024-09-14T11:39:06.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.391+0000 7fa1ea00f800 20 remove_watcher() i=3 2024-09-14T11:39:06.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.392+0000 7fa1ea00f800 20 remove_watcher() i=4 2024-09-14T11:39:06.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.393+0000 7fa1ea00f800 20 remove_watcher() i=5 2024-09-14T11:39:06.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.394+0000 7fa1ea00f800 20 remove_watcher() i=6 2024-09-14T11:39:06.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.395+0000 7fa1ea00f800 20 remove_watcher() i=7 2024-09-14T11:39:06.406 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:39:06.435 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:06.435 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:06.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.473+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 realm 2024-09-14T11:39:06.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:06.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.475+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.476+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.476+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.477+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:06.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.477+0000 7feffb726800 20 searching for the correct realm 2024-09-14T11:39:06.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.478+0000 7feff7309640 0 -- 172.21.15.116:0/4219187424 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7feff0035070 msgr2=0x7feff001c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.684+0000 7feff7b0a640 0 -- 172.21.15.116:0/4219187424 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fefec07d040 msgr2=0x7fefec062510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:06.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.690+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:06.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:06.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 zone default found 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 4 Realm: () 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 zonegroup default 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.691+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.692+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.692+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.692+0000 7feffb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.692+0000 7feffb726800 20 started sync module instance, tier type = 2024-09-14T11:39:06.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.692+0000 7feffb726800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:06.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=0 2024-09-14T11:39:06.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=1 2024-09-14T11:39:06.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=2 2024-09-14T11:39:06.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=3 2024-09-14T11:39:06.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=4 2024-09-14T11:39:06.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=5 2024-09-14T11:39:06.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.701+0000 7feffb726800 20 add_watcher() i=6 2024-09-14T11:39:06.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.702+0000 7feffb726800 20 add_watcher() i=7 2024-09-14T11:39:06.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.702+0000 7feffb726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:06.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.704+0000 7feeadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.704+0000 7feffb726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.704+0000 7feffb726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.704+0000 7feffb726800 5 note: GC not initialized 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feeacfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feffb726800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feffb726800 20 Filter name: none 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7fee267fc640 20 reqs_thread_entry: start 2024-09-14T11:39:06.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:39:06.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.705+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 rados->read ofs=0 len=0 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:39:06.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.706+0000 7feffb726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:06.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.708+0000 7feeadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:06.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.711+0000 7feffb726800 20 remove_watcher() i=0 2024-09-14T11:39:06.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.711+0000 7feffb726800 2 removed watcher, disabling cache 2024-09-14T11:39:06.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.712+0000 7feffb726800 20 remove_watcher() i=1 2024-09-14T11:39:06.712 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.713+0000 7feffb726800 20 remove_watcher() i=2 2024-09-14T11:39:06.713 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.714+0000 7feffb726800 20 remove_watcher() i=3 2024-09-14T11:39:06.714 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.715+0000 7feffb726800 20 remove_watcher() i=4 2024-09-14T11:39:06.715 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.716+0000 7feffb726800 20 remove_watcher() i=5 2024-09-14T11:39:06.716 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.717+0000 7feffb726800 20 remove_watcher() i=6 2024-09-14T11:39:06.717 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:06.718+0000 7feffb726800 20 remove_watcher() i=7 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-block-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:06.727 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:07.096 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:39:07.096 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:07.899 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:39:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:07.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.965+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 realm 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:07.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.967+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.968+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:07.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.968+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:07.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.968+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:07.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.968+0000 7f5d3840e800 20 searching for the correct realm 2024-09-14T11:39:07.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.971+0000 7f5d3425a640 0 -- 172.21.15.116:0/3653301114 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f5d1c017040 msgr2=0x7f5d1c049a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:07.975+0000 7f5d33a59640 0 -- 172.21.15.116:0/3653301114 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5d1c076600 msgr2=0x7f5d1c049150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:08.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:08.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.180+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 zone default found 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 4 Realm: () 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:08.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 zonegroup default 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.181+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.182+0000 7f5d3840e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.182+0000 7f5d3840e800 20 started sync module instance, tier type = 2024-09-14T11:39:08.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.182+0000 7f5d3840e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:08.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=0 2024-09-14T11:39:08.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=1 2024-09-14T11:39:08.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=2 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=3 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=4 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=5 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.190+0000 7f5d3840e800 20 add_watcher() i=6 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.191+0000 7f5d3840e800 20 add_watcher() i=7 2024-09-14T11:39:08.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.191+0000 7f5d3840e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:08.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.193+0000 7f5be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.193+0000 7f5d3840e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.193+0000 7f5d3840e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5d3840e800 5 note: GC not initialized 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5be8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5d3840e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5d3840e800 20 Filter name: none 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5b627fc640 20 reqs_thread_entry: start 2024-09-14T11:39:08.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.194+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.195+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:08.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.195+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.194 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.195+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:08.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.195+0000 7f5d3840e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.195+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.196+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:08.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.196+0000 7f5d3840e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.196+0000 7f5d3840e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:08.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.196+0000 7f5d3840e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.198+0000 7f5be9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.200+0000 7f5d3840e800 20 remove_watcher() i=0 2024-09-14T11:39:08.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.200+0000 7f5d3840e800 2 removed watcher, disabling cache 2024-09-14T11:39:08.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.201+0000 7f5d3840e800 20 remove_watcher() i=1 2024-09-14T11:39:08.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.202+0000 7f5d3840e800 20 remove_watcher() i=2 2024-09-14T11:39:08.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.203+0000 7f5d3840e800 20 remove_watcher() i=3 2024-09-14T11:39:08.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.204+0000 7f5d3840e800 20 remove_watcher() i=4 2024-09-14T11:39:08.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.205+0000 7f5d3840e800 20 remove_watcher() i=5 2024-09-14T11:39:08.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.206+0000 7f5d3840e800 20 remove_watcher() i=6 2024-09-14T11:39:08.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.207+0000 7f5d3840e800 20 remove_watcher() i=7 2024-09-14T11:39:08.216 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:08.216 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:08.216 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:08.216 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:08.218 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:39:08.252 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:08.252 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:08.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.290+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 20 realm 2024-09-14T11:39:08.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:08.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.291+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.292+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.292+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.292+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.292+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.293+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:08.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.293+0000 7f998ec40800 20 searching for the correct realm 2024-09-14T11:39:08.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.295+0000 7f9983fff640 0 -- 172.21.15.116:0/4068396036 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f997c03f030 msgr2=0x7f997c03f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.299+0000 7f998c72a640 0 -- 172.21.15.116:0/4068396036 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9974085030 msgr2=0x7f9974073040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.504+0000 7f998ec40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 zone default found 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 4 Realm: () 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 zonegroup default 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.505+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 started sync module instance, tier type = 2024-09-14T11:39:08.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.506+0000 7f998ec40800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=0 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=1 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=2 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=3 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=4 2024-09-14T11:39:08.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=5 2024-09-14T11:39:08.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.515+0000 7f998ec40800 20 add_watcher() i=6 2024-09-14T11:39:08.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.516+0000 7f998ec40800 20 add_watcher() i=7 2024-09-14T11:39:08.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.516+0000 7f998ec40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:08.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f9842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 5 note: GC not initialized 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f9841fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 20 Filter name: none 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f97b37fe640 20 reqs_thread_entry: start 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.518+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:08.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 : miss 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:08.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:08.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.519+0000 7f998ec40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f998ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f998ec40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f998ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f998ec40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30, ofs0, ns] 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f9862ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 93875418954112 notifier 6800 bl.length()=931 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f9862ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f9862ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:08.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.525+0000 7f9862ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:08.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.527+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_sources= new_sources= 2024-09-14T11:39:08.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.527+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential sources added=[] removed=[] 2024-09-14T11:39:08.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.527+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_dests= new_dests= 2024-09-14T11:39:08.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.527+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential dests added=[] removed=[] 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.0 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.0 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.1 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.1 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.2 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.2 2024-09-14T11:39:08.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.3 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.3 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.4 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.4 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.5 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.5 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.6 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.6 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.7 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.7 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.8 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.8 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.9 2024-09-14T11:39:08.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.9 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.10 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.10 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.11 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1.11 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.0 2024-09-14T11:39:08.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.532+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.533+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.533+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.3 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.534+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.4 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.534+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.5 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.535+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.6 2024-09-14T11:39:08.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.535+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.7 2024-09-14T11:39:08.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.536+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.8 2024-09-14T11:39:08.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.536+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.9 2024-09-14T11:39:08.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.537+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.10 2024-09-14T11:39:08.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.540+0000 7f998ec40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:08.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.540+0000 7f998ec40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 2024-09-14T11:39:08.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.541+0000 7f998ec40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:08.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.541+0000 7f998ec40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:08.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.541+0000 7f998ec40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:08.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.541+0000 7f998ec40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30, ofs0, ns] 2024-09-14T11:39:08.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.542+0000 7f9862ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 93875418954112 notifier 6800 bl.length()=931 2024-09-14T11:39:08.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.542+0000 7f9862ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:08.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.542+0000 7f9862ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:08.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.542+0000 7f9862ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:08.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.543+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_sources= new_sources= 2024-09-14T11:39:08.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.543+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential sources added=[] removed=[] 2024-09-14T11:39:08.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.543+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_dests= new_dests= 2024-09-14T11:39:08.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.543+0000 7f998ec40800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential dests added=[] removed=[] 2024-09-14T11:39:08.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.546+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.0 2024-09-14T11:39:08.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.547+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1 2024-09-14T11:39:08.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.547+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2 2024-09-14T11:39:08.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.547+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.3 2024-09-14T11:39:08.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.547+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.4 2024-09-14T11:39:08.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.548+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.5 2024-09-14T11:39:08.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.548+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.6 2024-09-14T11:39:08.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.548+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.7 2024-09-14T11:39:08.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.549+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.8 2024-09-14T11:39:08.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.549+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.9 2024-09-14T11:39:08.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.549+0000 7f998ec40800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.10 2024-09-14T11:39:08.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.550+0000 7f998ec40800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:39:08.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.550+0000 7f998ec40800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:39:08.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.554+0000 7f9842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.556+0000 7f998ec40800 20 remove_watcher() i=0 2024-09-14T11:39:08.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.556+0000 7f998ec40800 2 removed watcher, disabling cache 2024-09-14T11:39:08.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.557+0000 7f998ec40800 20 remove_watcher() i=1 2024-09-14T11:39:08.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.558+0000 7f998ec40800 20 remove_watcher() i=2 2024-09-14T11:39:08.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.559+0000 7f998ec40800 20 remove_watcher() i=3 2024-09-14T11:39:08.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.560+0000 7f998ec40800 20 remove_watcher() i=4 2024-09-14T11:39:08.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.561+0000 7f998ec40800 20 remove_watcher() i=5 2024-09-14T11:39:08.561 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.562+0000 7f998ec40800 20 remove_watcher() i=6 2024-09-14T11:39:08.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.563+0000 7f998ec40800 20 remove_watcher() i=7 2024-09-14T11:39:08.574 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:39:08.602 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:08.602 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:08.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.640+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 20 realm 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.641+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.642+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.642+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.643+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.643+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.643+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:08.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.643+0000 7f6d92898800 20 searching for the correct realm 2024-09-14T11:39:08.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.646+0000 7f6d87b81640 0 -- 172.21.15.116:0/190146630 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5569f067f770 msgr2=0x5569f0681b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.650+0000 7f6d90382640 0 -- 172.21.15.116:0/190146630 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6d7801d430 msgr2=0x7f6d7801d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.653 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 zone default found 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 4 Realm: () 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 zonegroup default 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.654+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.655 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 started sync module instance, tier type = 2024-09-14T11:39:08.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.655+0000 7f6d92898800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=0 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=1 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=2 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=3 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=4 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=5 2024-09-14T11:39:08.663 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.664+0000 7f6d92898800 20 add_watcher() i=6 2024-09-14T11:39:08.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.665+0000 7f6d92898800 20 add_watcher() i=7 2024-09-14T11:39:08.664 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.665+0000 7f6d92898800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:08.665 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.666+0000 7f6c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 5 note: GC not initialized 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6c45fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 20 Filter name: none 2024-09-14T11:39:08.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6bb77fe640 20 reqs_thread_entry: start 2024-09-14T11:39:08.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.667+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.668+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:08.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.668+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.668+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.668+0000 7f6d92898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.668+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.669+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.669+0000 7f6d92898800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.669+0000 7f6d92898800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:08.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.669+0000 7f6d92898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:08.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.670+0000 7f6c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:08.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.672+0000 7f6d92898800 20 remove_watcher() i=0 2024-09-14T11:39:08.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.673+0000 7f6d92898800 2 removed watcher, disabling cache 2024-09-14T11:39:08.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.673+0000 7f6d92898800 20 remove_watcher() i=1 2024-09-14T11:39:08.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.674+0000 7f6d92898800 20 remove_watcher() i=2 2024-09-14T11:39:08.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.675+0000 7f6d92898800 20 remove_watcher() i=3 2024-09-14T11:39:08.675 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.676+0000 7f6d92898800 20 remove_watcher() i=4 2024-09-14T11:39:08.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.677+0000 7f6d92898800 20 remove_watcher() i=5 2024-09-14T11:39:08.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.678+0000 7f6d92898800 20 remove_watcher() i=6 2024-09-14T11:39:08.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.679+0000 7f6d92898800 20 remove_watcher() i=7 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:08.688 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:08.779 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:08.809 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:08.809 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:08.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.846+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.847+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.847+0000 7f0b04663800 20 realm 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.847+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.848+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.848+0000 7f0b04663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.848+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.848+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:08.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.848+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.849+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:08.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.849+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:08.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.849+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:08.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.849+0000 7f0b04663800 20 searching for the correct realm 2024-09-14T11:39:08.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.852+0000 7f0b02955640 0 -- 172.21.15.116:0/2246286562 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f0aec00e070 msgr2=0x7f0aec05fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:08.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:08.855+0000 7f0b02154640 0 -- 172.21.15.116:0/2246286562 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f0aec05f5d0 msgr2=0x7f0aec087620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:09.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:09.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:09.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.061+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 zone default found 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 4 Realm: () 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:09.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 zonegroup default 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 started sync module instance, tier type = 2024-09-14T11:39:09.063 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.062+0000 7f0b04663800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=0 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=1 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=2 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=3 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=4 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=5 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.072+0000 7f0b04663800 20 add_watcher() i=6 2024-09-14T11:39:09.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.073+0000 7f0b04663800 20 add_watcher() i=7 2024-09-14T11:39:09.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.073+0000 7f0b04663800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.074+0000 7f09b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.074+0000 7f0b04663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.074+0000 7f0b04663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.074+0000 7f0b04663800 5 note: GC not initialized 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f09337fe640 20 reqs_thread_entry: start 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f0b04663800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f0b04663800 20 Filter name: none 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f09317fa640 20 reqs_thread_entry: start 2024-09-14T11:39:09.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f0b04663800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.075+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:09.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 : miss 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.076+0000 7f0b04663800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 2024-09-14T11:39:09.076 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.077+0000 7f0b04663800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:39:09.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f0b04663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f0b04663800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f0b04663800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f0b04663800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30, ofs0, ns] 2024-09-14T11:39:09.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f09e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94547490902784 notifier 6830 bl.length()=931 2024-09-14T11:39:09.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f09e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f09e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.086+0000 7f09e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.088+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_sources= new_sources= 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.088+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential sources added=[] removed=[] 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.088+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_dests= new_dests= 2024-09-14T11:39:09.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.088+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential dests added=[] removed=[] 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.0 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.0 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.1 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.1 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.2 2024-09-14T11:39:09.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.2 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.3 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.3 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.4 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.4 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.5 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.5 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.6 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.6 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.7 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.7 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.8 2024-09-14T11:39:09.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.8 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.9 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.9 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.10 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.10 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.11 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2.11 2024-09-14T11:39:09.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.093+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.0 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.094+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.094+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.094+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.3 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.095+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.4 2024-09-14T11:39:09.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.096+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.5 2024-09-14T11:39:09.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.096+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.6 2024-09-14T11:39:09.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.097+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.7 2024-09-14T11:39:09.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.097+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.8 2024-09-14T11:39:09.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.098+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.9 2024-09-14T11:39:09.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.099+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.10 2024-09-14T11:39:09.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.102+0000 7f0b04663800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:09.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.102+0000 7f0b04663800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f0b04663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f0b04663800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f0b04663800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f0b04663800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30, ofs0, ns] 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f09e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94547490902784 notifier 6830 bl.length()=931 2024-09-14T11:39:09.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f09e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f09e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.103+0000 7f09e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.105+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_sources= new_sources= 2024-09-14T11:39:09.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.105+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential sources added=[] removed=[] 2024-09-14T11:39:09.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.105+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_dests= new_dests= 2024-09-14T11:39:09.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.105+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential dests added=[] removed=[] 2024-09-14T11:39:09.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.107+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.0 2024-09-14T11:39:09.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.107+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.1 2024-09-14T11:39:09.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.108+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.2 2024-09-14T11:39:09.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.108+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.3 2024-09-14T11:39:09.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.108+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.4 2024-09-14T11:39:09.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.109+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.5 2024-09-14T11:39:09.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.109+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.6 2024-09-14T11:39:09.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.109+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.7 2024-09-14T11:39:09.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.110+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.8 2024-09-14T11:39:09.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.110+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.9 2024-09-14T11:39:09.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.110+0000 7f0b04663800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30.10 2024-09-14T11:39:09.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.110+0000 7f0b04663800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:09.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.110+0000 7f0b04663800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f0b04663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f0b04663800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f0b04663800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f0b04663800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30, ofs0, ns] 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f09e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94547490902784 notifier 6830 bl.length()=899 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f09e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 info.flags=0x17 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f09e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 to cache LRU end 2024-09-14T11:39:09.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.112+0000 7f09e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.113+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_sources= new_sources= 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.113+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential sources added=[] removed=[] 2024-09-14T11:39:09.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.113+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): orig_dests= new_dests= 2024-09-14T11:39:09.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.113+0000 7f0b04663800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30]): potential dests added=[] removed=[] 2024-09-14T11:39:09.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.116+0000 7f0b04663800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:09.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.117+0000 7f09b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.120+0000 7f0b04663800 20 remove_watcher() i=0 2024-09-14T11:39:09.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.120+0000 7f0b04663800 2 removed watcher, disabling cache 2024-09-14T11:39:09.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.121+0000 7f0b04663800 20 remove_watcher() i=1 2024-09-14T11:39:09.121 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.122+0000 7f0b04663800 20 remove_watcher() i=2 2024-09-14T11:39:09.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.123+0000 7f0b04663800 20 remove_watcher() i=3 2024-09-14T11:39:09.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.124+0000 7f0b04663800 20 remove_watcher() i=4 2024-09-14T11:39:09.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.125+0000 7f0b04663800 20 remove_watcher() i=5 2024-09-14T11:39:09.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.125+0000 7f0b04663800 20 remove_watcher() i=6 2024-09-14T11:39:09.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.126+0000 7f0b04663800 20 remove_watcher() i=7 2024-09-14T11:39:09.136 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:39:09.166 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:09.166 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:09.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.203+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 realm 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.205+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.206+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.206+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.207+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:09.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.207+0000 7f2b37b22800 20 searching for the correct realm 2024-09-14T11:39:09.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.209+0000 7f2b34069640 0 -- 172.21.15.116:0/2712370282 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f2b1c018440 msgr2=0x7f2b1c018860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.212 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.213+0000 7f2b33868640 0 -- 172.21.15.116:0/2712370282 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f2b1c041920 msgr2=0x7f2b1c028400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:09.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:09.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.419+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 zone default found 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 4 Realm: () 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 zonegroup default 2024-09-14T11:39:09.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 started sync module instance, tier type = 2024-09-14T11:39:09.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.420+0000 7f2b37b22800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:09.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=0 2024-09-14T11:39:09.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=1 2024-09-14T11:39:09.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=2 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=3 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=4 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=5 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.429+0000 7f2b37b22800 20 add_watcher() i=6 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.430+0000 7f2b37b22800 20 add_watcher() i=7 2024-09-14T11:39:09.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.430+0000 7f2b37b22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:09.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f29e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f2b37b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f2b37b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f2b37b22800 5 note: GC not initialized 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f29e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f2b37b22800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.432+0000 7f2b37b22800 20 Filter name: none 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.433+0000 7f29627fc640 20 reqs_thread_entry: start 2024-09-14T11:39:09.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.433+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.433+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.433+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:09.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 rados->read ofs=0 len=0 2024-09-14T11:39:09.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:09.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.434+0000 7f2b37b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:09.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.436+0000 7f29e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:09.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.438+0000 7f2b37b22800 20 remove_watcher() i=0 2024-09-14T11:39:09.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.438+0000 7f2b37b22800 2 removed watcher, disabling cache 2024-09-14T11:39:09.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.439+0000 7f2b37b22800 20 remove_watcher() i=1 2024-09-14T11:39:09.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.440+0000 7f2b37b22800 20 remove_watcher() i=2 2024-09-14T11:39:09.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.441+0000 7f2b37b22800 20 remove_watcher() i=3 2024-09-14T11:39:09.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.442+0000 7f2b37b22800 20 remove_watcher() i=4 2024-09-14T11:39:09.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.443+0000 7f2b37b22800 20 remove_watcher() i=5 2024-09-14T11:39:09.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.444+0000 7f2b37b22800 20 remove_watcher() i=6 2024-09-14T11:39:09.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:09.445+0000 7f2b37b22800 20 remove_watcher() i=7 2024-09-14T11:39:09.454 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:09.454 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:09.454 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:09.454 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:09.823 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:39:09.823 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:10.623 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:39:10.651 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.651 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:10.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.688+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 20 realm 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.690+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.691+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.691+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.691+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.691+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.692+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:10.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.692+0000 7fa18d940800 20 searching for the correct realm 2024-09-14T11:39:10.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.695+0000 7fa189e87640 0 -- 172.21.15.116:0/3310359577 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa18007a410 msgr2=0x7fa18007a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.698+0000 7fa189686640 0 -- 172.21.15.116:0/3310359577 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa18006d3e0 msgr2=0x7fa18006d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:10.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:10.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:10.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.904+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 zone default found 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 4 Realm: () 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 zonegroup default 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.905 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:10.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 started sync module instance, tier type = 2024-09-14T11:39:10.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.905+0000 7fa18d940800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:10.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=0 2024-09-14T11:39:10.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=1 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=2 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=3 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=4 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=5 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.914+0000 7fa18d940800 20 add_watcher() i=6 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.915+0000 7fa18d940800 20 add_watcher() i=7 2024-09-14T11:39:10.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.915+0000 7fa18d940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.918+0000 7fa03f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.918+0000 7fa18d940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.918+0000 7fa18d940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.918+0000 7fa18d940800 5 note: GC not initialized 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.919+0000 7fa03e7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.919+0000 7fa18d940800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.919+0000 7fa18d940800 20 Filter name: none 2024-09-14T11:39:10.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.919+0000 7f9faffff640 20 reqs_thread_entry: start 2024-09-14T11:39:10.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.919+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.920+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.920+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.920+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.920+0000 7fa18d940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.920+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.921+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.921+0000 7fa18d940800 20 rados->read ofs=0 len=0 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.921+0000 7fa18d940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:10.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.921+0000 7fa18d940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:10.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.922+0000 7fa03f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:10.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.925+0000 7fa18d940800 20 remove_watcher() i=0 2024-09-14T11:39:10.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.925+0000 7fa18d940800 2 removed watcher, disabling cache 2024-09-14T11:39:10.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.926+0000 7fa18d940800 20 remove_watcher() i=1 2024-09-14T11:39:10.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.927+0000 7fa18d940800 20 remove_watcher() i=2 2024-09-14T11:39:10.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.928+0000 7fa18d940800 20 remove_watcher() i=3 2024-09-14T11:39:10.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.929+0000 7fa18d940800 20 remove_watcher() i=4 2024-09-14T11:39:10.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.929+0000 7fa18d940800 20 remove_watcher() i=5 2024-09-14T11:39:10.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.930+0000 7fa18d940800 20 remove_watcher() i=6 2024-09-14T11:39:10.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:10.931+0000 7fa18d940800 20 remove_watcher() i=7 2024-09-14T11:39:10.940 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:10.940 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:10.940 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:10.941 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:10.942 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:39:10.978 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:10.978 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.015+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 realm 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.017+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.018+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.018+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.018+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.018+0000 7fc988c98800 20 searching for the correct realm 2024-09-14T11:39:11.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.021+0000 7fc985f81640 0 -- 172.21.15.116:0/2161151336 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fc9780722a0 msgr2=0x7fc978067b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.024+0000 7fc986782640 0 -- 172.21.15.116:0/2161151336 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc970074780 msgr2=0x7fc9700c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.229+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 zone default found 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 4 Realm: () 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 zonegroup default 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.230+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.231+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.231+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.231+0000 7fc988c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.231+0000 7fc988c98800 20 started sync module instance, tier type = 2024-09-14T11:39:11.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.231+0000 7fc988c98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=0 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=1 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=2 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=3 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=4 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=5 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=6 2024-09-14T11:39:11.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 20 add_watcher() i=7 2024-09-14T11:39:11.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.240+0000 7fc988c98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.242+0000 7fc83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 5 note: GC not initialized 2024-09-14T11:39:11.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc7b77fe640 20 reqs_thread_entry: start 2024-09-14T11:39:11.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 20 Filter name: none 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc7b57fa640 20 reqs_thread_entry: start 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.243+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 : miss 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:11.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.244+0000 7fc988c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc988c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc988c98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc988c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc988c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31, ofs0, ns] 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc8697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94357939082272 notifier 7449 bl.length()=931 2024-09-14T11:39:11.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc8697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc8697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.250+0000 7fc8697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.252+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_sources= new_sources= 2024-09-14T11:39:11.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.252+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential sources added=[] removed=[] 2024-09-14T11:39:11.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.252+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_dests= new_dests= 2024-09-14T11:39:11.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.252+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential dests added=[] removed=[] 2024-09-14T11:39:11.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.0 2024-09-14T11:39:11.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.0 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.1 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.1 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.2 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.2 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.3 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.3 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.4 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.4 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.5 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.5 2024-09-14T11:39:11.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.6 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.6 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.7 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.7 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.8 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.8 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.9 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.9 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.10 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.10 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.11 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1.11 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.256+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.0 2024-09-14T11:39:11.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.257+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1 2024-09-14T11:39:11.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.257+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.2 2024-09-14T11:39:11.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.257+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.3 2024-09-14T11:39:11.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.258+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.4 2024-09-14T11:39:11.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.259+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.5 2024-09-14T11:39:11.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.260+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.6 2024-09-14T11:39:11.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.260+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.7 2024-09-14T11:39:11.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.260+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.8 2024-09-14T11:39:11.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.261+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.9 2024-09-14T11:39:11.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.262+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.10 2024-09-14T11:39:11.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.264+0000 7fc988c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:11.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.264+0000 7fc988c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 2024-09-14T11:39:11.264 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.265+0000 7fc988c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.265+0000 7fc988c98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.265+0000 7fc988c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.265+0000 7fc988c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31, ofs0, ns] 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.266+0000 7fc869ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94357939082272 notifier 7449 bl.length()=931 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.266+0000 7fc869ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.266+0000 7fc869ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.266+0000 7fc869ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.268+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_sources= new_sources= 2024-09-14T11:39:11.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.268+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential sources added=[] removed=[] 2024-09-14T11:39:11.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.268+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_dests= new_dests= 2024-09-14T11:39:11.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.268+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential dests added=[] removed=[] 2024-09-14T11:39:11.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.270+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.0 2024-09-14T11:39:11.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.270+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.1 2024-09-14T11:39:11.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.271+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.2 2024-09-14T11:39:11.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.271+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.3 2024-09-14T11:39:11.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.271+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.4 2024-09-14T11:39:11.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.272+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.5 2024-09-14T11:39:11.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.272+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.6 2024-09-14T11:39:11.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.272+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.7 2024-09-14T11:39:11.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.272+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.8 2024-09-14T11:39:11.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.273+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.9 2024-09-14T11:39:11.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.273+0000 7fc988c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31.10 2024-09-14T11:39:11.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.273+0000 7fc988c98800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:39:11.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.273+0000 7fc988c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:11.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.274+0000 7fc988c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 2024-09-14T11:39:11.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc988c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc988c98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc988c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc988c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31, ofs0, ns] 2024-09-14T11:39:11.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc869ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94357939082272 notifier 7449 bl.length()=899 2024-09-14T11:39:11.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc869ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 info.flags=0x17 2024-09-14T11:39:11.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc869ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 to cache LRU end 2024-09-14T11:39:11.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.275+0000 7fc869ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:11.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.277+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_sources= new_sources= 2024-09-14T11:39:11.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.277+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential sources added=[] removed=[] 2024-09-14T11:39:11.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.277+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): orig_dests= new_dests= 2024-09-14T11:39:11.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.277+0000 7fc988c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31]): potential dests added=[] removed=[] 2024-09-14T11:39:11.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.279+0000 7fc988c98800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:11.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.281+0000 7fc83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.283+0000 7fc988c98800 20 remove_watcher() i=0 2024-09-14T11:39:11.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.283+0000 7fc988c98800 2 removed watcher, disabling cache 2024-09-14T11:39:11.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.284+0000 7fc988c98800 20 remove_watcher() i=1 2024-09-14T11:39:11.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.285+0000 7fc988c98800 20 remove_watcher() i=2 2024-09-14T11:39:11.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.286+0000 7fc988c98800 20 remove_watcher() i=3 2024-09-14T11:39:11.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.287+0000 7fc988c98800 20 remove_watcher() i=4 2024-09-14T11:39:11.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.288+0000 7fc988c98800 20 remove_watcher() i=5 2024-09-14T11:39:11.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.289+0000 7fc988c98800 20 remove_watcher() i=6 2024-09-14T11:39:11.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.290+0000 7fc988c98800 20 remove_watcher() i=7 2024-09-14T11:39:11.300 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:39:11.329 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:11.329 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:11.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.366+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 realm 2024-09-14T11:39:11.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:11.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.368+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.370+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.370+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.370+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:11.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.370+0000 7f73d5b19800 20 searching for the correct realm 2024-09-14T11:39:11.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.373+0000 7f73d3e04640 0 -- 172.21.15.116:0/2526792501 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f73bc044370 msgr2=0x7f73bc0965a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:11.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.376+0000 7f73d3603640 0 -- 172.21.15.116:0/2526792501 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f73bc06a160 msgr2=0x7f73bc0830b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:11.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:11.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.582+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:11.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 zone default found 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 4 Realm: () 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:11.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 zonegroup default 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.583+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.584+0000 7f73d5b19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.584+0000 7f73d5b19800 20 started sync module instance, tier type = 2024-09-14T11:39:11.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.584+0000 7f73d5b19800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=0 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=1 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=2 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=3 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=4 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=5 2024-09-14T11:39:11.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.593+0000 7f73d5b19800 20 add_watcher() i=6 2024-09-14T11:39:11.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.594+0000 7f73d5b19800 20 add_watcher() i=7 2024-09-14T11:39:11.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.594+0000 7f73d5b19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:11.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f7289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 5 note: GC not initialized 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f7288fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 Filter name: none 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f72027fc640 20 reqs_thread_entry: start 2024-09-14T11:39:11.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.596+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.597+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.597+0000 7f73d5b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.597+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.597+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:11.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.597+0000 7f73d5b19800 20 rados->read ofs=0 len=0 2024-09-14T11:39:11.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.598+0000 7f73d5b19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:11.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.598+0000 7f73d5b19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:11.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.599+0000 7f7289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.601+0000 7f73d5b19800 20 remove_watcher() i=0 2024-09-14T11:39:11.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.601+0000 7f73d5b19800 2 removed watcher, disabling cache 2024-09-14T11:39:11.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.602+0000 7f73d5b19800 20 remove_watcher() i=1 2024-09-14T11:39:11.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.603+0000 7f73d5b19800 20 remove_watcher() i=2 2024-09-14T11:39:11.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.604+0000 7f73d5b19800 20 remove_watcher() i=3 2024-09-14T11:39:11.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.606+0000 7f73d5b19800 20 remove_watcher() i=4 2024-09-14T11:39:11.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.607+0000 7f73d5b19800 20 remove_watcher() i=5 2024-09-14T11:39:11.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.608+0000 7f73d5b19800 20 remove_watcher() i=6 2024-09-14T11:39:11.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:11.608+0000 7f73d5b19800 20 remove_watcher() i=7 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:39:11.618 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:11.989 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:39:11.989 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:12.795 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:39:12.822 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:12.822 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:12.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.860+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 realm 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:12.861 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.862+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.863+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:12.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.863+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:12.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.864+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:12.862 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.864+0000 7ff6745a9800 20 searching for the correct realm 2024-09-14T11:39:12.864 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:12.866+0000 7ff66bfff640 0 -- 172.21.15.116:0/918187194 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7ff6640884d0 msgr2=0x7ff664073a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.072+0000 7ff672093640 0 -- 172.21.15.116:0/918187194 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff65c059910 msgr2=0x7ff65c017420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.279+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 zone default found 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 4 Realm: () 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 zonegroup default 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.280+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.281+0000 7ff6745a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.281+0000 7ff6745a9800 20 started sync module instance, tier type = 2024-09-14T11:39:13.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.281+0000 7ff6745a9800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=0 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=1 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=2 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=3 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=4 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=5 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.290+0000 7ff6745a9800 20 add_watcher() i=6 2024-09-14T11:39:13.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.291+0000 7ff6745a9800 20 add_watcher() i=7 2024-09-14T11:39:13.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.291+0000 7ff6745a9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.292+0000 7ff528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 5 note: GC not initialized 2024-09-14T11:39:13.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff4a37fe640 20 reqs_thread_entry: start 2024-09-14T11:39:13.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 20 Filter name: none 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff4a17fa640 20 reqs_thread_entry: start 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.293+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.294+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.294+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.294+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.294+0000 7ff6745a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:13.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.294+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.295+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.295+0000 7ff6745a9800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.295+0000 7ff6745a9800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.295+0000 7ff6745a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:13.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.297+0000 7ff528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.299+0000 7ff6745a9800 20 remove_watcher() i=0 2024-09-14T11:39:13.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.299+0000 7ff6745a9800 2 removed watcher, disabling cache 2024-09-14T11:39:13.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.300+0000 7ff6745a9800 20 remove_watcher() i=1 2024-09-14T11:39:13.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.301+0000 7ff6745a9800 20 remove_watcher() i=2 2024-09-14T11:39:13.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.302+0000 7ff6745a9800 20 remove_watcher() i=3 2024-09-14T11:39:13.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.303+0000 7ff6745a9800 20 remove_watcher() i=4 2024-09-14T11:39:13.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.304+0000 7ff6745a9800 20 remove_watcher() i=5 2024-09-14T11:39:13.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.305+0000 7ff6745a9800 20 remove_watcher() i=6 2024-09-14T11:39:13.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.306+0000 7ff6745a9800 20 remove_watcher() i=7 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:13.315 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.316 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:39:13.351 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:13.351 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:13.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.390+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 realm 2024-09-14T11:39:13.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.393+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.393+0000 7fa0dea98800 20 searching for the correct realm 2024-09-14T11:39:13.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.395+0000 7fa0d3fff640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa0cc061740 msgr2=0x7fa0cc0783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.399+0000 7fa0dc582640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa0c408e220 msgr2=0x7fa0c401c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.603 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zone default found 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Realm: () 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zonegroup default 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started sync module instance, tier type = 2024-09-14T11:39:13.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=0 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=1 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=2 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=3 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=4 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=5 2024-09-14T11:39:13.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=6 2024-09-14T11:39:13.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=7 2024-09-14T11:39:13.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.615+0000 7fa0dea98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.617+0000 7f9f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 5 note: GC not initialized 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7f9f91fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 20 Filter name: none 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7f9f037fe640 20 reqs_thread_entry: start 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:39:13.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : miss 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:13.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.619+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.625 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.629 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.630 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.636+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.639+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:13.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.639+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.638 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.644+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.646 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0dea98800 time 2024-09-14T11:39:13.648818+0000 2024-09-14T11:39:13.646 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:13.646 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.646 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0e1f8c76a] 2024-09-14T11:39:13.646 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa0dea98800 thread_name:radosgw-admin 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.648+0000 7fa0dea98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0dea98800 time 2024-09-14T11:39:13.648818+0000 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.647 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0e1f8c76a] 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:13.648 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0e0c3e6f0] 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0e0c8b99c] 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0e1f8c7c4] 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.676 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.649+0000 7fa0dea98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa0dea98800 thread_name:radosgw-admin 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0e0c3e6f0] 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0e0c8b99c] 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:13.677 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0e1f8c7c4] 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.678 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x55823fff75d0 auth_method 0 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.679 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:39:13.375+0000 7fa0dc582640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: dump: 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.680 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: dump: 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.681 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:39:13.376+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:39:13.376+0000 7f9fca60c640 4 set_mon_vals no callback set 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:39:13.376+0000 7fa0dea98800 1 librados: init done 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.682 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:39:13.378+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7f9fc4077230 auth_method 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:39:13.378+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x55824017ccd0 auth_method 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:39:13.379+0000 7fa0dc582640 10 monclient: get_auth_request con 0x5582401969f0 auth_method 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:39:13.380+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x55824019ba80 auth_method 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:39:13.381+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.683 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.684 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:39:13.381+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command objecter_requests cmddesc objecter_requests hook 0x5582401a3000 EEXIST 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.685 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:39:13.381+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:39:13.382+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:39:13.382+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x55824019ebd0 EEXIST 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.686 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x5582401c7320 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x5582401c7700 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x5582401c6030 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.988135s 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x5582401c7700 auth_method 0 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x5582401c6030 auth_method 0 2024-09-14T11:39:13.687 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x5582401c7320 auth_method 0 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.688 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 6926 payload 824 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 1 monclient: found mon.noname-c 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: dump: 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.689 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:13.690 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: dump: 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:39:13.382+0000 7fa0dea98800 5 monclient: authenticate success, global_id 6926 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:39:13.382+0000 7fa0dd584640 4 set_mon_vals no callback set 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.691 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:39:13.384+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7f9fb4077140 auth_method 0 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: get_monmap_and_config 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:39:13.384+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.692 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.693 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.694 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x7fffdf696408 EEXIST 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x55824021b8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.695 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x55824020c200 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x558240216ce0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.991916s 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x55824020c200 auth_method 0 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x55824021b8b0 auth_method 0 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.696 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x558240216ce0 auth_method 0 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.697 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 7500 payload 274 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: dump: 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.698 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: dump: 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.699 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:39:13.386+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7500 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:39:13.386+0000 7fa0dea98800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:39:13.386+0000 7fa0dea98800 4 set_mon_vals no callback set 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:39:13.386+0000 7fa0dea98800 10 monclient: shutdown 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.700 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.701 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: starting msgr at 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: starting objecter 2024-09-14T11:39:13.702 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command objecter_requests cmddesc objecter_requests hook 0x5582401ed2b0 EEXIST 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: setting wanted keys 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: calling monclient init 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.703 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x5582401dbd28 EEXIST 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x55824020c200 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x558240216ce0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x55824021b8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.704 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.994049s 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x558240216ce0 auth_method 0 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x55824021b8b0 auth_method 0 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x55824020c200 auth_method 0 2024-09-14T11:39:13.705 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.706 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: dump: 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.707 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: dump: 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:39:13.388+0000 7f9fb37fe640 4 set_mon_vals no callback set 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:39:13.388+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7503 2024-09-14T11:39:13.708 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:39:13.388+0000 7fa0dea98800 1 librados: init done 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:39:13.388+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cr dump hook 0x558240211348 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:39:13.390+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:39:13.390+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7f9fa4077230 auth_method 0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:39:13.390+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x5582402358a0 auth_method 0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.709 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 realm 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:39:13.391+0000 7fa0dea98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:39:13.392+0000 7fa0dc582640 10 monclient: get_auth_request con 0x558240239ae0 auth_method 0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:39:13.393+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:39:13.393+0000 7fa0dea98800 20 searching for the correct realm 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:39:13.393+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x55824023ed10 auth_method 0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:39:13.393+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x7fa0c407b580 auth_method 0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:39:13.394+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0d4061040 auth_method 0 2024-09-14T11:39:13.710 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7fa0cc061740 auth_method 0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa0cc061740 msgr2=0x7fa0cc0783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 1 client.7503.objecter ms_handle_reset 0x7fa0cc061740 session 0x7fa0cc090040 osd.4 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 10 monclient: _renew_subs 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7f9fa40870d0 auth_method 0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:39:13.397+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x7fa0c4074260 auth_method 0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:39:13.399+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0c408e220 auth_method 0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:39:13.399+0000 7fa0dc582640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa0c408e220 msgr2=0x7fa0c401c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:39:13.600+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0c408e220 auth_method 0 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:13.711 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zone default found 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Realm: () 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:39:13.605+0000 7fa0dea98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.712 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zonegroup default 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started sync module instance, tier type = 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=0 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=1 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=2 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=3 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=4 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=5 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=6 2024-09-14T11:39:13.713 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=7 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:39:13.615+0000 7fa0dea98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:39:13.617+0000 7f9f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.714 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:39:13.618+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache list hook 0x558240212ab0 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache inspect hook 0x558240212ab0 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache erase hook 0x558240212ab0 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache zap hook 0x558240212ab0 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 note: GC not initialized 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:39:13.618+0000 7f9f91fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace show hook 0x7fa0d4064040 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace history hook 0x7fa0d4064040 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace active hook 0x7fa0d4064040 2024-09-14T11:39:13.715 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace active_short hook 0x7fa0d4064040 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 Filter name: none 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:39:13.618+0000 7f9f037fe640 20 reqs_thread_entry: start 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:39:13.618+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : miss 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.716 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.717 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.718 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.719 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:39:13.636+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:39:13.639+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:39:13.639+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.720 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:39:13.644+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.721 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:39:13.648+0000 7fa0dea98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0dea98800 time 2024-09-14T11:39:13.648818+0000 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0e1f8c76a] 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.722 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:39:13.649+0000 7fa0dea98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa0dea98800 thread_name:radosgw-admin 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0e0c3e6f0] 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0e0c8b99c] 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0e1f8c7c4] 2024-09-14T11:39:13.723 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:39:13.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:39:13.725 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:39:13.726 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:13.727 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:39:13.728 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:39:13.729 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:39:13.730 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f037fe640 / http_manager 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f91fdb640 / http_manager 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f92fdd640 / rgw_dt_lg_renew 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb1ffb640 / ms_dispatch 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb2ffd640 / io_context_pool 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb37fe640 / io_context_pool 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fc1ffb640 / ms_dispatch 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fc8e09640 / ms_dispatch 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fca60c640 / io_context_pool 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0d3fff640 / msgr-worker-2 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dc582640 / msgr-worker-1 2024-09-14T11:39:13.731 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dcd83640 / msgr-worker-0 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dd584640 / io_context_pool 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dea98800 / radosgw-admin 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.121963.log 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x55823fff75d0 auth_method 0 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.732 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:39:13.375+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:39:13.375+0000 7fa0dc582640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:39:13.375+0000 7fa0dc582640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:39:13.375+0000 7f9fc8e09640 10 monclient: dump: 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.733 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:39:13.376+0000 7f9fc8e09640 10 monclient: dump: 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.734 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:39:13.376+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7494 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:39:13.376+0000 7f9fca60c640 4 set_mon_vals no callback set 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:39:13.376+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.735 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:39:13.376+0000 7fa0dea98800 1 librados: init done 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:39:13.377+0000 7f9fc8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:39:13.378+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7f9fc4077230 auth_method 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:39:13.378+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x55824017ccd0 auth_method 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:39:13.379+0000 7fa0dc582640 10 monclient: get_auth_request con 0x5582401969f0 auth_method 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:39:13.380+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x55824019ba80 auth_method 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:39:13.381+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.736 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding auth protocol: cephx 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.737 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: crc 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019fad0) adding con mode: secure 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:39:13.381+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command objecter_requests cmddesc objecter_requests hook 0x5582401a3000 EEXIST 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:39:13.381+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding auth protocol: cephx 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.738 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: crc 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:39:13.381+0000 7fa0dea98800 5 AuthRegistry(0x55824019ea88) adding con mode: secure 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:39:13.381+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:39:13.382+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:39:13.382+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x55824019ebd0 EEXIST 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.739 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x5582401c7320 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x5582401c7700 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x5582401c6030 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.988135s 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x5582401c7700 auth_method 0 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x5582401c6030 auth_method 0 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.740 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x5582401c7320 auth_method 0 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:39:13.382+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:39:13.382+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 6926 payload 824 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.741 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 1 monclient: found mon.noname-c 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:39:13.382+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: dump: 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.742 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:39:13.382+0000 7f9fc1ffb640 10 monclient: dump: 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.743 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:39:13.382+0000 7fa0dea98800 5 monclient: authenticate success, global_id 6926 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:39:13.382+0000 7fa0dd584640 4 set_mon_vals no callback set 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:39:13.382+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:39:13.384+0000 7f9fc1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:39:13.384+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7f9fb4077140 auth_method 0 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: get_monmap_and_config 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:39:13.384+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.744 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:39:13.384+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding auth protocol: cephx 2024-09-14T11:39:13.745 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: crc 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x5582401e7290) adding con mode: secure 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.746 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding auth protocol: cephx 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: crc 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6962c0) adding con mode: secure 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:39:13.385+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.747 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:39:13.385+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x7fffdf696408 EEXIST 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x55824021b8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x55824020c200 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x558240216ce0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:39:13.385+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.991916s 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x55824020c200 auth_method 0 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.748 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x55824021b8b0 auth_method 0 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:39:13.386+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x558240216ce0 auth_method 0 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.749 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:39:13.386+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 7500 payload 274 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:39:13.386+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: dump: 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.750 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:39:13.386+0000 7f9fb37fe640 10 monclient: dump: 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.751 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:39:13.386+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7500 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:39:13.386+0000 7fa0dea98800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:39:13.386+0000 7fa0dea98800 4 set_mon_vals no callback set 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:39:13.386+0000 7fa0dea98800 10 monclient: shutdown 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: build_initial_monmap 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 build_initial for_mkfs: 0 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: monmap: 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:13.752 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding auth protocol: cephx 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.753 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: crc 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401eae10) adding con mode: secure 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: starting msgr at 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: starting objecter 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command objecter_requests cmddesc objecter_requests hook 0x5582401ed2b0 EEXIST 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: setting wanted keys 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:39:13.387+0000 7fa0dea98800 1 librados: calling monclient init 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:39:13.387+0000 7fa0dea98800 10 monclient: init 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding auth protocol: cephx 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.754 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: crc 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 AuthRegistry(0x5582401dbbe0) adding con mode: secure 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:39:13.387+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:39:13.387+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command rotate-key cmddesc rotate-key hook 0x5582401dbd28 EEXIST 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:13.755 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-b con 0x55824020c200 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-a con 0x558240216ce0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): picked mon.noname-c con 0x55824021b8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient(hunting): authenticate will time out at 2150.994049s 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request con 0x558240216ce0 auth_method 0 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request con 0x55824021b8b0 auth_method 0 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.756 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): get_auth_request con 0x55824020c200 auth_method 0 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:39:13.388+0000 7fa0dcd83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:39:13.388+0000 7fa0dc582640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient(hunting): handle_auth_done global_id 7503 payload 824 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:39:13.757 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 1 monclient: found mon.noname-a 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:39:13.388+0000 7fa0d3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: dump: 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:39:13.758 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:39:13.388+0000 7f9fb1ffb640 10 monclient: dump: 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:39:13.388+0000 7f9fb37fe640 4 set_mon_vals no callback set 2024-09-14T11:39:13.759 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:39:13.388+0000 7fa0dea98800 5 monclient: authenticate success, global_id 7503 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _renew_subs 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:39:13.388+0000 7fa0dea98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:39:13.388+0000 7fa0dea98800 1 librados: init done 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:39:13.388+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cr dump hook 0x558240211348 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:39:13.390+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:39:13.390+0000 7f9fb1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:39:13.390+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7f9fa4077230 auth_method 0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:39:13.390+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x5582402358a0 auth_method 0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 realm 2024-09-14T11:39:13.760 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:39:13.391+0000 7fa0dea98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:39:13.391+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:39:13.392+0000 7fa0dc582640 10 monclient: get_auth_request con 0x558240239ae0 auth_method 0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:39:13.392+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:39:13.393+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:39:13.393+0000 7fa0dea98800 20 searching for the correct realm 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:39:13.393+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x55824023ed10 auth_method 0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:39:13.393+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x7fa0c407b580 auth_method 0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:39:13.394+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0d4061040 auth_method 0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7fa0cc061740 auth_method 0 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fa0cc061740 msgr2=0x7fa0cc0783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:13.761 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 1 client.7503.objecter ms_handle_reset 0x7fa0cc061740 session 0x7fa0cc090040 osd.4 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 10 monclient: _renew_subs 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:39:13.395+0000 7f9fb1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:39:13.395+0000 7fa0d3fff640 10 monclient: get_auth_request con 0x7f9fa40870d0 auth_method 0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:39:13.397+0000 7fa0dcd83640 10 monclient: get_auth_request con 0x7fa0c4074260 auth_method 0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:39:13.399+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0c408e220 auth_method 0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:39:13.399+0000 7fa0dc582640 0 -- 172.21.15.116:0/2087771633 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa0c408e220 msgr2=0x7fa0c401c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:39:13.600+0000 7fa0dc582640 10 monclient: get_auth_request con 0x7fa0c408e220 auth_method 0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.762 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:39:13.604+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zone default found 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Realm: () 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:39:13.605+0000 7fa0dea98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:39:13.605+0000 7fa0dea98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 zonegroup default 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:39:13.605+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.763 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started sync module instance, tier type = 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:39:13.606+0000 7fa0dea98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=0 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=1 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=2 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=3 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=4 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=5 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=6 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:39:13.615+0000 7fa0dea98800 20 add_watcher() i=7 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:39:13.615+0000 7fa0dea98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.764 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding auth protocol: cephx 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:39:13.617+0000 7f9f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: crc 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:39:13.617+0000 7fa0dea98800 5 AuthRegistry(0x7fffdf6967a0) adding con mode: secure 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:39:13.618+0000 7fa0dea98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:13.765 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache list hook 0x558240212ab0 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache inspect hook 0x558240212ab0 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache erase hook 0x558240212ab0 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command cache zap hook 0x558240212ab0 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 note: GC not initialized 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:39:13.618+0000 7f9f91fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace show hook 0x7fa0d4064040 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace history hook 0x7fa0d4064040 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace active hook 0x7fa0d4064040 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:39:13.618+0000 7fa0dea98800 5 asok(0x55823ff2b270) register_command sync trace active_short hook 0x7fa0d4064040 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 Filter name: none 2024-09-14T11:39:13.766 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:39:13.618+0000 7f9f037fe640 20 reqs_thread_entry: start 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:39:13.618+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:39:13.618+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : miss 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:39:13.619+0000 7fa0dea98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.767 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:39:13.619+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:39:13.624+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:39:13.624+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:39:13.626+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.768 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.769 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.770 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:13.771 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:39:13.631+0000 7fa0dea98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:39:13.631+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:39:13.632+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.772 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:39:13.633+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:39:13.634+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:39:13.635+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:39:13.636+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:39:13.639+0000 7fa0dea98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:39:13.639+0000 7fa0dea98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.773 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:39:13.640+0000 7fa0dea98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94017910224736 notifier 7503 bl.length()=931 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:39:13.640+0000 7f9fb2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:39:13.642+0000 7fa0dea98800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:39:13.644+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:13.774 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:39:13.645+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:39:13.646+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:39:13.647+0000 7fa0dea98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:39:13.648+0000 7fa0dea98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0dea98800 time 2024-09-14T11:39:13.648818+0000 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.775 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0e1f8c76a] 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:39:13.649+0000 7fa0dea98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fa0dea98800 thread_name:radosgw-admin 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:13.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0e0c3e6f0] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0e0c8b99c] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0e1f8c7c4] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa0e1f8c928] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55823d91e0b1] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55823d92e217] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0e0c29590] 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.777 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:13.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:39:13.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:39:13.780 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:39:13.781 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:13.782 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:39:13.783 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f037fe640 / http_manager 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f91fdb640 / http_manager 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9f92fdd640 / rgw_dt_lg_renew 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb1ffb640 / ms_dispatch 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb2ffd640 / io_context_pool 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fb37fe640 / io_context_pool 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fc1ffb640 / ms_dispatch 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fc8e09640 / ms_dispatch 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7f9fca60c640 / io_context_pool 2024-09-14T11:39:13.784 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0d3fff640 / msgr-worker-2 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dc582640 / msgr-worker-1 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dcd83640 / msgr-worker-0 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dd584640 / io_context_pool 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: 7fa0dea98800 / radosgw-admin 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:13.650220Z_a42a3931-7d79-4113-aa11-82ba54e400d4/log 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:39:13.785 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.723+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 realm 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.725+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.726+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.726+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.726+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:13.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.726+0000 7fbaa7b46800 20 searching for the correct realm 2024-09-14T11:39:13.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.729+0000 7fbaa5e38640 0 -- 172.21.15.116:0/894668451 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fba9c08c070 msgr2=0x7fba9c06c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.732+0000 7fbaa5637640 0 -- 172.21.15.116:0/894668451 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fba9c01e660 msgr2=0x7fba9c01eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 zone default found 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 4 Realm: () 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.938+0000 7fbaa7b46800 20 zonegroup default 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.939+0000 7fbaa7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:13.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.940+0000 7fbaa7b46800 20 started sync module instance, tier type = 2024-09-14T11:39:13.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.940+0000 7fbaa7b46800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:13.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=0 2024-09-14T11:39:13.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=1 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=2 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=3 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=4 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=5 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.948+0000 7fbaa7b46800 20 add_watcher() i=6 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.949+0000 7fbaa7b46800 20 add_watcher() i=7 2024-09-14T11:39:13.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.949+0000 7fbaa7b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:13.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.951+0000 7fb95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.951+0000 7fbaa7b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.951+0000 7fbaa7b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.951+0000 7fbaa7b46800 5 note: GC not initialized 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.951+0000 7fb95a7e4640 20 reqs_thread_entry: start 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fbaa7b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fbaa7b46800 20 Filter name: none 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fb8cbfff640 20 reqs_thread_entry: start 2024-09-14T11:39:13.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.952+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.953+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.953+0000 7fbaa7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.953+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.953+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:13.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.953+0000 7fbaa7b46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:13.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.954+0000 7fbaa7b46800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:13.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.954+0000 7fbaa7b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:13.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.955+0000 7fb95b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:13.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.957+0000 7fbaa7b46800 20 remove_watcher() i=0 2024-09-14T11:39:13.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.957+0000 7fbaa7b46800 2 removed watcher, disabling cache 2024-09-14T11:39:13.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.958+0000 7fbaa7b46800 20 remove_watcher() i=1 2024-09-14T11:39:13.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.959+0000 7fbaa7b46800 20 remove_watcher() i=2 2024-09-14T11:39:13.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.960+0000 7fbaa7b46800 20 remove_watcher() i=3 2024-09-14T11:39:13.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.961+0000 7fbaa7b46800 20 remove_watcher() i=4 2024-09-14T11:39:13.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.962+0000 7fbaa7b46800 20 remove_watcher() i=5 2024-09-14T11:39:13.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.963+0000 7fbaa7b46800 20 remove_watcher() i=6 2024-09-14T11:39:13.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:13.964+0000 7fbaa7b46800 20 remove_watcher() i=7 2024-09-14T11:39:13.972 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:13.973 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:13.973 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:13.973 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:44.188 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:44.220 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:44.220 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:44.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.260+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.261+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.261+0000 7fc8b620e800 20 realm 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.261+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.262+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.262+0000 7fc8b620e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.262+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.262+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.262+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.263+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.263+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.263+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:44.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.263+0000 7fc8b620e800 20 searching for the correct realm 2024-09-14T11:39:44.265 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.267+0000 7fc8b216c640 0 -- 172.21.15.116:0/2573944587 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fc89c06c1b0 msgr2=0x7fc89c0a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:44.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.473+0000 7fc8b196b640 0 -- 172.21.15.116:0/2573944587 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x5576c0a6a600 msgr2=0x5576c0a6ca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.476+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 zone default found 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 4 Realm: () 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 zonegroup default 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 started sync module instance, tier type = 2024-09-14T11:39:44.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.477+0000 7fc8b620e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=0 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=1 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=2 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=3 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=4 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=5 2024-09-14T11:39:44.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.486+0000 7fc8b620e800 20 add_watcher() i=6 2024-09-14T11:39:44.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.487+0000 7fc8b620e800 20 add_watcher() i=7 2024-09-14T11:39:44.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.487+0000 7fc8b620e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:44.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.489+0000 7fc7637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 5 note: GC not initialized 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc7627fc640 20 reqs_thread_entry: start 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 20 Filter name: none 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc6d3fff640 20 reqs_thread_entry: start 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.490+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:44.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:39:44.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:39:44.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : miss 2024-09-14T11:39:44.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:44.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:44.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.491+0000 7fc8b620e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:44.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc8b620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc8b620e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc8b620e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc8b620e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:44.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc794ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 93968526657664 notifier 7539 bl.length()=931 2024-09-14T11:39:44.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc794ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc794ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.497+0000 7fc794ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.499+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:44.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.499+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:44.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.499+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:44.497 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.499+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:44.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:44.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.0 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.1 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.2 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.3 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.4 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.5 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:44.503 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.6 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.7 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.8 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.9 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.10 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1.11 2024-09-14T11:39:44.504 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:44.505 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.504+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.505+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.505+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.506+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.506+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.506+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.507+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.507+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:44.506 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.508+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:44.507 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.508+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:44.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.512+0000 7fc8b620e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:44.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.512+0000 7fc8b620e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:44.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc8b620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc8b620e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc8b620e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc8b620e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc7957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 93968526657664 notifier 7539 bl.length()=931 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc7957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc7957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.513+0000 7fc7957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.515+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:44.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.515+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:44.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.515+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:44.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.515+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:44.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.518+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.0 2024-09-14T11:39:44.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.518+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.1 2024-09-14T11:39:44.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.518+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.2 2024-09-14T11:39:44.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.518+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.3 2024-09-14T11:39:44.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.519+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.4 2024-09-14T11:39:44.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.519+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.5 2024-09-14T11:39:44.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.519+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.6 2024-09-14T11:39:44.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.520+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.7 2024-09-14T11:39:44.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.520+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.8 2024-09-14T11:39:44.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.520+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.9 2024-09-14T11:39:44.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.521+0000 7fc8b620e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32.10 2024-09-14T11:39:44.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.521+0000 7fc8b620e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:44.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.521+0000 7fc8b620e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 2024-09-14T11:39:44.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.522+0000 7fc8b620e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.522+0000 7fc8b620e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.522+0000 7fc8b620e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.522+0000 7fc8b620e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32, ofs0, ns] 2024-09-14T11:39:44.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.523+0000 7fc7957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93968526657664 notifier 7539 bl.length()=899 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.523+0000 7fc7957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 info.flags=0x17 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.523+0000 7fc7957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 to cache LRU end 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.523+0000 7fc7957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.524+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_sources= new_sources= 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.524+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential sources added=[] removed=[] 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.524+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): orig_dests= new_dests= 2024-09-14T11:39:44.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.524+0000 7fc8b620e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32]): potential dests added=[] removed=[] 2024-09-14T11:39:44.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.526+0000 7fc8b620e800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:44.526 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.528+0000 7fc7637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.530+0000 7fc8b620e800 20 remove_watcher() i=0 2024-09-14T11:39:44.528 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.530+0000 7fc8b620e800 2 removed watcher, disabling cache 2024-09-14T11:39:44.529 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.531+0000 7fc8b620e800 20 remove_watcher() i=1 2024-09-14T11:39:44.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.532+0000 7fc8b620e800 20 remove_watcher() i=2 2024-09-14T11:39:44.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.534+0000 7fc8b620e800 20 remove_watcher() i=3 2024-09-14T11:39:44.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.535+0000 7fc8b620e800 20 remove_watcher() i=4 2024-09-14T11:39:44.534 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.536+0000 7fc8b620e800 20 remove_watcher() i=5 2024-09-14T11:39:44.535 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.537+0000 7fc8b620e800 20 remove_watcher() i=6 2024-09-14T11:39:44.536 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.538+0000 7fc8b620e800 20 remove_watcher() i=7 2024-09-14T11:39:44.547 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:39:44.576 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:44.576 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:44.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.614+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.615+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.615+0000 7f6e5bd46800 20 realm 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.615+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.616+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.616+0000 7f6e5bd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.616+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.616+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.616+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.617+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:44.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.617+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.617+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:44.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.617+0000 7f6e5bd46800 20 searching for the correct realm 2024-09-14T11:39:44.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.620+0000 7f6e5a038640 0 -- 172.21.15.116:0/1942199574 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6e50062070 msgr2=0x7f6e500575f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:44.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.623+0000 7f6e59837640 0 -- 172.21.15.116:0/1942199574 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6e500c7280 msgr2=0x7f6e500c7960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:44.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.828+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:44.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 zone default found 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 4 Realm: () 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 zonegroup default 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.829+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.830+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.830+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.830+0000 7f6e5bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:44.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.830+0000 7f6e5bd46800 20 started sync module instance, tier type = 2024-09-14T11:39:44.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.830+0000 7f6e5bd46800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:44.837 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=0 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=1 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=2 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=3 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=4 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=5 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.839+0000 7f6e5bd46800 20 add_watcher() i=6 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.840+0000 7f6e5bd46800 20 add_watcher() i=7 2024-09-14T11:39:44.838 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.840+0000 7f6e5bd46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:44.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.842+0000 7f6d0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.842+0000 7f6e5bd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.842+0000 7f6e5bd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.842+0000 7f6e5bd46800 5 note: GC not initialized 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.842+0000 7f6d0a7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6e5bd46800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6e5bd46800 20 Filter name: none 2024-09-14T11:39:44.841 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6c7bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:44.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:44.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.843+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.844+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:44.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.844+0000 7f6e5bd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:44.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.844+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.844+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:44.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.844+0000 7f6e5bd46800 20 rados->read ofs=0 len=0 2024-09-14T11:39:44.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.845+0000 7f6e5bd46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:44.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.845+0000 7f6e5bd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:44.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.846+0000 7f6d0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:44.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.849+0000 7f6e5bd46800 20 remove_watcher() i=0 2024-09-14T11:39:44.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.849+0000 7f6e5bd46800 2 removed watcher, disabling cache 2024-09-14T11:39:44.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.850+0000 7f6e5bd46800 20 remove_watcher() i=1 2024-09-14T11:39:44.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.851+0000 7f6e5bd46800 20 remove_watcher() i=2 2024-09-14T11:39:44.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.852+0000 7f6e5bd46800 20 remove_watcher() i=3 2024-09-14T11:39:44.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.853+0000 7f6e5bd46800 20 remove_watcher() i=4 2024-09-14T11:39:44.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.854+0000 7f6e5bd46800 20 remove_watcher() i=5 2024-09-14T11:39:44.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.855+0000 7f6e5bd46800 20 remove_watcher() i=6 2024-09-14T11:39:44.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:44.856+0000 7f6e5bd46800 20 remove_watcher() i=7 2024-09-14T11:39:44.864 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:44.864 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:44.864 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-commit-target-layout id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:44.864 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:45.259 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:39:45.259 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:46.073 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:39:46.102 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:46.102 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:46.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.140+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 20 realm 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.142+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.143+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.143+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.143+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:46.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.143+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.144+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:46.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.144+0000 7fc2f3122800 20 searching for the correct realm 2024-09-14T11:39:46.144 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.146+0000 7fc2ef5af640 0 -- 172.21.15.116:0/983121308 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fc2d807c020 msgr2=0x7fc2d807d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:46.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.150+0000 7fc2eedae640 0 -- 172.21.15.116:0/983121308 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc2d8049910 msgr2=0x7fc2d8089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.356+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:46.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:46.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 zone default found 2024-09-14T11:39:46.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 4 Realm: () 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 zonegroup default 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.357+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 started sync module instance, tier type = 2024-09-14T11:39:46.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.358+0000 7fc2f3122800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=0 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=1 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=2 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=3 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=4 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=5 2024-09-14T11:39:46.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.368+0000 7fc2f3122800 20 add_watcher() i=6 2024-09-14T11:39:46.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.369+0000 7fc2f3122800 20 add_watcher() i=7 2024-09-14T11:39:46.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.369+0000 7fc2f3122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:46.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.370+0000 7fc1a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:46.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.370+0000 7fc2f3122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:46.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.370+0000 7fc2f3122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:46.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.370+0000 7fc2f3122800 5 note: GC not initialized 2024-09-14T11:39:46.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc11ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:46.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc2f3122800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:46.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc2f3122800 20 Filter name: none 2024-09-14T11:39:46.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc11dffb640 20 reqs_thread_entry: start 2024-09-14T11:39:46.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:46.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.371+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.372+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:46.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.372+0000 7fc2f3122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.372+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.372+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.372+0000 7fc2f3122800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.373+0000 7fc2f3122800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.373+0000 7fc2f3122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:46.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.374+0000 7fc1a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:46.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.376+0000 7fc2f3122800 20 remove_watcher() i=0 2024-09-14T11:39:46.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.376+0000 7fc2f3122800 2 removed watcher, disabling cache 2024-09-14T11:39:46.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.377+0000 7fc2f3122800 20 remove_watcher() i=1 2024-09-14T11:39:46.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.378+0000 7fc2f3122800 20 remove_watcher() i=2 2024-09-14T11:39:46.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.379+0000 7fc2f3122800 20 remove_watcher() i=3 2024-09-14T11:39:46.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.380+0000 7fc2f3122800 20 remove_watcher() i=4 2024-09-14T11:39:46.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.381+0000 7fc2f3122800 20 remove_watcher() i=5 2024-09-14T11:39:46.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.382+0000 7fc2f3122800 20 remove_watcher() i=6 2024-09-14T11:39:46.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.383+0000 7fc2f3122800 20 remove_watcher() i=7 2024-09-14T11:39:46.391 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:46.391 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:46.391 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:46.391 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:46.392 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:39:46.427 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:46.427 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:46.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.465+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 20 realm 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.466+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.467+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.467+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.467+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:46.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.467+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.468+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:46.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.468+0000 7f7113613800 20 searching for the correct realm 2024-09-14T11:39:46.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.673+0000 7f7106591640 0 -- 172.21.15.116:0/3231178763 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f7100049040 msgr2=0x7f710003c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:46.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.676+0000 7f710ed92640 0 -- 172.21.15.116:0/3231178763 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f70f807abf0 msgr2=0x7f70f80bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:46.882 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.883+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 zone default found 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 4 Realm: () 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:46.883 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 zonegroup default 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.884+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.885+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.885+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.884 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.885+0000 7f7113613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:46.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.885+0000 7f7113613800 20 started sync module instance, tier type = 2024-09-14T11:39:46.885 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.885+0000 7f7113613800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:46.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=0 2024-09-14T11:39:46.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=1 2024-09-14T11:39:46.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=2 2024-09-14T11:39:46.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=3 2024-09-14T11:39:46.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=4 2024-09-14T11:39:46.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=5 2024-09-14T11:39:46.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.894+0000 7f7113613800 20 add_watcher() i=6 2024-09-14T11:39:46.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.895+0000 7f7113613800 20 add_watcher() i=7 2024-09-14T11:39:46.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.895+0000 7f7113613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:46.895 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f6fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f7113613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f7113613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f7113613800 5 note: GC not initialized 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f6f3ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.897+0000 7f7113613800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 20 Filter name: none 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f6f3dffb640 20 reqs_thread_entry: start 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:39:46.896 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:46.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:39:46.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:39:46.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 : miss 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 20 rados->read ofs=0 len=0 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:46.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.898+0000 7f7113613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f7113613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f7113613800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f7113613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f7113613800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33, ofs0, ns] 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f6ff1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94860319583584 notifier 7593 bl.length()=911 2024-09-14T11:39:46.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f6ff1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:46.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f6ff1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:46.903 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.904+0000 7f6ff1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:46.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.906+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_sources= new_sources= 2024-09-14T11:39:46.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.906+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential sources added=[] removed=[] 2024-09-14T11:39:46.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.906+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_dests= new_dests= 2024-09-14T11:39:46.904 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.906+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential dests added=[] removed=[] 2024-09-14T11:39:46.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.911+0000 7f7113613800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:39:46.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.919+0000 7f7113613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:46.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.919+0000 7f7113613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 2024-09-14T11:39:46.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f7113613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:46.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f7113613800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:46.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f7113613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:46.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f7113613800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33, ofs0, ns] 2024-09-14T11:39:46.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f6ff1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94860319583584 notifier 7593 bl.length()=879 2024-09-14T11:39:46.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f6ff1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:46.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f6ff1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:46.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.920+0000 7f6ff1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:46.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.922+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_sources= new_sources= 2024-09-14T11:39:46.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.922+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential sources added=[] removed=[] 2024-09-14T11:39:46.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.922+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_dests= new_dests= 2024-09-14T11:39:46.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.922+0000 7f7113613800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential dests added=[] removed=[] 2024-09-14T11:39:46.920 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.922+0000 7f7113613800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:39:46.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.924+0000 7f6fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:46.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.926+0000 7f7113613800 20 remove_watcher() i=0 2024-09-14T11:39:46.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.926+0000 7f7113613800 2 removed watcher, disabling cache 2024-09-14T11:39:46.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.927+0000 7f7113613800 20 remove_watcher() i=1 2024-09-14T11:39:46.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.928+0000 7f7113613800 20 remove_watcher() i=2 2024-09-14T11:39:46.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.929+0000 7f7113613800 20 remove_watcher() i=3 2024-09-14T11:39:46.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.930+0000 7f7113613800 20 remove_watcher() i=4 2024-09-14T11:39:46.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.931+0000 7f7113613800 20 remove_watcher() i=5 2024-09-14T11:39:46.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.932+0000 7f7113613800 20 remove_watcher() i=6 2024-09-14T11:39:46.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:46.933+0000 7f7113613800 20 remove_watcher() i=7 2024-09-14T11:39:46.942 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:39:46.971 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:46.971 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:47.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.009+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 realm 2024-09-14T11:39:47.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.011+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.012+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.012+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.012+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:47.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.012+0000 7f65cdf21800 20 searching for the correct realm 2024-09-14T11:39:47.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.016+0000 7f65c9443640 0 -- 172.21.15.116:0/948353789 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5562a674fc00 msgr2=0x5562a6751ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:47.017 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.019+0000 7f65c9c44640 0 -- 172.21.15.116:0/948353789 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f65c00793e0 msgr2=0x7f65c0079840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 zone default found 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 4 Realm: () 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 zonegroup default 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.023+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 started sync module instance, tier type = 2024-09-14T11:39:47.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.024+0000 7f65cdf21800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:47.030 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=0 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=1 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=2 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=3 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=4 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=5 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=6 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 20 add_watcher() i=7 2024-09-14T11:39:47.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.033+0000 7f65cdf21800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:47.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f647b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f65cdf21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f65cdf21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f65cdf21800 5 note: GC not initialized 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f647a7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.035+0000 7f65cdf21800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.036+0000 7f65cdf21800 20 Filter name: none 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.036+0000 7f63ebfff640 20 reqs_thread_entry: start 2024-09-14T11:39:47.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.036+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.036+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:47.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.036+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.035 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:47.036 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.037+0000 7f65cdf21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:47.037 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.039+0000 7f647b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.041+0000 7f65cdf21800 20 remove_watcher() i=0 2024-09-14T11:39:47.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.041+0000 7f65cdf21800 2 removed watcher, disabling cache 2024-09-14T11:39:47.040 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.042+0000 7f65cdf21800 20 remove_watcher() i=1 2024-09-14T11:39:47.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.043+0000 7f65cdf21800 20 remove_watcher() i=2 2024-09-14T11:39:47.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.044+0000 7f65cdf21800 20 remove_watcher() i=3 2024-09-14T11:39:47.043 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.045+0000 7f65cdf21800 20 remove_watcher() i=4 2024-09-14T11:39:47.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.046+0000 7f65cdf21800 20 remove_watcher() i=5 2024-09-14T11:39:47.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.047+0000 7f65cdf21800 20 remove_watcher() i=6 2024-09-14T11:39:47.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.048+0000 7f65cdf21800 20 remove_watcher() i=7 2024-09-14T11:39:47.056 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:47.056 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:47.056 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:47.056 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:47.146 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:47.178 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:47.178 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:47.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.217+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 20 realm 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.218+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.219+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.219+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.220+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.220+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.220+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:47.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.220+0000 7f126ed25800 20 searching for the correct realm 2024-09-14T11:39:47.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.222+0000 7f12621b4640 0 -- 172.21.15.116:0/4039222977 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f125c046050 msgr2=0x7f125c025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:47.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.226+0000 7f126a9b5640 0 -- 172.21.15.116:0/4039222977 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f12540443f0 msgr2=0x7f1254069d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:47.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:47.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:47.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:47.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.433+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 zone default found 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 4 Realm: () 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:47.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 zonegroup default 2024-09-14T11:39:47.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.434+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.435+0000 7f126ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.435+0000 7f126ed25800 20 started sync module instance, tier type = 2024-09-14T11:39:47.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.435+0000 7f126ed25800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=0 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=1 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=2 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=3 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=4 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=5 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.444+0000 7f126ed25800 20 add_watcher() i=6 2024-09-14T11:39:47.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.445+0000 7f126ed25800 20 add_watcher() i=7 2024-09-14T11:39:47.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.445+0000 7f126ed25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:47.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.446+0000 7f11217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 5 note: GC not initialized 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f109bfff640 20 reqs_thread_entry: start 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 20 Filter name: none 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f1099ffb640 20 reqs_thread_entry: start 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.447+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:39:47.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 : miss 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.448+0000 7f126ed25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f126ed25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f126ed25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f126ed25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f126ed25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33, ofs0, ns] 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f114dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 93993807910512 notifier 7052 bl.length()=911 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f114dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f114dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.453+0000 7f114dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.455+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_sources= new_sources= 2024-09-14T11:39:47.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.455+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential sources added=[] removed=[] 2024-09-14T11:39:47.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.455+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_dests= new_dests= 2024-09-14T11:39:47.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.455+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential dests added=[] removed=[] 2024-09-14T11:39:47.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.0 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.0 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.1 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.1 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.2 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.2 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.3 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.3 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.4 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.4 2024-09-14T11:39:47.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.5 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.5 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.6 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.6 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.7 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.7 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.8 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.8 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.9 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.9 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.10 2024-09-14T11:39:47.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.10 2024-09-14T11:39:47.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.11 2024-09-14T11:39:47.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1.11 2024-09-14T11:39:47.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.0 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.460+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.461+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.2 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.461+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.3 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.462+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.4 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.462+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.5 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.462+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.6 2024-09-14T11:39:47.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.463+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.7 2024-09-14T11:39:47.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.463+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.8 2024-09-14T11:39:47.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.464+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.9 2024-09-14T11:39:47.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.464+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.10 2024-09-14T11:39:47.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.467+0000 7f126ed25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:47.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.467+0000 7f126ed25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 2024-09-14T11:39:47.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f126ed25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f126ed25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f126ed25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f126ed25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33, ofs0, ns] 2024-09-14T11:39:47.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f114dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 93993807910512 notifier 7052 bl.length()=911 2024-09-14T11:39:47.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f114dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f114dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.469+0000 7f114dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.470+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_sources= new_sources= 2024-09-14T11:39:47.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.470+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential sources added=[] removed=[] 2024-09-14T11:39:47.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.470+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_dests= new_dests= 2024-09-14T11:39:47.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.470+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential dests added=[] removed=[] 2024-09-14T11:39:47.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.473+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.0 2024-09-14T11:39:47.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.474+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.1 2024-09-14T11:39:47.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.474+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.2 2024-09-14T11:39:47.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.474+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.3 2024-09-14T11:39:47.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.475+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.4 2024-09-14T11:39:47.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.475+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.5 2024-09-14T11:39:47.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.476+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.6 2024-09-14T11:39:47.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.476+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.7 2024-09-14T11:39:47.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.476+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.8 2024-09-14T11:39:47.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.477+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.9 2024-09-14T11:39:47.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.477+0000 7f126ed25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33.10 2024-09-14T11:39:47.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.477+0000 7f126ed25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:47.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.477+0000 7f126ed25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.478+0000 7f126ed25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.478+0000 7f126ed25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.478+0000 7f126ed25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.478+0000 7f126ed25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33, ofs0, ns] 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.479+0000 7f114dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 93993807910512 notifier 7052 bl.length()=879 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.479+0000 7f114dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 info.flags=0x17 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.479+0000 7f114dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 to cache LRU end 2024-09-14T11:39:47.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.479+0000 7f114dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:47.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.480+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_sources= new_sources= 2024-09-14T11:39:47.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.480+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential sources added=[] removed=[] 2024-09-14T11:39:47.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.480+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): orig_dests= new_dests= 2024-09-14T11:39:47.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.480+0000 7f126ed25800 20 handle_bi_update(): bucket=:error-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33]): potential dests added=[] removed=[] 2024-09-14T11:39:47.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.484+0000 7f126ed25800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:47.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.486+0000 7f11217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.489+0000 7f126ed25800 20 remove_watcher() i=0 2024-09-14T11:39:47.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.489+0000 7f126ed25800 2 removed watcher, disabling cache 2024-09-14T11:39:47.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.489+0000 7f126ed25800 20 remove_watcher() i=1 2024-09-14T11:39:47.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.491+0000 7f126ed25800 20 remove_watcher() i=2 2024-09-14T11:39:47.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.491+0000 7f126ed25800 20 remove_watcher() i=3 2024-09-14T11:39:47.490 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.492+0000 7f126ed25800 20 remove_watcher() i=4 2024-09-14T11:39:47.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.493+0000 7f126ed25800 20 remove_watcher() i=5 2024-09-14T11:39:47.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.494+0000 7f126ed25800 20 remove_watcher() i=6 2024-09-14T11:39:47.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.495+0000 7f126ed25800 20 remove_watcher() i=7 2024-09-14T11:39:47.504 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:39:47.533 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:47.533 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:47.570 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.572+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.573+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.573+0000 7fc7a432e800 20 realm 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.573+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.574+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.574+0000 7fc7a432e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.574+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.574+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.574+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.575+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.575+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.575+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:47.573 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.575+0000 7fc7a432e800 20 searching for the correct realm 2024-09-14T11:39:47.576 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.578+0000 7fc797763640 0 -- 172.21.15.116:0/537335723 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fc7900a0040 msgr2=0x7fc790021030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:47.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.581+0000 7fc79ff64640 0 -- 172.21.15.116:0/537335723 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc788017840 msgr2=0x7fc78805fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:47.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.787+0000 7fc7a432e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:47.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 zone default found 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 4 Realm: () 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 zonegroup default 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.788+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:47.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 started sync module instance, tier type = 2024-09-14T11:39:47.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.789+0000 7fc7a432e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=0 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=1 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=2 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=3 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=4 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=5 2024-09-14T11:39:47.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.798+0000 7fc7a432e800 20 add_watcher() i=6 2024-09-14T11:39:47.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.799+0000 7fc7a432e800 20 add_watcher() i=7 2024-09-14T11:39:47.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.799+0000 7fc7a432e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:47.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:47.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:47.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 5 note: GC not initialized 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc654fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 20 Filter name: none 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc5ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.801+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.802+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:47.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.802+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.802+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:47.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.802+0000 7fc7a432e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.802+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.803+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.803+0000 7fc7a432e800 20 rados->read ofs=0 len=0 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.803+0000 7fc7a432e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.803+0000 7fc7a432e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:47.802 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.805+0000 7fc655fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:47.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.807+0000 7fc7a432e800 20 remove_watcher() i=0 2024-09-14T11:39:47.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.807+0000 7fc7a432e800 2 removed watcher, disabling cache 2024-09-14T11:39:47.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.808+0000 7fc7a432e800 20 remove_watcher() i=1 2024-09-14T11:39:47.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.809+0000 7fc7a432e800 20 remove_watcher() i=2 2024-09-14T11:39:47.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.810+0000 7fc7a432e800 20 remove_watcher() i=3 2024-09-14T11:39:47.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.811+0000 7fc7a432e800 20 remove_watcher() i=4 2024-09-14T11:39:47.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.812+0000 7fc7a432e800 20 remove_watcher() i=5 2024-09-14T11:39:47.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.813+0000 7fc7a432e800 20 remove_watcher() i=6 2024-09-14T11:39:47.811 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:47.813+0000 7fc7a432e800 20 remove_watcher() i=7 2024-09-14T11:39:47.821 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:47.821 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:47.821 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:47.821 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:48.180 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:39:48.180 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.010 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:39:49.038 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:49.038 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:49.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.077+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 realm 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.079+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.080+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.080+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.080+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.080+0000 7f6a38175800 20 searching for the correct realm 2024-09-14T11:39:49.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.083+0000 7f6a3545e640 0 -- 172.21.15.116:0/3950648135 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f6a28082c20 msgr2=0x7f6a28067680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.087+0000 7f6a35c5f640 0 -- 172.21.15.116:0/3950648135 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6a2c083880 msgr2=0x7f6a2c087070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.293+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.294+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.294+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.294+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.294+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 zone default found 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 4 Realm: () 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 zonegroup default 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.295+0000 7f6a38175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.296+0000 7f6a38175800 20 started sync module instance, tier type = 2024-09-14T11:39:49.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.296+0000 7f6a38175800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=0 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=1 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=2 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=3 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=4 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=5 2024-09-14T11:39:49.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.306+0000 7f6a38175800 20 add_watcher() i=6 2024-09-14T11:39:49.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.307+0000 7f6a38175800 20 add_watcher() i=7 2024-09-14T11:39:49.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.307+0000 7f6a38175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.308+0000 7f68e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 5 note: GC not initialized 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f68e67fc640 20 reqs_thread_entry: start 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 20 Filter name: none 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6857fff640 20 reqs_thread_entry: start 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.309+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.310+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.310+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.311+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:49.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.311+0000 7f6a38175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:49.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.311+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.312+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.312+0000 7f6a38175800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.312+0000 7f6a38175800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:49.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.312+0000 7f6a38175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:49.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.314+0000 7f68e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.316+0000 7f6a38175800 20 remove_watcher() i=0 2024-09-14T11:39:49.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.316+0000 7f6a38175800 2 removed watcher, disabling cache 2024-09-14T11:39:49.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.317+0000 7f6a38175800 20 remove_watcher() i=1 2024-09-14T11:39:49.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.317+0000 7f6a38175800 20 remove_watcher() i=2 2024-09-14T11:39:49.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.319+0000 7f6a38175800 20 remove_watcher() i=3 2024-09-14T11:39:49.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.320+0000 7f6a38175800 20 remove_watcher() i=4 2024-09-14T11:39:49.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.322+0000 7f6a38175800 20 remove_watcher() i=5 2024-09-14T11:39:49.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.322+0000 7f6a38175800 20 remove_watcher() i=6 2024-09-14T11:39:49.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.323+0000 7f6a38175800 20 remove_watcher() i=7 2024-09-14T11:39:49.331 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.331 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:49.332 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:49.332 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.333 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:39:49.366 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:49.366 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:49.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.405+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.406+0000 7fdb38487800 20 realm 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.407+0000 7fdb38487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.408+0000 7fdb38487800 20 searching for the correct realm 2024-09-14T11:39:49.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.410+0000 7fdb35f78640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x562d456bddf0 msgr2=0x7fdb30061940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.616+0000 7fdb36779640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fdb2001c040 msgr2=0x7fdb2007d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 zone default found 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 4 Realm: () 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 zonegroup default 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.623+0000 7fdb38487800 20 started sync module instance, tier type = 2024-09-14T11:39:49.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.623+0000 7fdb38487800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=0 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=1 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=2 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=3 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=4 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=5 2024-09-14T11:39:49.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=6 2024-09-14T11:39:49.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.635+0000 7fdb38487800 20 add_watcher() i=7 2024-09-14T11:39:49.633 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.635+0000 7fdb38487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.636+0000 7fd9ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 5 note: GC not initialized 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fd9eafe5640 20 reqs_thread_entry: start 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 20 Filter name: none 2024-09-14T11:39:49.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fd9e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:49.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:39:49.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : miss 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.638+0000 7fdb38487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fdb38487800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fdb38487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94752440639104 notifier 7097 bl.length()=911 2024-09-14T11:39:49.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:39:49.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:39:49.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:39:49.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:39:49.647 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdb38487800 time 2024-09-14T11:39:49.650687+0000 2024-09-14T11:39:49.647 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdb3b98c76a] 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:49.648 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.650+0000 7fdb38487800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdb38487800 time 2024-09-14T11:39:49.650687+0000 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdb3b98c76a] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.649 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:49.650 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:49.650 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.650 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:49.650 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fdb38487800 thread_name:radosgw-admin 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdb3a63e6f0] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdb3a68b99c] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdb3b98c7c4] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:49.668 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.651+0000 7fdb38487800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fdb38487800 thread_name:radosgw-admin 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdb3a63e6f0] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdb3a68b99c] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdb3b98c7c4] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.669 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:39:49.388+0000 7fdb36779640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: dump: 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.670 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: dump: 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.671 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 monclient: authenticate success, global_id 7085 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:39:49.389+0000 7fdb38487800 4 set_mon_vals no callback set 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: shutdown 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 asok(0x562d455f2270) unregister_commands rotate-key 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:39:49.389+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.672 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.673 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: starting msgr at 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: starting objecter 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests hook 0x562d45812940 2024-09-14T11:39:49.674 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: setting wanted keys 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: calling monclient init 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.675 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key hook 0x562d458110b8 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d4583b1c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d4583bb20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x7fdb24003bd0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.676 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2186.996887s 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d4583b1c0 auth_method 0 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d4583bb20 auth_method 0 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x7fdb24003bd0 auth_method 0 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.677 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_done global_id 7088 payload 824 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:39:49.391+0000 7fdb35f78640 1 monclient: found mon.noname-c 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.678 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: dump: 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.679 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: dump: 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:39:49.391+0000 7fdb38487800 5 monclient: authenticate success, global_id 7088 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:39:49.391+0000 7fda23e07640 4 set_mon_vals no callback set 2024-09-14T11:39:49.680 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:39:49.391+0000 7fdb38487800 1 librados: init done 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:39:49.393+0000 7fdb2d777640 10 monclient: get_auth_request con 0x7fda1c077230 auth_method 0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:39:49.393+0000 7fdb36779640 10 monclient: get_auth_request con 0x562d45839dc0 auth_method 0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:39:49.394+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d4585cfd0 auth_method 0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:39:49.395+0000 7fdb2d777640 10 monclient: get_auth_request con 0x562d458621d0 auth_method 0 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.681 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:39:49.396+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.682 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:39:49.396+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests cmddesc objecter_requests hook 0x562d4586a840 EEXIST 2024-09-14T11:39:49.683 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.684 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:39:49.397+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:39:49.397+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:39:49.397+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x562d45865310 EEXIST 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458911b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d45891590 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d45894e60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.003387s 2024-09-14T11:39:49.685 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d458911b0 auth_method 0 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d45891590 auth_method 0 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x562d45894e60 auth_method 0 2024-09-14T11:39:49.686 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7680 payload 824 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:39:49.397+0000 7fdb2d777640 1 monclient: found mon.noname-a 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:39:49.397+0000 7fda1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: dump: 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.687 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: dump: 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.688 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:39:49.398+0000 7fdb38487800 5 monclient: authenticate success, global_id 7680 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:39:49.398+0000 7fdb36f7a640 4 set_mon_vals no callback set 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.689 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:39:49.400+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fda10077140 auth_method 0 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: get_monmap_and_config 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:39:49.400+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.690 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.691 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:39:49.400+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.692 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:39:49.401+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:39:49.401+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:39:49.401+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x7ffe46bb4238 EEXIST 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d458e3030 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d458b3f80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.693 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458de8d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.007312s 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d458b3f80 auth_method 0 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x562d458de8d0 auth_method 0 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.694 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7683 payload 274 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:39:49.401+0000 7fdb2d777640 1 monclient: found mon.noname-a 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: dump: 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.695 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: dump: 2024-09-14T11:39:49.696 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:39:49.401+0000 7fdb38487800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:39:49.401+0000 7fdb38487800 4 set_mon_vals no callback set 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: shutdown 2024-09-14T11:39:49.697 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.698 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:39:49.402+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: starting msgr at 2024-09-14T11:39:49.699 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: starting objecter 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests cmddesc objecter_requests hook 0x562d458b4710 EEXIST 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: setting wanted keys 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: calling monclient init 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.700 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:39:49.403+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:39:49.403+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x562d4588d278 EEXIST 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d458b3f80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458de8d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d458e3030 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.701 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.009499s 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d458b3f80 auth_method 0 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d458de8d0 auth_method 0 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.702 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:39:49.403+0000 7fdb2d777640 1 monclient: found mon.noname-c 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:39:49.403+0000 7fda077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: dump: 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.703 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: dump: 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.704 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:39:49.404+0000 7fdb38487800 5 monclient: authenticate success, global_id 7097 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:39:49.404+0000 7fda197fa640 4 set_mon_vals no callback set 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:39:49.404+0000 7fdb38487800 1 librados: init done 2024-09-14T11:39:49.705 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:39:49.404+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cr dump hook 0x562d458d76c8 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:39:49.405+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:39:49.406+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fda00077230 auth_method 0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:39:49.406+0000 7fdb36779640 10 monclient: get_auth_request con 0x562d458fca50 auth_method 0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 realm 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:39:49.407+0000 7fdb38487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.706 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:39:49.407+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d45900c60 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 searching for the correct realm 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:39:49.408+0000 7fdb2d777640 10 monclient: get_auth_request con 0x562d45905f10 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:39:49.409+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fdb2001c040 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:39:49.410+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d456bddf0 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:39:49.410+0000 7fdb35f78640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x562d456bddf0 msgr2=0x7fdb30061940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:39:49.611+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d456bddf0 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:39:49.612+0000 7fdb2d777640 10 monclient: get_auth_request con 0x7fdb28060f50 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:39:49.614+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fdb200800a0 auth_method 0 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:39:49.616+0000 7fdb36779640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fdb2001c040 msgr2=0x7fdb2007d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:39:49.616+0000 7fda077fe640 1 client.7097.objecter ms_handle_reset 0x7fdb2001c040 session 0x7fdb200816a0 osd.7 2024-09-14T11:39:49.707 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:39:49.616+0000 7fda077fe640 10 monclient: _renew_subs 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:39:49.616+0000 7fda077fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:39:49.616+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fda000870d0 auth_method 0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:39:49.616+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fdb20022bf0 auth_method 0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.708 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 zone default found 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 Realm: () 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:39:49.622+0000 7fdb38487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 zonegroup default 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 started sync module instance, tier type = 2024-09-14T11:39:49.709 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.710 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=0 2024-09-14T11:39:49.710 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=1 2024-09-14T11:39:49.710 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=2 2024-09-14T11:39:49.710 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=3 2024-09-14T11:39:49.710 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=4 2024-09-14T11:39:49.711 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=5 2024-09-14T11:39:49.711 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=6 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:39:49.635+0000 7fdb38487800 20 add_watcher() i=7 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:39:49.635+0000 7fdb38487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.712 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:39:49.636+0000 7fd9ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:39:49.636+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache list hook 0x562d458d1360 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache inspect hook 0x562d458d1360 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache erase hook 0x562d458d1360 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache zap hook 0x562d458d1360 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 note: GC not initialized 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:39:49.637+0000 7fd9eafe5640 20 reqs_thread_entry: start 2024-09-14T11:39:49.713 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace show hook 0x7fdb200014e0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace history hook 0x7fdb200014e0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace active hook 0x7fdb200014e0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace active_short hook 0x7fdb200014e0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 Filter name: none 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:39:49.637+0000 7fd9e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : miss 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.714 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:39:49.638+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94752440639104 notifier 7097 bl.length()=911 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.715 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:39:49.650+0000 7fdb38487800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdb38487800 time 2024-09-14T11:39:49.650687+0000 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdb3b98c76a] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.716 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:39:49.651+0000 7fdb38487800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fdb38487800 thread_name:radosgw-admin 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdb3a63e6f0] 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdb3a68b99c] 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdb3b98c7c4] 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.717 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:39:49.718 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:49.719 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:39:49.720 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:39:49.721 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:39:49.722 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:49.723 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:49.724 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9e8fe1640 / http_manager 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9eafe5640 / http_manager 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9ebfe7640 / rgw_dt_lg_renew 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda077fe640 / ms_dispatch 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda197fa640 / io_context_pool 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda1b7fe640 / ms_dispatch 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda22604640 / ms_dispatch 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda23e07640 / io_context_pool 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb2d777640 / msgr-worker-2 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb35f78640 / msgr-worker-1 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb36779640 / msgr-worker-0 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb36f7a640 / io_context_pool 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb38487800 / radosgw-admin 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:39:49.725 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.127853.log 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:39:49.388+0000 7fdb36779640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: dump: 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.726 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:39:49.389+0000 7fda23e07640 10 monclient: dump: 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.727 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 monclient: authenticate success, global_id 7085 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:39:49.389+0000 7fdb38487800 4 set_mon_vals no callback set 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: shutdown 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 asok(0x562d455f2270) unregister_commands rotate-key 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:39:49.389+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:39:49.389+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.728 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding auth protocol: cephx 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.729 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: crc 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:39:49.389+0000 7fdb38487800 5 AuthRegistry(0x562d45816b10) adding con mode: secure 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: starting msgr at 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: starting objecter 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests hook 0x562d45812940 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: setting wanted keys 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:39:49.390+0000 7fdb38487800 1 librados: calling monclient init 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.730 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding auth protocol: cephx 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.731 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: crc 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 AuthRegistry(0x562d45810f70) adding con mode: secure 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:39:49.390+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:39:49.390+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key hook 0x562d458110b8 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d4583b1c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d4583bb20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x7fdb24003bd0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.732 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:39:49.390+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2186.996887s 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d4583b1c0 auth_method 0 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:39:49.390+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d4583bb20 auth_method 0 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x7fdb24003bd0 auth_method 0 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.733 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:39:49.391+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:39:49.391+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient(hunting): handle_auth_done global_id 7088 payload 824 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:39:49.391+0000 7fdb35f78640 1 monclient: found mon.noname-c 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:39:49.391+0000 7fdb35f78640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.734 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: dump: 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.735 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:39:49.391+0000 7fda22604640 10 monclient: dump: 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:39:49.391+0000 7fdb38487800 5 monclient: authenticate success, global_id 7088 2024-09-14T11:39:49.736 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:39:49.391+0000 7fda23e07640 4 set_mon_vals no callback set 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:39:49.391+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:39:49.391+0000 7fdb38487800 1 librados: init done 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:39:49.393+0000 7fda22604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:39:49.393+0000 7fdb2d777640 10 monclient: get_auth_request con 0x7fda1c077230 auth_method 0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:39:49.393+0000 7fdb36779640 10 monclient: get_auth_request con 0x562d45839dc0 auth_method 0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:39:49.394+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d4585cfd0 auth_method 0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:39:49.395+0000 7fdb2d777640 10 monclient: get_auth_request con 0x562d458621d0 auth_method 0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:39:49.396+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.737 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding auth protocol: cephx 2024-09-14T11:39:49.738 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: crc 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d45866210) adding con mode: secure 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:39:49.396+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests cmddesc objecter_requests hook 0x562d4586a840 EEXIST 2024-09-14T11:39:49.739 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:39:49.396+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding auth protocol: cephx 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.740 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: crc 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:39:49.396+0000 7fdb38487800 5 AuthRegistry(0x562d458651c8) adding con mode: secure 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:39:49.397+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:39:49.397+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:39:49.397+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x562d45865310 EEXIST 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458911b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d45891590 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d45894e60 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.741 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:39:49.397+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.003387s 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d458911b0 auth_method 0 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d45891590 auth_method 0 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:39:49.397+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.742 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x562d45894e60 auth_method 0 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:39:49.397+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7680 payload 824 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:39:49.397+0000 7fdb2d777640 1 monclient: found mon.noname-a 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:39:49.397+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:39:49.397+0000 7fda1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: dump: 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.743 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:39:49.398+0000 7fda1b7fe640 10 monclient: dump: 2024-09-14T11:39:49.744 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:39:49.398+0000 7fdb38487800 5 monclient: authenticate success, global_id 7680 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:39:49.398+0000 7fdb36f7a640 4 set_mon_vals no callback set 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.745 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:39:49.398+0000 7fdb38487800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:39:49.399+0000 7fda1b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:39:49.400+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fda10077140 auth_method 0 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: get_monmap_and_config 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:39:49.400+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.746 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding auth protocol: cephx 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.747 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: crc 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x562d458ae970) adding con mode: secure 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:39:49.400+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:39:49.400+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding auth protocol: cephx 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.748 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: crc 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:39:49.400+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb40f0) adding con mode: secure 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:39:49.401+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:39:49.401+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:39:49.401+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x7ffe46bb4238 EEXIST 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d458e3030 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.749 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d458b3f80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458de8d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.007312s 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d458b3f80 auth_method 0 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): get_auth_request con 0x562d458de8d0 auth_method 0 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.750 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:39:49.401+0000 7fdb36779640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7683 payload 274 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:39:49.401+0000 7fdb2d777640 1 monclient: found mon.noname-a 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:39:49.401+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:49.751 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: dump: 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.752 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:39:49.401+0000 7fda197fa640 10 monclient: dump: 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:39:49.401+0000 7fdb38487800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:39:49.753 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:39:49.401+0000 7fdb38487800 10 monclient: get_monmap_and_config success 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:39:49.401+0000 7fdb38487800 4 set_mon_vals no callback set 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: shutdown 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: build_initial_monmap 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 build_initial for_mkfs: 0 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: monmap: 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:39:49.754 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding auth protocol: cephx 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.755 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: crc 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d458df200) adding con mode: secure 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:39:49.402+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: starting msgr at 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: starting objecter 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 asok(0x562d455f2270) register_command objecter_requests cmddesc objecter_requests hook 0x562d458b4710 EEXIST 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: setting wanted keys 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:39:49.402+0000 7fdb38487800 1 librados: calling monclient init 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:39:49.402+0000 7fdb38487800 10 monclient: init 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding auth protocol: cephx 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.756 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:39:49.402+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: crc 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 AuthRegistry(0x562d4588d130) adding con mode: secure 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:39:49.403+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:39:49.403+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:39:49.403+0000 7fdb38487800 5 asok(0x562d455f2270) register_command rotate-key cmddesc rotate-key hook 0x562d4588d278 EEXIST 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient: _reopen_session rank -1 2024-09-14T11:39:49.757 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-a con 0x562d458b3f80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-c con 0x562d458de8d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): picked mon.noname-b con 0x562d458e3030 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): _renew_subs 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:39:49.403+0000 7fdb38487800 10 monclient(hunting): authenticate will time out at 2187.009499s 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): get_auth_request con 0x562d458b3f80 auth_method 0 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): get_auth_request con 0x562d458de8d0 auth_method 0 2024-09-14T11:39:49.758 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:39:49.403+0000 7fdb35f78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient: _finish_hunting 0 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:39:49.403+0000 7fdb2d777640 1 monclient: found mon.noname-c 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:39:49.403+0000 7fdb2d777640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:39:49.403+0000 7fda077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.759 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: dump: 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: _finish_auth 0 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: _check_auth_tickets 2024-09-14T11:39:49.760 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:39:49.404+0000 7fda077fe640 10 monclient: dump: 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.761 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:39:49.404+0000 7fdb38487800 5 monclient: authenticate success, global_id 7097 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:39:49.404+0000 7fda197fa640 4 set_mon_vals no callback set 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _renew_subs 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:39:49.404+0000 7fdb38487800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:39:49.404+0000 7fdb38487800 1 librados: init done 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:39:49.404+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cr dump hook 0x562d458d76c8 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:39:49.405+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:39:49.405+0000 7fda077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:39:49.406+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fda00077230 auth_method 0 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:39:49.406+0000 7fdb36779640 10 monclient: get_auth_request con 0x562d458fca50 auth_method 0 2024-09-14T11:39:49.762 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 realm 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:39:49.406+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:39:49.407+0000 7fdb38487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:39:49.407+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:39:49.407+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d45900c60 auth_method 0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:39:49.408+0000 7fdb38487800 20 searching for the correct realm 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:39:49.408+0000 7fdb2d777640 10 monclient: get_auth_request con 0x562d45905f10 auth_method 0 2024-09-14T11:39:49.763 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:39:49.409+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fdb2001c040 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:39:49.410+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d456bddf0 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:39:49.410+0000 7fdb35f78640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x562d456bddf0 msgr2=0x7fdb30061940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:39:49.611+0000 7fdb35f78640 10 monclient: get_auth_request con 0x562d456bddf0 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:39:49.612+0000 7fdb2d777640 10 monclient: get_auth_request con 0x7fdb28060f50 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:39:49.614+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fdb200800a0 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:39:49.616+0000 7fdb36779640 0 -- 172.21.15.116:0/2578929722 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fdb2001c040 msgr2=0x7fdb2007d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:39:49.616+0000 7fda077fe640 1 client.7097.objecter ms_handle_reset 0x7fdb2001c040 session 0x7fdb200816a0 osd.7 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:39:49.616+0000 7fda077fe640 10 monclient: _renew_subs 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:39:49.616+0000 7fda077fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:39:49.616+0000 7fdb36779640 10 monclient: get_auth_request con 0x7fda000870d0 auth_method 0 2024-09-14T11:39:49.764 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:39:49.616+0000 7fdb35f78640 10 monclient: get_auth_request con 0x7fdb20022bf0 auth_method 0 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:39:49.621+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.765 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 zone default found 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 Realm: () 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:39:49.622+0000 7fdb38487800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:39:49.622+0000 7fdb38487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 zonegroup default 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:39:49.622+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 started sync module instance, tier type = 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:39:49.623+0000 7fdb38487800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=0 2024-09-14T11:39:49.766 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=1 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=2 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=3 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=4 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=5 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:39:49.634+0000 7fdb38487800 20 add_watcher() i=6 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:39:49.635+0000 7fdb38487800 20 add_watcher() i=7 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:39:49.635+0000 7fdb38487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding auth protocol: cephx 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.767 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: crc 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:39:49.636+0000 7fd9ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 AuthRegistry(0x7ffe46bb45d0) adding con mode: secure 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:39:49.636+0000 7fdb38487800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:39:49.636+0000 7fdb38487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache list hook 0x562d458d1360 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache inspect hook 0x562d458d1360 2024-09-14T11:39:49.768 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache erase hook 0x562d458d1360 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:39:49.636+0000 7fdb38487800 5 asok(0x562d455f2270) register_command cache zap hook 0x562d458d1360 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 note: GC not initialized 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:39:49.637+0000 7fd9eafe5640 20 reqs_thread_entry: start 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace show hook 0x7fdb200014e0 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace history hook 0x7fdb200014e0 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace active hook 0x7fdb200014e0 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:39:49.637+0000 7fdb38487800 5 asok(0x562d455f2270) register_command sync trace active_short hook 0x7fdb200014e0 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 Filter name: none 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:39:49.637+0000 7fd9e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:39:49.769 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:39:49.637+0000 7fdb38487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : miss 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:39:49.637+0000 7fdb38487800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:39:49.638+0000 7fdb38487800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:39:49.638+0000 7fdb38487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:39:49.643+0000 7fdb38487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:39:49.770 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94752440639104 notifier 7097 bl.length()=911 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:39:49.643+0000 7fda197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:39:49.645+0000 7fdb38487800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:39:49.650+0000 7fdb38487800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdb38487800 time 2024-09-14T11:39:49.650687+0000 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdb3b98c76a] 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.771 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:39:49.651+0000 7fdb38487800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7fdb38487800 thread_name:radosgw-admin 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdb3a63e6f0] 2024-09-14T11:39:49.772 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdb3a68b99c] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdb3b98c7c4] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdb3b98c928] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d433130b1] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562d43322f6a] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdb3a629590] 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:39:49.773 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:39:49.774 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:39:49.775 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:49.776 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:39:49.777 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:49.778 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:39:49.779 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9e8fe1640 / http_manager 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9eafe5640 / http_manager 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fd9ebfe7640 / rgw_dt_lg_renew 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda077fe640 / ms_dispatch 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda197fa640 / io_context_pool 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda1b7fe640 / ms_dispatch 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda22604640 / ms_dispatch 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fda23e07640 / io_context_pool 2024-09-14T11:39:49.780 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb2d777640 / msgr-worker-2 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb35f78640 / msgr-worker-1 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb36779640 / msgr-worker-0 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb36f7a640 / io_context_pool 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: 7fdb38487800 / radosgw-admin 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:49.652079Z_bc0e56ca-2c0a-4ef2-a653-43946d5f6c80/log 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:39:49.781 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:39:49.786 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:49.786 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.724+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.725+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.725+0000 7f165f52c800 20 realm 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.725+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.726+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.726+0000 7f165f52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.726+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.726+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.726+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.727+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.727+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.727+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.727+0000 7f165f52c800 20 searching for the correct realm 2024-09-14T11:39:49.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.731+0000 7f165ba50640 0 -- 172.21.15.116:0/2873074986 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x5634aba1fc50 msgr2=0x5634aba220c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.734+0000 7f165b24f640 0 -- 172.21.15.116:0/2873074986 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f164405f080 msgr2=0x7f16440975f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 zone default found 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 4 Realm: () 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 zonegroup default 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.738+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 started sync module instance, tier type = 2024-09-14T11:39:49.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.739+0000 7f165f52c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=0 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=1 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=2 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=3 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=4 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=5 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.748+0000 7f165f52c800 20 add_watcher() i=6 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.749+0000 7f165f52c800 20 add_watcher() i=7 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.749+0000 7f165f52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.751+0000 7f1511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.751+0000 7f165f52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.751+0000 7f165f52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.751+0000 7f165f52c800 5 note: GC not initialized 2024-09-14T11:39:49.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.751+0000 7f1510fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f165f52c800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f165f52c800 20 Filter name: none 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f148a7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.752+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.753+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.753+0000 7f165f52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.753+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.754+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.754+0000 7f165f52c800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.754+0000 7f165f52c800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.754+0000 7f165f52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:49.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.757+0000 7f1511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.759+0000 7f165f52c800 20 remove_watcher() i=0 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.759+0000 7f165f52c800 2 removed watcher, disabling cache 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.760+0000 7f165f52c800 20 remove_watcher() i=1 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.761+0000 7f165f52c800 20 remove_watcher() i=2 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.763+0000 7f165f52c800 20 remove_watcher() i=3 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.765+0000 7f165f52c800 20 remove_watcher() i=4 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.766+0000 7f165f52c800 20 remove_watcher() i=5 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.766+0000 7f165f52c800 20 remove_watcher() i=6 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.767+0000 7f165f52c800 20 remove_watcher() i=7 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:49.792 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:39:49.864 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:49.894 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:49.894 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:49.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.933+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 realm 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:49.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.935+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.936+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.936+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.936+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:49.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.936+0000 7ff685013800 20 searching for the correct realm 2024-09-14T11:39:49.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.939+0000 7ff677f91640 0 -- 172.21.15.116:0/2687637429 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55e53ee182e0 msgr2=0x55e53ee1a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.943+0000 7ff680792640 0 -- 172.21.15.116:0/2687637429 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff668069640 msgr2=0x7ff668083650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:49.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:49.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.947+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 zone default found 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 4 Realm: () 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:49.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 zonegroup default 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.948+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.949+0000 7ff685013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.949+0000 7ff685013800 20 started sync module instance, tier type = 2024-09-14T11:39:49.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.949+0000 7ff685013800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=0 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=1 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=2 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=3 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=4 2024-09-14T11:39:49.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=5 2024-09-14T11:39:49.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.957+0000 7ff685013800 20 add_watcher() i=6 2024-09-14T11:39:49.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.958+0000 7ff685013800 20 add_watcher() i=7 2024-09-14T11:39:49.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.958+0000 7ff685013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:49.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.960+0000 7ff536fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:49.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:49.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 5 note: GC not initialized 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff535fdb640 20 reqs_thread_entry: start 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 20 init_complete bucket index max shards: 11 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 20 Filter name: none 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff4a77fe640 20 reqs_thread_entry: start 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:39:49.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.961+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : miss 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 20 rados->read ofs=0 len=0 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:39:49.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:49.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:49.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.962+0000 7ff685013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:39:49.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.963+0000 7ff685013800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to be held by another RGW process; skipping for now 2024-09-14T11:39:49.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.964+0000 7ff536fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:49.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.966+0000 7ff685013800 20 remove_watcher() i=0 2024-09-14T11:39:49.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.966+0000 7ff685013800 2 removed watcher, disabling cache 2024-09-14T11:39:49.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.967+0000 7ff685013800 20 remove_watcher() i=1 2024-09-14T11:39:49.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.968+0000 7ff685013800 20 remove_watcher() i=2 2024-09-14T11:39:49.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.969+0000 7ff685013800 20 remove_watcher() i=3 2024-09-14T11:39:49.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.970+0000 7ff685013800 20 remove_watcher() i=4 2024-09-14T11:39:49.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.973+0000 7ff685013800 20 remove_watcher() i=5 2024-09-14T11:39:49.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.974+0000 7ff685013800 20 remove_watcher() i=6 2024-09-14T11:39:49.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:39:49.975+0000 7ff685013800 20 remove_watcher() i=7 2024-09-14T11:39:49.983 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:40:20.016 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:20.051 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:20.051 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:20.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.096+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.095 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 20 realm 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.097+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.098+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.098+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.099+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:20.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.099+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.099+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:20.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.099+0000 7f89deb28800 20 searching for the correct realm 2024-09-14T11:40:20.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.101+0000 7f89da86f640 0 -- 172.21.15.116:0/3373531074 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x55bed8e035e0 msgr2=0x7f89d4068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:20.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.307+0000 7f89db070640 0 -- 172.21.15.116:0/3373531074 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f89c408f020 msgr2=0x7f89c4071460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.314+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:20.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 zone default found 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 4 Realm: () 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 zonegroup default 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.315+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 started sync module instance, tier type = 2024-09-14T11:40:20.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.316+0000 7f89deb28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:20.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=0 2024-09-14T11:40:20.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=1 2024-09-14T11:40:20.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=2 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=3 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=4 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=5 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.326+0000 7f89deb28800 20 add_watcher() i=6 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.327+0000 7f89deb28800 20 add_watcher() i=7 2024-09-14T11:40:20.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.327+0000 7f89deb28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.329+0000 7f88917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.329+0000 7f89deb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.329+0000 7f89deb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.329+0000 7f89deb28800 5 note: GC not initialized 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f880bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:20.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 20 Filter name: none 2024-09-14T11:40:20.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f8809ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:20.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:40:20.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : miss 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.330+0000 7f89deb28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.331+0000 7f89deb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:40:20.331 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.332+0000 7f89deb28800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:20.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f89deb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f89deb28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f89deb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f89deb28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:40:20.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f88bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94278173176384 notifier 7148 bl.length()=911 2024-09-14T11:40:20.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f88bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f88bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.340+0000 7f88bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.342+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:40:20.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.342+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:40:20.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.342+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:40:20.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.342+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.0 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.0 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.1 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.1 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.2 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.2 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.3 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.3 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.4 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.4 2024-09-14T11:40:20.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.5 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.5 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.6 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.6 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.7 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.7 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.8 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.8 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.9 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.9 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.10 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.10 2024-09-14T11:40:20.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.11 2024-09-14T11:40:20.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2.11 2024-09-14T11:40:20.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.348+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.0 2024-09-14T11:40:20.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.349+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.1 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.349+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.350+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.3 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.351+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.4 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.351+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.5 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.352+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.6 2024-09-14T11:40:20.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.352+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.7 2024-09-14T11:40:20.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.353+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.8 2024-09-14T11:40:20.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.353+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.9 2024-09-14T11:40:20.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.354+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.10 2024-09-14T11:40:20.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.358+0000 7f89deb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:20.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.358+0000 7f89deb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.359+0000 7f89deb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.359+0000 7f89deb28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.359+0000 7f89deb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.359+0000 7f89deb28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.360+0000 7f88bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94278173176384 notifier 7148 bl.length()=911 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.360+0000 7f88bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.360+0000 7f88bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.360+0000 7f88bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.361+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:40:20.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.361+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:40:20.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.361+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:40:20.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.361+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:40:20.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.364+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.0 2024-09-14T11:40:20.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.364+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.1 2024-09-14T11:40:20.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.365+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.2 2024-09-14T11:40:20.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.365+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.3 2024-09-14T11:40:20.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.365+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.4 2024-09-14T11:40:20.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.365+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.5 2024-09-14T11:40:20.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.366+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.6 2024-09-14T11:40:20.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.366+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.7 2024-09-14T11:40:20.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.366+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.8 2024-09-14T11:40:20.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.367+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.9 2024-09-14T11:40:20.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.367+0000 7f89deb28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34.10 2024-09-14T11:40:20.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.367+0000 7f89deb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:20.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.367+0000 7f89deb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f89deb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f89deb28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f89deb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f89deb28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34, ofs0, ns] 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f88bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94278173176384 notifier 7148 bl.length()=879 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f88bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 info.flags=0x17 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f88bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 to cache LRU end 2024-09-14T11:40:20.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.369+0000 7f88bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:20.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.371+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_sources= new_sources= 2024-09-14T11:40:20.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.371+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential sources added=[] removed=[] 2024-09-14T11:40:20.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.371+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): orig_dests= new_dests= 2024-09-14T11:40:20.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.371+0000 7f89deb28800 20 handle_bi_update(): bucket=:abort-at-do-reshard[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34]): potential dests added=[] removed=[] 2024-09-14T11:40:20.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.375+0000 7f89deb28800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:20.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.376+0000 7f88917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:20.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.379+0000 7f89deb28800 20 remove_watcher() i=0 2024-09-14T11:40:20.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.379+0000 7f89deb28800 2 removed watcher, disabling cache 2024-09-14T11:40:20.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.380+0000 7f89deb28800 20 remove_watcher() i=1 2024-09-14T11:40:20.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.381+0000 7f89deb28800 20 remove_watcher() i=2 2024-09-14T11:40:20.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.382+0000 7f89deb28800 20 remove_watcher() i=3 2024-09-14T11:40:20.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.383+0000 7f89deb28800 20 remove_watcher() i=4 2024-09-14T11:40:20.382 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.384+0000 7f89deb28800 20 remove_watcher() i=5 2024-09-14T11:40:20.383 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.385+0000 7f89deb28800 20 remove_watcher() i=6 2024-09-14T11:40:20.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.386+0000 7f89deb28800 20 remove_watcher() i=7 2024-09-14T11:40:20.396 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:40:20.425 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:20.425 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:20.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.464+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 realm 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.466+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.467+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:20.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.467+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.468+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:20.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.468+0000 7fd200487800 20 searching for the correct realm 2024-09-14T11:40:20.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.470+0000 7fd1fd770640 0 -- 172.21.15.116:0/4103595216 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd1f007e060 msgr2=0x7fd1f0098040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:20.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.474+0000 7fd1fdf71640 0 -- 172.21.15.116:0/4103595216 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd1e8008920 msgr2=0x7fd1e80093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:20.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:20.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:20.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.681+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 zone default found 2024-09-14T11:40:20.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 4 Realm: () 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 zonegroup default 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.682+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:20.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 started sync module instance, tier type = 2024-09-14T11:40:20.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.683+0000 7fd200487800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:20.690 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=0 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=1 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=2 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=3 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=4 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=5 2024-09-14T11:40:20.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.692+0000 7fd200487800 20 add_watcher() i=6 2024-09-14T11:40:20.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.693+0000 7fd200487800 20 add_watcher() i=7 2024-09-14T11:40:20.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.693+0000 7fd200487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:20.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.695+0000 7fd0affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 5 note: GC not initialized 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd0aeffd640 20 reqs_thread_entry: start 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 20 Filter name: none 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd0acff9640 20 reqs_thread_entry: start 2024-09-14T11:40:20.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.696+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.697+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.697+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.697+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.697+0000 7fd200487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.697+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.698+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.698+0000 7fd200487800 20 rados->read ofs=0 len=0 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.698+0000 7fd200487800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:40:20.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.698+0000 7fd200487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:20.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.700+0000 7fd0affff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:20.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.702+0000 7fd200487800 20 remove_watcher() i=0 2024-09-14T11:40:20.701 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.702+0000 7fd200487800 2 removed watcher, disabling cache 2024-09-14T11:40:20.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.704+0000 7fd200487800 20 remove_watcher() i=1 2024-09-14T11:40:20.703 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.705+0000 7fd200487800 20 remove_watcher() i=2 2024-09-14T11:40:20.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.706+0000 7fd200487800 20 remove_watcher() i=3 2024-09-14T11:40:20.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.707+0000 7fd200487800 20 remove_watcher() i=4 2024-09-14T11:40:20.706 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.708+0000 7fd200487800 20 remove_watcher() i=5 2024-09-14T11:40:20.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.709+0000 7fd200487800 20 remove_watcher() i=6 2024-09-14T11:40:20.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:20.710+0000 7fd200487800 20 remove_watcher() i=7 2024-09-14T11:40:20.718 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:20.718 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:20.718 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-do-reshard id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:20.719 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:21.082 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:40:21.082 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:21.879 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:40:21.907 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:21.908 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:21.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.946+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 realm 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:21.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:21.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.948+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:21.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.949+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:21.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.949+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:21.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.949+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:21.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.949+0000 7f84bcb22800 20 searching for the correct realm 2024-09-14T11:40:21.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:21.951+0000 7f84b8702640 0 -- 172.21.15.116:0/2513176561 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f84b0017020 msgr2=0x7f84b0022400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.156+0000 7f84b8f03640 0 -- 172.21.15.116:0/2513176561 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f84a006c070 msgr2=0x7f84a00dc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:22.160 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.161+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 zone default found 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 4 Realm: () 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 zonegroup default 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.162+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.163+0000 7f84bcb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.163+0000 7f84bcb22800 20 started sync module instance, tier type = 2024-09-14T11:40:22.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.163+0000 7f84bcb22800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=0 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=1 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=2 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=3 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=4 2024-09-14T11:40:22.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=5 2024-09-14T11:40:22.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.171+0000 7f84bcb22800 20 add_watcher() i=6 2024-09-14T11:40:22.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.172+0000 7f84bcb22800 20 add_watcher() i=7 2024-09-14T11:40:22.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.172+0000 7f84bcb22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:22.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f836efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f84bcb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f84bcb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f84bcb22800 5 note: GC not initialized 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f836dfdb640 20 reqs_thread_entry: start 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f84bcb22800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f84bcb22800 20 Filter name: none 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.174+0000 7f82df7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:22.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.175+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.175+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:22.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.175+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.176+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:22.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.176+0000 7f84bcb22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:22.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.176+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.176+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:22.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.176+0000 7f84bcb22800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.177+0000 7f84bcb22800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:22.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.177+0000 7f84bcb22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:22.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.178+0000 7f836efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.180+0000 7f84bcb22800 20 remove_watcher() i=0 2024-09-14T11:40:22.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.180+0000 7f84bcb22800 2 removed watcher, disabling cache 2024-09-14T11:40:22.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.181+0000 7f84bcb22800 20 remove_watcher() i=1 2024-09-14T11:40:22.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.182+0000 7f84bcb22800 20 remove_watcher() i=2 2024-09-14T11:40:22.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.183+0000 7f84bcb22800 20 remove_watcher() i=3 2024-09-14T11:40:22.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.184+0000 7f84bcb22800 20 remove_watcher() i=4 2024-09-14T11:40:22.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.185+0000 7f84bcb22800 20 remove_watcher() i=5 2024-09-14T11:40:22.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.186+0000 7f84bcb22800 20 remove_watcher() i=6 2024-09-14T11:40:22.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.187+0000 7f84bcb22800 20 remove_watcher() i=7 2024-09-14T11:40:22.194 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:22.195 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:22.195 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:22.195 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:22.196 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:40:22.230 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:22.230 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:22.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.269+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 20 realm 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.270+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.271+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.271+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.272+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.272+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.272+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:22.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.272+0000 7fd46e41d800 20 searching for the correct realm 2024-09-14T11:40:22.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.276+0000 7fd463fff640 0 -- 172.21.15.116:0/15302038 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd45c083c20 msgr2=0x7fd45c068680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.279+0000 7fd463fff640 0 -- 172.21.15.116:0/15302038 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd3340870d0 msgr2=0x7fd334089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.282+0000 7fd46e41d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 zone default found 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 4 Realm: () 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 zonegroup default 2024-09-14T11:40:22.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.283+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 started sync module instance, tier type = 2024-09-14T11:40:22.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.284+0000 7fd46e41d800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=0 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=1 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=2 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=3 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=4 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=5 2024-09-14T11:40:22.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.293+0000 7fd46e41d800 20 add_watcher() i=6 2024-09-14T11:40:22.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.294+0000 7fd46e41d800 20 add_watcher() i=7 2024-09-14T11:40:22.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.294+0000 7fd46e41d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:22.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.295+0000 7fd2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.295+0000 7fd46e41d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:22.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.295+0000 7fd46e41d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:22.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.295+0000 7fd46e41d800 5 note: GC not initialized 2024-09-14T11:40:22.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd2fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:22.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:22.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 20 Filter name: none 2024-09-14T11:40:22.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd28ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:22.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:40:22.295 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 : miss 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.296+0000 7fd46e41d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:22.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:22.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:22.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:22.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:22.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.297+0000 7fd46e41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 2024-09-14T11:40:22.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd46e41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:22.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd46e41d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:22.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd46e41d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:22.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd46e41d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35, ofs0, ns] 2024-09-14T11:40:22.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd34d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94090276344784 notifier 7791 bl.length()=923 2024-09-14T11:40:22.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd34d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:22.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd34d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:22.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.302+0000 7fd34d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:22.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.304+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_sources= new_sources= 2024-09-14T11:40:22.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.304+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential sources added=[] removed=[] 2024-09-14T11:40:22.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.304+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_dests= new_dests= 2024-09-14T11:40:22.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.304+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential dests added=[] removed=[] 2024-09-14T11:40:22.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.306+0000 7fd46e41d800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:40:22.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.306+0000 7fd46e41d800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:40:22.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.310+0000 7fd46e41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:22.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.310+0000 7fd46e41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 2024-09-14T11:40:22.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd46e41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:22.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd46e41d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:22.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd46e41d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:22.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd46e41d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35, ofs0, ns] 2024-09-14T11:40:22.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd34cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94090276344784 notifier 7791 bl.length()=891 2024-09-14T11:40:22.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd34cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:22.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd34cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:22.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.312+0000 7fd34cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:22.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.313+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_sources= new_sources= 2024-09-14T11:40:22.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.313+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential sources added=[] removed=[] 2024-09-14T11:40:22.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.313+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_dests= new_dests= 2024-09-14T11:40:22.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.313+0000 7fd46e41d800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential dests added=[] removed=[] 2024-09-14T11:40:22.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.315+0000 7fd2fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.317+0000 7fd46e41d800 20 remove_watcher() i=0 2024-09-14T11:40:22.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.317+0000 7fd46e41d800 2 removed watcher, disabling cache 2024-09-14T11:40:22.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.318+0000 7fd46e41d800 20 remove_watcher() i=1 2024-09-14T11:40:22.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.319+0000 7fd46e41d800 20 remove_watcher() i=2 2024-09-14T11:40:22.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.320+0000 7fd46e41d800 20 remove_watcher() i=3 2024-09-14T11:40:22.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.321+0000 7fd46e41d800 20 remove_watcher() i=4 2024-09-14T11:40:22.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.322+0000 7fd46e41d800 20 remove_watcher() i=5 2024-09-14T11:40:22.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.323+0000 7fd46e41d800 20 remove_watcher() i=6 2024-09-14T11:40:22.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.323+0000 7fd46e41d800 20 remove_watcher() i=7 2024-09-14T11:40:22.333 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:40:22.361 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:22.361 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:22.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.399+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.400+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.400+0000 7fd543f42800 20 realm 2024-09-14T11:40:22.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.400+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.401+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.401+0000 7fd543f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:22.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.401+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.401+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.401+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.402+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.402+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.402+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:22.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.402+0000 7fd543f42800 20 searching for the correct realm 2024-09-14T11:40:22.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.405+0000 7fd540487640 0 -- 172.21.15.116:0/1641813895 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x558e2d4a44a0 msgr2=0x558e2d4a6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.408+0000 7fd53f485640 0 -- 172.21.15.116:0/1641813895 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd530087050 msgr2=0x7fd530088940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:22.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.412+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 zone default found 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 4 Realm: () 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 zonegroup default 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 started sync module instance, tier type = 2024-09-14T11:40:22.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.413+0000 7fd543f42800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:22.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=0 2024-09-14T11:40:22.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=1 2024-09-14T11:40:22.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=2 2024-09-14T11:40:22.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=3 2024-09-14T11:40:22.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=4 2024-09-14T11:40:22.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=5 2024-09-14T11:40:22.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.422+0000 7fd543f42800 20 add_watcher() i=6 2024-09-14T11:40:22.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.423+0000 7fd543f42800 20 add_watcher() i=7 2024-09-14T11:40:22.421 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.423+0000 7fd543f42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:22.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd543f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd543f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd543f42800 5 note: GC not initialized 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd3f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd543f42800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.425+0000 7fd543f42800 20 Filter name: none 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd36e7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:22.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.426+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.427+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.427+0000 7fd543f42800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.427+0000 7fd543f42800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:22.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.427+0000 7fd543f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:22.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.429+0000 7fd3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:22.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.431+0000 7fd543f42800 20 remove_watcher() i=0 2024-09-14T11:40:22.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.431+0000 7fd543f42800 2 removed watcher, disabling cache 2024-09-14T11:40:22.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.432+0000 7fd543f42800 20 remove_watcher() i=1 2024-09-14T11:40:22.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.433+0000 7fd543f42800 20 remove_watcher() i=2 2024-09-14T11:40:22.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.434+0000 7fd543f42800 20 remove_watcher() i=3 2024-09-14T11:40:22.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.436+0000 7fd543f42800 20 remove_watcher() i=4 2024-09-14T11:40:22.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.437+0000 7fd543f42800 20 remove_watcher() i=5 2024-09-14T11:40:22.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.438+0000 7fd543f42800 20 remove_watcher() i=6 2024-09-14T11:40:22.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.439+0000 7fd543f42800 20 remove_watcher() i=7 2024-09-14T11:40:22.447 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:22.447 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:22.447 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:22.536 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:22.567 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:22.567 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:22.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.606+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.607+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.607+0000 7f86e152c800 20 realm 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.607+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.608+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.608+0000 7f86e152c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.608+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.608+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:22.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.608+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.609+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:22.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.609+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:22.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.609+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:22.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.609+0000 7f86e152c800 20 searching for the correct realm 2024-09-14T11:40:22.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.612+0000 7f86d493d640 0 -- 172.21.15.116:0/2441437658 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f86d0080040 msgr2=0x7f86d008d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:22.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:22.615+0000 7f86dd13e640 0 -- 172.21.15.116:0/2441437658 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f86c80193c0 msgr2=0x7f86c8019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.224+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:23.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 zone default found 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 4 Realm: () 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 zonegroup default 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.225+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 started sync module instance, tier type = 2024-09-14T11:40:23.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.226+0000 7f86e152c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=0 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=1 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=2 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=3 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=4 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=5 2024-09-14T11:40:23.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.236+0000 7f86e152c800 20 add_watcher() i=6 2024-09-14T11:40:23.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.237+0000 7f86e152c800 20 add_watcher() i=7 2024-09-14T11:40:23.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.237+0000 7f86e152c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:23.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f8593fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:23.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f86e152c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f86e152c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f86e152c800 5 note: GC not initialized 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f8592fe5640 20 reqs_thread_entry: start 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f86e152c800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.239+0000 7f86e152c800 20 Filter name: none 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f8590fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:40:23.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 : miss 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.240+0000 7f86e152c800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:23.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:23.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.241+0000 7f86e152c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 2024-09-14T11:40:23.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f86e152c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f86e152c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f86e152c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f86e152c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35, ofs0, ns] 2024-09-14T11:40:23.244 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f85c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 93825969424928 notifier 7821 bl.length()=923 2024-09-14T11:40:23.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f85c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f85c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.246+0000 7f85c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.248+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_sources= new_sources= 2024-09-14T11:40:23.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.248+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential sources added=[] removed=[] 2024-09-14T11:40:23.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.248+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_dests= new_dests= 2024-09-14T11:40:23.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.248+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential dests added=[] removed=[] 2024-09-14T11:40:23.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.0 2024-09-14T11:40:23.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.0 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.1 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.1 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.2 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.2 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.3 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.3 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.4 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.4 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.5 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.5 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.6 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.6 2024-09-14T11:40:23.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.7 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.7 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.8 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.8 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.9 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.9 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.10 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.10 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.11 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1.11 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.0 2024-09-14T11:40:23.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.253+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1 2024-09-14T11:40:23.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.254+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.2 2024-09-14T11:40:23.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.254+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.3 2024-09-14T11:40:23.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.255+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.4 2024-09-14T11:40:23.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.255+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.5 2024-09-14T11:40:23.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.256+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.6 2024-09-14T11:40:23.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.257+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.7 2024-09-14T11:40:23.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.257+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.8 2024-09-14T11:40:23.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.258+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.9 2024-09-14T11:40:23.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.258+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.10 2024-09-14T11:40:23.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.262+0000 7f86e152c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:23.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.262+0000 7f86e152c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 2024-09-14T11:40:23.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f86e152c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f86e152c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f86e152c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f86e152c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35, ofs0, ns] 2024-09-14T11:40:23.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f85c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 93825969424928 notifier 7821 bl.length()=923 2024-09-14T11:40:23.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f85c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f85c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.262 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.263+0000 7f85c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.265+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_sources= new_sources= 2024-09-14T11:40:23.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.265+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential sources added=[] removed=[] 2024-09-14T11:40:23.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.265+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_dests= new_dests= 2024-09-14T11:40:23.263 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.265+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential dests added=[] removed=[] 2024-09-14T11:40:23.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.268+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.0 2024-09-14T11:40:23.266 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.269+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.1 2024-09-14T11:40:23.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.269+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.2 2024-09-14T11:40:23.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.269+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.3 2024-09-14T11:40:23.267 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.270+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.4 2024-09-14T11:40:23.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.270+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.5 2024-09-14T11:40:23.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.270+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.6 2024-09-14T11:40:23.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.270+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.7 2024-09-14T11:40:23.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.271+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.8 2024-09-14T11:40:23.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.271+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.9 2024-09-14T11:40:23.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.271+0000 7f86e152c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35.10 2024-09-14T11:40:23.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.272+0000 7f86e152c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:23.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.272+0000 7f86e152c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 2024-09-14T11:40:23.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.273+0000 7f86e152c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.273+0000 7f86e152c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.273+0000 7f86e152c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.273+0000 7f86e152c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35, ofs0, ns] 2024-09-14T11:40:23.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.274+0000 7f85affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 93825969424928 notifier 7821 bl.length()=891 2024-09-14T11:40:23.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.274+0000 7f85affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 info.flags=0x17 2024-09-14T11:40:23.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.274+0000 7f85affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 to cache LRU end 2024-09-14T11:40:23.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.274+0000 7f85affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:23.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.275+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_sources= new_sources= 2024-09-14T11:40:23.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.275+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential sources added=[] removed=[] 2024-09-14T11:40:23.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.275+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): orig_dests= new_dests= 2024-09-14T11:40:23.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.275+0000 7f86e152c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35]): potential dests added=[] removed=[] 2024-09-14T11:40:23.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.277+0000 7f86e152c800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:23.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.279+0000 7f8593fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:23.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.281+0000 7f86e152c800 20 remove_watcher() i=0 2024-09-14T11:40:23.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.281+0000 7f86e152c800 2 removed watcher, disabling cache 2024-09-14T11:40:23.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.282+0000 7f86e152c800 20 remove_watcher() i=1 2024-09-14T11:40:23.281 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.284+0000 7f86e152c800 20 remove_watcher() i=2 2024-09-14T11:40:23.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.285+0000 7f86e152c800 20 remove_watcher() i=3 2024-09-14T11:40:23.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.286+0000 7f86e152c800 20 remove_watcher() i=4 2024-09-14T11:40:23.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.287+0000 7f86e152c800 20 remove_watcher() i=5 2024-09-14T11:40:23.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.288+0000 7f86e152c800 20 remove_watcher() i=6 2024-09-14T11:40:23.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.289+0000 7f86e152c800 20 remove_watcher() i=7 2024-09-14T11:40:23.299 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:40:23.328 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:23.328 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:23.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.366+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 realm 2024-09-14T11:40:23.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.368+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.369+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.369+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.369+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:23.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.369+0000 7fceaa22f800 20 searching for the correct realm 2024-09-14T11:40:23.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.372+0000 7fcea8521640 0 -- 172.21.15.116:0/347671381 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fce9008b070 msgr2=0x7fce90066aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:23.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.376+0000 7fcea7d20640 0 -- 172.21.15.116:0/347671381 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fce90098830 msgr2=0x7fce9004d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:23.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:23.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:23.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:23.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:23.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:23.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:23.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.379 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.380+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 zone default found 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 4 Realm: () 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:23.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 zonegroup default 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.381+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.382+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.382+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.382+0000 7fceaa22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.382+0000 7fceaa22f800 20 started sync module instance, tier type = 2024-09-14T11:40:23.381 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.382+0000 7fceaa22f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:23.388 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=0 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=1 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=2 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=3 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=4 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=5 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=6 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 20 add_watcher() i=7 2024-09-14T11:40:23.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.391+0000 7fceaa22f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:23.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.393+0000 7fcd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:23.392 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 5 note: GC not initialized 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fcd5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 20 Filter name: none 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fccd67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.394+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.395+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:23.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.395+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.395+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:23.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.395+0000 7fceaa22f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:23.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.395+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.396+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:23.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.396+0000 7fceaa22f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:23.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.396+0000 7fceaa22f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:23.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.396+0000 7fceaa22f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:23.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.397+0000 7fcd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:23.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.400+0000 7fceaa22f800 20 remove_watcher() i=0 2024-09-14T11:40:23.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.400+0000 7fceaa22f800 2 removed watcher, disabling cache 2024-09-14T11:40:23.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.401+0000 7fceaa22f800 20 remove_watcher() i=1 2024-09-14T11:40:23.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.401+0000 7fceaa22f800 20 remove_watcher() i=2 2024-09-14T11:40:23.400 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.402+0000 7fceaa22f800 20 remove_watcher() i=3 2024-09-14T11:40:23.401 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.403+0000 7fceaa22f800 20 remove_watcher() i=4 2024-09-14T11:40:23.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.404+0000 7fceaa22f800 20 remove_watcher() i=5 2024-09-14T11:40:23.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.405+0000 7fceaa22f800 20 remove_watcher() i=6 2024-09-14T11:40:23.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:23.406+0000 7fceaa22f800 20 remove_watcher() i=7 2024-09-14T11:40:23.414 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:23.414 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:23.414 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:23.414 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:23.779 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:40:23.779 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:24.576 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:40:24.604 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:24.604 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:24.639 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.642+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.643+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.643+0000 7fc234f19800 20 realm 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.643+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.644+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.644+0000 7fc234f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.644+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.644+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.644+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.645+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.645+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.645+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:24.643 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.645+0000 7fc234f19800 20 searching for the correct realm 2024-09-14T11:40:24.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.648+0000 7fc22a202640 0 -- 172.21.15.116:0/2024365982 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fc224025040 msgr2=0x7fc224017ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:24.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.651+0000 7fc232a03640 0 -- 172.21.15.116:0/2024365982 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc21c07c000 msgr2=0x7fc21c06c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:24.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 zone default found 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 4 Realm: () 2024-09-14T11:40:24.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 zonegroup default 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.857+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 started sync module instance, tier type = 2024-09-14T11:40:24.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.858+0000 7fc234f19800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=0 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=1 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=2 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=3 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=4 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=5 2024-09-14T11:40:24.865 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.867+0000 7fc234f19800 20 add_watcher() i=6 2024-09-14T11:40:24.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.868+0000 7fc234f19800 20 add_watcher() i=7 2024-09-14T11:40:24.866 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.868+0000 7fc234f19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:24.867 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.869+0000 7fc0e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.869+0000 7fc234f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.869+0000 7fc234f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.869+0000 7fc234f19800 5 note: GC not initialized 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.870+0000 7fc063fff640 20 reqs_thread_entry: start 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.870+0000 7fc234f19800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.870+0000 7fc234f19800 20 Filter name: none 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.870+0000 7fc061ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:24.868 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.870+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:24.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:24.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:24.869 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:24.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.871+0000 7fc234f19800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.872+0000 7fc234f19800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:24.870 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.872+0000 7fc234f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:24.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.874+0000 7fc0e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:24.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.876+0000 7fc234f19800 20 remove_watcher() i=0 2024-09-14T11:40:24.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.876+0000 7fc234f19800 2 removed watcher, disabling cache 2024-09-14T11:40:24.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.877+0000 7fc234f19800 20 remove_watcher() i=1 2024-09-14T11:40:24.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.878+0000 7fc234f19800 20 remove_watcher() i=2 2024-09-14T11:40:24.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.879+0000 7fc234f19800 20 remove_watcher() i=3 2024-09-14T11:40:24.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.880+0000 7fc234f19800 20 remove_watcher() i=4 2024-09-14T11:40:24.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.881+0000 7fc234f19800 20 remove_watcher() i=5 2024-09-14T11:40:24.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.881+0000 7fc234f19800 20 remove_watcher() i=6 2024-09-14T11:40:24.880 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.882+0000 7fc234f19800 20 remove_watcher() i=7 2024-09-14T11:40:24.890 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:24.891 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:24.891 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:24.891 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:24.892 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:40:24.926 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:24.926 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:24.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.964+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 realm 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:24.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:24.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.967+0000 7f8d1293e800 20 searching for the correct realm 2024-09-14T11:40:24.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.970+0000 7f8d0debf640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55c5712324d0 msgr2=0x55c571234950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:24.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.973+0000 7f8d0e6c0640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8d040188a0 msgr2=0x7f8d0400c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zone default found 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Realm: () 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zonegroup default 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.980+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:24.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started sync module instance, tier type = 2024-09-14T11:40:24.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=0 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=1 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=2 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=3 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=4 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=5 2024-09-14T11:40:24.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=6 2024-09-14T11:40:24.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.989+0000 7f8d1293e800 20 add_watcher() i=7 2024-09-14T11:40:24.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.989+0000 7f8d1293e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:24.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.990+0000 7f8bc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:24.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:24.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:24.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 5 note: GC not initialized 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8b3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 20 Filter name: none 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8b3d7fa640 20 reqs_thread_entry: start 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:40:24.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : miss 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:24.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:24.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.992+0000 7f8d1293e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:24.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.998+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:24.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.998+0000 7f8d1293e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:24.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.998+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:24.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.998+0000 7f8d1293e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:24.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94306495078992 notifier 7286 bl.length()=923 2024-09-14T11:40:24.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:24.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:24.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:24.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:24.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:24.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:24.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:25.001 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8d1293e800 time 2024-09-14T11:40:25.003927+0000 2024-09-14T11:40:25.001 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:25.001 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.001 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8d1418c76a] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.003+0000 7f8d1293e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8d1293e800 time 2024-09-14T11:40:25.003927+0000 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8d1418c76a] 2024-09-14T11:40:25.002 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:25.003 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f8d1293e800 thread_name:radosgw-admin 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8d12e3e6f0] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8d12e8b99c] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8d1418c7c4] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.023 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.004+0000 7f8d1293e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f8d1293e800 thread_name:radosgw-admin 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8d12e3e6f0] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8d12e8b99c] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8d1418c7c4] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.024 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: dump: 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.025 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: dump: 2024-09-14T11:40:25.026 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:40:24.948+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7866 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:40:24.948+0000 7f8d1293e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:40:24.948+0000 7f8d1293e800 4 set_mon_vals no callback set 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: shutdown 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 asok(0x55c570f1f270) unregister_commands rotate-key 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.027 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.028 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:40:24.949+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: starting msgr at 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: starting objecter 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests hook 0x55c571168b50 2024-09-14T11:40:25.029 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: setting wanted keys 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: calling monclient init 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.030 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:40:24.949+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:40:24.950+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:40:24.950+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key hook 0x55c57113e218 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c570fca3f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c571080ef0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c571081360 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.556121s 2024-09-14T11:40:25.031 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c570fca3f0 auth_method 0 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): get_auth_request con 0x55c571080ef0 auth_method 0 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c571081360 auth_method 0 2024-09-14T11:40:25.032 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7869 payload 824 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 1 monclient: found mon.noname-a 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: dump: 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.033 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: dump: 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.034 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:40:24.950+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7869 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:40:24.950+0000 7f8bfc608640 4 set_mon_vals no callback set 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:40:24.950+0000 7f8d1293e800 1 librados: init done 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:40:24.952+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bf4077230 auth_method 0 2024-09-14T11:40:25.035 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:40:24.952+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x55c571165810 auth_method 0 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:40:24.953+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c57118a8a0 auth_method 0 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:40:24.955+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c57118fb10 auth_method 0 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:40:24.955+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:40:24.955+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:40:24.955+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.036 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.037 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5711975a0 EEXIST 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.038 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x55c571192c50 EEXIST 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c5711bb290 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c5711bd560 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c5711b9a60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.039 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.562815s 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c5711bb290 auth_method 0 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c5711b9a60 auth_method 0 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:40:24.957+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:40:24.957+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): get_auth_request con 0x55c5711bd560 auth_method 0 2024-09-14T11:40:25.040 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7280 payload 824 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: dump: 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.041 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:40:24.957+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7280 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: dump: 2024-09-14T11:40:25.042 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:40:24.957+0000 7f8d0f6c2640 4 set_mon_vals no callback set 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.043 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:40:24.959+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8be8077140 auth_method 0 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: get_monmap_and_config 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:40:24.959+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.044 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.045 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:40:24.959+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.046 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:40:24.960+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:40:24.960+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:40:24.960+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x7fff595e2d38 EEXIST 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c57120f170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c5711def80 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c57120a530 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.047 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.566359s 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c57120f170 auth_method 0 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c57120a530 auth_method 0 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.048 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_done global_id 7283 payload 274 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:40:24.960+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c5711def80 auth_method 0 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: dump: 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.049 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:40:24.960+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7283 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:40:24.961+0000 7f8d1293e800 4 set_mon_vals no callback set 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.050 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: dump: 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: shutdown 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.051 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.052 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:40:24.961+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.053 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 librados: starting msgr at 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 librados: starting objecter 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5711bd3d0 EEXIST 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:40:24.962+0000 7f8d1293e800 1 librados: setting wanted keys 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:40:24.962+0000 7f8d1293e800 1 librados: calling monclient init 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.054 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:40:24.962+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:40:24.962+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x55c5711d3188 EEXIST 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c5711def80 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c57120a530 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.055 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c57120f170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.568552s 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c5711def80 auth_method 0 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c57120f170 auth_method 0 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.056 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: dump: 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.057 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: dump: 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.058 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:40:24.963+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:40:24.963+0000 7f8bf1ffb640 4 set_mon_vals no callback set 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.059 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:40:24.963+0000 7f8d1293e800 1 librados: init done 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:40:24.963+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cr dump hook 0x55c571206578 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:40:24.964+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:40:24.965+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bd8077230 auth_method 0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:40:24.965+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x55c571229030 auth_method 0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 realm 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:40:24.966+0000 7f8d1293e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.060 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:40:24.966+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c57122d260 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 searching for the correct realm 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:40:24.967+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c5712324d0 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:40:24.968+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x7f8d0401b040 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:40:24.969+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d0806e930 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:40:24.969+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8d00021030 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:40:24.970+0000 7f8d0debf640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55c5712324d0 msgr2=0x55c571234950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:40:24.970+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x55c5712324d0 session 0x55c571231e50 osd.3 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:40:24.970+0000 7f8bdffff640 10 monclient: _renew_subs 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:40:24.970+0000 7f8bdffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:40:24.970+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bd80870d0 auth_method 0 2024-09-14T11:40:25.061 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:40:24.971+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x7f8d040323d0 auth_method 0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d040188a0 auth_method 0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8d040188a0 msgr2=0x7f8d0400c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:40:24.973+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x7f8d040188a0 session 0x7f8d04033bb0 osd.0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c5712324d0 auth_method 0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:40:24.975+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x55c5712324d0 session 0x7f8d04033bb0 osd.0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:40:24.975+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d040188a0 auth_method 0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.062 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zone default found 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Realm: () 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:40:24.979+0000 7f8d1293e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zonegroup default 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.063 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started sync module instance, tier type = 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=0 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=1 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=2 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=3 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=4 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=5 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=6 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:40:24.989+0000 7f8d1293e800 20 add_watcher() i=7 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:40:24.989+0000 7f8d1293e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.064 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:40:24.990+0000 7f8bc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:40:24.991+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.065 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache list hook 0x55c571206860 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache inspect hook 0x55c571206860 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache erase hook 0x55c571206860 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache zap hook 0x55c571206860 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 note: GC not initialized 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:40:24.991+0000 7f8b3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace show hook 0x7f8d0804da00 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace history hook 0x7f8d0804da00 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace active hook 0x7f8d0804da00 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace active_short hook 0x7f8d0804da00 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 Filter name: none 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:40:24.991+0000 7f8b3d7fa640 20 reqs_thread_entry: start 2024-09-14T11:40:25.066 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:40:24.991+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : miss 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.067 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94306495078992 notifier 7286 bl.length()=923 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:40:25.003+0000 7f8d1293e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8d1293e800 time 2024-09-14T11:40:25.003927+0000 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8d1418c76a] 2024-09-14T11:40:25.068 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:40:25.004+0000 7f8d1293e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f8d1293e800 thread_name:radosgw-admin 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8d12e3e6f0] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8d12e8b99c] 2024-09-14T11:40:25.069 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8d1418c7c4] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:40:25.070 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:40:25.071 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:40:25.072 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:40:25.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:40:25.074 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:40:25.075 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8b3d7fa640 / http_manager 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8b3f7fe640 / http_manager 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bc4fe1640 / rgw_dt_lg_renew 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bdffff640 / ms_dispatch 2024-09-14T11:40:25.076 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf17fa640 / io_context_pool 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf1ffb640 / io_context_pool 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf3fff640 / ms_dispatch 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bfae05640 / ms_dispatch 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bfc608640 / io_context_pool 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0debf640 / msgr-worker-2 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0e6c0640 / msgr-worker-1 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0eec1640 / msgr-worker-0 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0f6c2640 / io_context_pool 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d1293e800 / radosgw-admin 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.134334.log 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.077 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: dump: 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.078 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:40:24.948+0000 7f8bfc608640 10 monclient: dump: 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:40:24.948+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7866 2024-09-14T11:40:25.079 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:40:24.948+0000 7f8d1293e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:40:24.948+0000 7f8d1293e800 4 set_mon_vals no callback set 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: shutdown 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 asok(0x55c570f1f270) unregister_commands rotate-key 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.080 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding auth protocol: cephx 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.081 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: crc 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c571143ca0) adding con mode: secure 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:40:24.949+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: starting msgr at 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: starting objecter 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests hook 0x55c571168b50 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: setting wanted keys 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:40:24.949+0000 7f8d1293e800 1 librados: calling monclient init 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:40:24.949+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding auth protocol: cephx 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.082 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: crc 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:40:24.949+0000 7f8d1293e800 5 AuthRegistry(0x55c57113e0d0) adding con mode: secure 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:40:24.949+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:40:24.950+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:40:24.950+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key hook 0x55c57113e218 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:25.083 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c570fca3f0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c571080ef0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c571081360 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.556121s 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c570fca3f0 auth_method 0 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): get_auth_request con 0x55c571080ef0 auth_method 0 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.084 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:40:24.950+0000 7f8d0debf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c571081360 auth_method 0 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:40:24.950+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7869 payload 824 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.085 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 1 monclient: found mon.noname-a 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:40:24.950+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: dump: 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.086 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:40:24.950+0000 7f8bfae05640 10 monclient: dump: 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.087 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:40:24.950+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7869 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:40:24.950+0000 7f8bfc608640 4 set_mon_vals no callback set 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:40:24.950+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:40:24.950+0000 7f8d1293e800 1 librados: init done 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:40:24.952+0000 7f8bfae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:40:24.952+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bf4077230 auth_method 0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:40:24.952+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x55c571165810 auth_method 0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:40:24.953+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c57118a8a0 auth_method 0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:40:24.955+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c57118fb10 auth_method 0 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:40:24.955+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.088 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:40:24.955+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:40:24.955+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.089 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding auth protocol: cephx 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.090 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: crc 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:40:24.955+0000 7f8d1293e800 5 AuthRegistry(0x55c571193b50) adding con mode: secure 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5711975a0 EEXIST 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding auth protocol: cephx 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.091 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: crc 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 AuthRegistry(0x55c571192b08) adding con mode: secure 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:40:24.956+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:40:24.956+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x55c571192c50 EEXIST 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c5711bb290 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c5711bd560 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c5711b9a60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.092 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:40:24.956+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.562815s 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c5711bb290 auth_method 0 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c5711b9a60 auth_method 0 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:40:24.956+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.093 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:40:24.956+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:40:24.957+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:40:24.957+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): get_auth_request con 0x55c5711bd560 auth_method 0 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:40:24.957+0000 7f8d0debf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7280 payload 824 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:40:24.957+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: dump: 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.094 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:40:24.957+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7280 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.095 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:40:24.957+0000 7f8bf3fff640 10 monclient: dump: 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.096 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:40:24.957+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:40:24.957+0000 7f8d0f6c2640 4 set_mon_vals no callback set 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:40:24.959+0000 7f8bf3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:40:24.959+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8be8077140 auth_method 0 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: get_monmap_and_config 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:40:24.959+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.097 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding auth protocol: cephx 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.098 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: crc 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x55c5711daaf0) adding con mode: secure 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:40:24.959+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:40:24.959+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding auth protocol: cephx 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.099 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: crc 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:40:24.959+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e2bf0) adding con mode: secure 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:40:24.960+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:40:24.960+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:40:24.960+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x7fff595e2d38 EEXIST 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c57120f170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.100 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c5711def80 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c57120a530 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.566359s 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c57120f170 auth_method 0 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c57120a530 auth_method 0 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.101 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:40:24.960+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_done global_id 7283 payload 274 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:40:24.960+0000 7f8d0eec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:40:24.960+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c5711def80 auth_method 0 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: dump: 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.102 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:40:24.960+0000 7f8bf1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:40:24.960+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7283 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:40:24.960+0000 7f8d1293e800 10 monclient: get_monmap_and_config success 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:40:24.961+0000 7f8d1293e800 4 set_mon_vals no callback set 2024-09-14T11:40:25.103 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:40:24.961+0000 7f8bf1ffb640 10 monclient: dump: 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: shutdown 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: build_initial_monmap 2024-09-14T11:40:25.104 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 build_initial for_mkfs: 0 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:40:24.961+0000 7f8d1293e800 10 monclient: monmap: 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.105 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding auth protocol: cephx 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: crc 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 AuthRegistry(0x55c57120a9e0) adding con mode: secure 2024-09-14T11:40:25.106 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:40:24.961+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 librados: starting msgr at 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:40:24.961+0000 7f8d1293e800 1 librados: starting objecter 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:40:24.961+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5711bd3d0 EEXIST 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:40:24.962+0000 7f8d1293e800 1 librados: setting wanted keys 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:40:24.962+0000 7f8d1293e800 1 librados: calling monclient init 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: init 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding auth protocol: cephx 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.107 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: crc 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 AuthRegistry(0x55c5711d3040) adding con mode: secure 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:40:24.962+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:40:24.962+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:40:24.962+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command rotate-key cmddesc rotate-key hook 0x55c5711d3188 EEXIST 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: _reopen_session rank -1 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-c con 0x55c5711def80 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-b con 0x55c57120a530 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): picked mon.noname-a con 0x55c57120f170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.108 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): _renew_subs 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:40:24.962+0000 7f8d1293e800 10 monclient(hunting): authenticate will time out at 2222.568552s 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request con 0x55c5711def80 auth_method 0 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request con 0x55c57120f170 auth_method 0 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:25.109 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:40:24.962+0000 7f8d0eec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient: _finish_hunting 0 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 1 monclient: found mon.noname-c 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:40:24.962+0000 7f8d0e6c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: dump: 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.110 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: _finish_auth 0 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: _check_auth_tickets 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:40:24.963+0000 7f8bdffff640 10 monclient: dump: 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.111 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:40:24.963+0000 7f8d1293e800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:40:24.963+0000 7f8bf1ffb640 4 set_mon_vals no callback set 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _renew_subs 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:40:24.963+0000 7f8d1293e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.112 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:40:24.963+0000 7f8d1293e800 1 librados: init done 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:40:24.963+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cr dump hook 0x55c571206578 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:40:24.964+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:40:24.965+0000 7f8bdffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:40:24.965+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bd8077230 auth_method 0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:40:24.965+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x55c571229030 auth_method 0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 realm 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:40:24.966+0000 7f8d1293e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.113 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:40:24.966+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:40:24.966+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c57122d260 auth_method 0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:40:24.967+0000 7f8d1293e800 20 searching for the correct realm 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:40:24.967+0000 7f8d0debf640 10 monclient: get_auth_request con 0x55c5712324d0 auth_method 0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:40:24.968+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x7f8d0401b040 auth_method 0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:40:24.969+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d0806e930 auth_method 0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:40:24.969+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8d00021030 auth_method 0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:40:24.970+0000 7f8d0debf640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55c5712324d0 msgr2=0x55c571234950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:40:24.970+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x55c5712324d0 session 0x55c571231e50 osd.3 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:40:24.970+0000 7f8bdffff640 10 monclient: _renew_subs 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:40:24.970+0000 7f8bdffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:40:25.114 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:40:24.970+0000 7f8d0debf640 10 monclient: get_auth_request con 0x7f8bd80870d0 auth_method 0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:40:24.971+0000 7f8d0eec1640 10 monclient: get_auth_request con 0x7f8d040323d0 auth_method 0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d040188a0 auth_method 0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 0 -- 172.21.15.116:0/4147989600 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8d040188a0 msgr2=0x7f8d0400c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:40:24.973+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x7f8d040188a0 session 0x7f8d04033bb0 osd.0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:40:24.973+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x55c5712324d0 auth_method 0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:40:24.975+0000 7f8bdffff640 1 client.7286.objecter ms_handle_reset 0x55c5712324d0 session 0x7f8d04033bb0 osd.0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:40:24.975+0000 7f8d0e6c0640 10 monclient: get_auth_request con 0x7f8d040188a0 auth_method 0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.115 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:40:24.978+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zone default found 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Realm: () 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:40:24.979+0000 7f8d1293e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:40:24.979+0000 7f8d1293e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 zonegroup default 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.116 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:40:24.979+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started sync module instance, tier type = 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:40:24.980+0000 7f8d1293e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=0 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=1 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=2 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=3 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=4 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=5 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:40:24.988+0000 7f8d1293e800 20 add_watcher() i=6 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:40:24.989+0000 7f8d1293e800 20 add_watcher() i=7 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:40:24.989+0000 7f8d1293e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:25.117 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding auth protocol: cephx 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:40:24.990+0000 7f8bc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: crc 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:40:24.990+0000 7f8d1293e800 5 AuthRegistry(0x7fff595e30d0) adding con mode: secure 2024-09-14T11:40:25.118 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:40:24.991+0000 7f8d1293e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache list hook 0x55c571206860 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache inspect hook 0x55c571206860 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache erase hook 0x55c571206860 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command cache zap hook 0x55c571206860 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 note: GC not initialized 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:40:24.991+0000 7f8b3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace show hook 0x7f8d0804da00 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace history hook 0x7f8d0804da00 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace active hook 0x7f8d0804da00 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:40:24.991+0000 7f8d1293e800 5 asok(0x55c570f1f270) register_command sync trace active_short hook 0x7f8d0804da00 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 Filter name: none 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:40:24.991+0000 7f8b3d7fa640 20 reqs_thread_entry: start 2024-09-14T11:40:25.119 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:40:24.991+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:40:24.991+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : miss 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:40:24.992+0000 7f8d1293e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:40:24.992+0000 7f8d1293e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.120 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:40:24.998+0000 7f8d1293e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94306495078992 notifier 7286 bl.length()=923 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:40:24.999+0000 7f8bf17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:40:25.000+0000 7f8d1293e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:40:25.003+0000 7f8d1293e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8d1293e800 time 2024-09-14T11:40:25.003927+0000 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8d1418c76a] 2024-09-14T11:40:25.121 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:40:25.004+0000 7f8d1293e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f8d1293e800 thread_name:radosgw-admin 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8d12e3e6f0] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8d12e8b99c] 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:40:25.122 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8d1418c7c4] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8d1418c928] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c56f8b80b1] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55c56fdcc07c] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c56f8c7efd] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8d12e29590] 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:40:25.123 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:25.124 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:40:25.125 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:40:25.126 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:40:25.127 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:25.128 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8b3d7fa640 / http_manager 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8b3f7fe640 / http_manager 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bc4fe1640 / rgw_dt_lg_renew 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bdffff640 / ms_dispatch 2024-09-14T11:40:25.129 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf17fa640 / io_context_pool 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf1ffb640 / io_context_pool 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bf3fff640 / ms_dispatch 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bfae05640 / ms_dispatch 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8bfc608640 / io_context_pool 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0debf640 / msgr-worker-2 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0e6c0640 / msgr-worker-1 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0eec1640 / msgr-worker-0 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d0f6c2640 / io_context_pool 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8d1293e800 / radosgw-admin 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:25.005631Z_9f54bae6-75e9-42e1-bff3-6327f0ecb8ec/log 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:40:25.130 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.081+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.082+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 realm 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.083+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.084+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.084+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.084+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.084+0000 7f2e0dd28800 20 searching for the correct realm 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.087+0000 7f2e0a24c640 0 -- 172.21.15.116:0/329458197 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f2df403f040 msgr2=0x7f2df403e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.091+0000 7f2e09a4b640 0 -- 172.21.15.116:0/329458197 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f2df401b040 msgr2=0x7f2df4052410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.136 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.095+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 zone default found 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 4 Realm: () 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 zonegroup default 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 started sync module instance, tier type = 2024-09-14T11:40:25.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.096+0000 7f2e0dd28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=0 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=1 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=2 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=3 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=4 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=5 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.105+0000 7f2e0dd28800 20 add_watcher() i=6 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.106+0000 7f2e0dd28800 20 add_watcher() i=7 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.106+0000 7f2e0dd28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.107+0000 7f2cbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 5 note: GC not initialized 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2cba7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 20 Filter name: none 2024-09-14T11:40:25.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2c2bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.108+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.109+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.109+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.109+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.109+0000 7f2e0dd28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.109+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.110+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.110+0000 7f2e0dd28800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.110+0000 7f2e0dd28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.110+0000 7f2e0dd28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.112+0000 7f2cbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.114+0000 7f2e0dd28800 20 remove_watcher() i=0 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.114+0000 7f2e0dd28800 2 removed watcher, disabling cache 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.115+0000 7f2e0dd28800 20 remove_watcher() i=1 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.116+0000 7f2e0dd28800 20 remove_watcher() i=2 2024-09-14T11:40:25.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.117+0000 7f2e0dd28800 20 remove_watcher() i=3 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.118+0000 7f2e0dd28800 20 remove_watcher() i=4 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.118+0000 7f2e0dd28800 20 remove_watcher() i=5 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.119+0000 7f2e0dd28800 20 remove_watcher() i=6 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.120+0000 7f2e0dd28800 20 remove_watcher() i=7 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:25.140 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:25.218 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:25.248 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:25.248 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:25.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.287+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.288+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.288+0000 7f5a9dd75800 20 realm 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.288+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.289+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.289+0000 7f5a9dd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.289+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.289+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.289+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.290+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.290+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.290+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:25.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.290+0000 7f5a9dd75800 20 searching for the correct realm 2024-09-14T11:40:25.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.293+0000 7f5a9c060640 0 -- 172.21.15.116:0/3993200445 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55bb2f1c9e10 msgr2=0x55bb2f1cc200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.296+0000 7f5a9b05e640 0 -- 172.21.15.116:0/3993200445 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5a8c032040 msgr2=0x7f5a8c0690f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:25.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 zone default found 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 4 Realm: () 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 zonegroup default 2024-09-14T11:40:25.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.300+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 started sync module instance, tier type = 2024-09-14T11:40:25.301 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.301+0000 7f5a9dd75800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=0 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=1 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=2 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=3 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=4 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=5 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=6 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 20 add_watcher() i=7 2024-09-14T11:40:25.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.310+0000 7f5a9dd75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:25.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.312+0000 7f5951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.312+0000 7f5a9dd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.312+0000 7f5a9dd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.312+0000 7f5a9dd75800 5 note: GC not initialized 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5950fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 20 Filter name: none 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f58ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:40:25.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:25.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:25.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : miss 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.313+0000 7f5a9dd75800 20 rados->read ofs=0 len=0 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.314+0000 7f5a9dd75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:25.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.315+0000 7f5a9dd75800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to be held by another RGW process; skipping for now 2024-09-14T11:40:25.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.316+0000 7f5951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.317+0000 7f5a9dd75800 20 remove_watcher() i=0 2024-09-14T11:40:25.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.317+0000 7f5a9dd75800 2 removed watcher, disabling cache 2024-09-14T11:40:25.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.318+0000 7f5a9dd75800 20 remove_watcher() i=1 2024-09-14T11:40:25.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.319+0000 7f5a9dd75800 20 remove_watcher() i=2 2024-09-14T11:40:25.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.320+0000 7f5a9dd75800 20 remove_watcher() i=3 2024-09-14T11:40:25.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.322+0000 7f5a9dd75800 20 remove_watcher() i=4 2024-09-14T11:40:25.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.322+0000 7f5a9dd75800 20 remove_watcher() i=5 2024-09-14T11:40:25.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.323+0000 7f5a9dd75800 20 remove_watcher() i=6 2024-09-14T11:40:25.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:25.324+0000 7f5a9dd75800 20 remove_watcher() i=7 2024-09-14T11:40:25.333 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:40:55.347 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:55.385 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:55.385 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:55.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.428+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.429+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.429+0000 7f454c739800 20 realm 2024-09-14T11:40:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:55.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.430+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.431+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:55.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.431+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.431+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:55.430 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.431+0000 7f454c739800 20 searching for the correct realm 2024-09-14T11:40:55.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.434+0000 7f4547bcd640 0 -- 172.21.15.116:0/3829565595 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f4538045040 msgr2=0x7f453800d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:55.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.439+0000 7f45483ce640 0 -- 172.21.15.116:0/3829565595 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f453c0629a0 msgr2=0x7f453c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:55.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:55.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:55.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:55.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:55.644 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:55.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:55.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.645 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:55.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.646+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.646 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 zone default found 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 4 Realm: () 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 zonegroup default 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.647+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.648+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.648+0000 7f454c739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.648+0000 7f454c739800 20 started sync module instance, tier type = 2024-09-14T11:40:55.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.648+0000 7f454c739800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:55.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=0 2024-09-14T11:40:55.656 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=1 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=2 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=3 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=4 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=5 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.658+0000 7f454c739800 20 add_watcher() i=6 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.659+0000 7f454c739800 20 add_watcher() i=7 2024-09-14T11:40:55.657 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.659+0000 7f454c739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:55.659 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.661+0000 7f43fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.661+0000 7f454c739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.661+0000 7f454c739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.661+0000 7f454c739800 5 note: GC not initialized 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.661+0000 7f43fdfdb640 20 reqs_thread_entry: start 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 20 Filter name: none 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f436f7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:40:55.660 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:55.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:40:55.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:40:55.661 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : miss 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.662+0000 7f454c739800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.663+0000 7f454c739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:55.662 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.664+0000 7f454c739800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:55.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.671+0000 7f454c739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.671+0000 7f454c739800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.671+0000 7f454c739800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.670 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.671+0000 7f454c739800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.672+0000 7f441effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496973 cookie 93964234623408 notifier 7337 bl.length()=923 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.672+0000 7f441effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.672+0000 7f441effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.672+0000 7f441effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.673+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:55.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.673+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:55.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.673+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:55.672 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.673+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:55.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.0 2024-09-14T11:40:55.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.0 2024-09-14T11:40:55.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.1 2024-09-14T11:40:55.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.1 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.2 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.2 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.3 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.3 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.4 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.4 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.5 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.5 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.6 2024-09-14T11:40:55.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.6 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.7 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.7 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.8 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.8 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.9 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.9 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.10 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.10 2024-09-14T11:40:55.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.11 2024-09-14T11:40:55.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2.11 2024-09-14T11:40:55.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.0 2024-09-14T11:40:55.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.679+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.1 2024-09-14T11:40:55.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.680+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2 2024-09-14T11:40:55.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.680+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.3 2024-09-14T11:40:55.681 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.680+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.4 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.681+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.5 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.681+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.6 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.682+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.7 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.682+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.8 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.683+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.9 2024-09-14T11:40:55.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.683+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.10 2024-09-14T11:40:55.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.687+0000 7f454c739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:55.685 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.687+0000 7f454c739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.688+0000 7f454c739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.688+0000 7f454c739800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.688+0000 7f454c739800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.688+0000 7f454c739800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.689+0000 7f441effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 93964234623408 notifier 7337 bl.length()=923 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.689+0000 7f441effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.689+0000 7f441effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.687 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.689+0000 7f441effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.688 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.690+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:55.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.690+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:55.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.690+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:55.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.690+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:55.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.693+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.0 2024-09-14T11:40:55.691 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.693+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.1 2024-09-14T11:40:55.692 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.694+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.2 2024-09-14T11:40:55.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.694+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.3 2024-09-14T11:40:55.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.694+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.4 2024-09-14T11:40:55.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.694+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.5 2024-09-14T11:40:55.693 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.695+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.6 2024-09-14T11:40:55.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.695+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.7 2024-09-14T11:40:55.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.695+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.8 2024-09-14T11:40:55.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.696+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.9 2024-09-14T11:40:55.694 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.696+0000 7f454c739800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36.10 2024-09-14T11:40:55.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.697+0000 7f454c739800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:55.695 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.697+0000 7f454c739800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 2024-09-14T11:40:55.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.698+0000 7f454c739800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.698+0000 7f454c739800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.698+0000 7f454c739800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.696 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.698+0000 7f454c739800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36, ofs0, ns] 2024-09-14T11:40:55.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.699+0000 7f441effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 93964234623408 notifier 7337 bl.length()=891 2024-09-14T11:40:55.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.699+0000 7f441effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 info.flags=0x17 2024-09-14T11:40:55.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.699+0000 7f441effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 to cache LRU end 2024-09-14T11:40:55.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.699+0000 7f441effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:55.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.700+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_sources= new_sources= 2024-09-14T11:40:55.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.700+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential sources added=[] removed=[] 2024-09-14T11:40:55.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.700+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): orig_dests= new_dests= 2024-09-14T11:40:55.698 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.700+0000 7f454c739800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36]): potential dests added=[] removed=[] 2024-09-14T11:40:55.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.702+0000 7f454c739800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:55.702 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.704+0000 7f43fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:55.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.706+0000 7f454c739800 20 remove_watcher() i=0 2024-09-14T11:40:55.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.706+0000 7f454c739800 2 removed watcher, disabling cache 2024-09-14T11:40:55.705 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.707+0000 7f454c739800 20 remove_watcher() i=1 2024-09-14T11:40:55.707 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.708+0000 7f454c739800 20 remove_watcher() i=2 2024-09-14T11:40:55.708 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.710+0000 7f454c739800 20 remove_watcher() i=3 2024-09-14T11:40:55.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.711+0000 7f454c739800 20 remove_watcher() i=4 2024-09-14T11:40:55.709 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.711+0000 7f454c739800 20 remove_watcher() i=5 2024-09-14T11:40:55.710 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.712+0000 7f454c739800 20 remove_watcher() i=6 2024-09-14T11:40:55.711 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.713+0000 7f454c739800 20 remove_watcher() i=7 2024-09-14T11:40:55.723 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:40:55.752 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:55.752 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:55.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.792+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 realm 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:55.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.793+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.794+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:55.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.794+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:55.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.794+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:55.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.794+0000 7f5c1533e800 20 searching for the correct realm 2024-09-14T11:40:55.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.797+0000 7f5c11887640 0 -- 172.21.15.116:0/1809944756 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f5bfc034040 msgr2=0x7f5bfc03d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:55.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:55.801+0000 7f5c11086640 0 -- 172.21.15.116:0/1809944756 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5bfc0473f0 msgr2=0x7f5bfc047850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:56.006 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.008+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:56.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 zone default found 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 4 Realm: () 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 zonegroup default 2024-09-14T11:40:56.009 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.009+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.010+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.010+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.010+0000 7f5c1533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.010+0000 7f5c1533e800 20 started sync module instance, tier type = 2024-09-14T11:40:56.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.010+0000 7f5c1533e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=0 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=1 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=2 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=3 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=4 2024-09-14T11:40:56.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=5 2024-09-14T11:40:56.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=6 2024-09-14T11:40:56.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 20 add_watcher() i=7 2024-09-14T11:40:56.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.020+0000 7f5c1533e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:56.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.022+0000 7f5ac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:56.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:56.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:56.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 5 note: GC not initialized 2024-09-14T11:40:56.022 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5ac67e4640 20 reqs_thread_entry: start 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 20 Filter name: none 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5a37fff640 20 reqs_thread_entry: start 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.023+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.024+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:56.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.024+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.024+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:56.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.024+0000 7f5c1533e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:56.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.024+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.025+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:40:56.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.025+0000 7f5c1533e800 20 rados->read ofs=0 len=0 2024-09-14T11:40:56.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.025+0000 7f5c1533e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:40:56.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.025+0000 7f5c1533e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:56.026 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.027+0000 7f5ac77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:56.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.029+0000 7f5c1533e800 20 remove_watcher() i=0 2024-09-14T11:40:56.027 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.029+0000 7f5c1533e800 2 removed watcher, disabling cache 2024-09-14T11:40:56.028 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.030+0000 7f5c1533e800 20 remove_watcher() i=1 2024-09-14T11:40:56.029 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.031+0000 7f5c1533e800 20 remove_watcher() i=2 2024-09-14T11:40:56.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.032+0000 7f5c1533e800 20 remove_watcher() i=3 2024-09-14T11:40:56.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.033+0000 7f5c1533e800 20 remove_watcher() i=4 2024-09-14T11:40:56.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.034+0000 7f5c1533e800 20 remove_watcher() i=5 2024-09-14T11:40:56.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.035+0000 7f5c1533e800 20 remove_watcher() i=6 2024-09-14T11:40:56.034 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:56.036+0000 7f5c1533e800 20 remove_watcher() i=7 2024-09-14T11:40:56.045 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:56.045 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:56.045 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-logrecord-writes id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:56.045 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:56.405 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:40:56.405 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:57.218 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:40:57.246 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:57.246 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:57.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.284+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 realm 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.286+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.287+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.287+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.288+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:57.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.288+0000 7fb214e2f800 20 searching for the correct realm 2024-09-14T11:40:57.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.291+0000 7fb20a118640 0 -- 172.21.15.116:0/3707928413 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55f9420a40a0 msgr2=0x55f9420a6490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:57.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.295+0000 7fb212919640 0 -- 172.21.15.116:0/3707928413 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fb1fc0551c0 msgr2=0x7fb1fc0519f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.500 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.500+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 zone default found 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 4 Realm: () 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 zonegroup default 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.501 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 started sync module instance, tier type = 2024-09-14T11:40:57.502 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.501+0000 7fb214e2f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:57.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=0 2024-09-14T11:40:57.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=1 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=2 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=3 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=4 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=5 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.510+0000 7fb214e2f800 20 add_watcher() i=6 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.511+0000 7fb214e2f800 20 add_watcher() i=7 2024-09-14T11:40:57.509 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.511+0000 7fb214e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:57.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb0c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb214e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb214e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb214e2f800 5 note: GC not initialized 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb043fff640 20 reqs_thread_entry: start 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb214e2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.513+0000 7fb214e2f800 20 Filter name: none 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.514+0000 7fb041ffb640 20 reqs_thread_entry: start 2024-09-14T11:40:57.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.514+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.513 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.514+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.514+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.515+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.515+0000 7fb214e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.515+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.515+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.515+0000 7fb214e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.516+0000 7fb214e2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:57.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.516+0000 7fb214e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:57.515 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.517+0000 7fb0c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.520+0000 7fb214e2f800 20 remove_watcher() i=0 2024-09-14T11:40:57.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.520+0000 7fb214e2f800 2 removed watcher, disabling cache 2024-09-14T11:40:57.519 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.521+0000 7fb214e2f800 20 remove_watcher() i=1 2024-09-14T11:40:57.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.523+0000 7fb214e2f800 20 remove_watcher() i=2 2024-09-14T11:40:57.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.524+0000 7fb214e2f800 20 remove_watcher() i=3 2024-09-14T11:40:57.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.525+0000 7fb214e2f800 20 remove_watcher() i=4 2024-09-14T11:40:57.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.526+0000 7fb214e2f800 20 remove_watcher() i=5 2024-09-14T11:40:57.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.526+0000 7fb214e2f800 20 remove_watcher() i=6 2024-09-14T11:40:57.525 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.527+0000 7fb214e2f800 20 remove_watcher() i=7 2024-09-14T11:40:57.536 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:57.536 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:57.536 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:57.536 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:57.537 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:40:57.571 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:57.571 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:57.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.609+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 realm 2024-09-14T11:40:57.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:57.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.611+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.612+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.612+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.612+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:57.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.612+0000 7f8b09f3d800 20 searching for the correct realm 2024-09-14T11:40:57.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.616+0000 7f8b05429640 0 -- 172.21.15.116:0/1714051526 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55fdad6d7180 msgr2=0x55fdad6d9620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:57.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.619+0000 7f8b05c2a640 0 -- 172.21.15.116:0/1714051526 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8afc038920 msgr2=0x7f8afc00e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:57.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:57.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:57.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 zone default found 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 4 Realm: () 2024-09-14T11:40:57.623 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 zonegroup default 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.623+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 started sync module instance, tier type = 2024-09-14T11:40:57.624 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.624+0000 7f8b09f3d800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=0 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=1 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=2 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=3 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=4 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=5 2024-09-14T11:40:57.631 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=6 2024-09-14T11:40:57.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 20 add_watcher() i=7 2024-09-14T11:40:57.632 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.633+0000 7f8b09f3d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.635+0000 7f89b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.635+0000 7f8b09f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.635+0000 7f8b09f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.635+0000 7f8b09f3d800 5 note: GC not initialized 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.635+0000 7f89b67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 20 Filter name: none 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8927fff640 20 reqs_thread_entry: start 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:40:57.634 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.635 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 : miss 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.636+0000 7f8b09f3d800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:57.636 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:57.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:57.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:57.637 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.637+0000 7f8b09f3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 2024-09-14T11:40:57.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f8b09f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:57.640 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f8b09f3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f8b09f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f8b09f3d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37, ofs0, ns] 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f89e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94548024725552 notifier 7388 bl.length()=931 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f89e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f89e97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:57.641 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.642+0000 7f89e97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.644+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_sources= new_sources= 2024-09-14T11:40:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.644+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential sources added=[] removed=[] 2024-09-14T11:40:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.644+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_dests= new_dests= 2024-09-14T11:40:57.642 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.644+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential dests added=[] removed=[] 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.0 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.0 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.1 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.1 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.2 2024-09-14T11:40:57.647 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.2 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.3 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.3 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.4 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.4 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.5 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.5 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.6 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.6 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.7 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.7 2024-09-14T11:40:57.648 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.8 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.8 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.9 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.9 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.10 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.10 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.11 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.11 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.648+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.0 2024-09-14T11:40:57.649 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.649+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1 2024-09-14T11:40:57.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.649+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.2 2024-09-14T11:40:57.650 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.650+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.3 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.650+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.4 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.651+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.5 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.651+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.6 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.652+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.7 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.652+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.8 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.652+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.9 2024-09-14T11:40:57.651 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.653+0000 7f8b09f3d800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.10 2024-09-14T11:40:57.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.656+0000 7f8b09f3d800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:40:57.654 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.656+0000 7f8b09f3d800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:40:57.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.668+0000 7f8b09f3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:57.666 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.668+0000 7f8b09f3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 2024-09-14T11:40:57.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f8b09f3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:57.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f8b09f3d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:57.667 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f8b09f3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:57.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f8b09f3d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37, ofs0, ns] 2024-09-14T11:40:57.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f89e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94548024725552 notifier 7388 bl.length()=899 2024-09-14T11:40:57.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f89e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:57.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f89e97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:57.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.669+0000 7f89e97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:57.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.671+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_sources= new_sources= 2024-09-14T11:40:57.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.671+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential sources added=[] removed=[] 2024-09-14T11:40:57.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.671+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_dests= new_dests= 2024-09-14T11:40:57.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.671+0000 7f8b09f3d800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential dests added=[] removed=[] 2024-09-14T11:40:57.669 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.671+0000 7f8b09f3d800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:40:57.671 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.673+0000 7f89b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.675+0000 7f8b09f3d800 20 remove_watcher() i=0 2024-09-14T11:40:57.673 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.675+0000 7f8b09f3d800 2 removed watcher, disabling cache 2024-09-14T11:40:57.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.676+0000 7f8b09f3d800 20 remove_watcher() i=1 2024-09-14T11:40:57.674 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.677+0000 7f8b09f3d800 20 remove_watcher() i=2 2024-09-14T11:40:57.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.678+0000 7f8b09f3d800 20 remove_watcher() i=3 2024-09-14T11:40:57.676 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.679+0000 7f8b09f3d800 20 remove_watcher() i=4 2024-09-14T11:40:57.677 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.680+0000 7f8b09f3d800 20 remove_watcher() i=5 2024-09-14T11:40:57.678 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.680+0000 7f8b09f3d800 20 remove_watcher() i=6 2024-09-14T11:40:57.679 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.681+0000 7f8b09f3d800 20 remove_watcher() i=7 2024-09-14T11:40:57.691 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:40:57.720 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:57.720 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:57.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.759+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 20 realm 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.760+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.761+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.761+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.761+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.761+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.762+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:57.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.762+0000 7f6025820800 20 searching for the correct realm 2024-09-14T11:40:57.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.764+0000 7f6022b09640 0 -- 172.21.15.116:0/3230059981 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f60140ad4c0 msgr2=0x7f60140abf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:57.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.768+0000 7f602330a640 0 -- 172.21.15.116:0/3230059981 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f601809ac60 msgr2=0x7f601809a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:57.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:57.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:57.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:57.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:57.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.973+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:57.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 zone default found 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 4 Realm: () 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 zonegroup default 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.974+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:57.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 started sync module instance, tier type = 2024-09-14T11:40:57.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.975+0000 7f6025820800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:57.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=0 2024-09-14T11:40:57.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=1 2024-09-14T11:40:57.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=2 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=3 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=4 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=5 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.984+0000 7f6025820800 20 add_watcher() i=6 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.985+0000 7f6025820800 20 add_watcher() i=7 2024-09-14T11:40:57.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.985+0000 7f6025820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f5ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f6025820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f6025820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f6025820800 5 note: GC not initialized 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f5ed8fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f6025820800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f6025820800 20 Filter name: none 2024-09-14T11:40:57.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.987+0000 7f5e527fc640 20 reqs_thread_entry: start 2024-09-14T11:40:57.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.988+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.988+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:57.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.988+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.989+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:57.988 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.989+0000 7f6025820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:57.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.989+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.989+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:57.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.989+0000 7f6025820800 20 rados->read ofs=0 len=0 2024-09-14T11:40:57.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.990+0000 7f6025820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:57.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.990+0000 7f6025820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:57.990 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.991+0000 7f5ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:57.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.993+0000 7f6025820800 20 remove_watcher() i=0 2024-09-14T11:40:57.991 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.993+0000 7f6025820800 2 removed watcher, disabling cache 2024-09-14T11:40:57.992 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.994+0000 7f6025820800 20 remove_watcher() i=1 2024-09-14T11:40:57.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.995+0000 7f6025820800 20 remove_watcher() i=2 2024-09-14T11:40:57.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.996+0000 7f6025820800 20 remove_watcher() i=3 2024-09-14T11:40:57.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.997+0000 7f6025820800 20 remove_watcher() i=4 2024-09-14T11:40:57.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.998+0000 7f6025820800 20 remove_watcher() i=5 2024-09-14T11:40:57.997 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:57.999+0000 7f6025820800 20 remove_watcher() i=6 2024-09-14T11:40:57.998 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.000+0000 7f6025820800 20 remove_watcher() i=7 2024-09-14T11:40:58.008 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:58.008 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:58.008 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:40:58.008 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:58.098 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:40:58.129 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:58.129 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:58.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.169+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.170+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.170+0000 7f6fc4f25800 20 realm 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.170+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.171+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.171+0000 7f6fc4f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.171+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.171+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.171+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.172+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:58.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.172+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.172+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:58.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.172+0000 7f6fc4f25800 20 searching for the correct realm 2024-09-14T11:40:58.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.173+0000 7f6fc1334640 0 -- 172.21.15.116:0/1286341672 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f6fa80093c0 msgr2=0x7f6fa807d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:58.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.176+0000 7f6fc1334640 0 -- 172.21.15.116:0/1286341672 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f6fa80a1e90 msgr2=0x7f6fa80b3560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.384+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 zone default found 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 4 Realm: () 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 zonegroup default 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.385+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.385 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.386 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 started sync module instance, tier type = 2024-09-14T11:40:58.387 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.386+0000 7f6fc4f25800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:58.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=0 2024-09-14T11:40:58.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=1 2024-09-14T11:40:58.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=2 2024-09-14T11:40:58.393 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=3 2024-09-14T11:40:58.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=4 2024-09-14T11:40:58.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=5 2024-09-14T11:40:58.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.395+0000 7f6fc4f25800 20 add_watcher() i=6 2024-09-14T11:40:58.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.396+0000 7f6fc4f25800 20 add_watcher() i=7 2024-09-14T11:40:58.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.396+0000 7f6fc4f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:58.395 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.397+0000 7f6e72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:58.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.397+0000 7f6fc4f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.397+0000 7f6fc4f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 5 note: GC not initialized 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6e71fe3640 20 reqs_thread_entry: start 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 20 Filter name: none 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6de37fe640 20 reqs_thread_entry: start 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:40:58.397 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:58.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:40:58.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:40:58.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 : miss 2024-09-14T11:40:58.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.398+0000 7f6fc4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.399 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.399+0000 7f6fc4f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 2024-09-14T11:40:58.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6fc4f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.402 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6fc4f25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6fc4f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6fc4f25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37, ofs0, ns] 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6e8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 93846661471680 notifier 7421 bl.length()=931 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6e8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6e8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.404+0000 7f6e8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.406+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_sources= new_sources= 2024-09-14T11:40:58.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.406+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential sources added=[] removed=[] 2024-09-14T11:40:58.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.406+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_dests= new_dests= 2024-09-14T11:40:58.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.406+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential dests added=[] removed=[] 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.0 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.0 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.1 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.1 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.2 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.2 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.3 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.3 2024-09-14T11:40:58.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.4 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.4 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.5 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.5 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.6 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.6 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.7 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.7 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.8 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.8 2024-09-14T11:40:58.410 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.9 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.9 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.10 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.10 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.11 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1.11 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.410+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.0 2024-09-14T11:40:58.411 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.411+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1 2024-09-14T11:40:58.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.411+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.2 2024-09-14T11:40:58.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.412+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.3 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.412+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.4 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.413+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.5 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.413+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.6 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.413+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.7 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.414+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.8 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.414+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.9 2024-09-14T11:40:58.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.415+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.10 2024-09-14T11:40:58.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.419+0000 7f6fc4f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:58.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.419+0000 7f6fc4f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 2024-09-14T11:40:58.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6fc4f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6fc4f25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6fc4f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6fc4f25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37, ofs0, ns] 2024-09-14T11:40:58.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6e8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 93846661471680 notifier 7421 bl.length()=931 2024-09-14T11:40:58.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6e8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6e8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.420+0000 7f6e8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.422+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_sources= new_sources= 2024-09-14T11:40:58.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.422+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential sources added=[] removed=[] 2024-09-14T11:40:58.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.422+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_dests= new_dests= 2024-09-14T11:40:58.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.422+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential dests added=[] removed=[] 2024-09-14T11:40:58.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.424+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.0 2024-09-14T11:40:58.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.425+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.1 2024-09-14T11:40:58.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.425+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.2 2024-09-14T11:40:58.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.425+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.3 2024-09-14T11:40:58.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.425+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.4 2024-09-14T11:40:58.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.426+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.5 2024-09-14T11:40:58.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.426+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.6 2024-09-14T11:40:58.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.426+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.7 2024-09-14T11:40:58.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.427+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.8 2024-09-14T11:40:58.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.427+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.9 2024-09-14T11:40:58.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.427+0000 7f6fc4f25800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37.10 2024-09-14T11:40:58.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.428+0000 7f6fc4f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:40:58.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.428+0000 7f6fc4f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 2024-09-14T11:40:58.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6fc4f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6fc4f25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6fc4f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6fc4f25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37, ofs0, ns] 2024-09-14T11:40:58.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6e8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 93846661471680 notifier 7421 bl.length()=899 2024-09-14T11:40:58.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6e8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 info.flags=0x17 2024-09-14T11:40:58.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6e8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 to cache LRU end 2024-09-14T11:40:58.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.429+0000 7f6e8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:40:58.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.431+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_sources= new_sources= 2024-09-14T11:40:58.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.431+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential sources added=[] removed=[] 2024-09-14T11:40:58.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.431+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): orig_dests= new_dests= 2024-09-14T11:40:58.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.431+0000 7f6fc4f25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37]): potential dests added=[] removed=[] 2024-09-14T11:40:58.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.434+0000 7f6fc4f25800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:40:58.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.436+0000 7f6e72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:58.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.437+0000 7f6fc4f25800 20 remove_watcher() i=0 2024-09-14T11:40:58.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.437+0000 7f6fc4f25800 2 removed watcher, disabling cache 2024-09-14T11:40:58.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.438+0000 7f6fc4f25800 20 remove_watcher() i=1 2024-09-14T11:40:58.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.439+0000 7f6fc4f25800 20 remove_watcher() i=2 2024-09-14T11:40:58.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.440+0000 7f6fc4f25800 20 remove_watcher() i=3 2024-09-14T11:40:58.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.441+0000 7f6fc4f25800 20 remove_watcher() i=4 2024-09-14T11:40:58.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.442+0000 7f6fc4f25800 20 remove_watcher() i=5 2024-09-14T11:40:58.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.443+0000 7f6fc4f25800 20 remove_watcher() i=6 2024-09-14T11:40:58.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.444+0000 7f6fc4f25800 20 remove_watcher() i=7 2024-09-14T11:40:58.454 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:40:58.482 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:58.482 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:58.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.520+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 realm 2024-09-14T11:40:58.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:58.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.521 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.522+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.523+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:58.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.523+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.522 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.523+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:58.523 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.523+0000 7f8b08b2a800 20 searching for the correct realm 2024-09-14T11:40:58.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.526+0000 7f8afc016640 0 -- 172.21.15.116:0/3082659424 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f8af403e050 msgr2=0x7f8af4055420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:58.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.732+0000 7f8b04817640 0 -- 172.21.15.116:0/3082659424 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f8aec0b9900 msgr2=0x7f8aec0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:58.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.937+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:58.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 zone default found 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 4 Realm: () 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 zonegroup default 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.938+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 started sync module instance, tier type = 2024-09-14T11:40:58.940 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.939+0000 7f8b08b2a800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:40:58.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=0 2024-09-14T11:40:58.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=1 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=2 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=3 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=4 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=5 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.948+0000 7f8b08b2a800 20 add_watcher() i=6 2024-09-14T11:40:58.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.949+0000 7f8b08b2a800 20 add_watcher() i=7 2024-09-14T11:40:58.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.949+0000 7f8b08b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.951+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.951+0000 7f8b08b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.951+0000 7f8b08b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.951+0000 7f8b08b2a800 5 note: GC not initialized 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.951+0000 7f89b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.952+0000 7f8b08b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:40:58.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.952+0000 7f8b08b2a800 20 Filter name: none 2024-09-14T11:40:58.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.952+0000 7f892b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:58.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.952+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.953+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.953+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.953+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:58.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.953+0000 7f8b08b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.953+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.954+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:40:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.954+0000 7f8b08b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:40:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.954+0000 7f8b08b2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:40:58.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.954+0000 7f8b08b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:58.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.956+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:58.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.957+0000 7f8b08b2a800 20 remove_watcher() i=0 2024-09-14T11:40:58.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.957+0000 7f8b08b2a800 2 removed watcher, disabling cache 2024-09-14T11:40:58.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.958+0000 7f8b08b2a800 20 remove_watcher() i=1 2024-09-14T11:40:58.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.959+0000 7f8b08b2a800 20 remove_watcher() i=2 2024-09-14T11:40:58.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.961+0000 7f8b08b2a800 20 remove_watcher() i=3 2024-09-14T11:40:58.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.962+0000 7f8b08b2a800 20 remove_watcher() i=4 2024-09-14T11:40:58.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.962+0000 7f8b08b2a800 20 remove_watcher() i=5 2024-09-14T11:40:58.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.963+0000 7f8b08b2a800 20 remove_watcher() i=6 2024-09-14T11:40:58.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:40:58.964+0000 7f8b08b2a800 20 remove_watcher() i=7 2024-09-14T11:40:58.972 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:58.973 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:40:58.973 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:40:58.973 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:40:59.331 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:40:59.331 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:00.122 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:41:00.149 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:00.149 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:00.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.187+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 20 realm 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.189+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.190+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.190+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.190+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:00.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.190+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.191+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:00.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.191+0000 7f70b5719800 20 searching for the correct realm 2024-09-14T11:41:00.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.193+0000 7f70b3203640 0 -- 172.21.15.116:0/994253159 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x562708970d80 msgr2=0x7f70ac024400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:00.396 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.397+0000 7f70b3a04640 0 -- 172.21.15.116:0/994253159 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f709c004a70 msgr2=0x7f709c0af710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 zone default found 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 4 Realm: () 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 zonegroup default 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.404+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 started sync module instance, tier type = 2024-09-14T11:41:00.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.405+0000 7f70b5719800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:00.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=0 2024-09-14T11:41:00.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=1 2024-09-14T11:41:00.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=2 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=3 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=4 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=5 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.414+0000 7f70b5719800 20 add_watcher() i=6 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.415+0000 7f70b5719800 20 add_watcher() i=7 2024-09-14T11:41:00.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.415+0000 7f70b5719800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f6f69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f70b5719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f70b5719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f70b5719800 5 note: GC not initialized 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f6f68fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.417+0000 7f70b5719800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.418+0000 7f70b5719800 20 Filter name: none 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.418+0000 7f6ee27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:00.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.418+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.418+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.418+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.419+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.419+0000 7f70b5719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.419+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.419+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.419+0000 7f70b5719800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.420+0000 7f70b5719800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:00.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.420+0000 7f70b5719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:00.420 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.421+0000 7f6f69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:00.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.423+0000 7f70b5719800 20 remove_watcher() i=0 2024-09-14T11:41:00.422 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.423+0000 7f70b5719800 2 removed watcher, disabling cache 2024-09-14T11:41:00.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.424+0000 7f70b5719800 20 remove_watcher() i=1 2024-09-14T11:41:00.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.425+0000 7f70b5719800 20 remove_watcher() i=2 2024-09-14T11:41:00.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.426+0000 7f70b5719800 20 remove_watcher() i=3 2024-09-14T11:41:00.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.427+0000 7f70b5719800 20 remove_watcher() i=4 2024-09-14T11:41:00.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.428+0000 7f70b5719800 20 remove_watcher() i=5 2024-09-14T11:41:00.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.429+0000 7f70b5719800 20 remove_watcher() i=6 2024-09-14T11:41:00.429 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.430+0000 7f70b5719800 20 remove_watcher() i=7 2024-09-14T11:41:00.440 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:00.440 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:00.440 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:00.440 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:00.441 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:41:00.477 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:00.477 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:00.514 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.515+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.516+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.516+0000 7fb48531f800 20 realm 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.516+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.517+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.517+0000 7fb48531f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.517+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.517+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.517+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.518+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:00.517 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.518+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.518+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:00.518 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.518+0000 7fb48531f800 20 searching for the correct realm 2024-09-14T11:41:00.520 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.521+0000 7fb481793640 0 -- 172.21.15.116:0/4181981061 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fb468020070 msgr2=0x7fb46806e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:00.524 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.525+0000 7fb480f92640 0 -- 172.21.15.116:0/4181981061 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fb468073b70 msgr2=0x7fb468068410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:00.731 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.731+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 zone default found 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 4 Realm: () 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 zonegroup default 2024-09-14T11:41:00.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.732+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.733+0000 7fb48531f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.733+0000 7fb48531f800 20 started sync module instance, tier type = 2024-09-14T11:41:00.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.733+0000 7fb48531f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=0 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=1 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=2 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=3 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=4 2024-09-14T11:41:00.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=5 2024-09-14T11:41:00.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.742+0000 7fb48531f800 20 add_watcher() i=6 2024-09-14T11:41:00.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.743+0000 7fb48531f800 20 add_watcher() i=7 2024-09-14T11:41:00.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.743+0000 7fb48531f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.744+0000 7fb336fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 5 note: GC not initialized 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb335fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 20 Filter name: none 2024-09-14T11:41:00.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb2a77fe640 20 reqs_thread_entry: start 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.745+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 : miss 2024-09-14T11:41:00.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:00.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:00.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.748 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.746+0000 7fb48531f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb48531f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb48531f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb48531f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb48531f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38, ofs0, ns] 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb357fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 94184001825072 notifier 8073 bl.length()=931 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb357fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb357fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.752+0000 7fb357fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.754+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_sources= new_sources= 2024-09-14T11:41:00.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.754+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential sources added=[] removed=[] 2024-09-14T11:41:00.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.754+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_dests= new_dests= 2024-09-14T11:41:00.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.754+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential dests added=[] removed=[] 2024-09-14T11:41:00.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.0 2024-09-14T11:41:00.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.0 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.1 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.1 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.2 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.2 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.3 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.3 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.4 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.4 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.5 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.5 2024-09-14T11:41:00.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.6 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.6 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.7 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.7 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.8 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.8 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.9 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.9 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.10 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.10 2024-09-14T11:41:00.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.11 2024-09-14T11:41:00.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1.11 2024-09-14T11:41:00.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.0 2024-09-14T11:41:00.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.760+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.761+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.2 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.761+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.3 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.762+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.4 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.762+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.5 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.763+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.6 2024-09-14T11:41:00.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.763+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.7 2024-09-14T11:41:00.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.764+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.8 2024-09-14T11:41:00.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.764+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.9 2024-09-14T11:41:00.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.765+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.10 2024-09-14T11:41:00.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.768+0000 7fb48531f800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:41:00.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.768+0000 7fb48531f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:00.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.768+0000 7fb48531f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.769+0000 7fb48531f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.769+0000 7fb48531f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.769+0000 7fb48531f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.769+0000 7fb48531f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38, ofs0, ns] 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.770+0000 7fb357fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 94184001825072 notifier 8073 bl.length()=931 2024-09-14T11:41:00.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.770+0000 7fb357fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.770+0000 7fb357fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.770+0000 7fb357fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.772+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_sources= new_sources= 2024-09-14T11:41:00.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.772+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential sources added=[] removed=[] 2024-09-14T11:41:00.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.772+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_dests= new_dests= 2024-09-14T11:41:00.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.772+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential dests added=[] removed=[] 2024-09-14T11:41:00.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.774+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.0 2024-09-14T11:41:00.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.775+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.1 2024-09-14T11:41:00.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.775+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.2 2024-09-14T11:41:00.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.775+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.3 2024-09-14T11:41:00.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.775+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.4 2024-09-14T11:41:00.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.776+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.5 2024-09-14T11:41:00.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.776+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.6 2024-09-14T11:41:00.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.776+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.7 2024-09-14T11:41:00.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.777+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.8 2024-09-14T11:41:00.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.777+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.9 2024-09-14T11:41:00.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.777+0000 7fb48531f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38.10 2024-09-14T11:41:00.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.778+0000 7fb48531f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:00.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.778+0000 7fb48531f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 2024-09-14T11:41:00.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb48531f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb48531f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb48531f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb48531f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38, ofs0, ns] 2024-09-14T11:41:00.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb357fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94184001825072 notifier 8073 bl.length()=899 2024-09-14T11:41:00.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb357fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 info.flags=0x17 2024-09-14T11:41:00.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb357fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 to cache LRU end 2024-09-14T11:41:00.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.779+0000 7fb357fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:00.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.781+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_sources= new_sources= 2024-09-14T11:41:00.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.781+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential sources added=[] removed=[] 2024-09-14T11:41:00.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.781+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): orig_dests= new_dests= 2024-09-14T11:41:00.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.781+0000 7fb48531f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38]): potential dests added=[] removed=[] 2024-09-14T11:41:00.783 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.784+0000 7fb48531f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:00.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.785+0000 7fb336fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:00.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.787+0000 7fb48531f800 20 remove_watcher() i=0 2024-09-14T11:41:00.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.787+0000 7fb48531f800 2 removed watcher, disabling cache 2024-09-14T11:41:00.788 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.789+0000 7fb48531f800 20 remove_watcher() i=1 2024-09-14T11:41:00.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.790+0000 7fb48531f800 20 remove_watcher() i=2 2024-09-14T11:41:00.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.791+0000 7fb48531f800 20 remove_watcher() i=3 2024-09-14T11:41:00.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.792+0000 7fb48531f800 20 remove_watcher() i=4 2024-09-14T11:41:00.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.793+0000 7fb48531f800 20 remove_watcher() i=5 2024-09-14T11:41:00.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.794+0000 7fb48531f800 20 remove_watcher() i=6 2024-09-14T11:41:00.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.795+0000 7fb48531f800 20 remove_watcher() i=7 2024-09-14T11:41:00.806 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:41:00.834 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:00.834 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:00.871 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.872+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.873 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 realm 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:00.874 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.874+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.875+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:00.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.875+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:00.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.876+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:00.875 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.876+0000 7f9e48f2a800 20 searching for the correct realm 2024-09-14T11:41:00.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.878+0000 7f9e4444e640 0 -- 172.21.15.116:0/395776450 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f9e34069580 msgr2=0x7f9e34087a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:00.881 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:00.882+0000 7f9e44c4f640 0 -- 172.21.15.116:0/395776450 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9e3806f8e0 msgr2=0x7f9e380883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:01.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:01.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.087+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 zone default found 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 4 Realm: () 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 zonegroup default 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.088+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.089+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:01.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.089+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.089+0000 7f9e48f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:01.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.089+0000 7f9e48f2a800 20 started sync module instance, tier type = 2024-09-14T11:41:01.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.089+0000 7f9e48f2a800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=0 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=1 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=2 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=3 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=4 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=5 2024-09-14T11:41:01.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=6 2024-09-14T11:41:01.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 20 add_watcher() i=7 2024-09-14T11:41:01.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.098+0000 7f9e48f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:01.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.100+0000 7f9cfafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:01.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.100+0000 7f9e48f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:01.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.100+0000 7f9e48f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:01.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.100+0000 7f9e48f2a800 5 note: GC not initialized 2024-09-14T11:41:01.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9cf9fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:01.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9e48f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:01.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9e48f2a800 20 Filter name: none 2024-09-14T11:41:01.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9c6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:01.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:01.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.101+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.102+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.102+0000 7f9e48f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.102+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.103+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.103+0000 7f9e48f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.103+0000 7f9e48f2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:01.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.103+0000 7f9e48f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:01.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.105+0000 7f9cfafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:01.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.107+0000 7f9e48f2a800 20 remove_watcher() i=0 2024-09-14T11:41:01.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.107+0000 7f9e48f2a800 2 removed watcher, disabling cache 2024-09-14T11:41:01.107 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.108+0000 7f9e48f2a800 20 remove_watcher() i=1 2024-09-14T11:41:01.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.109+0000 7f9e48f2a800 20 remove_watcher() i=2 2024-09-14T11:41:01.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.110+0000 7f9e48f2a800 20 remove_watcher() i=3 2024-09-14T11:41:01.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.111+0000 7f9e48f2a800 20 remove_watcher() i=4 2024-09-14T11:41:01.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.112+0000 7f9e48f2a800 20 remove_watcher() i=5 2024-09-14T11:41:01.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.113+0000 7f9e48f2a800 20 remove_watcher() i=6 2024-09-14T11:41:01.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:01.114+0000 7f9e48f2a800 20 remove_watcher() i=7 2024-09-14T11:41:01.123 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:01.123 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:01.124 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: error-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:41:01.124 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:01.493 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:41:01.493 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.291 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:41:02.320 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:02.320 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:02.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.357+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.358+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.358+0000 7fdcc7346800 20 realm 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.358+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.359+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.359+0000 7fdcc7346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.359+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.359+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.358 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.359+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.360+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:02.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.360+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.360+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:02.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.360+0000 7fdcc7346800 20 searching for the correct realm 2024-09-14T11:41:02.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.363+0000 7fdcc5638640 0 -- 172.21.15.116:0/1590267917 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fdcac01f060 msgr2=0x7fdcac07d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:02.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.366+0000 7fdcc4e37640 0 -- 172.21.15.116:0/1590267917 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fdcac06cae0 msgr2=0x7fdcac07b160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.572+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:02.572 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 zone default found 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 4 Realm: () 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 zonegroup default 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.573+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.574+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.574+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.574+0000 7fdcc7346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.574+0000 7fdcc7346800 20 started sync module instance, tier type = 2024-09-14T11:41:02.575 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.574+0000 7fdcc7346800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:02.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=0 2024-09-14T11:41:02.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=1 2024-09-14T11:41:02.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=2 2024-09-14T11:41:02.582 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=3 2024-09-14T11:41:02.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=4 2024-09-14T11:41:02.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=5 2024-09-14T11:41:02.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.583+0000 7fdcc7346800 20 add_watcher() i=6 2024-09-14T11:41:02.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.584+0000 7fdcc7346800 20 add_watcher() i=7 2024-09-14T11:41:02.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.584+0000 7fdcc7346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:02.585 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdb7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdcc7346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdcc7346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdcc7346800 5 note: GC not initialized 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdb79fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdcc7346800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdcc7346800 20 Filter name: none 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.586+0000 7fdaeb7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:02.586 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.587+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.587+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:02.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.587+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.588+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:02.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.588+0000 7fdcc7346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:02.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.588+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.588+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:02.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.588+0000 7fdcc7346800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.589+0000 7fdcc7346800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:02.588 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.589+0000 7fdcc7346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:02.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.591+0000 7fdb7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:02.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.593+0000 7fdcc7346800 20 remove_watcher() i=0 2024-09-14T11:41:02.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.593+0000 7fdcc7346800 2 removed watcher, disabling cache 2024-09-14T11:41:02.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.594+0000 7fdcc7346800 20 remove_watcher() i=1 2024-09-14T11:41:02.594 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.595+0000 7fdcc7346800 20 remove_watcher() i=2 2024-09-14T11:41:02.595 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.596+0000 7fdcc7346800 20 remove_watcher() i=3 2024-09-14T11:41:02.596 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.597+0000 7fdcc7346800 20 remove_watcher() i=4 2024-09-14T11:41:02.597 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.598+0000 7fdcc7346800 20 remove_watcher() i=5 2024-09-14T11:41:02.598 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.599+0000 7fdcc7346800 20 remove_watcher() i=6 2024-09-14T11:41:02.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.600+0000 7fdcc7346800 20 remove_watcher() i=7 2024-09-14T11:41:02.609 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.609 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:02.609 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:02.609 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.610 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:41:02.644 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:02.644 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:02.680 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.681+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 realm 2024-09-14T11:41:02.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.682 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:02.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.683 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:02.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:02.684 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.684+0000 7f5b54d28800 20 searching for the correct realm 2024-09-14T11:41:02.686 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.687+0000 7f5b5015c640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5b40074040 msgr2=0x7f5b400b9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:02.689 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.690+0000 7f5b5095d640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5b440093c0 msgr2=0x7f5b44017040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.897 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zone default found 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Realm: () 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:02.898 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zonegroup default 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.898+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started sync module instance, tier type = 2024-09-14T11:41:02.899 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=0 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=1 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=2 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=3 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=4 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=5 2024-09-14T11:41:02.906 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=6 2024-09-14T11:41:02.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.907+0000 7f5b54d28800 20 add_watcher() i=7 2024-09-14T11:41:02.907 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.907+0000 7f5b54d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:02.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:02.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:02.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:02.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5b54d28800 5 note: GC not initialized 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5a05fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5b54d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.909+0000 7f5b54d28800 20 Filter name: none 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f59777fe640 20 reqs_thread_entry: start 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:41:02.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:02.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : miss 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:02.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.910+0000 7f5b54d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.915+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.915+0000 7f5b54d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.915+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.915+0000 7f5b54d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:02.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 93911062730512 notifier 7526 bl.length()=931 2024-09-14T11:41:02.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:02.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:02.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:02.918 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:02.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:02.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:02.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:02.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:02.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:02.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:02.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.0 2024-09-14T11:41:02.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1 2024-09-14T11:41:02.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2 2024-09-14T11:41:02.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.3 2024-09-14T11:41:02.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.4 2024-09-14T11:41:02.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.5 2024-09-14T11:41:02.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.6 2024-09-14T11:41:02.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.7 2024-09-14T11:41:02.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.8 2024-09-14T11:41:02.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.9 2024-09-14T11:41:02.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.10 2024-09-14T11:41:02.929 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b54d28800 time 2024-09-14T11:41:02.931997+0000 2024-09-14T11:41:02.929 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5638c76a] 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:02.930 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.930+0000 7f5b54d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b54d28800 time 2024-09-14T11:41:02.931997+0000 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5638c76a] 2024-09-14T11:41:02.931 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:02.932 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.933 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:41:02.933 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f5b54d28800 thread_name:radosgw-admin 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5503e6f0] 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5508b99c] 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:02.954 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5638c7c4] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:02.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:02.931+0000 7f5b54d28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f5b54d28800 thread_name:radosgw-admin 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5503e6f0] 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5508b99c] 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5638c7c4] 2024-09-14T11:41:02.956 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:02.957 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:41:02.666+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:41:02.666+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.958 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:41:02.666+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key hook 0x55695f78e2e8 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f63b5d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f6474c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f6d1550 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.273388s 2024-09-14T11:41:02.959 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f6474c0 auth_method 0 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f6d1550 auth_method 0 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.960 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f63b5d0 auth_method 0 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.961 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:41:02.666+0000 7f5b5015c640 1 monclient: found mon.noname-c 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: dump: 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.962 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: _finish_auth 0 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:41:02.963 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:41:02.667+0000 7f5b54d28800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: dump: 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.964 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:41:02.667+0000 7f5a3ee0d640 4 set_mon_vals no callback set 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:02.965 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:41:02.667+0000 7f5b54d28800 1 librados: init done 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:41:02.669+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5a38077230 auth_method 0 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:41:02.669+0000 7f5b5115e640 10 monclient: get_auth_request con 0x55695f7d8000 auth_method 0 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:41:02.670+0000 7f5b5095d640 10 monclient: get_auth_request con 0x55695f7db1e0 auth_method 0 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:41:02.671+0000 7f5b5015c640 10 monclient: get_auth_request con 0x55695f7e0270 auth_method 0 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:41:02.671+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:02.966 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:41:02.671+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:41:02.671+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:02.967 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.968 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command objecter_requests cmddesc objecter_requests hook 0x55695f7e7610 EEXIST 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:02.969 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.970 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x55695f7e3100 EEXIST 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:02.971 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f80b930 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f80bd10 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f80a640 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.279894s 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f80bd10 auth_method 0 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.972 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f80a640 auth_method 0 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f80b930 auth_method 0 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.973 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_done global_id 8124 payload 824 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:41:02.673+0000 7f5b5015c640 1 monclient: found mon.noname-a 2024-09-14T11:41:02.974 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: dump: 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.975 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: _finish_auth 0 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: dump: 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.976 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:41:02.673+0000 7f5b54d28800 5 monclient: authenticate success, global_id 8124 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:41:02.673+0000 7f5b5195f640 4 set_mon_vals no callback set 2024-09-14T11:41:02.977 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:41:02.675+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5a28077140 auth_method 0 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: get_monmap_and_config 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:41:02.675+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:02.978 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:02.979 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.980 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.981 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x7fff03ea1cd8 EEXIST 2024-09-14T11:41:02.982 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f85fb50 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f82f960 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f85af10 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.283865s 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f82f960 auth_method 0 2024-09-14T11:41:02.983 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f85af10 auth_method 0 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.984 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f85fb50 auth_method 0 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_done global_id 8127 payload 274 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient: _finish_hunting 0 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:41:02.677+0000 7f5b5115e640 1 monclient: found mon.noname-a 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.985 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: dump: 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.986 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: _finish_auth 0 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: _check_auth_tickets 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:41:02.677+0000 7f5b54d28800 5 monclient: authenticate success, global_id 8127 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:41:02.677+0000 7f5b54d28800 10 monclient: get_monmap_and_config success 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:41:02.677+0000 7f5b54d28800 4 set_mon_vals no callback set 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: dump: 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.987 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:41:02.677+0000 7f5b54d28800 10 monclient: shutdown 2024-09-14T11:41:02.988 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:02.989 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.990 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: starting msgr at 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: starting objecter 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command objecter_requests cmddesc objecter_requests hook 0x55695f82db30 EEXIST 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: setting wanted keys 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: calling monclient init 2024-09-14T11:41:02.991 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.992 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x55695f820338 EEXIST 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f82f960 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f85af10 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:02.993 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f85fb50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.286037s 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f82f960 auth_method 0 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f85fb50 auth_method 0 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.994 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f85af10 auth_method 0 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:02.995 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient: _finish_hunting 0 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:41:02.679+0000 7f5b5095d640 1 monclient: found mon.noname-c 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:02.996 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: dump: 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.997 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: _finish_auth 0 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: dump: 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:02.998 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:41:02.679+0000 7f5a27fff640 4 set_mon_vals no callback set 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:41:02.680+0000 7f5b54d28800 5 monclient: authenticate success, global_id 7526 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:02.999 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:41:02.680+0000 7f5b54d28800 1 librados: init done 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:41:02.680+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cr dump hook 0x55695f84f7a8 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:41:02.681+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:41:02.682+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5a1c077230 auth_method 0 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:41:02.682+0000 7f5b5115e640 10 monclient: get_auth_request con 0x55695f87a8e0 auth_method 0 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.000 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 realm 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:41:02.683+0000 7f5b54d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:41:02.683+0000 7f5b5095d640 10 monclient: get_auth_request con 0x55695f87eb00 auth_method 0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:03.001 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 searching for the correct realm 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:41:02.684+0000 7f5b5015c640 10 monclient: get_auth_request con 0x55695f883d60 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:41:02.685+0000 7f5b5115e640 10 monclient: get_auth_request con 0x7f5b4401da90 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:41:02.686+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b48018760 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:41:02.686+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5b40074040 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:41:02.687+0000 7f5b5015c640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5b40074040 msgr2=0x7f5b400b9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:41:02.687+0000 7f5a267fc640 1 client.7526.objecter ms_handle_reset 0x7f5b40074040 session 0x7f5b400e8040 osd.4 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:41:02.687+0000 7f5a267fc640 10 monclient: _renew_subs 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:41:02.687+0000 7f5a267fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:41:02.687+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5a1c087050 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:41:02.688+0000 7f5b5115e640 10 monclient: get_auth_request con 0x7f5b4406c2b0 auth_method 0 2024-09-14T11:41:03.002 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:41:02.690+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b440093c0 auth_method 0 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:41:02.690+0000 7f5b5095d640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5b440093c0 msgr2=0x7f5b44017040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:41:02.891+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b440093c0 auth_method 0 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.003 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zone default found 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Realm: () 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:41:02.897+0000 7f5b54d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zonegroup default 2024-09-14T11:41:03.004 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started sync module instance, tier type = 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=0 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=1 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=2 2024-09-14T11:41:03.005 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=3 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=4 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=5 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=6 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:41:02.907+0000 7f5b54d28800 20 add_watcher() i=7 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:41:02.907+0000 7f5b54d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.006 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.007 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:41:02.909+0000 7f5a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:41:02.909+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache list hook 0x55695f8507c0 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache inspect hook 0x55695f8507c0 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache erase hook 0x55695f8507c0 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache zap hook 0x55695f8507c0 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 note: GC not initialized 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:41:02.909+0000 7f5a05fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:03.008 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace show hook 0x7f5b48010440 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace history hook 0x7f5b48010440 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace active hook 0x7f5b48010440 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace active_short hook 0x7f5b48010440 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 Filter name: none 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:41:02.910+0000 7f59777fe640 20 reqs_thread_entry: start 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:03.009 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : miss 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.010 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 93911062730512 notifier 7526 bl.length()=931 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:03.011 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:03.012 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:03.013 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.0 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.3 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.4 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.5 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.6 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.7 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.8 2024-09-14T11:41:03.014 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.9 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.10 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:41:02.930+0000 7f5b54d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b54d28800 time 2024-09-14T11:41:02.931997+0000 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5638c76a] 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:03.015 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:41:02.931+0000 7f5b54d28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f5b54d28800 thread_name:radosgw-admin 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5503e6f0] 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5508b99c] 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:03.016 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5638c7c4] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.017 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:03.018 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:03.019 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:41:03.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:03.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:41:03.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:03.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:03.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:03.025 INFO:tasks.workunit.client.0.smithi116.stderr: 7f59777fe640 / http_manager 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a05fe3640 / http_manager 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a06fe5640 / rgw_dt_lg_renew 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a267fc640 / ms_dispatch 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a27fff640 / io_context_pool 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a367fc640 / ms_dispatch 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a3d60a640 / ms_dispatch 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a3ee0d640 / io_context_pool 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5015c640 / msgr-worker-2 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5095d640 / msgr-worker-1 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5115e640 / msgr-worker-0 2024-09-14T11:41:03.026 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5195f640 / io_context_pool 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b54d28800 / radosgw-admin 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.142580.log 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: crc 2024-09-14T11:41:03.027 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:41:02.665+0000 7f5b54d28800 5 AuthRegistry(0x55695f78e1a0) adding con mode: secure 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:41:02.666+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:41:02.666+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:41:02.666+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key hook 0x55695f78e2e8 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f63b5d0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f6474c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f6d1550 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.028 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:41:02.666+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.273388s 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f6474c0 auth_method 0 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f6d1550 auth_method 0 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.029 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:41:02.666+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f63b5d0 auth_method 0 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:41:02.666+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.030 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:41:02.666+0000 7f5b5015c640 1 monclient: found mon.noname-c 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:41:02.666+0000 7f5b5015c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: dump: 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.031 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: _finish_auth 0 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:41:02.666+0000 7f5a3d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:41:02.667+0000 7f5b54d28800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:03.032 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:41:02.667+0000 7f5a3d60a640 10 monclient: dump: 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.033 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:41:02.667+0000 7f5a3ee0d640 4 set_mon_vals no callback set 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:41:02.667+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:41:02.667+0000 7f5b54d28800 1 librados: init done 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:41:02.668+0000 7f5a3d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:41:02.669+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5a38077230 auth_method 0 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:41:02.669+0000 7f5b5115e640 10 monclient: get_auth_request con 0x55695f7d8000 auth_method 0 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:41:02.670+0000 7f5b5095d640 10 monclient: get_auth_request con 0x55695f7db1e0 auth_method 0 2024-09-14T11:41:03.034 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:41:02.671+0000 7f5b5015c640 10 monclient: get_auth_request con 0x55695f7e0270 auth_method 0 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:41:02.671+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:41:02.671+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:41:02.671+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:03.035 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding auth protocol: cephx 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.036 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: crc 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:41:02.671+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e40c0) adding con mode: secure 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command objecter_requests cmddesc objecter_requests hook 0x55695f7e7610 EEXIST 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding auth protocol: cephx 2024-09-14T11:41:03.037 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: crc 2024-09-14T11:41:03.038 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 AuthRegistry(0x55695f7e2fb8) adding con mode: secure 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:41:02.672+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:41:02.672+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x55695f7e3100 EEXIST 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f80b930 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f80bd10 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f80a640 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.039 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:41:02.672+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.279894s 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f80bd10 auth_method 0 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f80a640 auth_method 0 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f80b930 auth_method 0 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.040 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:41:02.673+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:41:02.673+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.041 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient(hunting): handle_auth_done global_id 8124 payload 824 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:41:02.673+0000 7f5b5015c640 1 monclient: found mon.noname-a 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:41:02.673+0000 7f5b5015c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: dump: 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.042 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: _finish_auth 0 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:41:02.673+0000 7f5a367fc640 10 monclient: dump: 2024-09-14T11:41:03.043 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:41:02.673+0000 7f5b54d28800 5 monclient: authenticate success, global_id 8124 2024-09-14T11:41:03.044 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:41:02.673+0000 7f5b5195f640 4 set_mon_vals no callback set 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:41:02.673+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:41:02.675+0000 7f5a367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:41:02.675+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5a28077140 auth_method 0 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: get_monmap_and_config 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:03.045 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:41:02.675+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:41:02.675+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:03.046 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding auth protocol: cephx 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.047 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: crc 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:41:02.675+0000 7f5b54d28800 5 AuthRegistry(0x55695f82b510) adding con mode: secure 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding auth protocol: cephx 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.048 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: crc 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea1b90) adding con mode: secure 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.049 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:41:02.676+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:41:02.676+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x7fff03ea1cd8 EEXIST 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f85fb50 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f82f960 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f85af10 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:41:02.676+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.283865s 2024-09-14T11:41:03.050 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f82f960 auth_method 0 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:41:02.676+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f85af10 auth_method 0 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:41:02.676+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.051 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:41:02.677+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f85fb50 auth_method 0 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:41:02.677+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient(hunting): handle_auth_done global_id 8127 payload 274 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient: _finish_hunting 0 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:41:02.677+0000 7f5b5115e640 1 monclient: found mon.noname-a 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:41:02.677+0000 7f5b5115e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.052 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: dump: 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.053 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: _finish_auth 0 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: _check_auth_tickets 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:41:02.677+0000 7f5b54d28800 5 monclient: authenticate success, global_id 8127 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:41:02.677+0000 7f5b54d28800 10 monclient: get_monmap_and_config success 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:41:02.677+0000 7f5b54d28800 4 set_mon_vals no callback set 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:41:02.677+0000 7f5a27fff640 10 monclient: dump: 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.054 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:41:02.677+0000 7f5b54d28800 10 monclient: shutdown 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: build_initial_monmap 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 build_initial for_mkfs: 0 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: monmap: 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:03.055 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding auth protocol: cephx 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.056 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: crc 2024-09-14T11:41:03.057 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f85b3c0) adding con mode: secure 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: starting msgr at 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: starting objecter 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command objecter_requests cmddesc objecter_requests hook 0x55695f82db30 EEXIST 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: setting wanted keys 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:41:02.678+0000 7f5b54d28800 1 librados: calling monclient init 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: init 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding auth protocol: cephx 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.058 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: crc 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 AuthRegistry(0x55695f8201f0) adding con mode: secure 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:41:02.678+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.059 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:41:02.678+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command rotate-key cmddesc rotate-key hook 0x55695f820338 EEXIST 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:41:02.678+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-c con 0x55695f82f960 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-b con 0x55695f85af10 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): picked mon.noname-a con 0x55695f85fb50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:41:02.679+0000 7f5b54d28800 10 monclient(hunting): authenticate will time out at 2260.286037s 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): get_auth_request con 0x55695f82f960 auth_method 0 2024-09-14T11:41:03.060 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): get_auth_request con 0x55695f85fb50 auth_method 0 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.061 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:41:02.679+0000 7f5b5115e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): get_auth_request con 0x55695f85af10 auth_method 0 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:41:02.679+0000 7f5b5015c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient(hunting): handle_auth_done global_id 7526 payload 824 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient: _finish_hunting 0 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:41:02.679+0000 7f5b5095d640 1 monclient: found mon.noname-c 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:41:02.679+0000 7f5b5095d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.062 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: dump: 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.063 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: _finish_auth 0 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:41:02.679+0000 7f5a267fc640 10 monclient: dump: 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:03.064 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:41:02.679+0000 7f5a27fff640 4 set_mon_vals no callback set 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:41:02.680+0000 7f5b54d28800 5 monclient: authenticate success, global_id 7526 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _renew_subs 2024-09-14T11:41:03.065 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:41:02.680+0000 7f5b54d28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:41:02.680+0000 7f5b54d28800 1 librados: init done 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:41:02.680+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cr dump hook 0x55695f84f7a8 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:41:02.681+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:41:02.682+0000 7f5a267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:41:02.682+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5a1c077230 auth_method 0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:41:02.682+0000 7f5b5115e640 10 monclient: get_auth_request con 0x55695f87a8e0 auth_method 0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 realm 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.066 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:41:02.683+0000 7f5b54d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:41:02.683+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:41:02.683+0000 7f5b5095d640 10 monclient: get_auth_request con 0x55695f87eb00 auth_method 0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:41:02.684+0000 7f5b54d28800 20 searching for the correct realm 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:41:02.684+0000 7f5b5015c640 10 monclient: get_auth_request con 0x55695f883d60 auth_method 0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:41:02.685+0000 7f5b5115e640 10 monclient: get_auth_request con 0x7f5b4401da90 auth_method 0 2024-09-14T11:41:03.067 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:41:02.686+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b48018760 auth_method 0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:41:02.686+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5b40074040 auth_method 0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:41:02.687+0000 7f5b5015c640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f5b40074040 msgr2=0x7f5b400b9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:41:02.687+0000 7f5a267fc640 1 client.7526.objecter ms_handle_reset 0x7f5b40074040 session 0x7f5b400e8040 osd.4 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:41:02.687+0000 7f5a267fc640 10 monclient: _renew_subs 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:41:02.687+0000 7f5a267fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:41:02.687+0000 7f5b5015c640 10 monclient: get_auth_request con 0x7f5a1c087050 auth_method 0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:41:02.688+0000 7f5b5115e640 10 monclient: get_auth_request con 0x7f5b4406c2b0 auth_method 0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:41:02.690+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b440093c0 auth_method 0 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:41:02.690+0000 7f5b5095d640 0 -- 172.21.15.116:0/2461369265 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5b440093c0 msgr2=0x7f5b44017040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.068 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:41:02.891+0000 7f5b5095d640 10 monclient: get_auth_request con 0x7f5b440093c0 auth_method 0 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.069 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:41:02.896+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zone default found 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Realm: () 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:41:02.897+0000 7f5b54d28800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:41:02.897+0000 7f5b54d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 zonegroup default 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.070 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:41:02.897+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started sync module instance, tier type = 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:41:02.898+0000 7f5b54d28800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=0 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=1 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=2 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=3 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=4 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=5 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:41:02.906+0000 7f5b54d28800 20 add_watcher() i=6 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:41:02.907+0000 7f5b54d28800 20 add_watcher() i=7 2024-09-14T11:41:03.071 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:41:02.907+0000 7f5b54d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding auth protocol: cephx 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.072 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: crc 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 AuthRegistry(0x7fff03ea2070) adding con mode: secure 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:41:02.909+0000 7f5a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:41:02.909+0000 7f5b54d28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache list hook 0x55695f8507c0 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache inspect hook 0x55695f8507c0 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache erase hook 0x55695f8507c0 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command cache zap hook 0x55695f8507c0 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 note: GC not initialized 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:41:02.909+0000 7f5a05fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:03.073 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace show hook 0x7f5b48010440 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace history hook 0x7f5b48010440 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace active hook 0x7f5b48010440 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:41:02.909+0000 7f5b54d28800 5 asok(0x55695f56f270) register_command sync trace active_short hook 0x7f5b48010440 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:41:02.909+0000 7f5b54d28800 20 Filter name: none 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:41:02.910+0000 7f59777fe640 20 reqs_thread_entry: start 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : miss 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.074 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:41:02.910+0000 7f5b54d28800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:41:02.910+0000 7f5b54d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:41:02.915+0000 7f5b54d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 93911062730512 notifier 7526 bl.length()=931 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.075 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:41:02.916+0000 7f5a27fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:41:02.917+0000 7f5b54d28800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.0 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.1 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.2 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.3 2024-09-14T11:41:03.076 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.4 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.5 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.6 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.7 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.8 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.9 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:03.077 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.10 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:41:02.921+0000 7f5b54d28800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1.11 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:41:02.921+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.0 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:41:02.922+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.3 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.4 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:41:02.923+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.5 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.6 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.7 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:41:02.924+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.8 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.9 2024-09-14T11:41:03.078 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:41:02.925+0000 7f5b54d28800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.10 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:41:02.930+0000 7f5b54d28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b54d28800 time 2024-09-14T11:41:02.931997+0000 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5638c76a] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:03.079 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:41:02.931+0000 7f5b54d28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f5b54d28800 thread_name:radosgw-admin 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5503e6f0] 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5508b99c] 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5638c7c4] 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5b5638c928] 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55695d2f10b1] 2024-09-14T11:41:03.080 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55695d300124] 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55695d300fc4] 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5b55029590] 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:41:03.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:41:03.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:41:03.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:03.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:41:03.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:03.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:41:03.087 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7f59777fe640 / http_manager 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a05fe3640 / http_manager 2024-09-14T11:41:03.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a06fe5640 / rgw_dt_lg_renew 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a267fc640 / ms_dispatch 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a27fff640 / io_context_pool 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a367fc640 / ms_dispatch 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a3d60a640 / ms_dispatch 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5a3ee0d640 / io_context_pool 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5015c640 / msgr-worker-2 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5095d640 / msgr-worker-1 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5115e640 / msgr-worker-0 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b5195f640 / io_context_pool 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7f5b54d28800 / radosgw-admin 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:41:02.933600Z_7a618b9f-9690-4871-b368-186965f8966f/log 2024-09-14T11:41:03.089 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:41:03.090 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.004+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.006+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.006+0000 7f647f733800 20 realm 2024-09-14T11:41:03.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.006+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.006+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.007+0000 7f647f733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.007+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.007+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.007+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.008+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.008+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.008+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.008+0000 7f647f733800 20 searching for the correct realm 2024-09-14T11:41:03.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.011+0000 7f647ac75640 0 -- 172.21.15.116:0/4050299378 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f646c085c20 msgr2=0x7f646c0737c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:03.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.217+0000 7f647b476640 0 -- 172.21.15.116:0/4050299378 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f647007b070 msgr2=0x7f64700b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.423+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 zone default found 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 4 Realm: () 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 zonegroup default 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.424+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.425+0000 7f647f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.425+0000 7f647f733800 20 started sync module instance, tier type = 2024-09-14T11:41:03.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.425+0000 7f647f733800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:03.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=0 2024-09-14T11:41:03.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=1 2024-09-14T11:41:03.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=2 2024-09-14T11:41:03.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=3 2024-09-14T11:41:03.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=4 2024-09-14T11:41:03.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=5 2024-09-14T11:41:03.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.434+0000 7f647f733800 20 add_watcher() i=6 2024-09-14T11:41:03.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.435+0000 7f647f733800 20 add_watcher() i=7 2024-09-14T11:41:03.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.435+0000 7f647f733800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:03.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.437+0000 7f6331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.437+0000 7f647f733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:03.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.437+0000 7f647f733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:03.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.437+0000 7f647f733800 5 note: GC not initialized 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f6330fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f647f733800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f647f733800 20 Filter name: none 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f62aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:03.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.438+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.439+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:03.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.439+0000 7f647f733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:03.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.439+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.439+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:03.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.439+0000 7f647f733800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.440+0000 7f647f733800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:03.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.440+0000 7f647f733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:03.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.441+0000 7f6331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.443+0000 7f647f733800 20 remove_watcher() i=0 2024-09-14T11:41:03.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.443+0000 7f647f733800 2 removed watcher, disabling cache 2024-09-14T11:41:03.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.444+0000 7f647f733800 20 remove_watcher() i=1 2024-09-14T11:41:03.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.445+0000 7f647f733800 20 remove_watcher() i=2 2024-09-14T11:41:03.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.446+0000 7f647f733800 20 remove_watcher() i=3 2024-09-14T11:41:03.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.447+0000 7f647f733800 20 remove_watcher() i=4 2024-09-14T11:41:03.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.448+0000 7f647f733800 20 remove_watcher() i=5 2024-09-14T11:41:03.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.449+0000 7f647f733800 20 remove_watcher() i=6 2024-09-14T11:41:03.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.450+0000 7f647f733800 20 remove_watcher() i=7 2024-09-14T11:41:03.459 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.459 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:03.459 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:41:03.460 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:03.550 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:41:03.581 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:03.581 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:03.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.618+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 realm 2024-09-14T11:41:03.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:03.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.620+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.621+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.621+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.621+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:03.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.621+0000 7f300a139800 20 searching for the correct realm 2024-09-14T11:41:03.622 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.624+0000 7f2ffd5c6640 0 -- 172.21.15.116:0/4260599387 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f2ff802a060 msgr2=0x7f2ff8069560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.626 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.628+0000 7f3005dc7640 0 -- 172.21.15.116:0/4260599387 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f2ff006d910 msgr2=0x7f2ff0094410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.833+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:03.834 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 zone default found 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 4 Realm: () 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 zonegroup default 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.834+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.835+0000 7f300a139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:03.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.835+0000 7f300a139800 20 started sync module instance, tier type = 2024-09-14T11:41:03.836 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.835+0000 7f300a139800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=0 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=1 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=2 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=3 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=4 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=5 2024-09-14T11:41:03.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.843+0000 7f300a139800 20 add_watcher() i=6 2024-09-14T11:41:03.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.844+0000 7f300a139800 20 add_watcher() i=7 2024-09-14T11:41:03.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.844+0000 7f300a139800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.846+0000 7f2eb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 5 note: GC not initialized 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f2eb67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:03.847 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 Filter name: none 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f2e27fff640 20 reqs_thread_entry: start 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : miss 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.847+0000 7f300a139800 20 rados->read ofs=0 len=0 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:03.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:03.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:03.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:03.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.848+0000 7f300a139800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:03.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.849+0000 7f300a139800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to be held by another RGW process; skipping for now 2024-09-14T11:41:03.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.850+0000 7f2eb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:03.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.852+0000 7f300a139800 20 remove_watcher() i=0 2024-09-14T11:41:03.851 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.852+0000 7f300a139800 2 removed watcher, disabling cache 2024-09-14T11:41:03.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.853+0000 7f300a139800 20 remove_watcher() i=1 2024-09-14T11:41:03.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.854+0000 7f300a139800 20 remove_watcher() i=2 2024-09-14T11:41:03.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.855+0000 7f300a139800 20 remove_watcher() i=3 2024-09-14T11:41:03.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.856+0000 7f300a139800 20 remove_watcher() i=4 2024-09-14T11:41:03.856 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.857+0000 7f300a139800 20 remove_watcher() i=5 2024-09-14T11:41:03.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.858+0000 7f300a139800 20 remove_watcher() i=6 2024-09-14T11:41:03.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:03.859+0000 7f300a139800 20 remove_watcher() i=7 2024-09-14T11:41:03.868 INFO:tasks.workunit.client.0.smithi116.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:41:33.896 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:41:33.930 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:33.931 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:33.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.974+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 20 realm 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.976+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.977+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:33.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.977+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.978+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:33.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.978+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:33.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.978+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:33.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.978+0000 7feae5840800 20 searching for the correct realm 2024-09-14T11:41:33.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.982+0000 7feae3b2b640 0 -- 172.21.15.116:0/383758321 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7feacc038bd0 msgr2=0x7feacc031440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:33.983 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:33.985+0000 7feae332a640 0 -- 172.21.15.116:0/383758321 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7feacc00f400 msgr2=0x7feacc00f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:34.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.192+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:34.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 zone default found 2024-09-14T11:41:34.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 4 Realm: () 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 zonegroup default 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.193+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.194+0000 7feae5840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.194+0000 7feae5840800 20 started sync module instance, tier type = 2024-09-14T11:41:34.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.194+0000 7feae5840800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=0 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=1 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=2 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=3 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=4 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=5 2024-09-14T11:41:34.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.204+0000 7feae5840800 20 add_watcher() i=6 2024-09-14T11:41:34.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.205+0000 7feae5840800 20 add_watcher() i=7 2024-09-14T11:41:34.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.205+0000 7feae5840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:34.205 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.207+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.207+0000 7feae5840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.207+0000 7feae5840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.207+0000 7feae5840800 5 note: GC not initialized 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.207+0000 7fe998fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 20 Filter name: none 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7fe9127fc640 20 reqs_thread_entry: start 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:41:34.206 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:34.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:41:34.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:41:34.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : miss 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.208+0000 7feae5840800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.209+0000 7feae5840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:34.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.210+0000 7feae5840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:34.214 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7feae5840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7feae5840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7feae5840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7feae5840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7fe9c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94514618574064 notifier 7580 bl.length()=931 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7fe9c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.215 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7fe9c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.217+0000 7fe9c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.216 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.219+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:34.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.219+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:34.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.219+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:34.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.219+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.0 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.0 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.1 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.1 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.2 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.2 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.3 2024-09-14T11:41:34.223 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.3 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.4 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.4 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.5 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.5 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.6 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.6 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.7 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.7 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.8 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.8 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.9 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.9 2024-09-14T11:41:34.224 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.10 2024-09-14T11:41:34.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.10 2024-09-14T11:41:34.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.11 2024-09-14T11:41:34.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2.11 2024-09-14T11:41:34.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.0 2024-09-14T11:41:34.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.225+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.226+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.226+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.3 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.227+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.4 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.227+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.5 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.228+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.6 2024-09-14T11:41:34.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.229+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.7 2024-09-14T11:41:34.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.229+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.8 2024-09-14T11:41:34.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.230+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.9 2024-09-14T11:41:34.228 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.230+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.10 2024-09-14T11:41:34.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.233+0000 7feae5840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:34.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.233+0000 7feae5840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.234+0000 7feae5840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.234+0000 7feae5840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.234+0000 7feae5840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.234+0000 7feae5840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.235+0000 7fe9c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94514618574064 notifier 7580 bl.length()=931 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.235+0000 7fe9c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.235+0000 7fe9c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.235+0000 7fe9c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.236+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:34.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.236+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:34.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.236+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:34.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.236+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:34.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.239+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.0 2024-09-14T11:41:34.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.239+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.1 2024-09-14T11:41:34.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.239+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.2 2024-09-14T11:41:34.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.240+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.3 2024-09-14T11:41:34.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.240+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.4 2024-09-14T11:41:34.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.240+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.5 2024-09-14T11:41:34.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.240+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.6 2024-09-14T11:41:34.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.241+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.7 2024-09-14T11:41:34.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.241+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.8 2024-09-14T11:41:34.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.241+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.9 2024-09-14T11:41:34.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.242+0000 7feae5840800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39.10 2024-09-14T11:41:34.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.242+0000 7feae5840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:34.240 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.242+0000 7feae5840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7feae5840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7feae5840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7feae5840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7feae5840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39, ofs0, ns] 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7fe9c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94514618574064 notifier 7580 bl.length()=899 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7fe9c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 info.flags=0x17 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7fe9c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 to cache LRU end 2024-09-14T11:41:34.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.244+0000 7fe9c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:41:34.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.248+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_sources= new_sources= 2024-09-14T11:41:34.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.248+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential sources added=[] removed=[] 2024-09-14T11:41:34.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.248+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): orig_dests= new_dests= 2024-09-14T11:41:34.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.248+0000 7feae5840800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39]): potential dests added=[] removed=[] 2024-09-14T11:41:34.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.251+0000 7feae5840800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:34.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.253+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.255+0000 7feae5840800 20 remove_watcher() i=0 2024-09-14T11:41:34.253 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.255+0000 7feae5840800 2 removed watcher, disabling cache 2024-09-14T11:41:34.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.256+0000 7feae5840800 20 remove_watcher() i=1 2024-09-14T11:41:34.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.257+0000 7feae5840800 20 remove_watcher() i=2 2024-09-14T11:41:34.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.258+0000 7feae5840800 20 remove_watcher() i=3 2024-09-14T11:41:34.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.259+0000 7feae5840800 20 remove_watcher() i=4 2024-09-14T11:41:34.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.260+0000 7feae5840800 20 remove_watcher() i=5 2024-09-14T11:41:34.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.261+0000 7feae5840800 20 remove_watcher() i=6 2024-09-14T11:41:34.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.262+0000 7feae5840800 20 remove_watcher() i=7 2024-09-14T11:41:34.272 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:41:34.300 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:34.300 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:34.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.339+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.340+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.340+0000 7fc07d640800 20 realm 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.340+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.341+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.341+0000 7fc07d640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.341+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.341+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.341+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.342+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.342+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.342+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:34.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.342+0000 7fc07d640800 20 searching for the correct realm 2024-09-14T11:41:34.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.346+0000 7fc07a929640 0 -- 172.21.15.116:0/3728425133 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fc06c044040 msgr2=0x7fc06c076a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.349+0000 7fc07a929640 0 -- 172.21.15.116:0/3728425133 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fbf440870d0 msgr2=0x7fbf44089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.353+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 zone default found 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 4 Realm: () 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 zonegroup default 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.354+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.355+0000 7fc07d640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.355+0000 7fc07d640800 20 started sync module instance, tier type = 2024-09-14T11:41:34.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.355+0000 7fc07d640800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:34.361 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=0 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=1 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=2 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=3 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=4 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=5 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=6 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 20 add_watcher() i=7 2024-09-14T11:41:34.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.364+0000 7fc07d640800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:34.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.366+0000 7fbf31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 5 note: GC not initialized 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fbf30fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 20 Filter name: none 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fbeaa7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.367+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.368+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:34.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.368+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.368+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.368+0000 7fc07d640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.368+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.369+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:41:34.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.369+0000 7fc07d640800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.369+0000 7fc07d640800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:41:34.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.369+0000 7fc07d640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:34.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.371+0000 7fbf31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:34.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.373+0000 7fc07d640800 20 remove_watcher() i=0 2024-09-14T11:41:34.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.373+0000 7fc07d640800 2 removed watcher, disabling cache 2024-09-14T11:41:34.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.374+0000 7fc07d640800 20 remove_watcher() i=1 2024-09-14T11:41:34.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.375+0000 7fc07d640800 20 remove_watcher() i=2 2024-09-14T11:41:34.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.376+0000 7fc07d640800 20 remove_watcher() i=3 2024-09-14T11:41:34.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.377+0000 7fc07d640800 20 remove_watcher() i=4 2024-09-14T11:41:34.376 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.378+0000 7fc07d640800 20 remove_watcher() i=5 2024-09-14T11:41:34.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.379+0000 7fc07d640800 20 remove_watcher() i=6 2024-09-14T11:41:34.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.380+0000 7fc07d640800 20 remove_watcher() i=7 2024-09-14T11:41:34.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:34.388 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:34.388 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: abort-at-change-reshard-state id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:41:34.388 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:34.747 INFO:tasks.workunit.client.0.smithi116.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:41:34.748 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:34.777 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:34.777 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:34.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.816+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 20 realm 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.817+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.818+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:34.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.818+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.818+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:34.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.818+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:34.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.819+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:34.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.819+0000 7fcc4bf31800 20 searching for the correct realm 2024-09-14T11:41:34.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.821+0000 7fcc48477640 0 -- 172.21.15.116:0/1579584361 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fcc3c02f040 msgr2=0x7fcc3c00a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:34.823 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:34.825+0000 7fcc47c76640 0 -- 172.21.15.116:0/1579584361 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fcc3c040940 msgr2=0x7fcc3c04b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.031 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.031+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 zone default found 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 4 Realm: () 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 zonegroup default 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.032+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.032 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.033+0000 7fcc4bf31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.033+0000 7fcc4bf31800 20 started sync module instance, tier type = 2024-09-14T11:41:35.033 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.033+0000 7fcc4bf31800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=0 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=1 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=2 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=3 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=4 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=5 2024-09-14T11:41:35.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.043+0000 7fcc4bf31800 20 add_watcher() i=6 2024-09-14T11:41:35.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.044+0000 7fcc4bf31800 20 add_watcher() i=7 2024-09-14T11:41:35.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.044+0000 7fcc4bf31800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:35.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.045+0000 7fcafdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:35.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:35.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 5 note: GC not initialized 2024-09-14T11:41:35.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcafcfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 20 Filter name: none 2024-09-14T11:41:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fca767fc640 20 reqs_thread_entry: start 2024-09-14T11:41:35.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.046+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.047+0000 7fcc4bf31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.048+0000 7fcc4bf31800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.048+0000 7fcc4bf31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.049+0000 7fcafdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.051+0000 7fcc4bf31800 20 remove_watcher() i=0 2024-09-14T11:41:35.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.051+0000 7fcc4bf31800 2 removed watcher, disabling cache 2024-09-14T11:41:35.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.052+0000 7fcc4bf31800 20 remove_watcher() i=1 2024-09-14T11:41:35.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.053+0000 7fcc4bf31800 20 remove_watcher() i=2 2024-09-14T11:41:35.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.054+0000 7fcc4bf31800 20 remove_watcher() i=3 2024-09-14T11:41:35.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.055+0000 7fcc4bf31800 20 remove_watcher() i=4 2024-09-14T11:41:35.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.056+0000 7fcc4bf31800 20 remove_watcher() i=5 2024-09-14T11:41:35.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.057+0000 7fcc4bf31800 20 remove_watcher() i=6 2024-09-14T11:41:35.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.058+0000 7fcc4bf31800 20 remove_watcher() i=7 2024-09-14T11:41:35.066 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.066 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:41:35.066 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:41:35.066 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.067 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:35.096 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:35.132 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.134+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.135+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.135+0000 7fe60d098800 20 realm 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.135+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.136+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.136+0000 7fe60d098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.136+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.136+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.134 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.136+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.137+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.137+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.137+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:35.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.137+0000 7fe60d098800 20 searching for the correct realm 2024-09-14T11:41:35.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.140+0000 7fe60b383640 0 -- 172.21.15.116:0/4091672329 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fe5f40af600 msgr2=0x7fe5f40a7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.143+0000 7fe60ab82640 0 -- 172.21.15.116:0/4091672329 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe5f404d800 msgr2=0x7fe5f409da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:35.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:35.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.350+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:35.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 zone default found 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 4 Realm: () 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 zonegroup default 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.351+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.352+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.352+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.352+0000 7fe60d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.352+0000 7fe60d098800 20 started sync module instance, tier type = 2024-09-14T11:41:35.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.352+0000 7fe60d098800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=0 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=1 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=2 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=3 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=4 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=5 2024-09-14T11:41:35.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.361+0000 7fe60d098800 20 add_watcher() i=6 2024-09-14T11:41:35.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.362+0000 7fe60d098800 20 add_watcher() i=7 2024-09-14T11:41:35.360 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.362+0000 7fe60d098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.363+0000 7fe4c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.363+0000 7fe60d098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.363+0000 7fe60d098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.363+0000 7fe60d098800 5 note: GC not initialized 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.364+0000 7fe43bfff640 20 reqs_thread_entry: start 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.364+0000 7fe60d098800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:35.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.364+0000 7fe60d098800 20 Filter name: none 2024-09-14T11:41:35.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.364+0000 7fe439ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:35.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.364+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.365+0000 7fe60d098800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.366+0000 7fe60d098800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.366+0000 7fe60d098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:35.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.367+0000 7fe4c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.369+0000 7fe60d098800 20 remove_watcher() i=0 2024-09-14T11:41:35.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.369+0000 7fe60d098800 2 removed watcher, disabling cache 2024-09-14T11:41:35.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.370+0000 7fe60d098800 20 remove_watcher() i=1 2024-09-14T11:41:35.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.372+0000 7fe60d098800 20 remove_watcher() i=2 2024-09-14T11:41:35.370 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.372+0000 7fe60d098800 20 remove_watcher() i=3 2024-09-14T11:41:35.371 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.373+0000 7fe60d098800 20 remove_watcher() i=4 2024-09-14T11:41:35.372 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.374+0000 7fe60d098800 20 remove_watcher() i=5 2024-09-14T11:41:35.373 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.375+0000 7fe60d098800 20 remove_watcher() i=6 2024-09-14T11:41:35.374 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.376+0000 7fe60d098800 20 remove_watcher() i=7 2024-09-14T11:41:35.386 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:41:35.419 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:35.419 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:35.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.458+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 realm 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.462+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:35.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.462+0000 7f799a3af800 20 searching for the correct realm 2024-09-14T11:41:35.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.464+0000 7f798f69f640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f798808d040 msgr2=0x7f798808c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.668 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.670+0000 7f7997ea0640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f79800560d0 msgr2=0x7f7980073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.876 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.877 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 zone default found 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 4 Realm: () 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 zonegroup default 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.878 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.879+0000 7f799a3af800 20 started sync module instance, tier type = 2024-09-14T11:41:35.879 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.879+0000 7f799a3af800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=0 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=1 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=2 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=3 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=4 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=5 2024-09-14T11:41:35.887 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=6 2024-09-14T11:41:35.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.890+0000 7f799a3af800 20 add_watcher() i=7 2024-09-14T11:41:35.888 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.890+0000 7f799a3af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:35.890 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.892+0000 7f784dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.892+0000 7f799a3af800 5 note: GC not initialized 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.892+0000 7f784cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 20 Filter name: none 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f77c67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:35.891 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:35.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.892 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.893 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.894+0000 7f799a3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.901+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.901+0000 7f799a3af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.901+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.901+0000 7f799a3af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94338044884272 notifier 8259 bl.length()=827 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.900 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:41:35.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:41:35.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:41:35.902 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:35.908 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:35.909 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:35.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:35.912 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.914+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:35.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.914+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.916+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:35.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.916+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:35.916 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f799a3af800 time 2024-09-14T11:41:35.918912+0000 2024-09-14T11:41:35.916 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:35.916 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.916 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f799d98c76a] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.918+0000 7f799a3af800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f799a3af800 time 2024-09-14T11:41:35.918912+0000 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:35.917 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f799d98c76a] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:41:35.918 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f799a3af800 thread_name:radosgw-admin 2024-09-14T11:41:35.937 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f799c63e6f0] 2024-09-14T11:41:35.937 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f799c68b99c] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f799d98c7c4] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.919+0000 7f799a3af800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:35.938 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f799a3af800 thread_name:radosgw-admin 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f799c63e6f0] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f799c68b99c] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f799d98c7c4] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:35.939 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc98c2130 auth_method 0 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9834d30 auth_method 0 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.940 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9807040 auth_method 0 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.941 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient: _finish_hunting 0 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:41:35.444+0000 7f798f69f640 1 monclient: found mon.noname-c 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: dump: 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.942 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: _finish_auth 0 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:41:35.444+0000 7f799a3af800 5 monclient: authenticate success, global_id 7637 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: dump: 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.943 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:41:35.444+0000 7f7885e0b640 4 set_mon_vals no callback set 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:41:35.444+0000 7f799a3af800 1 librados: init done 2024-09-14T11:41:35.944 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:41:35.446+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7880077230 auth_method 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:41:35.446+0000 7f79986a1640 10 monclient: get_auth_request con 0x55ccc99a8240 auth_method 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:41:35.447+0000 7f7997ea0640 10 monclient: get_auth_request con 0x55ccc99cabd0 auth_method 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:41:35.448+0000 7f798f69f640 10 monclient: get_auth_request con 0x55ccc99ce400 auth_method 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:41:35.449+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:35.945 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.946 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:41:35.449+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command objecter_requests cmddesc objecter_requests hook 0x55ccc99d72d0 EEXIST 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.947 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:41:35.450+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:41:35.450+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x55ccc99d2ea0 EEXIST 2024-09-14T11:41:35.948 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc99fb5f0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc99fb9d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc99fa300 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.056515s 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc99fb9d0 auth_method 0 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.949 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc99fa300 auth_method 0 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc99fb5f0 auth_method 0 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.950 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient: _finish_hunting 0 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:41:35.450+0000 7f79986a1640 1 monclient: found mon.noname-c 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: dump: 2024-09-14T11:41:35.951 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:35.952 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: dump: 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.953 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:41:35.451+0000 7f799a3af800 5 monclient: authenticate success, global_id 7640 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:41:35.451+0000 7f7998ea2640 4 set_mon_vals no callback set 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:41:35.453+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7870077140 auth_method 0 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: get_monmap_and_config 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:35.954 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:41:35.453+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:35.955 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:41:35.453+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:35.956 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:35.957 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:41:35.454+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:41:35.454+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb9950df8 EEXIST 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc9a4fb30 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc9a40480 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc9a4af60 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.060564s 2024-09-14T11:41:35.958 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9a4fb30 auth_method 0 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc9a4af60 auth_method 0 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9a40480 auth_method 0 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.959 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient: _finish_hunting 0 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:41:35.454+0000 7f79986a1640 1 monclient: found mon.noname-c 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: dump: 2024-09-14T11:41:35.960 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:35.961 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: dump: 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.962 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: get_monmap_and_config success 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:41:35.455+0000 7f799a3af800 4 set_mon_vals no callback set 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: shutdown 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:41:35.455+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:35.963 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.964 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: starting msgr at 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: starting objecter 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command objecter_requests cmddesc objecter_requests hook 0x55ccc9a4ad60 EEXIST 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: setting wanted keys 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: calling monclient init 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.965 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x55ccc9a0fff8 EEXIST 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:35.966 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc9a40480 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc9a4af60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc9a4fb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.062795s 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9a4af60 auth_method 0 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc9a4fb30 auth_method 0 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.967 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9a40480 auth_method 0 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.968 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient: _finish_hunting 0 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:41:35.457+0000 7f798f69f640 1 monclient: found mon.noname-a 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: dump: 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.969 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: dump: 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.970 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:41:35.457+0000 7f799a3af800 5 monclient: authenticate success, global_id 8259 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:41:35.457+0000 7f7876ffd640 4 set_mon_vals no callback set 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:41:35.457+0000 7f799a3af800 1 librados: init done 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:41:35.457+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cr dump hook 0x55ccc9a5d1e8 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:41:35.458+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:35.971 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:41:35.459+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7860077230 auth_method 0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:41:35.459+0000 7f79986a1640 10 monclient: get_auth_request con 0x55ccc9a69e10 auth_method 0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 realm 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:41:35.460+0000 7f799a3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:41:35.461+0000 7f7997ea0640 10 monclient: get_auth_request con 0x55ccc9a6e210 auth_method 0 2024-09-14T11:41:35.972 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:41:35.462+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:41:35.462+0000 7f799a3af800 20 searching for the correct realm 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:41:35.462+0000 7f798f69f640 10 monclient: get_auth_request con 0x55ccc9a734d0 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:41:35.463+0000 7f79986a1640 10 monclient: get_auth_request con 0x7f7980002fa0 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:41:35.463+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7990023020 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:41:35.464+0000 7f798f69f640 10 monclient: get_auth_request con 0x7f798808d040 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:41:35.464+0000 7f798f69f640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f798808d040 msgr2=0x7f798808c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:41:35.666+0000 7f798f69f640 10 monclient: get_auth_request con 0x7f798808d040 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:41:35.668+0000 7f79986a1640 10 monclient: get_auth_request con 0x7f7980072290 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:41:35.670+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f79800560d0 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:41:35.670+0000 7f7997ea0640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f79800560d0 msgr2=0x7f7980073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:41:35.872+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f79800560d0 auth_method 0 2024-09-14T11:41:35.973 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 zone default found 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 Realm: () 2024-09-14T11:41:35.974 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:41:35.878+0000 7f799a3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 zonegroup default 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 started sync module instance, tier type = 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=0 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=1 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=2 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=3 2024-09-14T11:41:35.975 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=4 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=5 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=6 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:41:35.890+0000 7f799a3af800 20 add_watcher() i=7 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:41:35.890+0000 7f799a3af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.976 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:41:35.892+0000 7f784dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:41:35.892+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache list hook 0x55ccc9a44220 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache inspect hook 0x55ccc9a44220 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache erase hook 0x55ccc9a44220 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache zap hook 0x55ccc9a44220 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 note: GC not initialized 2024-09-14T11:41:35.977 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:41:35.892+0000 7f784cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace show hook 0x7f799001c070 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace history hook 0x7f799001c070 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace active hook 0x7f799001c070 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace active_short hook 0x7f799001c070 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 Filter name: none 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:41:35.893+0000 7f77c67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:41:35.894+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:35.978 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94338044884272 notifier 8259 bl.length()=827 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:41:35.979 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:35.980 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:35.981 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:35.982 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:41:35.914+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:41:35.914+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:41:35.916+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:41:35.916+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:41:35.918+0000 7f799a3af800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f799a3af800 time 2024-09-14T11:41:35.918912+0000 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.983 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f799d98c76a] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:41:35.919+0000 7f799a3af800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f799a3af800 thread_name:radosgw-admin 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:35.984 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f799c63e6f0] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f799c68b99c] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f799d98c7c4] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:35.985 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:41:35.986 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:41:35.987 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:35.988 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:41:35.989 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:35.990 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:41:35.991 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f77c67fc640 / http_manager 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f784cfe1640 / http_manager 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f784dfe3640 / rgw_dt_lg_renew 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f78757fa640 / ms_dispatch 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f78767fc640 / io_context_pool 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7876ffd640 / io_context_pool 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f787d7fa640 / ms_dispatch 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f787ffff640 / ms_dispatch 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7885e0b640 / io_context_pool 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f798f69f640 / msgr-worker-2 2024-09-14T11:41:35.992 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7997ea0640 / msgr-worker-1 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: 7f79986a1640 / msgr-worker-0 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7998ea2640 / io_context_pool 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: 7f799a3af800 / radosgw-admin 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.146703.log 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc98c2130 auth_method 0 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9834d30 auth_method 0 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.993 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:41:35.443+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9807040 auth_method 0 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:41:35.443+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:41:35.443+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-14T11:41:35.994 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient: _finish_hunting 0 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:41:35.444+0000 7f798f69f640 1 monclient: found mon.noname-c 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:41:35.444+0000 7f798f69f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: dump: 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.995 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: _finish_auth 0 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:41:35.444+0000 7f799a3af800 5 monclient: authenticate success, global_id 7637 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:41:35.444+0000 7f787ffff640 10 monclient: dump: 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:35.996 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:41:35.444+0000 7f7885e0b640 4 set_mon_vals no callback set 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:41:35.444+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:41:35.444+0000 7f799a3af800 1 librados: init done 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:41:35.446+0000 7f787ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:41:35.446+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7880077230 auth_method 0 2024-09-14T11:41:35.997 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:41:35.446+0000 7f79986a1640 10 monclient: get_auth_request con 0x55ccc99a8240 auth_method 0 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:41:35.447+0000 7f7997ea0640 10 monclient: get_auth_request con 0x55ccc99cabd0 auth_method 0 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:41:35.448+0000 7f798f69f640 10 monclient: get_auth_request con 0x55ccc99ce400 auth_method 0 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:41:35.449+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:35.998 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding auth protocol: cephx 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: crc 2024-09-14T11:41:35.999 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d3da0) adding con mode: secure 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:41:35.449+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command objecter_requests cmddesc objecter_requests hook 0x55ccc99d72d0 EEXIST 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:41:35.449+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding auth protocol: cephx 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:41:35.449+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.000 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: crc 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 AuthRegistry(0x55ccc99d2d58) adding con mode: secure 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:41:35.450+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:41:35.450+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:41:35.450+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x55ccc99d2ea0 EEXIST 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc99fb5f0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc99fb9d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc99fa300 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.001 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:41:35.450+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.056515s 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc99fb9d0 auth_method 0 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc99fa300 auth_method 0 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:41:35.450+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.002 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc99fb5f0 auth_method 0 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:41:35.450+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient: _finish_hunting 0 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:41:35.450+0000 7f79986a1640 1 monclient: found mon.noname-c 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:41:35.450+0000 7f79986a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: dump: 2024-09-14T11:41:36.003 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:41:35.451+0000 7f787d7fa640 10 monclient: dump: 2024-09-14T11:41:36.004 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:41:35.451+0000 7f799a3af800 5 monclient: authenticate success, global_id 7640 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:41:35.451+0000 7f7998ea2640 4 set_mon_vals no callback set 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:41:35.451+0000 7f799a3af800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:41:36.005 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:41:35.453+0000 7f787d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:41:35.453+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7870077140 auth_method 0 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: get_monmap_and_config 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:41:35.453+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:41:35.453+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:36.006 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding auth protocol: cephx 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.007 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: crc 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:41:35.453+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a1b510) adding con mode: secure 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:41:35.453+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding auth protocol: cephx 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.008 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: crc 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9950cb0) adding con mode: secure 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:41:35.454+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:41:35.454+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:41:35.454+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb9950df8 EEXIST 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc9a4fb30 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc9a40480 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:36.009 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc9a4af60 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:41:35.454+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.060564s 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9a4fb30 auth_method 0 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc9a4af60 auth_method 0 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.010 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9a40480 auth_method 0 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:41:35.454+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:41:35.454+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-14T11:41:36.011 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient: _finish_hunting 0 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:41:35.454+0000 7f79986a1640 1 monclient: found mon.noname-c 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:41:35.454+0000 7f79986a1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: dump: 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.012 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:41:35.455+0000 7f7876ffd640 10 monclient: dump: 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.013 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 monclient: authenticate success, global_id 7643 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: get_monmap_and_config success 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:41:35.455+0000 7f799a3af800 4 set_mon_vals no callback set 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: shutdown 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: build_initial_monmap 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:41:35.455+0000 7f799a3af800 1 build_initial for_mkfs: 0 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:41:35.455+0000 7f799a3af800 10 monclient: monmap: 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:36.014 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding auth protocol: cephx 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.015 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: crc 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:41:35.455+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a202c0) adding con mode: secure 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: starting msgr at 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: starting objecter 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command objecter_requests cmddesc objecter_requests hook 0x55ccc9a4ad60 EEXIST 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: setting wanted keys 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:41:35.456+0000 7f799a3af800 1 librados: calling monclient init 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: init 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding auth protocol: cephx 2024-09-14T11:41:36.016 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: crc 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 AuthRegistry(0x55ccc9a0feb0) adding con mode: secure 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:41:35.456+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:41:35.456+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command rotate-key cmddesc rotate-key hook 0x55ccc9a0fff8 EEXIST 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: _reopen_session rank -1 2024-09-14T11:41:36.017 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-b con 0x55ccc9a40480 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-a con 0x55ccc9a4af60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): picked mon.noname-c con 0x55ccc9a4fb30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): _renew_subs 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:41:35.456+0000 7f799a3af800 10 monclient(hunting): authenticate will time out at 2293.062795s 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): get_auth_request con 0x55ccc9a4af60 auth_method 0 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): get_auth_request con 0x55ccc9a4fb30 auth_method 0 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.018 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:41:35.456+0000 7f798f69f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): get_auth_request con 0x55ccc9a40480 auth_method 0 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:41:35.456+0000 7f7997ea0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:41:35.456+0000 7f79986a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:36.019 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:41:35.457+0000 7f7997ea0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient: _finish_hunting 0 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:41:35.457+0000 7f798f69f640 1 monclient: found mon.noname-a 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:41:35.457+0000 7f798f69f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: dump: 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.020 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: _finish_auth 0 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: _check_auth_tickets 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:41:35.457+0000 7f78757fa640 10 monclient: dump: 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:41:36.021 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:41:35.457+0000 7f799a3af800 5 monclient: authenticate success, global_id 8259 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:41:35.457+0000 7f7876ffd640 4 set_mon_vals no callback set 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _renew_subs 2024-09-14T11:41:36.022 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:41:35.457+0000 7f799a3af800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:41:35.457+0000 7f799a3af800 1 librados: init done 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:41:35.457+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cr dump hook 0x55ccc9a5d1e8 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:41:35.458+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:41:35.459+0000 7f78757fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:41:35.459+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7860077230 auth_method 0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:41:35.459+0000 7f79986a1640 10 monclient: get_auth_request con 0x55ccc9a69e10 auth_method 0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 realm 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.023 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:41:35.460+0000 7f799a3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:41:35.460+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:41:35.461+0000 7f7997ea0640 10 monclient: get_auth_request con 0x55ccc9a6e210 auth_method 0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:41:35.461+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:41:35.462+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:41:35.462+0000 7f799a3af800 20 searching for the correct realm 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:41:35.462+0000 7f798f69f640 10 monclient: get_auth_request con 0x55ccc9a734d0 auth_method 0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:41:35.463+0000 7f79986a1640 10 monclient: get_auth_request con 0x7f7980002fa0 auth_method 0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:41:35.463+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f7990023020 auth_method 0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:41:35.464+0000 7f798f69f640 10 monclient: get_auth_request con 0x7f798808d040 auth_method 0 2024-09-14T11:41:36.024 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:41:35.464+0000 7f798f69f640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f798808d040 msgr2=0x7f798808c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:41:35.666+0000 7f798f69f640 10 monclient: get_auth_request con 0x7f798808d040 auth_method 0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:41:35.668+0000 7f79986a1640 10 monclient: get_auth_request con 0x7f7980072290 auth_method 0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:41:35.670+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f79800560d0 auth_method 0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:41:35.670+0000 7f7997ea0640 0 -- 172.21.15.116:0/2377406561 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f79800560d0 msgr2=0x7f7980073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:41:35.872+0000 7f7997ea0640 10 monclient: get_auth_request con 0x7f79800560d0 auth_method 0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.025 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:41:35.877+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 zone default found 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 Realm: () 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:41:35.878+0000 7f799a3af800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:41:35.878+0000 7f799a3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 zonegroup default 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:41:35.878+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.026 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 started sync module instance, tier type = 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:41:35.879+0000 7f799a3af800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=0 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=1 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=2 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=3 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=4 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=5 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:41:35.889+0000 7f799a3af800 20 add_watcher() i=6 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:41:35.890+0000 7f799a3af800 20 add_watcher() i=7 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:41:35.890+0000 7f799a3af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:36.027 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding auth protocol: cephx 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: crc 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 AuthRegistry(0x7ffdb9951190) adding con mode: secure 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:41:35.892+0000 7f784dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.028 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:41:35.892+0000 7f799a3af800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:41:35.892+0000 7f799a3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache list hook 0x55ccc9a44220 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache inspect hook 0x55ccc9a44220 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache erase hook 0x55ccc9a44220 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command cache zap hook 0x55ccc9a44220 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:41:35.892+0000 7f799a3af800 5 note: GC not initialized 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:41:35.892+0000 7f784cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace show hook 0x7f799001c070 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace history hook 0x7f799001c070 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace active hook 0x7f799001c070 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:41:35.893+0000 7f799a3af800 5 asok(0x55ccc975d270) register_command sync trace active_short hook 0x7f799001c070 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:36.029 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 Filter name: none 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:41:35.893+0000 7f77c67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:41:35.893+0000 7f799a3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:41:35.893+0000 7f799a3af800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:41:35.894+0000 7f799a3af800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:41:35.894+0000 7f799a3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:41:36.030 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:41:35.901+0000 7f799a3af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94338044884272 notifier 8259 bl.length()=827 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:41:35.902+0000 7f78767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:41:35.904+0000 7f799a3af800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:41:36.031 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.1 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.2 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.3 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.4 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.5 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.6 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.7 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:36.032 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.8 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.9 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.10 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.11 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.12 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.13 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:41:35.909+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:41:35.909+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:36.033 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:41:35.910+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:41:35.910+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:41:35.911+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:41:35.911+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:41:35.912+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:41:35.912+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:41:35.913+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:41:35.913+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:36.034 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:41:35.914+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:41:35.914+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:41:35.915+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:41:35.915+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:41:35.916+0000 7f799a3af800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:41:35.916+0000 7f799a3af800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:41:35.918+0000 7f799a3af800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f799a3af800 time 2024-09-14T11:41:35.918912+0000 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f799d98c76a] 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:36.035 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:41:35.919+0000 7f799a3af800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f799a3af800 thread_name:radosgw-admin 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f799c63e6f0] 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f799c68b99c] 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:41:36.036 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f799d98c7c4] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f799d98c928] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ccc7df70b1] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55ccc7e06124] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ccc7e06fc4] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f799c629590] 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:41:36.037 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:41:36.038 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:41:36.039 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:41:36.040 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:41:36.041 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:36.042 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 7f77c67fc640 / http_manager 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 7f784cfe1640 / http_manager 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 7f784dfe3640 / rgw_dt_lg_renew 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 7f78757fa640 / ms_dispatch 2024-09-14T11:41:36.043 INFO:tasks.workunit.client.0.smithi116.stderr: 7f78767fc640 / io_context_pool 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7876ffd640 / io_context_pool 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f787d7fa640 / ms_dispatch 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f787ffff640 / ms_dispatch 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7885e0b640 / io_context_pool 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f798f69f640 / msgr-worker-2 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7997ea0640 / msgr-worker-1 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f79986a1640 / msgr-worker-0 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f7998ea2640 / io_context_pool 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: 7f799a3af800 / radosgw-admin 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:41:35.920578Z_a8223d0b-305d-47a6-8a28-081dbd5177f1/log 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:41:36.044 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:36.049 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:36.049 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:36.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.995+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 realm 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.997+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.998+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.998+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.998+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:35.998+0000 7f8da1332800 20 searching for the correct realm 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.002+0000 7f8d9c8af640 0 -- 172.21.15.116:0/1238659967 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x56329618dcc0 msgr2=0x563296190110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.005+0000 7f8d9c8af640 0 -- 172.21.15.116:0/1238659967 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f8d9001f070 msgr2=0x7f8d90058930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.009+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 zone default found 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 4 Realm: () 2024-09-14T11:41:36.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 zonegroup default 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 started sync module instance, tier type = 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.010+0000 7f8da1332800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=0 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=1 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=2 2024-09-14T11:41:36.052 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=3 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=4 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=5 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.021+0000 7f8da1332800 20 add_watcher() i=6 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.022+0000 7f8da1332800 20 add_watcher() i=7 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.022+0000 7f8da1332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8c53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 5 note: GC not initialized 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8c52fe5640 20 reqs_thread_entry: start 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 20 Filter name: none 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8c50fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.024+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.025+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.025+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.026+0000 7f8da1332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.028+0000 7f8c53fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.030+0000 7f8da1332800 20 remove_watcher() i=0 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.030+0000 7f8da1332800 2 removed watcher, disabling cache 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.031+0000 7f8da1332800 20 remove_watcher() i=1 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.032+0000 7f8da1332800 20 remove_watcher() i=2 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.033+0000 7f8da1332800 20 remove_watcher() i=3 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.034+0000 7f8da1332800 20 remove_watcher() i=4 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.035+0000 7f8da1332800 20 remove_watcher() i=5 2024-09-14T11:41:36.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.036+0000 7f8da1332800 20 remove_watcher() i=6 2024-09-14T11:41:36.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.037+0000 7f8da1332800 20 remove_watcher() i=7 2024-09-14T11:41:36.085 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:41:36.114 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:36.114 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:36.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.152+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 realm 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.154+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.155+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.155+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.156+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:36.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.156+0000 7f69e513e800 20 searching for the correct realm 2024-09-14T11:41:36.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.159+0000 7f69dbfff640 0 -- 172.21.15.116:0/1501383525 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f69d406c070 msgr2=0x7f69d4086220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:36.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.163+0000 7f69dbfff640 0 -- 172.21.15.116:0/1501383525 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f68ac0870d0 msgr2=0x7f68ac089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:41:36.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.167+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 zone default found 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 4 Realm: () 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:41:36.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 zonegroup default 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 started sync module instance, tier type = 2024-09-14T11:41:36.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.168+0000 7f69e513e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=0 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=1 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=2 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=3 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=4 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=5 2024-09-14T11:41:36.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.177+0000 7f69e513e800 20 add_watcher() i=6 2024-09-14T11:41:36.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.179+0000 7f69e513e800 20 add_watcher() i=7 2024-09-14T11:41:36.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.179+0000 7f69e513e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.180+0000 7f6896fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 5 note: GC not initialized 2024-09-14T11:41:36.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f6895fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:36.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 20 init_complete bucket index max shards: 11 2024-09-14T11:41:36.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 20 Filter name: none 2024-09-14T11:41:36.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f68077fe640 20 reqs_thread_entry: start 2024-09-14T11:41:36.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:36.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.181+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:36.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:41:36.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.182+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:36.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.183+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:41:36.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:36.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:41:36.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.184+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.185+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.185+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.185+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.185+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.186+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.186+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.186+0000 7f69e513e800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:36.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.186+0000 7f69e513e800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:41:36.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.187+0000 7f6896fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.189+0000 7f69e513e800 20 remove_watcher() i=0 2024-09-14T11:41:36.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.189+0000 7f69e513e800 2 removed watcher, disabling cache 2024-09-14T11:41:36.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.190+0000 7f69e513e800 20 remove_watcher() i=1 2024-09-14T11:41:36.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.191+0000 7f69e513e800 20 remove_watcher() i=2 2024-09-14T11:41:36.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.192+0000 7f69e513e800 20 remove_watcher() i=3 2024-09-14T11:41:36.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.193+0000 7f69e513e800 20 remove_watcher() i=4 2024-09-14T11:41:36.192 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.194+0000 7f69e513e800 20 remove_watcher() i=5 2024-09-14T11:41:36.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.195+0000 7f69e513e800 20 remove_watcher() i=6 2024-09-14T11:41:36.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:41:36.196+0000 7f69e513e800 20 remove_watcher() i=7 2024-09-14T11:42:06.236 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:42:06.268 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:06.268 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:06.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.310+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.311 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 realm 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.312 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.312+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.313+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:06.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.313+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.314+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:06.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.314+0000 7f79f1d2e800 20 searching for the correct realm 2024-09-14T11:42:06.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.317+0000 7f79e7fff640 0 -- 172.21.15.116:0/2192740490 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f79e00393a0 msgr2=0x7f79e004a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:06.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.322+0000 7f79edadd640 0 -- 172.21.15.116:0/2192740490 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f79d8017040 msgr2=0x7f79d8031920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:06.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:06.530 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.529+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:06.531 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 zone default found 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 4 Realm: () 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 zonegroup default 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.530+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.531+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.532 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.531+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.531+0000 7f79f1d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.531+0000 7f79f1d2e800 20 started sync module instance, tier type = 2024-09-14T11:42:06.533 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.531+0000 7f79f1d2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=0 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=1 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=2 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=3 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=4 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=5 2024-09-14T11:42:06.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.543+0000 7f79f1d2e800 20 add_watcher() i=6 2024-09-14T11:42:06.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.544+0000 7f79f1d2e800 20 add_watcher() i=7 2024-09-14T11:42:06.543 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.544+0000 7f79f1d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:06.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.546+0000 7f789f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:06.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.546+0000 7f79f1d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:06.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.546+0000 7f79f1d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:06.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.546+0000 7f79f1d2e800 5 note: GC not initialized 2024-09-14T11:42:06.546 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.546+0000 7f789e7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f79f1d2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f79f1d2e800 20 Filter name: none 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f780ffff640 20 reqs_thread_entry: start 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:06.547 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.547+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.548+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:06.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.548+0000 7f79f1d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:06.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.548+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.549+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:06.548 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.549+0000 7f79f1d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.550+0000 7f79f1d2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:06.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.550+0000 7f79f1d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:06.550 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.551+0000 7f789f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:06.552 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.554+0000 7f79f1d2e800 20 remove_watcher() i=0 2024-09-14T11:42:06.553 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.554+0000 7f79f1d2e800 2 removed watcher, disabling cache 2024-09-14T11:42:06.554 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.555+0000 7f79f1d2e800 20 remove_watcher() i=1 2024-09-14T11:42:06.555 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.556+0000 7f79f1d2e800 20 remove_watcher() i=2 2024-09-14T11:42:06.556 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.557+0000 7f79f1d2e800 20 remove_watcher() i=3 2024-09-14T11:42:06.557 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.559+0000 7f79f1d2e800 20 remove_watcher() i=4 2024-09-14T11:42:06.558 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.560+0000 7f79f1d2e800 20 remove_watcher() i=5 2024-09-14T11:42:06.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.561+0000 7f79f1d2e800 20 remove_watcher() i=6 2024-09-14T11:42:06.560 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.562+0000 7f79f1d2e800 20 remove_watcher() i=7 2024-09-14T11:42:06.663 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:42:06.691 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:06.691 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:06.727 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.728+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 20 realm 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.729+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.730+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.729 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.730+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.731+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:06.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.731+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.731+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:06.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.731+0000 7eff4fc14800 20 searching for the correct realm 2024-09-14T11:42:06.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.734+0000 7eff4abdf640 0 -- 172.21.15.116:0/2855101071 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55a49f4f2300 msgr2=0x55a49f4f47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:06.736 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.737+0000 7eff4b3e0640 0 -- 172.21.15.116:0/2855101071 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7eff340492d0 msgr2=0x7eff3406c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.741 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.742 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.742+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 zone default found 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 4 Realm: () 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 zonegroup default 2024-09-14T11:42:06.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.743+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.744+0000 7eff4fc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.744+0000 7eff4fc14800 20 started sync module instance, tier type = 2024-09-14T11:42:06.744 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.744+0000 7eff4fc14800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=0 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=1 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=2 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=3 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=4 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=5 2024-09-14T11:42:06.752 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.752+0000 7eff4fc14800 20 add_watcher() i=6 2024-09-14T11:42:06.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.753+0000 7eff4fc14800 20 add_watcher() i=7 2024-09-14T11:42:06.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.753+0000 7eff4fc14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:06.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.755+0000 7efe01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:06.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.755+0000 7eff4fc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:06.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.755+0000 7eff4fc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.755+0000 7eff4fc14800 5 note: GC not initialized 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.755+0000 7efe00fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 20 Filter name: none 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7efd7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:06.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:06.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:06.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:06.757 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.756+0000 7eff4fc14800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.757+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:06.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.758+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.759+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:06.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:06.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:06.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:06.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:06.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.760+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:06.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.761+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:06.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.761+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:06.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.761+0000 7eff4fc14800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:06.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.761+0000 7eff4fc14800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:06.762 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.762+0000 7efe01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:06.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.764+0000 7eff4fc14800 20 remove_watcher() i=0 2024-09-14T11:42:06.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.764+0000 7eff4fc14800 2 removed watcher, disabling cache 2024-09-14T11:42:06.764 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.765+0000 7eff4fc14800 20 remove_watcher() i=1 2024-09-14T11:42:06.765 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.766+0000 7eff4fc14800 20 remove_watcher() i=2 2024-09-14T11:42:06.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.767+0000 7eff4fc14800 20 remove_watcher() i=3 2024-09-14T11:42:06.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.768+0000 7eff4fc14800 20 remove_watcher() i=4 2024-09-14T11:42:06.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.769+0000 7eff4fc14800 20 remove_watcher() i=5 2024-09-14T11:42:06.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.770+0000 7eff4fc14800 20 remove_watcher() i=6 2024-09-14T11:42:06.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.771+0000 7eff4fc14800 20 remove_watcher() i=7 2024-09-14T11:42:06.782 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:42:06.810 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:06.810 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:06.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.847+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 realm 2024-09-14T11:42:06.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.848 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:06.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:06.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:06.849 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:06.849+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.051+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.051+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.051+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:07.051 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.051+0000 7f1ceb942800 20 searching for the correct realm 2024-09-14T11:42:07.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.054+0000 7f1cdee85640 0 -- 172.21.15.116:0/1831888065 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f1cd8030070 msgr2=0x7f1cd8057920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.260+0000 7f1ce7686640 0 -- 172.21.15.116:0/1831888065 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f1cd006dba0 msgr2=0x7f1cd00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:07.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.468+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:07.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 zone default found 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 4 Realm: () 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 zonegroup default 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.469+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.470+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.470+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.470+0000 7f1ceb942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.470+0000 7f1ceb942800 20 started sync module instance, tier type = 2024-09-14T11:42:07.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.470+0000 7f1ceb942800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=0 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=1 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=2 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=3 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=4 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=5 2024-09-14T11:42:07.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.480+0000 7f1ceb942800 20 add_watcher() i=6 2024-09-14T11:42:07.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.481+0000 7f1ceb942800 20 add_watcher() i=7 2024-09-14T11:42:07.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.481+0000 7f1ceb942800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:07.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1ceb942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1ceb942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1ceb942800 5 note: GC not initialized 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1b9cfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1ceb942800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:07.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.483+0000 7f1ceb942800 20 Filter name: none 2024-09-14T11:42:07.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.484+0000 7f1b167fc640 20 reqs_thread_entry: start 2024-09-14T11:42:07.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.484+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.484+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:07.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.484+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:07.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.485+0000 7f1ceb942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:07.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.487+0000 7f1b9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:07.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.489+0000 7f1ceb942800 20 remove_watcher() i=0 2024-09-14T11:42:07.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.489+0000 7f1ceb942800 2 removed watcher, disabling cache 2024-09-14T11:42:07.489 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.491+0000 7f1ceb942800 20 remove_watcher() i=1 2024-09-14T11:42:07.491 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.492+0000 7f1ceb942800 20 remove_watcher() i=2 2024-09-14T11:42:07.492 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.493+0000 7f1ceb942800 20 remove_watcher() i=3 2024-09-14T11:42:07.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.494+0000 7f1ceb942800 20 remove_watcher() i=4 2024-09-14T11:42:07.494 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.496+0000 7f1ceb942800 20 remove_watcher() i=5 2024-09-14T11:42:07.495 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.497+0000 7f1ceb942800 20 remove_watcher() i=6 2024-09-14T11:42:07.496 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.498+0000 7f1ceb942800 20 remove_watcher() i=7 2024-09-14T11:42:07.507 INFO:tasks.workunit.client.0.smithi116.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:42:07.509 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:42:07.538 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:07.538 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:07.574 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.576+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 realm 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.577+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.578+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.578+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.579+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:07.578 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.579+0000 7f784abaf800 20 searching for the correct realm 2024-09-14T11:42:07.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.582+0000 7f7847e9f640 0 -- 172.21.15.116:0/2405639029 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x5596721ddd40 msgr2=0x5596721e01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.584 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.586+0000 7f78486a0640 0 -- 172.21.15.116:0/2405639029 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f783c07b7e0 msgr2=0x7f783c015770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.589 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.590+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 zone default found 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 4 Realm: () 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:07.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 zonegroup default 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.591+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.592+0000 7f784abaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.592+0000 7f784abaf800 20 started sync module instance, tier type = 2024-09-14T11:42:07.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.592+0000 7f784abaf800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:07.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=0 2024-09-14T11:42:07.599 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=1 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=2 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=3 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=4 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=5 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.600+0000 7f784abaf800 20 add_watcher() i=6 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.601+0000 7f784abaf800 20 add_watcher() i=7 2024-09-14T11:42:07.600 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.601+0000 7f784abaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:07.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f76fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f784abaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f784abaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f784abaf800 5 note: GC not initialized 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f76fdfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.603+0000 7f784abaf800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.604+0000 7f784abaf800 20 Filter name: none 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.604+0000 7f766f7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.604+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.604+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.604+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:07.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:07.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.605+0000 7f784abaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:07.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.607+0000 7f76fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:07.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.609+0000 7f784abaf800 20 remove_watcher() i=0 2024-09-14T11:42:07.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.609+0000 7f784abaf800 2 removed watcher, disabling cache 2024-09-14T11:42:07.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.610+0000 7f784abaf800 20 remove_watcher() i=1 2024-09-14T11:42:07.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.611+0000 7f784abaf800 20 remove_watcher() i=2 2024-09-14T11:42:07.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.612+0000 7f784abaf800 20 remove_watcher() i=3 2024-09-14T11:42:07.612 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.613+0000 7f784abaf800 20 remove_watcher() i=4 2024-09-14T11:42:07.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.614+0000 7f784abaf800 20 remove_watcher() i=5 2024-09-14T11:42:07.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.615+0000 7f784abaf800 20 remove_watcher() i=6 2024-09-14T11:42:07.615 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.616+0000 7f784abaf800 20 remove_watcher() i=7 2024-09-14T11:42:07.625 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.625 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:42:07.625 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:42:07.625 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.627 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:42:07.660 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:07.661 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:07.697 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.698+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 realm 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.699 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.701+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:07.700 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.701+0000 7efdda620800 20 searching for the correct realm 2024-09-14T11:42:07.704 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.705+0000 7efdd890b640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7efdc0036070 msgr2=0x7efdc0056940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.910 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.911+0000 7efdd810a640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x55b7003b0070 msgr2=0x55b7003b2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:07.913 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:07.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:07.914 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:07.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 zone default found 2024-09-14T11:42:07.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 4 Realm: () 2024-09-14T11:42:07.915 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 zonegroup default 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.916 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:07.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 started sync module instance, tier type = 2024-09-14T11:42:07.917 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.915+0000 7efdda620800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:07.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=0 2024-09-14T11:42:07.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=1 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=2 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=3 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=4 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=5 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=6 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.926+0000 7efdda620800 20 add_watcher() i=7 2024-09-14T11:42:07.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.926+0000 7efdda620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:07.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.927+0000 7efc8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:07.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:07.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:07.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 5 note: GC not initialized 2024-09-14T11:42:07.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efc8dfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:07.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 20 Filter name: none 2024-09-14T11:42:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efbff7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:07.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.928+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:07.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:07.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:07.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:07.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:07.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.929+0000 7efdda620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:07.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:07.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efdda620800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:07.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:07.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efdda620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:07.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94244471250704 notifier 8385 bl.length()=827 2024-09-14T11:42:07.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:07.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:07.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:07.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:07.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:07.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:07.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:07.942 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efdda620800 time 2024-09-14T11:42:07.945590+0000 2024-09-14T11:42:07.942 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:07.943 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:07.943 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efdddb8c76a] 2024-09-14T11:42:07.943 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:07.944 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:07.944 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:07.944 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:42:07.944 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:07.945 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:42:07.945 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:42:07.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.944+0000 7efdda620800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efdda620800 time 2024-09-14T11:42:07.945590+0000 2024-09-14T11:42:07.945 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:07.945 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efdddb8c76a] 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:42:07.946 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.947 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:42:07.947 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7efdda620800 thread_name:radosgw-admin 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efddc83e6f0] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efddc88b99c] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efdddb8c7c4] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:42:07.969 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:07.945+0000 7efdda620800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7efdda620800 thread_name:radosgw-admin 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efddc83e6f0] 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efddc88b99c] 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efdddb8c7c4] 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:07.970 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70016d5d0 auth_method 0 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient(hunting): handle_auth_done global_id 7751 payload 274 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient: _finish_hunting 0 2024-09-14T11:42:07.971 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:42:07.681+0000 7efdd7909640 1 monclient: found mon.noname-c 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: dump: 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.972 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: _finish_auth 0 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: _check_auth_tickets 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:42:07.681+0000 7efdda620800 5 monclient: authenticate success, global_id 7751 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: dump: 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.973 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:42:07.681+0000 7efdda620800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:42:07.681+0000 7efdda620800 4 set_mon_vals no callback set 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: shutdown 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:42:07.682+0000 7efdda620800 5 asok(0x55b7000a1270) unregister_commands rotate-key 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:42:07.682+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:07.974 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.975 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:42:07.682+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: starting msgr at 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: starting objecter 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:42:07.682+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests hook 0x55b7002ef6a0 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: setting wanted keys 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: calling monclient init 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.976 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:42:07.683+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:42:07.683+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:42:07.683+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key hook 0x55b7002c01b8 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:07.977 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70016d5d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b7001794c0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b700203550 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.290457s 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70016d5d0 auth_method 0 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b700203550 auth_method 0 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.978 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:07.979 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:42:07.683+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: dump: 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.980 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: _finish_auth 0 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: _check_auth_tickets 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: dump: 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.981 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:42:07.684+0000 7efdda620800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:42:07.684+0000 7efcc660c640 4 set_mon_vals no callback set 2024-09-14T11:42:07.982 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:42:07.684+0000 7efdda620800 1 librados: init done 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:42:07.686+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efcc0077260 auth_method 0 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:42:07.686+0000 7efdd890b640 10 monclient: get_auth_request con 0x55b7003021f0 auth_method 0 2024-09-14T11:42:07.983 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:42:07.687+0000 7efdd810a640 10 monclient: get_auth_request con 0x55b70030b9c0 auth_method 0 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:42:07.688+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b700310f00 auth_method 0 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:42:07.689+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.984 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.985 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:42:07.689+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:42:07.689+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55b700318350 EEXIST 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:07.986 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:07.987 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:42:07.689+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:42:07.690+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:42:07.690+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x55b700313e40 EEXIST 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70033c670 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b70033ca50 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b70033b380 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.297229s 2024-09-14T11:42:07.988 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70033c670 auth_method 0 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): get_auth_request con 0x55b70033ca50 auth_method 0 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:07.989 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:42:07.690+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: dump: 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.990 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: _finish_auth 0 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: dump: 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.991 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:42:07.690+0000 7efdda620800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:42:07.690+0000 7efdd910c640 4 set_mon_vals no callback set 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:42:07.693+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efcb0077140 auth_method 0 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: get_monmap_and_config 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:07.992 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:42:07.693+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:07.993 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:42:07.693+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:07.994 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:42:07.693+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:42:07.694+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:07.995 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:42:07.694+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x7ffde294def8 EEXIST 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b70038be20 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b70038c200 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b700391340 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.301155s 2024-09-14T11:42:07.996 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70038be20 auth_method 0 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b700391340 auth_method 0 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:07.997 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 7760 payload 274 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:42:07.694+0000 7efdd810a640 1 monclient: found mon.noname-c 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:42:07.694+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b70038c200 auth_method 0 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: dump: 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:07.998 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: dump: 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:07.999 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:42:07.694+0000 7efdda620800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:42:07.694+0000 7efdda620800 4 set_mon_vals no callback set 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: shutdown 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:08.000 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:42:07.695+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.001 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.002 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:42:07.695+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: starting msgr at 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: starting objecter 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:42:07.695+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55b700391c70 EEXIST 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: setting wanted keys 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: calling monclient init 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.003 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:42:07.696+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:42:07.696+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:42:07.696+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x55b700351078 EEXIST 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:08.004 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70038be20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b700391340 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b7003826a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.303319s 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70038be20 auth_method 0 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b7003826a0 auth_method 0 2024-09-14T11:42:08.005 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): get_auth_request con 0x55b700391340 auth_method 0 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.006 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:42:07.696+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: dump: 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.007 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: dump: 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.008 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:42:07.696+0000 7efdda620800 5 monclient: authenticate success, global_id 8385 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:42:07.696+0000 7efcaf7fe640 4 set_mon_vals no callback set 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:42:07.696+0000 7efdda620800 1 librados: init done 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:42:07.696+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cr dump hook 0x55b70038e828 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:42:07.698+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.009 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:42:07.699+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efca0077230 auth_method 0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:42:07.699+0000 7efdd890b640 10 monclient: get_auth_request con 0x55b7003abd00 auth_method 0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:42:07.700+0000 7efdda620800 20 realm 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:42:07.700+0000 7efdda620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:42:07.700+0000 7efdd810a640 10 monclient: get_auth_request con 0x55b7003b0070 auth_method 0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:08.010 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:42:07.701+0000 7efdda620800 20 searching for the correct realm 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:42:07.701+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b7003b51c0 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:42:07.702+0000 7efdd890b640 10 monclient: get_auth_request con 0x7efdc0044070 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:42:07.703+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efdd0064410 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:42:07.703+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efdc8044470 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:42:07.705+0000 7efdd890b640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7efdc0036070 msgr2=0x7efdc0056940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:42:07.906+0000 7efdd890b640 10 monclient: get_auth_request con 0x7efdc0036070 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:42:07.909+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efdc0037480 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:42:07.911+0000 7efdd810a640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x55b7003b0070 msgr2=0x55b7003b2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:42:07.911+0000 7efcadffb640 1 client.8385.objecter ms_handle_reset 0x55b7003b0070 session 0x55b7003aeef0 osd.5 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:42:07.911+0000 7efcadffb640 10 monclient: _renew_subs 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:42:07.911+0000 7efcadffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:42:07.911+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efca00870d0 auth_method 0 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:08.011 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:42:07.914+0000 7efdda620800 20 zone default found 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:42:07.914+0000 7efdda620800 4 Realm: () 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:42:07.914+0000 7efdda620800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:08.012 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:42:07.914+0000 7efdda620800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:42:07.914+0000 7efdda620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:42:07.914+0000 7efdda620800 20 zonegroup default 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:42:07.915+0000 7efdda620800 20 started sync module instance, tier type = 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:42:07.915+0000 7efdda620800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=0 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=1 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=2 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=3 2024-09-14T11:42:08.013 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=4 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=5 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=6 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:42:07.926+0000 7efdda620800 20 add_watcher() i=7 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:42:07.926+0000 7efdda620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.014 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:42:07.927+0000 7efc8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:42:07.928+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:08.015 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache list hook 0x55b70038a0c0 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache inspect hook 0x55b70038a0c0 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache erase hook 0x55b70038a0c0 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache zap hook 0x55b70038a0c0 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:42:07.928+0000 7efdda620800 5 note: GC not initialized 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:42:07.928+0000 7efc8dfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace show hook 0x7efdc8087050 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace history hook 0x7efdc8087050 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace active hook 0x7efdc8087050 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace active_short hook 0x7efdc8087050 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:42:07.928+0000 7efdda620800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:42:07.928+0000 7efdda620800 20 Filter name: none 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:42:07.928+0000 7efbff7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:42:07.928+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:08.016 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:42:07.929+0000 7efdda620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:08.017 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:42:07.935+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:42:07.935+0000 7efdda620800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:42:07.935+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:42:07.935+0000 7efdda620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94244471250704 notifier 8385 bl.length()=827 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:08.018 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:42:07.944+0000 7efdda620800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efdda620800 time 2024-09-14T11:42:07.945590+0000 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efdddb8c76a] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:42:08.019 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:42:07.945+0000 7efdda620800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7efdda620800 thread_name:radosgw-admin 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efddc83e6f0] 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efddc88b99c] 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:08.020 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efdddb8c7c4] 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:08.021 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:08.022 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:42:08.023 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:42:08.024 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:08.025 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:42:08.026 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:08.027 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:42:08.028 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efbff7fe640 / http_manager 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efc8dfdb640 / http_manager 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efc8efdd640 / rgw_dt_lg_renew 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcadffb640 / ms_dispatch 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcaf7fe640 / io_context_pool 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcbdffb640 / ms_dispatch 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcc4e09640 / ms_dispatch 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcc660c640 / io_context_pool 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd7909640 / msgr-worker-2 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd810a640 / msgr-worker-1 2024-09-14T11:42:08.029 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd890b640 / msgr-worker-0 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd910c640 / io_context_pool 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdda620800 / radosgw-admin 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.150826.log 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70016d5d0 auth_method 0 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:42:07.681+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.030 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient(hunting): handle_auth_done global_id 7751 payload 274 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:42:07.681+0000 7efdd7909640 1 monclient: found mon.noname-c 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:42:07.681+0000 7efdd7909640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: dump: 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.031 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:42:07.681+0000 7efdda620800 5 monclient: authenticate success, global_id 7751 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:42:07.681+0000 7efcc660c640 10 monclient: dump: 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.032 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:42:07.681+0000 7efdda620800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:42:07.681+0000 7efdda620800 4 set_mon_vals no callback set 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: shutdown 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:42:07.682+0000 7efdda620800 5 asok(0x55b7000a1270) unregister_commands rotate-key 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:08.033 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:42:07.682+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:08.034 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding auth protocol: cephx 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: crc 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c3650) adding con mode: secure 2024-09-14T11:42:08.035 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:42:07.682+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: starting msgr at 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: starting objecter 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:42:07.682+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests hook 0x55b7002ef6a0 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: setting wanted keys 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:42:07.682+0000 7efdda620800 1 librados: calling monclient init 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:42:07.682+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding auth protocol: cephx 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.036 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: crc 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:42:07.682+0000 7efdda620800 5 AuthRegistry(0x55b7002c0070) adding con mode: secure 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:42:07.683+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:42:07.683+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:42:07.683+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key hook 0x55b7002c01b8 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:08.037 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70016d5d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b7001794c0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b700203550 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:42:07.683+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.290457s 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70016d5d0 auth_method 0 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b700203550 auth_method 0 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.038 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:42:07.683+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8376 payload 824 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:42:07.683+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:42:07.683+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:08.039 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: dump: 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.040 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:42:07.684+0000 7efcc4e09640 10 monclient: dump: 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:42:07.684+0000 7efdda620800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:42:08.041 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:42:07.684+0000 7efcc660c640 4 set_mon_vals no callback set 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:42:07.684+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:42:07.684+0000 7efdda620800 1 librados: init done 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:42:07.685+0000 7efcc4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:42:07.686+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efcc0077260 auth_method 0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:42:07.686+0000 7efdd890b640 10 monclient: get_auth_request con 0x55b7003021f0 auth_method 0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:42:07.687+0000 7efdd810a640 10 monclient: get_auth_request con 0x55b70030b9c0 auth_method 0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:42:07.688+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b700310f00 auth_method 0 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:08.042 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:42:07.689+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding auth protocol: cephx 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.043 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: crc 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700314f10) adding con mode: secure 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:42:07.689+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:42:07.689+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55b700318350 EEXIST 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:42:07.689+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:08.044 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding auth protocol: cephx 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: crc 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:42:07.689+0000 7efdda620800 5 AuthRegistry(0x55b700313cf8) adding con mode: secure 2024-09-14T11:42:08.045 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:42:07.689+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:42:07.690+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:42:07.690+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x55b700313e40 EEXIST 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70033c670 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b70033ca50 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b70033b380 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.297229s 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70033c670 auth_method 0 2024-09-14T11:42:08.046 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): get_auth_request con 0x55b70033ca50 auth_method 0 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.047 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:42:07.690+0000 7efdd7909640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:42:07.690+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:42:07.690+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: dump: 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.048 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.049 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:42:07.690+0000 7efcbdffb640 10 monclient: dump: 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:42:07.690+0000 7efdda620800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:42:07.690+0000 7efdd910c640 4 set_mon_vals no callback set 2024-09-14T11:42:08.050 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:42:07.690+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:42:07.692+0000 7efcbdffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:42:07.693+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efcb0077140 auth_method 0 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: get_monmap_and_config 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:42:07.693+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:08.051 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:08.052 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding auth protocol: cephx 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.053 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: crc 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x55b70035c630) adding con mode: secure 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:42:07.693+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:42:07.693+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding auth protocol: cephx 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.054 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: crc 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:42:07.693+0000 7efdda620800 5 AuthRegistry(0x7ffde294ddb0) adding con mode: secure 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:42:07.693+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:42:07.694+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:42:07.694+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x7ffde294def8 EEXIST 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:08.055 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b70038be20 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b70038c200 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b700391340 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.301155s 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70038be20 auth_method 0 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.056 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b700391340 auth_method 0 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:42:07.694+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 7760 payload 274 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:42:07.694+0000 7efdd810a640 1 monclient: found mon.noname-c 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:42:07.694+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:08.057 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:42:07.694+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b70038c200 auth_method 0 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: dump: 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.058 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:42:07.694+0000 7efcaf7fe640 10 monclient: dump: 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.059 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:42:07.694+0000 7efdda620800 5 monclient: authenticate success, global_id 7760 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:42:07.694+0000 7efdda620800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:42:07.694+0000 7efdda620800 4 set_mon_vals no callback set 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: shutdown 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: build_initial_monmap 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:42:07.695+0000 7efdda620800 1 build_initial for_mkfs: 0 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: monmap: 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:08.060 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding auth protocol: cephx 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.061 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: crc 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b70014aa00) adding con mode: secure 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:42:07.695+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: starting msgr at 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: starting objecter 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:42:07.695+0000 7efdda620800 5 asok(0x55b7000a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55b700391c70 EEXIST 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: setting wanted keys 2024-09-14T11:42:08.062 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:42:07.695+0000 7efdda620800 1 librados: calling monclient init 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:42:07.695+0000 7efdda620800 10 monclient: init 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding auth protocol: cephx 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.063 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: crc 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:42:07.695+0000 7efdda620800 5 AuthRegistry(0x55b700350f30) adding con mode: secure 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:42:07.696+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:42:07.696+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:42:07.696+0000 7efdda620800 5 asok(0x55b7000a1270) register_command rotate-key cmddesc rotate-key hook 0x55b700351078 EEXIST 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-a con 0x55b70038be20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-b con 0x55b700391340 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): picked mon.noname-c con 0x55b7003826a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:08.064 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient(hunting): authenticate will time out at 2325.303319s 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): get_auth_request con 0x55b70038be20 auth_method 0 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): get_auth_request con 0x55b7003826a0 auth_method 0 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.065 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:42:07.696+0000 7efdd890b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): get_auth_request con 0x55b700391340 auth_method 0 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:42:07.696+0000 7efdd7909640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient: _finish_hunting 0 2024-09-14T11:42:08.066 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:42:07.696+0000 7efdd810a640 1 monclient: found mon.noname-a 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:42:07.696+0000 7efdd810a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: dump: 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.067 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: _finish_auth 0 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: _check_auth_tickets 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:42:07.696+0000 7efcadffb640 10 monclient: dump: 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:08.068 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:42:07.696+0000 7efdda620800 5 monclient: authenticate success, global_id 8385 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:42:07.696+0000 7efcaf7fe640 4 set_mon_vals no callback set 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _renew_subs 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:42:07.696+0000 7efdda620800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:42:07.696+0000 7efdda620800 1 librados: init done 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:42:07.696+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cr dump hook 0x55b70038e828 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:42:07.698+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:08.069 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:42:07.699+0000 7efcadffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:42:07.699+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efca0077230 auth_method 0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:42:07.699+0000 7efdd890b640 10 monclient: get_auth_request con 0x55b7003abd00 auth_method 0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:42:07.700+0000 7efdda620800 20 realm 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:42:07.700+0000 7efdda620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:42:07.700+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:42:07.700+0000 7efdd810a640 10 monclient: get_auth_request con 0x55b7003b0070 auth_method 0 2024-09-14T11:42:08.070 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:42:07.701+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:42:07.701+0000 7efdda620800 20 searching for the correct realm 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:42:07.701+0000 7efdd7909640 10 monclient: get_auth_request con 0x55b7003b51c0 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:42:07.702+0000 7efdd890b640 10 monclient: get_auth_request con 0x7efdc0044070 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:42:07.703+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efdd0064410 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:42:07.703+0000 7efdd7909640 10 monclient: get_auth_request con 0x7efdc8044470 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:42:07.705+0000 7efdd890b640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7efdc0036070 msgr2=0x7efdc0056940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:42:07.906+0000 7efdd890b640 10 monclient: get_auth_request con 0x7efdc0036070 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:42:07.909+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efdc0037480 auth_method 0 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:42:07.911+0000 7efdd810a640 0 -- 172.21.15.116:0/2419677682 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x55b7003b0070 msgr2=0x55b7003b2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:42:07.911+0000 7efcadffb640 1 client.8385.objecter ms_handle_reset 0x55b7003b0070 session 0x55b7003aeef0 osd.5 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:42:07.911+0000 7efcadffb640 10 monclient: _renew_subs 2024-09-14T11:42:08.071 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:42:07.911+0000 7efcadffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:42:07.911+0000 7efdd810a640 10 monclient: get_auth_request con 0x7efca00870d0 auth_method 0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:42:07.914+0000 7efdda620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:08.072 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:42:07.914+0000 7efdda620800 20 zone default found 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:42:07.914+0000 7efdda620800 4 Realm: () 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:42:07.914+0000 7efdda620800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:42:07.914+0000 7efdda620800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:42:07.914+0000 7efdda620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:42:07.914+0000 7efdda620800 20 zonegroup default 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:42:07.914+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:42:07.915+0000 7efdda620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:42:07.915+0000 7efdda620800 20 started sync module instance, tier type = 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:42:07.915+0000 7efdda620800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:08.073 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=0 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=1 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=2 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=3 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=4 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=5 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:42:07.925+0000 7efdda620800 20 add_watcher() i=6 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:42:07.926+0000 7efdda620800 20 add_watcher() i=7 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:42:07.926+0000 7efdda620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding auth protocol: cephx 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.074 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: crc 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:42:07.927+0000 7efdda620800 5 AuthRegistry(0x7ffde294e290) adding con mode: secure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:42:07.927+0000 7efc8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:42:07.928+0000 7efdda620800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache list hook 0x55b70038a0c0 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache inspect hook 0x55b70038a0c0 2024-09-14T11:42:08.075 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache erase hook 0x55b70038a0c0 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command cache zap hook 0x55b70038a0c0 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:42:07.928+0000 7efdda620800 5 note: GC not initialized 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:42:07.928+0000 7efc8dfdb640 20 reqs_thread_entry: start 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace show hook 0x7efdc8087050 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace history hook 0x7efdc8087050 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace active hook 0x7efdc8087050 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:42:07.928+0000 7efdda620800 5 asok(0x55b7000a1270) register_command sync trace active_short hook 0x7efdc8087050 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:42:07.928+0000 7efdda620800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:42:07.928+0000 7efdda620800 20 Filter name: none 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:42:07.928+0000 7efbff7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:42:07.928+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:42:07.928+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:08.076 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:42:07.929+0000 7efdda620800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:42:07.929+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:42:07.929+0000 7efdda620800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:42:07.929+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:42:07.929+0000 7efdda620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:42:07.935+0000 7efdda620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:42:07.935+0000 7efdda620800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:42:07.935+0000 7efdda620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:42:07.935+0000 7efdda620800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94244471250704 notifier 8385 bl.length()=827 2024-09-14T11:42:08.077 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:42:07.935+0000 7efcaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:42:07.937+0000 7efdda620800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:42:07.944+0000 7efdda620800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efdda620800 time 2024-09-14T11:42:07.945590+0000 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.078 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efdddb8c76a] 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:42:07.945+0000 7efdda620800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7efdda620800 thread_name:radosgw-admin 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.079 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efddc83e6f0] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efddc88b99c] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efdddb8c7c4] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efdddb8c928] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b6fedad0b1] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55b6fedbcf6a] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efddc829590] 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:08.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:42:08.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:42:08.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:08.083 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:42:08.084 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:08.085 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:08.086 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:08.087 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efbff7fe640 / http_manager 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efc8dfdb640 / http_manager 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efc8efdd640 / rgw_dt_lg_renew 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcadffb640 / ms_dispatch 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcaf7fe640 / io_context_pool 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcbdffb640 / ms_dispatch 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcc4e09640 / ms_dispatch 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efcc660c640 / io_context_pool 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd7909640 / msgr-worker-2 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd810a640 / msgr-worker-1 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd890b640 / msgr-worker-0 2024-09-14T11:42:08.088 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdd910c640 / io_context_pool 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr: 7efdda620800 / radosgw-admin 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:42:07.947022Z_700ff6ff-8e56-4d7d-8ba5-40428924ec45/log 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:42:08.089 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.019+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 realm 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.021+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.022+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.022+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.022+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.022+0000 7f57ff520800 20 searching for the correct realm 2024-09-14T11:42:08.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.026+0000 7f57fb903640 0 -- 172.21.15.116:0/1505722663 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f57e401e040 msgr2=0x7f57e4071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:08.232 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.233+0000 7f57fb102640 0 -- 172.21.15.116:0/1505722663 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x55d49b5e0710 msgr2=0x55d49b5e2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.235 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.235+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.236 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 zone default found 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 4 Realm: () 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:08.237 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 zonegroup default 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.236+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.237+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.237+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.237+0000 7f57ff520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.237+0000 7f57ff520800 20 started sync module instance, tier type = 2024-09-14T11:42:08.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.237+0000 7f57ff520800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=0 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=1 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=2 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=3 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=4 2024-09-14T11:42:08.245 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=5 2024-09-14T11:42:08.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.246+0000 7f57ff520800 20 add_watcher() i=6 2024-09-14T11:42:08.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.247+0000 7f57ff520800 20 add_watcher() i=7 2024-09-14T11:42:08.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.247+0000 7f57ff520800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:08.247 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.248+0000 7f56b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.248 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 5 note: GC not initialized 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f56b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 20 Filter name: none 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f562a7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:08.249 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.249+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.250+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:08.250 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.250+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.251 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:08.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.251+0000 7f57ff520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:08.252 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.253+0000 7f56b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.255+0000 7f57ff520800 20 remove_watcher() i=0 2024-09-14T11:42:08.254 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.255+0000 7f57ff520800 2 removed watcher, disabling cache 2024-09-14T11:42:08.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.256+0000 7f57ff520800 20 remove_watcher() i=1 2024-09-14T11:42:08.256 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.257+0000 7f57ff520800 20 remove_watcher() i=2 2024-09-14T11:42:08.257 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.258+0000 7f57ff520800 20 remove_watcher() i=3 2024-09-14T11:42:08.258 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.260+0000 7f57ff520800 20 remove_watcher() i=4 2024-09-14T11:42:08.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.261+0000 7f57ff520800 20 remove_watcher() i=5 2024-09-14T11:42:08.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.262+0000 7f57ff520800 20 remove_watcher() i=6 2024-09-14T11:42:08.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.263+0000 7f57ff520800 20 remove_watcher() i=7 2024-09-14T11:42:08.309 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:42:08.338 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:08.338 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:08.375 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.376+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 realm 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.377 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.377+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.378+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.378+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.378+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:08.378 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.378+0000 7fa62da0f800 20 searching for the correct realm 2024-09-14T11:42:08.380 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.382+0000 7fa629993640 0 -- 172.21.15.116:0/4091518551 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fa61407bb60 msgr2=0x7fa614086410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.384 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.385+0000 7fa629192640 0 -- 172.21.15.116:0/4091518551 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa614086920 msgr2=0x7fa6140793e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.590 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.591 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.591+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 zone default found 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 4 Realm: () 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 zonegroup default 2024-09-14T11:42:08.592 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 started sync module instance, tier type = 2024-09-14T11:42:08.593 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.592+0000 7fa62da0f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=0 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=1 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=2 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=3 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=4 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=5 2024-09-14T11:42:08.601 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.602+0000 7fa62da0f800 20 add_watcher() i=6 2024-09-14T11:42:08.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.603+0000 7fa62da0f800 20 add_watcher() i=7 2024-09-14T11:42:08.602 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.603+0000 7fa62da0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:08.604 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa4dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa62da0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa62da0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa62da0f800 5 note: GC not initialized 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa4defe5640 20 reqs_thread_entry: start 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa62da0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.605+0000 7fa62da0f800 20 Filter name: none 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa4dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:08.605 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:08.606 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.606+0000 7fa62da0f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:08.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:08.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:08.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:08.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:08.607 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.607+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:08.608 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.608+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:08.609 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.609+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.610+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.610+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.610+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.610+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.611+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.611+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.611+0000 7fa62da0f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:08.610 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.611+0000 7fa62da0f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:08.611 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.612+0000 7fa4dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:08.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.615+0000 7fa62da0f800 20 remove_watcher() i=0 2024-09-14T11:42:08.613 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.615+0000 7fa62da0f800 2 removed watcher, disabling cache 2024-09-14T11:42:08.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.616+0000 7fa62da0f800 20 remove_watcher() i=1 2024-09-14T11:42:08.616 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.617+0000 7fa62da0f800 20 remove_watcher() i=2 2024-09-14T11:42:08.617 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.618+0000 7fa62da0f800 20 remove_watcher() i=3 2024-09-14T11:42:08.618 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.619+0000 7fa62da0f800 20 remove_watcher() i=4 2024-09-14T11:42:08.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.620+0000 7fa62da0f800 20 remove_watcher() i=5 2024-09-14T11:42:08.620 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.621+0000 7fa62da0f800 20 remove_watcher() i=6 2024-09-14T11:42:08.621 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:08.622+0000 7fa62da0f800 20 remove_watcher() i=7 2024-09-14T11:42:38.664 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:42:38.701 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:38.701 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:38.743 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.745+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 realm 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.745 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:38.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.748+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.746 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:38.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.748+0000 7f230402f800 20 searching for the correct realm 2024-09-14T11:42:38.749 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.751+0000 7f230131f640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f22f40880b0 msgr2=0x7f22f4060e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:38.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.756+0000 7f2301b20640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f22f8017040 msgr2=0x7f22f806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 zone default found 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 4 Realm: () 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:38.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 zonegroup default 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.965+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.965+0000 7f230402f800 20 started sync module instance, tier type = 2024-09-14T11:42:38.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.965+0000 7f230402f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:38.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=0 2024-09-14T11:42:38.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=1 2024-09-14T11:42:38.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=2 2024-09-14T11:42:38.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=3 2024-09-14T11:42:38.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=4 2024-09-14T11:42:38.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=5 2024-09-14T11:42:38.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=6 2024-09-14T11:42:38.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.976+0000 7f230402f800 20 add_watcher() i=7 2024-09-14T11:42:38.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.976+0000 7f230402f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:38.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f21b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:38.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:38.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:38.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f230402f800 5 note: GC not initialized 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f21b27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f230402f800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.978+0000 7f230402f800 20 Filter name: none 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f2123fff640 20 reqs_thread_entry: start 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:38.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:38.979 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.980+0000 7f230402f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:38.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.981+0000 7f230402f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:42:38.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.988+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:38.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.988+0000 7f230402f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:38.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.988+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:38.986 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.988+0000 7f230402f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:38.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94357256947936 notifier 8442 bl.length()=827 2024-09-14T11:42:38.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:38.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:38.987 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:38.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:38.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:38.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:38.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:38.992 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f230402f800 time 2024-09-14T11:42:38.995744+0000 2024-09-14T11:42:38.993 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:38.993 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f230758c76a] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:42:38.994 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f230402f800 thread_name:radosgw-admin 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.995+0000 7f230402f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f230402f800 time 2024-09-14T11:42:38.995744+0000 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f230758c76a] 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:38.995 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:42:38.996 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.019 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.019 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f230623e6f0] 2024-09-14T11:42:39.019 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f230628b99c] 2024-09-14T11:42:39.019 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:39.019 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f230758c7c4] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:38.996+0000 7f230402f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:39.020 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f230402f800 thread_name:radosgw-admin 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f230623e6f0] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f230628b99c] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f230758c7c4] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.021 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:42:38.726+0000 7f230402f800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:39.022 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:42:38.726+0000 7f230402f800 4 set_mon_vals no callback set 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: dump: 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.023 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: shutdown 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:42:38.727+0000 7f230402f800 5 asok(0x55d14296c270) unregister_commands rotate-key 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:42:38.727+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.024 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.025 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:42:38.727+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:42:38.727+0000 7f230402f800 1 librados: starting msgr at 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:42:38.727+0000 7f230402f800 1 librados: starting objecter 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:42:38.728+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests hook 0x55d142b90bd0 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:42:38.728+0000 7f230402f800 1 librados: setting wanted keys 2024-09-14T11:42:39.026 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:42:38.728+0000 7f230402f800 1 librados: calling monclient init 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.027 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:42:38.728+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:42:38.728+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:42:38.728+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key hook 0x55d142b8c298 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142a39ba0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142a40880 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.028 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142a444c0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.334713s 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142a39ba0 auth_method 0 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142a444c0 auth_method 0 2024-09-14T11:42:39.029 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:42:38.729+0000 7f2301b20640 1 monclient: found mon.noname-c 2024-09-14T11:42:39.030 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:42:38.729+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142a40880 auth_method 0 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: dump: 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.031 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: dump: 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.032 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:42:38.729+0000 7f230402f800 5 monclient: authenticate success, global_id 7802 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:42:38.729+0000 7f21efe07640 4 set_mon_vals no callback set 2024-09-14T11:42:39.033 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:42:38.729+0000 7f230402f800 1 librados: init done 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:42:38.731+0000 7f230131f640 10 monclient: get_auth_request con 0x7f21e8077230 auth_method 0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:42:38.732+0000 7f2302321640 10 monclient: get_auth_request con 0x55d142bb4bc0 auth_method 0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:42:38.733+0000 7f2301b20640 10 monclient: get_auth_request con 0x55d142bd7c10 auth_method 0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:42:38.734+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142bdb440 auth_method 0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:42:38.735+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.034 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.035 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.036 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:42:38.735+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:42:38.735+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests cmddesc objecter_requests hook 0x55d142be4480 EEXIST 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.037 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:42:38.736+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:42:38.736+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:42:38.736+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x55d142bdff10 EEXIST 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c087a0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.038 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c08b80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c074b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.342553s 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c08b80 auth_method 0 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142c074b0 auth_method 0 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.039 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c087a0 auth_method 0 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.040 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8436 payload 824 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:42:38.737+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:42:38.737+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:42:38.737+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: dump: 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.041 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:42:38.737+0000 7f230402f800 5 monclient: authenticate success, global_id 8436 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.042 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: dump: 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.043 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:42:38.737+0000 7f2302b22640 4 set_mon_vals no callback set 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:42:38.739+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f21dc077140 auth_method 0 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: get_monmap_and_config 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:42:38.739+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.044 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.045 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.046 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.047 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:42:38.740+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x7ffebc416518 EEXIST 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c5ccb0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c2dcc0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.048 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c58190 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.346872s 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:42:38.740+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c2dcc0 auth_method 0 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142c58190 auth_method 0 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.049 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c5ccb0 auth_method 0 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.050 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8439 payload 274 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:42:38.741+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: dump: 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.051 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.052 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: dump: 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:42:38.741+0000 7f230402f800 5 monclient: authenticate success, global_id 8439 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:42:38.741+0000 7f230402f800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:39.053 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:42:38.741+0000 7f230402f800 4 set_mon_vals no callback set 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: shutdown 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:42:38.742+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.054 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.055 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:42:38.742+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: starting msgr at 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: starting objecter 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:42:38.742+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests cmddesc objecter_requests hook 0x55d142c2cad0 EEXIST 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: setting wanted keys 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: calling monclient init 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.056 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.057 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:42:38.742+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:42:38.743+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:42:38.743+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x55d142c1d1a8 EEXIST 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c2dcc0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c58190 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c5ccb0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.058 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.349281s 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c2dcc0 auth_method 0 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c58190 auth_method 0 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.059 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8442 payload 824 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:42:38.743+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: dump: 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.060 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.061 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: dump: 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:42:38.743+0000 7f230402f800 5 monclient: authenticate success, global_id 8442 2024-09-14T11:42:39.062 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:42:38.743+0000 7f21e57fa640 4 set_mon_vals no callback set 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:42:38.744+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:42:38.744+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:42:38.744+0000 7f230402f800 1 librados: init done 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:42:38.744+0000 7f230402f800 5 asok(0x55d14296c270) register_command cr dump hook 0x55d142c52ae8 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:42:38.745+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:42:38.746+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f21cc077260 auth_method 0 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:42:38.746+0000 7f2302321640 10 monclient: get_auth_request con 0x55d142c76860 auth_method 0 2024-09-14T11:42:39.063 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:42:38.747+0000 7f230402f800 20 realm 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:42:38.747+0000 7f230402f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:42:38.747+0000 7f2301b20640 10 monclient: get_auth_request con 0x55d142c7ac60 auth_method 0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:42:38.748+0000 7f230402f800 20 searching for the correct realm 2024-09-14T11:42:39.064 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:42:38.749+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142c7fdb0 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:42:38.749+0000 7f2302321640 10 monclient: get_auth_request con 0x7f22f8089070 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:42:38.750+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22fc078040 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:42:38.751+0000 7f230131f640 10 monclient: get_auth_request con 0x7f22f40880b0 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:42:38.751+0000 7f230131f640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f22f40880b0 msgr2=0x7f22f4060e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:42:38.751+0000 7f21d37fe640 1 client.8442.objecter ms_handle_reset 0x7f22f40880b0 session 0x7f22f4084040 osd.4 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:42:38.752+0000 7f21d37fe640 10 monclient: _renew_subs 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:42:38.752+0000 7f21d37fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:42:38.752+0000 7f230131f640 10 monclient: get_auth_request con 0x7f21cc087100 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:42:38.753+0000 7f2302321640 10 monclient: get_auth_request con 0x7f22f803b070 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:42:38.755+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f8017040 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:42:38.756+0000 7f2301b20640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f22f8017040 msgr2=0x7f22f806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:42:38.957+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f8017040 auth_method 0 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:39.065 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:42:38.964+0000 7f230402f800 20 zone default found 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:42:38.964+0000 7f230402f800 4 Realm: () 2024-09-14T11:42:39.066 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:42:38.964+0000 7f230402f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:42:38.964+0000 7f230402f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:42:38.964+0000 7f230402f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:42:38.964+0000 7f230402f800 20 zonegroup default 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:42:38.965+0000 7f230402f800 20 started sync module instance, tier type = 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:42:38.965+0000 7f230402f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:42:38.970+0000 7f21d37fe640 1 client.8442.objecter ms_handle_reset 0x7f22fc078040 session 0x7f22fc06f040 osd.2 2024-09-14T11:42:39.067 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:42:38.970+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f40880b0 auth_method 0 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=0 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=1 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=2 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=3 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=4 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=5 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=6 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:42:38.976+0000 7f230402f800 20 add_watcher() i=7 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:42:38.976+0000 7f230402f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.068 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:42:38.978+0000 7f21b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.069 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:42:38.978+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache list hook 0x55d142c52050 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache inspect hook 0x55d142c52050 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache erase hook 0x55d142c52050 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache zap hook 0x55d142c52050 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:42:38.978+0000 7f230402f800 5 note: GC not initialized 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:42:38.978+0000 7f21b27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace show hook 0x7f22f4066040 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace history hook 0x7f22f4066040 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace active hook 0x7f22f4066040 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace active_short hook 0x7f22f4066040 2024-09-14T11:42:39.070 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:42:38.978+0000 7f230402f800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:42:38.978+0000 7f230402f800 20 Filter name: none 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:42:38.979+0000 7f2123fff640 20 reqs_thread_entry: start 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:42:38.979+0000 7f230402f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:42:38.980+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:39.071 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:42:38.980+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:42:38.980+0000 7f230402f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:42:38.980+0000 7f230402f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:42:38.981+0000 7f230402f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:42:38.988+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:42:38.988+0000 7f230402f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:42:38.988+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:42:38.988+0000 7f230402f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94357256947936 notifier 8442 bl.length()=827 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.072 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:42:38.995+0000 7f230402f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f230402f800 time 2024-09-14T11:42:38.995744+0000 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f230758c76a] 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.073 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:42:38.996+0000 7f230402f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f230402f800 thread_name:radosgw-admin 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f230623e6f0] 2024-09-14T11:42:39.074 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f230628b99c] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f230758c7c4] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:39.075 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:39.076 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:42:39.077 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:42:39.078 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:39.079 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:42:39.080 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:42:39.081 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:42:39.082 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2123fff640 / http_manager 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21b27fc640 / http_manager 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21b37fe640 / rgw_dt_lg_renew 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21d37fe640 / ms_dispatch 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e4ff9640 / io_context_pool 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e57fa640 / io_context_pool 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e77fe640 / ms_dispatch 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21ee604640 / ms_dispatch 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21efe07640 / io_context_pool 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f230131f640 / msgr-worker-2 2024-09-14T11:42:39.083 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2301b20640 / msgr-worker-1 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2302321640 / msgr-worker-0 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2302b22640 / io_context_pool 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: 7f230402f800 / radosgw-admin 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.152593.log 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:42:38.726+0000 7f230402f800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:42:38.726+0000 7f230402f800 4 set_mon_vals no callback set 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.084 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:42:38.726+0000 7f21efe07640 10 monclient: dump: 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.085 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: shutdown 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:42:38.727+0000 7f230402f800 5 asok(0x55d14296c270) unregister_commands rotate-key 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:42:38.727+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:42:38.727+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.086 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding auth protocol: cephx 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: crc 2024-09-14T11:42:39.087 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:42:38.727+0000 7f230402f800 5 AuthRegistry(0x55d142b91e00) adding con mode: secure 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:42:38.727+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:42:38.727+0000 7f230402f800 1 librados: starting msgr at 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:42:38.727+0000 7f230402f800 1 librados: starting objecter 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:42:38.728+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests hook 0x55d142b90bd0 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:42:38.728+0000 7f230402f800 1 librados: setting wanted keys 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:42:38.728+0000 7f230402f800 1 librados: calling monclient init 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding auth protocol: cephx 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.088 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: crc 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:42:38.728+0000 7f230402f800 5 AuthRegistry(0x55d142b8c150) adding con mode: secure 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:42:38.728+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:42:38.728+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:42:38.728+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key hook 0x55d142b8c298 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:42:39.089 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142a39ba0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142a40880 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142a444c0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:42:38.728+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.334713s 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142a39ba0 auth_method 0 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142a444c0 auth_method 0 2024-09-14T11:42:39.090 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:42:38.728+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:42:38.728+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:42:38.729+0000 7f2301b20640 1 monclient: found mon.noname-c 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:42:38.729+0000 7f2301b20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.091 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:42:38.729+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142a40880 auth_method 0 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: dump: 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.092 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:42:38.729+0000 7f21ee604640 10 monclient: dump: 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.093 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:42:38.729+0000 7f230402f800 5 monclient: authenticate success, global_id 7802 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:42:38.729+0000 7f21efe07640 4 set_mon_vals no callback set 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:42:38.729+0000 7f230402f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:42:38.729+0000 7f230402f800 1 librados: init done 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:42:38.731+0000 7f21ee604640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:42:38.731+0000 7f230131f640 10 monclient: get_auth_request con 0x7f21e8077230 auth_method 0 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:42:38.732+0000 7f2302321640 10 monclient: get_auth_request con 0x55d142bb4bc0 auth_method 0 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:42:38.733+0000 7f2301b20640 10 monclient: get_auth_request con 0x55d142bd7c10 auth_method 0 2024-09-14T11:42:39.094 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:42:38.734+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142bdb440 auth_method 0 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:42:38.735+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.095 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding auth protocol: cephx 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.096 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: crc 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142be0fe0) adding con mode: secure 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:42:38.735+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:42:38.735+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests cmddesc objecter_requests hook 0x55d142be4480 EEXIST 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:42:38.735+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding auth protocol: cephx 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.097 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: crc 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:42:38.735+0000 7f230402f800 5 AuthRegistry(0x55d142bdfdc8) adding con mode: secure 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:42:38.736+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:42:38.736+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:42:38.736+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x55d142bdff10 EEXIST 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c087a0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c08b80 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.098 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c074b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:42:38.736+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.342553s 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c08b80 auth_method 0 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142c074b0 auth_method 0 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.099 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:42:38.736+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c087a0 auth_method 0 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.100 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:42:38.736+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:42:38.736+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8436 payload 824 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:42:38.737+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:42:38.737+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:42:38.737+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: dump: 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.101 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:42:38.737+0000 7f230402f800 5 monclient: authenticate success, global_id 8436 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.102 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:42:38.737+0000 7f21e77fe640 10 monclient: dump: 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:42:38.737+0000 7f2302b22640 4 set_mon_vals no callback set 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:42:38.737+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.103 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:42:38.739+0000 7f21e77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:42:38.739+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f21dc077140 auth_method 0 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: get_monmap_and_config 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:42:38.739+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:42:38.739+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.104 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding auth protocol: cephx 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.105 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: crc 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:42:38.739+0000 7f230402f800 5 AuthRegistry(0x55d142c28650) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding auth protocol: cephx 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.106 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: crc 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:42:38.740+0000 7f230402f800 5 AuthRegistry(0x7ffebc4163d0) adding con mode: secure 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:42:38.740+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:42:38.740+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x7ffebc416518 EEXIST 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c5ccb0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c2dcc0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.107 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c58190 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:42:38.740+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.346872s 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:42:38.740+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c2dcc0 auth_method 0 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): get_auth_request con 0x55d142c58190 auth_method 0 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.108 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c5ccb0 auth_method 0 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:42:38.741+0000 7f2302321640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:42:38.741+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8439 payload 274 2024-09-14T11:42:39.109 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:42:38.741+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:42:38.741+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: dump: 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.110 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:42:38.741+0000 7f21e57fa640 10 monclient: dump: 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.111 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:42:38.741+0000 7f230402f800 5 monclient: authenticate success, global_id 8439 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:42:38.741+0000 7f230402f800 10 monclient: get_monmap_and_config success 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:42:38.741+0000 7f230402f800 4 set_mon_vals no callback set 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: shutdown 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: build_initial_monmap 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:42:38.742+0000 7f230402f800 1 build_initial for_mkfs: 0 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: monmap: 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:42:39.112 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding auth protocol: cephx 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.113 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: crc 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c4eeb0) adding con mode: secure 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:42:38.742+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: starting msgr at 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: starting objecter 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:42:38.742+0000 7f230402f800 5 asok(0x55d14296c270) register_command objecter_requests cmddesc objecter_requests hook 0x55d142c2cad0 EEXIST 2024-09-14T11:42:39.114 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: setting wanted keys 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:42:38.742+0000 7f230402f800 1 librados: calling monclient init 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:42:38.742+0000 7f230402f800 10 monclient: init 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding auth protocol: cephx 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.115 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: crc 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:42:38.742+0000 7f230402f800 5 AuthRegistry(0x55d142c1d060) adding con mode: secure 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:42:38.742+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:42:38.743+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:42:38.743+0000 7f230402f800 5 asok(0x55d14296c270) register_command rotate-key cmddesc rotate-key hook 0x55d142c1d1a8 EEXIST 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _reopen_session rank -1 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-c con 0x55d142c2dcc0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-a con 0x55d142c58190 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): picked mon.noname-b con 0x55d142c5ccb0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): _renew_subs 2024-09-14T11:42:39.116 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient(hunting): authenticate will time out at 2356.349281s 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): get_auth_request con 0x55d142c2dcc0 auth_method 0 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): get_auth_request con 0x55d142c58190 auth_method 0 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:42:38.743+0000 7f2301b20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:42:39.117 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient(hunting): handle_auth_done global_id 8442 payload 824 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient: _finish_hunting 0 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:42:38.743+0000 7f230131f640 1 monclient: found mon.noname-a 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:42:38.743+0000 7f230131f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: dump: 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.118 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: _finish_auth 0 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:42:38.743+0000 7f21d37fe640 10 monclient: dump: 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:42:39.119 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:42:38.743+0000 7f230402f800 5 monclient: authenticate success, global_id 8442 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:42:38.743+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:42:38.743+0000 7f21e57fa640 4 set_mon_vals no callback set 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:42:38.744+0000 7f230402f800 10 monclient: _renew_subs 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:42:38.744+0000 7f230402f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:42:38.744+0000 7f230402f800 1 librados: init done 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:42:38.744+0000 7f230402f800 5 asok(0x55d14296c270) register_command cr dump hook 0x55d142c52ae8 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:42:38.745+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.120 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:42:38.745+0000 7f21d37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:42:38.746+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f21cc077260 auth_method 0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:42:38.746+0000 7f2302321640 10 monclient: get_auth_request con 0x55d142c76860 auth_method 0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:42:38.747+0000 7f230402f800 20 realm 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:42:38.747+0000 7f230402f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:42:38.747+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:42:38.747+0000 7f2301b20640 10 monclient: get_auth_request con 0x55d142c7ac60 auth_method 0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.121 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:42:38.748+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:42:38.748+0000 7f230402f800 20 searching for the correct realm 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:42:38.749+0000 7f230131f640 10 monclient: get_auth_request con 0x55d142c7fdb0 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:42:38.749+0000 7f2302321640 10 monclient: get_auth_request con 0x7f22f8089070 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:42:38.750+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22fc078040 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:42:38.751+0000 7f230131f640 10 monclient: get_auth_request con 0x7f22f40880b0 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:42:38.751+0000 7f230131f640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f22f40880b0 msgr2=0x7f22f4060e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:42:38.751+0000 7f21d37fe640 1 client.8442.objecter ms_handle_reset 0x7f22f40880b0 session 0x7f22f4084040 osd.4 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:42:38.752+0000 7f21d37fe640 10 monclient: _renew_subs 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:42:38.752+0000 7f21d37fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:42:38.752+0000 7f230131f640 10 monclient: get_auth_request con 0x7f21cc087100 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:42:38.753+0000 7f2302321640 10 monclient: get_auth_request con 0x7f22f803b070 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:42:38.755+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f8017040 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:42:38.756+0000 7f2301b20640 0 -- 172.21.15.116:0/3020590820 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f22f8017040 msgr2=0x7f22f806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:42:38.957+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f8017040 auth_method 0 2024-09-14T11:42:39.122 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:42:38.963+0000 7f230402f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:42:38.963+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:42:38.964+0000 7f230402f800 20 zone default found 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:42:38.964+0000 7f230402f800 4 Realm: () 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:42:38.964+0000 7f230402f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:39.123 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:42:38.964+0000 7f230402f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:42:38.964+0000 7f230402f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:42:38.964+0000 7f230402f800 20 zonegroup default 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:42:38.964+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:42:38.965+0000 7f230402f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:42:38.965+0000 7f230402f800 20 started sync module instance, tier type = 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:42:38.965+0000 7f230402f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:42:38.970+0000 7f21d37fe640 1 client.8442.objecter ms_handle_reset 0x7f22fc078040 session 0x7f22fc06f040 osd.2 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:42:38.970+0000 7f2301b20640 10 monclient: get_auth_request con 0x7f22f40880b0 auth_method 0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=0 2024-09-14T11:42:39.124 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=1 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=2 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=3 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=4 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=5 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:42:38.975+0000 7f230402f800 20 add_watcher() i=6 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:42:38.976+0000 7f230402f800 20 add_watcher() i=7 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:42:38.976+0000 7f230402f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding auth protocol: cephx 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.125 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:42:38.978+0000 7f21b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: crc 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:42:38.978+0000 7f230402f800 5 AuthRegistry(0x7ffebc4168b0) adding con mode: secure 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:42:38.978+0000 7f230402f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:42:38.978+0000 7f230402f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache list hook 0x55d142c52050 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache inspect hook 0x55d142c52050 2024-09-14T11:42:39.126 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache erase hook 0x55d142c52050 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command cache zap hook 0x55d142c52050 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:42:38.978+0000 7f230402f800 5 note: GC not initialized 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:42:38.978+0000 7f21b27fc640 20 reqs_thread_entry: start 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace show hook 0x7f22f4066040 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace history hook 0x7f22f4066040 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace active hook 0x7f22f4066040 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:42:38.978+0000 7f230402f800 5 asok(0x55d14296c270) register_command sync trace active_short hook 0x7f22f4066040 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:42:38.978+0000 7f230402f800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:42:38.978+0000 7f230402f800 20 Filter name: none 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:42:38.979+0000 7f2123fff640 20 reqs_thread_entry: start 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:39.127 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:42:38.979+0000 7f230402f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:42:38.979+0000 7f230402f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:42:38.979+0000 7f230402f800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:42:38.980+0000 7f230402f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:42:38.980+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:42:38.980+0000 7f230402f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:42:38.980+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:42:38.980+0000 7f230402f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:42:38.981+0000 7f230402f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:42:38.988+0000 7f230402f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:42:38.988+0000 7f230402f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:42:38.988+0000 7f230402f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:42:38.988+0000 7f230402f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:42:39.128 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94357256947936 notifier 8442 bl.length()=827 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:42:38.989+0000 7f21e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:42:38.991+0000 7f230402f800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:42:38.995+0000 7f230402f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f230402f800 time 2024-09-14T11:42:38.995744+0000 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f230758c76a] 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.129 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 4: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 6: main() 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 8: __libc_start_main() 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 9: _start() 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:42:38.996+0000 7f230402f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f230402f800 thread_name:radosgw-admin 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f230623e6f0] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f230628b99c] 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:42:39.130 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f230758c7c4] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f230758c928] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d1406af0b1] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 8: radosgw-admin(+0xd8907c) [0x55d140bc307c] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d1406beefd] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 10: main() 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2306229590] 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 12: __libc_start_main() 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 13: _start() 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:42:39.131 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:42:39.132 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:42:39.133 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:42:39.134 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:42:39.135 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:42:39.136 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2123fff640 / http_manager 2024-09-14T11:42:39.137 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21b27fc640 / http_manager 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21b37fe640 / rgw_dt_lg_renew 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21d37fe640 / ms_dispatch 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e4ff9640 / io_context_pool 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e57fa640 / io_context_pool 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21e77fe640 / ms_dispatch 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21ee604640 / ms_dispatch 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f21efe07640 / io_context_pool 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f230131f640 / msgr-worker-2 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2301b20640 / msgr-worker-1 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2302321640 / msgr-worker-0 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f2302b22640 / io_context_pool 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: 7f230402f800 / radosgw-admin 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:42:39.138 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:42:38.997421Z_18da7a95-d932-45de-9518-1bfd8ae97fea/log 2024-09-14T11:42:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:42:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.072+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.073+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.073+0000 7fb24e72c800 20 realm 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.073+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.074+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.074+0000 7fb24e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:39.145 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.074+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.074+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.074+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.075+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.075+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.075+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.075+0000 7fb24e72c800 20 searching for the correct realm 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.079+0000 7fb24ab3f640 0 -- 172.21.15.116:0/2358775695 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x56398cca2db0 msgr2=0x56398cca5220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.082+0000 7fb249b3d640 0 -- 172.21.15.116:0/2358775695 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fb23c06ddf0 msgr2=0x7fb23c083a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.086+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 zone default found 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 4 Realm: () 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 zonegroup default 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.087+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.147 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 started sync module instance, tier type = 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.088+0000 7fb24e72c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=0 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=1 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=2 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=3 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=4 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=5 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.097+0000 7fb24e72c800 20 add_watcher() i=6 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.098+0000 7fb24e72c800 20 add_watcher() i=7 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.098+0000 7fb24e72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:39.148 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb100fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 5 note: GC not initialized 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb07b7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 20 Filter name: none 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb0797fa640 20 reqs_thread_entry: start 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.100+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:42:39.149 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.101+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.102+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.102+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.102+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.102+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:39.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.103+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.104+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.104+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.104+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.104+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.105+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.106+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.106+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:42:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.106+0000 7fb24e72c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.106+0000 7fb24e72c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.107+0000 7fb100fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.109+0000 7fb24e72c800 20 remove_watcher() i=0 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.109+0000 7fb24e72c800 2 removed watcher, disabling cache 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.110+0000 7fb24e72c800 20 remove_watcher() i=1 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.112+0000 7fb24e72c800 20 remove_watcher() i=2 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.113+0000 7fb24e72c800 20 remove_watcher() i=3 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.114+0000 7fb24e72c800 20 remove_watcher() i=4 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.115+0000 7fb24e72c800 20 remove_watcher() i=5 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.116+0000 7fb24e72c800 20 remove_watcher() i=6 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:42:39.117+0000 7fb24e72c800 20 remove_watcher() i=7 2024-09-14T11:42:39.152 INFO:tasks.workunit.client.0.smithi116.stderr: test: duplicated entries can be purged manually 2024-09-14T11:43:09.157 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:43:09.189 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:09.189 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:09.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.232+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 realm 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:09.233 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.234+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.235+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.235+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.236+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:09.234 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.236+0000 7f3148e0f800 20 searching for the correct realm 2024-09-14T11:43:09.238 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.239+0000 7f3144d23640 0 -- 172.21.15.116:0/2536740748 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f3138027040 msgr2=0x7f313808b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.243+0000 7f3144522640 0 -- 172.21.15.116:0/2536740748 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f313808bdd0 msgr2=0x7f31380901d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:09.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:09.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.450+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 zone default found 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 4 Realm: () 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 zonegroup default 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.451 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.451+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.452+0000 7f3148e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.452+0000 7f3148e0f800 20 started sync module instance, tier type = 2024-09-14T11:43:09.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.452+0000 7f3148e0f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=0 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=1 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=2 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=3 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=4 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=5 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.462+0000 7f3148e0f800 20 add_watcher() i=6 2024-09-14T11:43:09.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.463+0000 7f3148e0f800 20 add_watcher() i=7 2024-09-14T11:43:09.462 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.463+0000 7f3148e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:09.463 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.464+0000 7f2ffafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:09.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:09.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 5 note: GC not initialized 2024-09-14T11:43:09.464 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f2ff9fdb640 20 reqs_thread_entry: start 2024-09-14T11:43:09.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:09.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 20 Filter name: none 2024-09-14T11:43:09.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f2f6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:09.465 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.465+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.466+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.466+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.466+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.466+0000 7f3148e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.466+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.467+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.467+0000 7f3148e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.467+0000 7f3148e0f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.467+0000 7f3148e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:09.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.469+0000 7f2ffafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.471+0000 7f3148e0f800 20 remove_watcher() i=0 2024-09-14T11:43:09.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.471+0000 7f3148e0f800 2 removed watcher, disabling cache 2024-09-14T11:43:09.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.473+0000 7f3148e0f800 20 remove_watcher() i=1 2024-09-14T11:43:09.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.474+0000 7f3148e0f800 20 remove_watcher() i=2 2024-09-14T11:43:09.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.475+0000 7f3148e0f800 20 remove_watcher() i=3 2024-09-14T11:43:09.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.476+0000 7f3148e0f800 20 remove_watcher() i=4 2024-09-14T11:43:09.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.477+0000 7f3148e0f800 20 remove_watcher() i=5 2024-09-14T11:43:09.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.478+0000 7f3148e0f800 20 remove_watcher() i=6 2024-09-14T11:43:09.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.479+0000 7f3148e0f800 20 remove_watcher() i=7 2024-09-14T11:43:09.489 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.489 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:43:09.489 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:43:09.489 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.490 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:43:09.525 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:09.525 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:09.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.564+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.564 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.565+0000 7f89c3f32800 20 realm 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.566+0000 7f89c3f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.565 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:09.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.567+0000 7f89c3f32800 20 searching for the correct realm 2024-09-14T11:43:09.567 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.569+0000 7f89bfbbc640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x55c62cffc770 msgr2=0x7f89b8061940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.774+0000 7f89c03bd640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f89a801c040 msgr2=0x7f89a803b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zone default found 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Realm: () 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zonegroup default 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started sync module instance, tier type = 2024-09-14T11:43:09.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:09.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=0 2024-09-14T11:43:09.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=1 2024-09-14T11:43:09.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=2 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=3 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=4 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=5 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=6 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.792+0000 7f89c3f32800 20 add_watcher() i=7 2024-09-14T11:43:09.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.792+0000 7f89c3f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:09.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f8875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:09.793 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f89c3f32800 5 note: GC not initialized 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f8874fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.794+0000 7f89c3f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 20 Filter name: none 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f87ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:09.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.796+0000 7f89c3f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:09.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.797+0000 7f89c3f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:43:09.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f89c3f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.803 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f89c3f32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:09.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94309649251376 notifier 8493 bl.length()=827 2024-09-14T11:43:09.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:09.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:09.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:09.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:09.811 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89c3f32800 time 2024-09-14T11:43:09.814499+0000 2024-09-14T11:43:09.811 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89c558c76a] 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.813+0000 7f89c3f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89c3f32800 time 2024-09-14T11:43:09.814499+0000 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:09.812 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89c558c76a] 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:43:09.813 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f89c3f32800 thread_name:radosgw-admin 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89c423e6f0] 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89c428b99c] 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89c558c7c4] 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.834 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.814+0000 7f89c3f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f89c3f32800 thread_name:radosgw-admin 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89c423e6f0] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89c428b99c] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89c558c7c4] 2024-09-14T11:43:09.835 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: dump: 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.836 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:43:09.547+0000 7f89c3f32800 5 monclient: authenticate success, global_id 7850 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:43:09.547+0000 7f89c3f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:43:09.547+0000 7f89c3f32800 4 set_mon_vals no callback set 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: shutdown 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 asok(0x55c62cf2f270) unregister_commands rotate-key 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.837 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.838 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:43:09.548+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: starting msgr at 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: starting objecter 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests hook 0x55c62d178620 2024-09-14T11:43:09.839 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: setting wanted keys 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: calling monclient init 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.840 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:43:09.549+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:43:09.549+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:43:09.549+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key hook 0x55c62d14f308 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d152710 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d181130 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x7f89ac003bd0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.841 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.156334s 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d181130 auth_method 0 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d152710 auth_method 0 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.842 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8484 payload 824 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: dump: 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.843 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:43:09.549+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8484 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: dump: 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.844 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:43:09.549+0000 7f88ade0b640 4 set_mon_vals no callback set 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:43:09.550+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:43:09.550+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:43:09.550+0000 7f89c3f32800 1 librados: init done 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:43:09.552+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f88a8077230 auth_method 0 2024-09-14T11:43:09.845 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:43:09.552+0000 7f89c03bd640 10 monclient: get_auth_request con 0x55c62d1846c0 auth_method 0 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:43:09.553+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62d19b0e0 auth_method 0 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:43:09.554+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x55c62d1a0690 auth_method 0 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:43:09.555+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.846 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.847 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:43:09.555+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c62d1a7b50 EEXIST 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.848 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:43:09.555+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:43:09.556+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:43:09.556+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x55c62d1a3720 EEXIST 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d1cbe70 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d1cc250 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d1cab80 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.849 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.163233s 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d1cbe70 auth_method 0 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d1cc250 auth_method 0 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.850 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d1cab80 auth_method 0 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8487 payload 824 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.851 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: dump: 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:43:09.556+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8487 2024-09-14T11:43:09.852 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: dump: 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.853 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:43:09.556+0000 7f89c0bbe640 4 set_mon_vals no callback set 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:43:09.559+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f8898077140 auth_method 0 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: get_monmap_and_config 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:43:09.559+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.854 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.855 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:43:09.559+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.856 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:43:09.559+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:43:09.560+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:43:09.560+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x7fff1ba0c858 EEXIST 2024-09-14T11:43:09.857 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d220220 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d1f1170 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d21bac0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.167194s 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d21bac0 auth_method 0 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d220220 auth_method 0 2024-09-14T11:43:09.858 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d1f1170 auth_method 0 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 7859 payload 274 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.859 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 1 monclient: found mon.noname-c 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: dump: 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.860 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: dump: 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.861 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:43:09.560+0000 7f89c3f32800 5 monclient: authenticate success, global_id 7859 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:43:09.560+0000 7f89c3f32800 4 set_mon_vals no callback set 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: shutdown 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.862 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.863 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:43:09.561+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: starting msgr at 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: starting objecter 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c62d21d1a0 EEXIST 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: setting wanted keys 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: calling monclient init 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.864 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:43:09.562+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:43:09.562+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:43:09.562+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x55c62d1e0878 EEXIST 2024-09-14T11:43:09.865 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d1f1170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d21bac0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d220220 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.169421s 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d1f1170 auth_method 0 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d220220 auth_method 0 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.866 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d21bac0 auth_method 0 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8493 payload 824 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.867 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: dump: 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.868 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: dump: 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.869 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:43:09.563+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8493 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:43:09.563+0000 7f889effd640 4 set_mon_vals no callback set 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:43:09.563+0000 7f89c3f32800 1 librados: init done 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:43:09.563+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cr dump hook 0x55c62d1f00e8 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:43:09.564+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:43:09.565+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f8888077230 auth_method 0 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:43:09.565+0000 7f89c03bd640 10 monclient: get_auth_request con 0x55c62d239bf0 auth_method 0 2024-09-14T11:43:09.870 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 realm 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:43:09.566+0000 7f89c3f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:43:09.566+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62d23de50 auth_method 0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 searching for the correct realm 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:43:09.567+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x55c62d243080 auth_method 0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:43:09.568+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f89a801c040 auth_method 0 2024-09-14T11:43:09.871 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:43:09.569+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62cffc770 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:43:09.569+0000 7f89bfbbc640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x55c62cffc770 msgr2=0x7f89b8061940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:43:09.770+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62cffc770 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:43:09.770+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f89b006ab10 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:43:09.772+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f89a804d430 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:43:09.774+0000 7f89c03bd640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f89a801c040 msgr2=0x7f89a803b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:43:09.774+0000 7f889d7fa640 1 client.8493.objecter ms_handle_reset 0x7f89a801c040 session 0x7f89a802d1d0 osd.7 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:43:09.774+0000 7f889d7fa640 10 monclient: _renew_subs 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:43:09.774+0000 7f889d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:43:09.774+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f88880870d0 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:43:09.775+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x7f89a801b410 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:43:09.777+0000 7f889d7fa640 1 client.8493.objecter ms_handle_reset 0x55c62cffc770 session 0x7f89b8070040 osd.2 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:43:09.777+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x7f89a801c040 auth_method 0 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:09.872 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zone default found 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Realm: () 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:43:09.781+0000 7f89c3f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:09.873 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zonegroup default 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started sync module instance, tier type = 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=0 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=1 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=2 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=3 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=4 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=5 2024-09-14T11:43:09.874 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=6 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:43:09.792+0000 7f89c3f32800 20 add_watcher() i=7 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:43:09.792+0000 7f89c3f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.875 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:43:09.794+0000 7f8875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:43:09.794+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache list hook 0x55c62d20d1a0 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache inspect hook 0x55c62d20d1a0 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache erase hook 0x55c62d20d1a0 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache zap hook 0x55c62d20d1a0 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 note: GC not initialized 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:43:09.794+0000 7f8874fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace show hook 0x7f89b0065070 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace history hook 0x7f89b0065070 2024-09-14T11:43:09.876 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace active hook 0x7f89b0065070 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace active_short hook 0x7f89b0065070 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 Filter name: none 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:43:09.795+0000 7f87ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:43:09.796+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.877 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:43:09.797+0000 7f89c3f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94309649251376 notifier 8493 bl.length()=827 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:09.878 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:43:09.813+0000 7f89c3f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89c3f32800 time 2024-09-14T11:43:09.814499+0000 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89c558c76a] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.879 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:43:09.814+0000 7f89c3f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f89c3f32800 thread_name:radosgw-admin 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89c423e6f0] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89c428b99c] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89c558c7c4] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:43:09.880 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:43:09.881 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:43:09.882 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:43:09.883 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:43:09.884 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:43:09.885 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:43:09.886 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f87ee7fc640 / http_manager 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8874fe1640 / http_manager 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8875fe3640 / rgw_dt_lg_renew 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889d7fa640 / ms_dispatch 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889e7fc640 / io_context_pool 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889effd640 / io_context_pool 2024-09-14T11:43:09.887 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88a57fa640 / ms_dispatch 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88a7fff640 / ms_dispatch 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88ade0b640 / io_context_pool 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89bf3bb640 / msgr-worker-2 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89bfbbc640 / msgr-worker-1 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c03bd640 / msgr-worker-0 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c0bbe640 / io_context_pool 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c3f32800 / radosgw-admin 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/log/ceph/ceph-client.admin.154360.log 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr:--- begin dump of recent events --- 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: -499> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: -498> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:09.888 INFO:tasks.workunit.client.0.smithi116.stderr: -497> 2024-09-14T11:43:09.547+0000 7f88ade0b640 10 monclient: dump: 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr: -496> 2024-09-14T11:43:09.547+0000 7f89c3f32800 5 monclient: authenticate success, global_id 7850 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr: -495> 2024-09-14T11:43:09.547+0000 7f89c3f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:43:09.889 INFO:tasks.workunit.client.0.smithi116.stderr: -494> 2024-09-14T11:43:09.547+0000 7f89c3f32800 4 set_mon_vals no callback set 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr: -493> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: shutdown 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr: -492> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 asok(0x55c62cf2f270) unregister_commands rotate-key 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr: -491> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr: -490> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr: -489> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.890 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -488> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -487> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -486> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding auth protocol: cephx 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -485> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -484> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -483> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -482> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -481> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -480> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -479> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -478> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -477> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.891 INFO:tasks.workunit.client.0.smithi116.stderr: -476> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -475> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: crc 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -474> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d154e10) adding con mode: secure 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -473> 2024-09-14T11:43:09.548+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -472> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: starting msgr at 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -471> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: starting objecter 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -470> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests hook 0x55c62d178620 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -469> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: setting wanted keys 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -468> 2024-09-14T11:43:09.548+0000 7f89c3f32800 1 librados: calling monclient init 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -467> 2024-09-14T11:43:09.548+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -466> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -465> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -464> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding auth protocol: cephx 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -463> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -462> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.892 INFO:tasks.workunit.client.0.smithi116.stderr: -461> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -460> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -459> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -458> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -457> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -456> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -455> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -454> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -453> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: crc 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -452> 2024-09-14T11:43:09.548+0000 7f89c3f32800 5 AuthRegistry(0x55c62d14f1c0) adding con mode: secure 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -451> 2024-09-14T11:43:09.549+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -450> 2024-09-14T11:43:09.549+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -449> 2024-09-14T11:43:09.549+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key hook 0x55c62d14f308 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -448> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -447> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:09.893 INFO:tasks.workunit.client.0.smithi116.stderr: -446> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d152710 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -445> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d181130 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -444> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x7f89ac003bd0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -443> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -442> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -441> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -440> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -439> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.156334s 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -438> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d181130 auth_method 0 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -437> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -436> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -435> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -434> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d152710 auth_method 0 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -433> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.894 INFO:tasks.workunit.client.0.smithi116.stderr: -432> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -431> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -430> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -429> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -428> 2024-09-14T11:43:09.549+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -427> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -426> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -425> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -424> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8484 payload 824 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -423> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -422> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -421> 2024-09-14T11:43:09.549+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -420> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -419> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr: -418> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: dump: 2024-09-14T11:43:09.895 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr: -417> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr: -416> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr: -415> 2024-09-14T11:43:09.549+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8484 2024-09-14T11:43:09.896 INFO:tasks.workunit.client.0.smithi116.stderr: -414> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr: -413> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr: -412> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr: -411> 2024-09-14T11:43:09.549+0000 7f88a7fff640 10 monclient: dump: 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.897 INFO:tasks.workunit.client.0.smithi116.stderr: -410> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -409> 2024-09-14T11:43:09.549+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -408> 2024-09-14T11:43:09.549+0000 7f88ade0b640 4 set_mon_vals no callback set 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -407> 2024-09-14T11:43:09.550+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -406> 2024-09-14T11:43:09.550+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -405> 2024-09-14T11:43:09.550+0000 7f89c3f32800 1 librados: init done 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -404> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -403> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -402> 2024-09-14T11:43:09.551+0000 7f88a7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -401> 2024-09-14T11:43:09.552+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f88a8077230 auth_method 0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -400> 2024-09-14T11:43:09.552+0000 7f89c03bd640 10 monclient: get_auth_request con 0x55c62d1846c0 auth_method 0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -399> 2024-09-14T11:43:09.553+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62d19b0e0 auth_method 0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -398> 2024-09-14T11:43:09.554+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x55c62d1a0690 auth_method 0 2024-09-14T11:43:09.898 INFO:tasks.workunit.client.0.smithi116.stderr: -397> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr: -396> 2024-09-14T11:43:09.555+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr: -395> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr: -394> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.899 INFO:tasks.workunit.client.0.smithi116.stderr: -393> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -392> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding auth protocol: cephx 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -391> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -390> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -389> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -388> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -387> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -386> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -385> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -384> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -383> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -382> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -381> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: crc 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -380> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a4620) adding con mode: secure 2024-09-14T11:43:09.900 INFO:tasks.workunit.client.0.smithi116.stderr: -379> 2024-09-14T11:43:09.555+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -378> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c62d1a7b50 EEXIST 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -377> 2024-09-14T11:43:09.555+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -376> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -375> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -374> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding auth protocol: cephx 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -373> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -372> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -371> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -370> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -369> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -368> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -367> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.901 INFO:tasks.workunit.client.0.smithi116.stderr: -366> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -365> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -364> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -363> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: crc 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -362> 2024-09-14T11:43:09.555+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1a35d8) adding con mode: secure 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -361> 2024-09-14T11:43:09.555+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -360> 2024-09-14T11:43:09.556+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -359> 2024-09-14T11:43:09.556+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x55c62d1a3720 EEXIST 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -358> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -357> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -356> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d1cbe70 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -355> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d1cc250 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -354> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d1cab80 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.902 INFO:tasks.workunit.client.0.smithi116.stderr: -353> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -352> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -351> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -350> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -349> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.163233s 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -348> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d1cbe70 auth_method 0 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -347> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -346> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -345> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -344> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d1cc250 auth_method 0 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -343> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -342> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -341> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -340> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -339> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.903 INFO:tasks.workunit.client.0.smithi116.stderr: -338> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -337> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -336> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -335> 2024-09-14T11:43:09.556+0000 7f89bf3bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -334> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d1cab80 auth_method 0 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -333> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -332> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -331> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -330> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -329> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -328> 2024-09-14T11:43:09.556+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -327> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8487 payload 824 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -326> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -325> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -324> 2024-09-14T11:43:09.556+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.904 INFO:tasks.workunit.client.0.smithi116.stderr: -323> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr: -322> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr: -321> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: dump: 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr: -320> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.905 INFO:tasks.workunit.client.0.smithi116.stderr: -319> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr: -318> 2024-09-14T11:43:09.556+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8487 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr: -317> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr: -316> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr: -315> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr: -314> 2024-09-14T11:43:09.556+0000 7f88a57fa640 10 monclient: dump: 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.906 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -313> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -312> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -311> 2024-09-14T11:43:09.556+0000 7f89c0bbe640 4 set_mon_vals no callback set 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -310> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -309> 2024-09-14T11:43:09.556+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -308> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -307> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -306> 2024-09-14T11:43:09.558+0000 7f88a57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -305> 2024-09-14T11:43:09.559+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f8898077140 auth_method 0 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -304> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: get_monmap_and_config 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -303> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -302> 2024-09-14T11:43:09.559+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr: -301> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.907 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -300> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -299> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -298> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding auth protocol: cephx 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -297> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -296> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.908 INFO:tasks.workunit.client.0.smithi116.stderr: -295> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -294> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -293> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -292> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -291> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -290> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -289> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -288> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -287> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: crc 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -286> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1ebb60) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -285> 2024-09-14T11:43:09.559+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -284> 2024-09-14T11:43:09.559+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -283> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -282> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -281> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding auth protocol: cephx 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -280> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.909 INFO:tasks.workunit.client.0.smithi116.stderr: -279> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -278> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -277> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -276> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -275> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -274> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -273> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -272> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -271> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -270> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: crc 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -269> 2024-09-14T11:43:09.559+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0c710) adding con mode: secure 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -268> 2024-09-14T11:43:09.559+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -267> 2024-09-14T11:43:09.560+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -266> 2024-09-14T11:43:09.560+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x7fff1ba0c858 EEXIST 2024-09-14T11:43:09.910 INFO:tasks.workunit.client.0.smithi116.stderr: -265> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -264> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -263> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d220220 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -262> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d1f1170 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -261> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d21bac0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -260> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -259> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -258> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -257> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -256> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.167194s 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -255> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d21bac0 auth_method 0 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -254> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -253> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -252> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -251> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d220220 auth_method 0 2024-09-14T11:43:09.911 INFO:tasks.workunit.client.0.smithi116.stderr: -250> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -249> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -248> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -247> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -246> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -245> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -244> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -243> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -242> 2024-09-14T11:43:09.560+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -241> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d1f1170 auth_method 0 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -240> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -239> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -238> 2024-09-14T11:43:09.560+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -237> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 7859 payload 274 2024-09-14T11:43:09.912 INFO:tasks.workunit.client.0.smithi116.stderr: -236> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr: -235> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 1 monclient: found mon.noname-c 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr: -234> 2024-09-14T11:43:09.560+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr: -233> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr: -232> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr: -231> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: dump: 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.913 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -230> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -229> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -228> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -227> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -226> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr: -225> 2024-09-14T11:43:09.560+0000 7f889effd640 10 monclient: dump: 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.914 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -224> 2024-09-14T11:43:09.560+0000 7f89c3f32800 5 monclient: authenticate success, global_id 7859 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -223> 2024-09-14T11:43:09.560+0000 7f89c3f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -222> 2024-09-14T11:43:09.560+0000 7f89c3f32800 4 set_mon_vals no callback set 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -221> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: shutdown 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -220> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: build_initial_monmap 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -219> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 build_initial for_mkfs: 0 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr: -218> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: monmap: 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 0 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 0.000000 2024-09-14T11:43:09.915 INFO:tasks.workunit.client.0.smithi116.stderr:created 0.000000 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 0 (unknown) 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.noname-b 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -217> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -216> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -215> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding auth protocol: cephx 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -214> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -213> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -212> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -211> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.916 INFO:tasks.workunit.client.0.smithi116.stderr: -210> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -209> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -208> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -207> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -206> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -205> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -204> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: crc 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -203> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d211df0) adding con mode: secure 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -202> 2024-09-14T11:43:09.561+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -201> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: starting msgr at 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -200> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: starting objecter 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -199> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command objecter_requests cmddesc objecter_requests hook 0x55c62d21d1a0 EEXIST 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -198> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: setting wanted keys 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -197> 2024-09-14T11:43:09.561+0000 7f89c3f32800 1 librados: calling monclient init 2024-09-14T11:43:09.917 INFO:tasks.workunit.client.0.smithi116.stderr: -196> 2024-09-14T11:43:09.561+0000 7f89c3f32800 10 monclient: init 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -195> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -194> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -193> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding auth protocol: cephx 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -192> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -191> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -190> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -189> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -188> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -187> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -186> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -185> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -184> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -183> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -182> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: crc 2024-09-14T11:43:09.918 INFO:tasks.workunit.client.0.smithi116.stderr: -181> 2024-09-14T11:43:09.561+0000 7f89c3f32800 5 AuthRegistry(0x55c62d1e0730) adding con mode: secure 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -180> 2024-09-14T11:43:09.562+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -179> 2024-09-14T11:43:09.562+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -178> 2024-09-14T11:43:09.562+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command rotate-key cmddesc rotate-key hook 0x55c62d1e0878 EEXIST 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -177> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -176> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -175> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-a con 0x55c62d1f1170 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -174> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-b con 0x55c62d21bac0 addr [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -173> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): picked mon.noname-c con 0x55c62d220220 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -172> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -171> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -170> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -169> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -168> 2024-09-14T11:43:09.562+0000 7f89c3f32800 10 monclient(hunting): authenticate will time out at 2387.169421s 2024-09-14T11:43:09.919 INFO:tasks.workunit.client.0.smithi116.stderr: -167> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request con 0x55c62d1f1170 auth_method 0 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -166> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -165> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -164> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -163> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): get_auth_request con 0x55c62d220220 auth_method 0 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -162> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -161> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -160> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -159> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -158> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -157> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -156> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -155> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -154> 2024-09-14T11:43:09.562+0000 7f89c03bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -153> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request con 0x55c62d21bac0 auth_method 0 2024-09-14T11:43:09.920 INFO:tasks.workunit.client.0.smithi116.stderr: -152> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -151> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -150> 2024-09-14T11:43:09.562+0000 7f89bf3bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -149> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient(hunting): handle_auth_done global_id 8493 payload 824 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -148> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient: _finish_hunting 0 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -147> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 1 monclient: found mon.noname-a 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -146> 2024-09-14T11:43:09.562+0000 7f89bfbbc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -145> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -144> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr: -143> 2024-09-14T11:43:09.562+0000 7f889d7fa640 10 monclient: dump: 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.921 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -142> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -141> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -140> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -139> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -138> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr: -137> 2024-09-14T11:43:09.563+0000 7f889d7fa640 10 monclient: dump: 2024-09-14T11:43:09.922 INFO:tasks.workunit.client.0.smithi116.stderr:epoch 1 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:fsid 9ea4f55e-d790-4296-a9e1-7e935db87a03 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:last_changed 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:created 2024-09-14T11:16:09.022174+0000 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:min_mon_release 19 (squid) 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:election_strategy: 1 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -136> 2024-09-14T11:43:09.563+0000 7f89c3f32800 5 monclient: authenticate success, global_id 8493 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -135> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -134> 2024-09-14T11:43:09.563+0000 7f889effd640 4 set_mon_vals no callback set 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -133> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -132> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _renew_subs 2024-09-14T11:43:09.923 INFO:tasks.workunit.client.0.smithi116.stderr: -131> 2024-09-14T11:43:09.563+0000 7f89c3f32800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -130> 2024-09-14T11:43:09.563+0000 7f89c3f32800 1 librados: init done 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -129> 2024-09-14T11:43:09.563+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cr dump hook 0x55c62d1f00e8 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -128> 2024-09-14T11:43:09.564+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -127> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -126> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -125> 2024-09-14T11:43:09.564+0000 7f889d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.116:6800/2191273462,v1:172.21.15.116:6801/2191273462] 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -124> 2024-09-14T11:43:09.565+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f8888077230 auth_method 0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -123> 2024-09-14T11:43:09.565+0000 7f89c03bd640 10 monclient: get_auth_request con 0x55c62d239bf0 auth_method 0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -122> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -121> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 realm 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -120> 2024-09-14T11:43:09.565+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -119> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -118> 2024-09-14T11:43:09.566+0000 7f89c3f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:09.924 INFO:tasks.workunit.client.0.smithi116.stderr: -117> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -116> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -115> 2024-09-14T11:43:09.566+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -114> 2024-09-14T11:43:09.566+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62d23de50 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -113> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -112> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -111> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -110> 2024-09-14T11:43:09.567+0000 7f89c3f32800 20 searching for the correct realm 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -109> 2024-09-14T11:43:09.567+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x55c62d243080 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -108> 2024-09-14T11:43:09.568+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f89a801c040 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -107> 2024-09-14T11:43:09.569+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62cffc770 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -106> 2024-09-14T11:43:09.569+0000 7f89bfbbc640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x55c62cffc770 msgr2=0x7f89b8061940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -105> 2024-09-14T11:43:09.770+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x55c62cffc770 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -104> 2024-09-14T11:43:09.770+0000 7f89bf3bb640 10 monclient: get_auth_request con 0x7f89b006ab10 auth_method 0 2024-09-14T11:43:09.925 INFO:tasks.workunit.client.0.smithi116.stderr: -103> 2024-09-14T11:43:09.772+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f89a804d430 auth_method 0 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -102> 2024-09-14T11:43:09.774+0000 7f89c03bd640 0 -- 172.21.15.116:0/170916527 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f89a801c040 msgr2=0x7f89a803b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -101> 2024-09-14T11:43:09.774+0000 7f889d7fa640 1 client.8493.objecter ms_handle_reset 0x7f89a801c040 session 0x7f89a802d1d0 osd.7 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -100> 2024-09-14T11:43:09.774+0000 7f889d7fa640 10 monclient: _renew_subs 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -99> 2024-09-14T11:43:09.774+0000 7f889d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -98> 2024-09-14T11:43:09.774+0000 7f89c03bd640 10 monclient: get_auth_request con 0x7f88880870d0 auth_method 0 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -97> 2024-09-14T11:43:09.775+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x7f89a801b410 auth_method 0 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -96> 2024-09-14T11:43:09.777+0000 7f889d7fa640 1 client.8493.objecter ms_handle_reset 0x55c62cffc770 session 0x7f89b8070040 osd.2 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -95> 2024-09-14T11:43:09.777+0000 7f89bfbbc640 10 monclient: get_auth_request con 0x7f89a801c040 auth_method 0 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -94> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -93> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -92> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:09.926 INFO:tasks.workunit.client.0.smithi116.stderr: -91> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -90> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -89> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -88> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -87> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -86> 2024-09-14T11:43:09.780+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -85> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -84> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -83> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -82> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zone default found 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -81> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Realm: () 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -80> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -79> 2024-09-14T11:43:09.781+0000 7f89c3f32800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:09.927 INFO:tasks.workunit.client.0.smithi116.stderr: -78> 2024-09-14T11:43:09.781+0000 7f89c3f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -77> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 zonegroup default 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -76> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -75> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -74> 2024-09-14T11:43:09.781+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -73> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -72> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -71> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -70> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started sync module instance, tier type = 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -69> 2024-09-14T11:43:09.782+0000 7f89c3f32800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -68> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=0 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -67> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=1 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -66> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=2 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -65> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=3 2024-09-14T11:43:09.928 INFO:tasks.workunit.client.0.smithi116.stderr: -64> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=4 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -63> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=5 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -62> 2024-09-14T11:43:09.791+0000 7f89c3f32800 20 add_watcher() i=6 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -61> 2024-09-14T11:43:09.792+0000 7f89c3f32800 20 add_watcher() i=7 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -60> 2024-09-14T11:43:09.792+0000 7f89c3f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -59> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -58> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -57> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding auth protocol: cephx 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -56> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -55> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -54> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -53> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -52> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -51> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -50> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.929 INFO:tasks.workunit.client.0.smithi116.stderr: -49> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -48> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -47> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -46> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: crc 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -45> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 AuthRegistry(0x7fff1ba0cbf0) adding con mode: secure 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -44> 2024-09-14T11:43:09.794+0000 7f8875fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -43> 2024-09-14T11:43:09.794+0000 7f89c3f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -42> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -41> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -40> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache list hook 0x55c62d20d1a0 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -39> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache inspect hook 0x55c62d20d1a0 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -38> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache erase hook 0x55c62d20d1a0 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -37> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command cache zap hook 0x55c62d20d1a0 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -36> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 note: GC not initialized 2024-09-14T11:43:09.930 INFO:tasks.workunit.client.0.smithi116.stderr: -35> 2024-09-14T11:43:09.794+0000 7f8874fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -34> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace show hook 0x7f89b0065070 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -33> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace history hook 0x7f89b0065070 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -32> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace active hook 0x7f89b0065070 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -31> 2024-09-14T11:43:09.794+0000 7f89c3f32800 5 asok(0x55c62cf2f270) register_command sync trace active_short hook 0x7f89b0065070 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -30> 2024-09-14T11:43:09.794+0000 7f89c3f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -29> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 Filter name: none 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -28> 2024-09-14T11:43:09.795+0000 7f87ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -27> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -26> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -25> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -24> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -23> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -22> 2024-09-14T11:43:09.795+0000 7f89c3f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -21> 2024-09-14T11:43:09.795+0000 7f89c3f32800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.931 INFO:tasks.workunit.client.0.smithi116.stderr: -20> 2024-09-14T11:43:09.796+0000 7f89c3f32800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -19> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -18> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -17> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -16> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -15> 2024-09-14T11:43:09.796+0000 7f89c3f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -14> 2024-09-14T11:43:09.797+0000 7f89c3f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -13> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -12> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -11> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -10> 2024-09-14T11:43:09.804+0000 7f89c3f32800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -9> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 94309649251376 notifier 8493 bl.length()=827 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -8> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -7> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:09.932 INFO:tasks.workunit.client.0.smithi116.stderr: -6> 2024-09-14T11:43:09.804+0000 7f889e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: -5> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: -4> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: -3> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: -2> 2024-09-14T11:43:09.807+0000 7f89c3f32800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: -1> 2024-09-14T11:43:09.813+0000 7f89c3f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f89c3f32800 time 2024-09-14T11:43:09.814499+0000 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f89c558c76a] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 5: main() 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.933 INFO:tasks.workunit.client.0.smithi116.stderr: 7: __libc_start_main() 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 8: _start() 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 0> 2024-09-14T11:43:09.814+0000 7f89c3f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: in thread 7f89c3f32800 thread_name:radosgw-admin 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f89c423e6f0] 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f89c428b99c] 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 3: raise() 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 4: abort() 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f89c558c7c4] 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f89c558c928] 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c62bb4e0b1] 2024-09-14T11:43:09.934 INFO:tasks.workunit.client.0.smithi116.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c62bb5df6a] 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 9: main() 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f89c4229590] 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 11: __libc_start_main() 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 12: _start() 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr:--- logging levels --- 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 none 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 lockdep 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 context 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 crush 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_balancer 2024-09-14T11:43:09.935 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_locker 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_log_expire 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mds_migrator 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 3/ 5 mds_quiesce 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 buffer 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 timer 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 filer 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 striper 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 1 objecter 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rados 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_mirror 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_replay 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 rbd_pwl 2024-09-14T11:43:09.936 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 journaler 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objectcacher 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 client 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 osd 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 optracker 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 objclass 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 filestore 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 journal 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 ms 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mon 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/10 monc 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 paxos 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 tp 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 auth 2024-09-14T11:43:09.937 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 crypto 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 finisher 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 reserver 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 heartbeatmap 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 perfcounter 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_sync 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_datacache 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_access 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_flight 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 20/20 rgw_notification 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 javaclient 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 asok 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 1 throttle 2024-09-14T11:43:09.938 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 0 refs 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 compressor 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluestore 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 bluefs 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 3 bdev 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 kstore 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 4/ 5 rocksdb 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 fuse 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 2/ 5 mgr 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mgrc 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 dpdk 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 eventtrace 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 prioritycache 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 test 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cephsqlite 2024-09-14T11:43:09.939 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_onode 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_odata 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_omap 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_tm 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_t 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_epm 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_lba 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_cache 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_journal 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_device 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 seastore_backref 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 alienstore 2024-09-14T11:43:09.940 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 mclock 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 cyanstore 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 ceph_exporter 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 memstore 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 1/ 5 trace 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 0/ 5 ceph_dedup 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: -2/-2 (syslog threshold) 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 99/99 (stderr threshold) 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f87ee7fc640 / http_manager 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8874fe1640 / http_manager 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f8875fe3640 / rgw_dt_lg_renew 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889d7fa640 / ms_dispatch 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889e7fc640 / io_context_pool 2024-09-14T11:43:09.941 INFO:tasks.workunit.client.0.smithi116.stderr: 7f889effd640 / io_context_pool 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88a57fa640 / ms_dispatch 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88a7fff640 / ms_dispatch 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f88ade0b640 / io_context_pool 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89bf3bb640 / msgr-worker-2 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89bfbbc640 / msgr-worker-1 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c03bd640 / msgr-worker-0 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c0bbe640 / io_context_pool 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: 7f89c3f32800 / radosgw-admin 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: max_recent 500 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: max_new 1000 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:43:09.815909Z_cb102b50-210b-4994-b756-da75f89927ba/log 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr:--- end dump of recent events --- 2024-09-14T11:43:09.942 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:43:09.947 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:09.947 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:09.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.888+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 realm 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.890+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.891+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.891+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.891+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.891+0000 7f9b6411f800 20 searching for the correct realm 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.895+0000 7f9b57fff640 0 -- 172.21.15.116:0/1429853620 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55928371bdd0 msgr2=0x55928371e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.898+0000 7f9b5fd8b640 0 -- 172.21.15.116:0/1429853620 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9b480970c0 msgr2=0x7f9b48087860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:09.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.902+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 zone default found 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 4 Realm: () 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 zonegroup default 2024-09-14T11:43:09.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.903+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.904+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.904+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.904+0000 7f9b6411f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.904+0000 7f9b6411f800 20 started sync module instance, tier type = 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.904+0000 7f9b6411f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=0 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=1 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=2 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=3 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=4 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=5 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.913+0000 7f9b6411f800 20 add_watcher() i=6 2024-09-14T11:43:09.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.914+0000 7f9b6411f800 20 add_watcher() i=7 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.914+0000 7f9b6411f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 5 note: GC not initialized 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9a14fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 20 Filter name: none 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f998e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.916+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.917+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.917+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.918+0000 7f9b6411f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.920+0000 7f9a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.923+0000 7f9b6411f800 20 remove_watcher() i=0 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.923+0000 7f9b6411f800 2 removed watcher, disabling cache 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.924+0000 7f9b6411f800 20 remove_watcher() i=1 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.925+0000 7f9b6411f800 20 remove_watcher() i=2 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.926+0000 7f9b6411f800 20 remove_watcher() i=3 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.927+0000 7f9b6411f800 20 remove_watcher() i=4 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.928+0000 7f9b6411f800 20 remove_watcher() i=5 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.929+0000 7f9b6411f800 20 remove_watcher() i=6 2024-09-14T11:43:09.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:09.930+0000 7f9b6411f800 20 remove_watcher() i=7 2024-09-14T11:43:09.978 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:43:10.005 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:10.005 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:10.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.043+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.044+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.044+0000 7f69a0325800 20 realm 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.044+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.045+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.045+0000 7f69a0325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.045+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.045+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.045+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.046+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:10.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.046+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.046+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:10.045 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.046+0000 7f69a0325800 20 searching for the correct realm 2024-09-14T11:43:10.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.050+0000 7f699c734640 0 -- 172.21.15.116:0/1865989201 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f6984097040 msgr2=0x7f698407b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:10.255 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.256+0000 7f699bf33640 0 -- 172.21.15.116:0/1865989201 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x565270edfa70 msgr2=0x565270ee1e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:10.259 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.259+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 zone default found 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 4 Realm: () 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 zonegroup default 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.260 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.260+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.261+0000 7f69a0325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:10.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.261+0000 7f69a0325800 20 started sync module instance, tier type = 2024-09-14T11:43:10.261 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.261+0000 7f69a0325800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:10.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=0 2024-09-14T11:43:10.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=1 2024-09-14T11:43:10.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=2 2024-09-14T11:43:10.269 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=3 2024-09-14T11:43:10.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=4 2024-09-14T11:43:10.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=5 2024-09-14T11:43:10.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.270+0000 7f69a0325800 20 add_watcher() i=6 2024-09-14T11:43:10.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.271+0000 7f69a0325800 20 add_watcher() i=7 2024-09-14T11:43:10.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.271+0000 7f69a0325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:10.272 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.273+0000 7f6851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.273+0000 7f69a0325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 5 note: GC not initialized 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f6850fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 20 Filter name: none 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f67ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:10.273 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.274+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 20 rados->read ofs=0 len=0 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:10.275 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.275+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.276+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:10.276 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.276+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.276+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.276+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.277+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:10.277 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.278+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.279+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.279+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:10.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.279+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:10.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.279+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:10.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.280+0000 7f69a0325800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:10.279 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.280+0000 7f69a0325800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:10.280 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.281+0000 7f6851fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:10.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.283+0000 7f69a0325800 20 remove_watcher() i=0 2024-09-14T11:43:10.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.283+0000 7f69a0325800 2 removed watcher, disabling cache 2024-09-14T11:43:10.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.284+0000 7f69a0325800 20 remove_watcher() i=1 2024-09-14T11:43:10.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.285+0000 7f69a0325800 20 remove_watcher() i=2 2024-09-14T11:43:10.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.286+0000 7f69a0325800 20 remove_watcher() i=3 2024-09-14T11:43:10.286 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.287+0000 7f69a0325800 20 remove_watcher() i=4 2024-09-14T11:43:10.287 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.288+0000 7f69a0325800 20 remove_watcher() i=5 2024-09-14T11:43:10.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.289+0000 7f69a0325800 20 remove_watcher() i=6 2024-09-14T11:43:10.289 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:10.290+0000 7f69a0325800 20 remove_watcher() i=7 2024-09-14T11:43:40.332 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:43:40.363 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:40.364 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:40.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.408+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.407 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 20 realm 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.409+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.410+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.408 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.410+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.411+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.411+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.411+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:40.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.411+0000 7f2882d73800 20 searching for the correct realm 2024-09-14T11:43:40.614 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.616+0000 7f287805c640 0 -- 172.21.15.116:0/2472905040 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f2870091020 msgr2=0x7f287001a030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:40.619 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.621+0000 7f288085d640 0 -- 172.21.15.116:0/2472905040 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f28680b3300 msgr2=0x7f28680c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:40.826 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.828+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.829+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.827 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.829+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.829+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.829+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:40.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 zone default found 2024-09-14T11:43:40.828 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 4 Realm: () 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 zonegroup default 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.829 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.830+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.831+0000 7f2882d73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.831+0000 7f2882d73800 20 started sync module instance, tier type = 2024-09-14T11:43:40.830 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.831+0000 7f2882d73800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:40.839 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=0 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=1 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=2 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=3 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=4 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=5 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.842+0000 7f2882d73800 20 add_watcher() i=6 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.843+0000 7f2882d73800 20 add_watcher() i=7 2024-09-14T11:43:40.840 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.843+0000 7f2882d73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:40.842 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f27377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.843 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f2882d73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f2882d73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f2882d73800 5 note: GC not initialized 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f27367e4640 20 reqs_thread_entry: start 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f2882d73800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.845+0000 7f2882d73800 20 Filter name: none 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.846+0000 7f272f7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.846+0000 7f2882d73800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:40.844 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.846+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:40.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:40.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:40.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:40.845 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:40.846 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.847+0000 7f2882d73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:40.850 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.852+0000 7f27377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:40.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.854+0000 7f2882d73800 20 remove_watcher() i=0 2024-09-14T11:43:40.852 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.854+0000 7f2882d73800 2 removed watcher, disabling cache 2024-09-14T11:43:40.853 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.855+0000 7f2882d73800 20 remove_watcher() i=1 2024-09-14T11:43:40.854 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.857+0000 7f2882d73800 20 remove_watcher() i=2 2024-09-14T11:43:40.855 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.858+0000 7f2882d73800 20 remove_watcher() i=3 2024-09-14T11:43:40.857 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.859+0000 7f2882d73800 20 remove_watcher() i=4 2024-09-14T11:43:40.858 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.860+0000 7f2882d73800 20 remove_watcher() i=5 2024-09-14T11:43:40.859 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.861+0000 7f2882d73800 20 remove_watcher() i=6 2024-09-14T11:43:40.860 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.862+0000 7f2882d73800 20 remove_watcher() i=7 2024-09-14T11:43:40.873 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:43:40.903 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:40.903 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:40.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.945+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 realm 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:40.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.947+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.948+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:40.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.948+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:40.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.949+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:40.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.949+0000 7feea4123800 20 searching for the correct realm 2024-09-14T11:43:40.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:40.950+0000 7fee9fe0c640 0 -- 172.21.15.116:0/4149577089 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7fee98032040 msgr2=0x7fee98032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:41.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.156+0000 7feea060d640 0 -- 172.21.15.116:0/4149577089 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fee9406d030 msgr2=0x7fee9406a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.161+0000 7feea4123800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:41.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:41.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 zone default found 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 4 Realm: () 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 zonegroup default 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.162+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 started sync module instance, tier type = 2024-09-14T11:43:41.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.163+0000 7feea4123800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:41.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=0 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=1 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=2 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=3 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=4 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=5 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.173+0000 7feea4123800 20 add_watcher() i=6 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.174+0000 7feea4123800 20 add_watcher() i=7 2024-09-14T11:43:41.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.174+0000 7feea4123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.175+0000 7fed55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 5 note: GC not initialized 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7fed54fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 20 Filter name: none 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7fecce7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:41.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:41.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.176+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:43:41.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.177+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.178+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.178+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.178+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:41.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.178+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:41.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.179+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:41.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.179+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:41.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.179+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:41.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.179+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:41.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.180+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:41.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.181+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.181+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.181+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.181+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.182+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.182+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.182+0000 7feea4123800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:41.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.182+0000 7feea4123800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:41.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.183+0000 7fed55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.185+0000 7feea4123800 20 remove_watcher() i=0 2024-09-14T11:43:41.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.185+0000 7feea4123800 2 removed watcher, disabling cache 2024-09-14T11:43:41.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.187+0000 7feea4123800 20 remove_watcher() i=1 2024-09-14T11:43:41.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.188+0000 7feea4123800 20 remove_watcher() i=2 2024-09-14T11:43:41.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.189+0000 7feea4123800 20 remove_watcher() i=3 2024-09-14T11:43:41.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.190+0000 7feea4123800 20 remove_watcher() i=4 2024-09-14T11:43:41.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.191+0000 7feea4123800 20 remove_watcher() i=5 2024-09-14T11:43:41.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.192+0000 7feea4123800 20 remove_watcher() i=6 2024-09-14T11:43:41.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.193+0000 7feea4123800 20 remove_watcher() i=7 2024-09-14T11:43:41.201 INFO:tasks.workunit.client.0.smithi116.stderr:check reshard logrecord successfully 2024-09-14T11:43:41.202 INFO:tasks.workunit.client.0.smithi116.stderr: test: reshard versioned bucket 2024-09-14T11:43:41.203 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:43:41.231 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:41.232 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:41.268 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.270+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 realm 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.270 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.272+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.273+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.273+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.273+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:41.271 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.273+0000 7fd366820800 20 searching for the correct realm 2024-09-14T11:43:41.274 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.277+0000 7fd35bfff640 0 -- 172.21.15.116:0/4046616086 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55d4c2b9c430 msgr2=0x55d4c2b9e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.278 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.280+0000 7fd36430a640 0 -- 172.21.15.116:0/4046616086 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd34c095820 msgr2=0x7fd34c066870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.282 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.284+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.283 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.284 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 zone default found 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 4 Realm: () 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 zonegroup default 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.285+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.286+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.286+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.286+0000 7fd366820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.286+0000 7fd366820800 20 started sync module instance, tier type = 2024-09-14T11:43:41.285 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.286+0000 7fd366820800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=0 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=1 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=2 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=3 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=4 2024-09-14T11:43:41.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=5 2024-09-14T11:43:41.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.295+0000 7fd366820800 20 add_watcher() i=6 2024-09-14T11:43:41.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.296+0000 7fd366820800 20 add_watcher() i=7 2024-09-14T11:43:41.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.296+0000 7fd366820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd21afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.296 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd366820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd366820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd366820800 5 note: GC not initialized 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd219fdb640 20 reqs_thread_entry: start 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd366820800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.298+0000 7fd366820800 20 Filter name: none 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.299+0000 7fd18b7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:41.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.299+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.299+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.299+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:41.298 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:41.299 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.300+0000 7fd366820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:41.300 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.302+0000 7fd21afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.304+0000 7fd366820800 20 remove_watcher() i=0 2024-09-14T11:43:41.302 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.304+0000 7fd366820800 2 removed watcher, disabling cache 2024-09-14T11:43:41.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.305+0000 7fd366820800 20 remove_watcher() i=1 2024-09-14T11:43:41.304 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.306+0000 7fd366820800 20 remove_watcher() i=2 2024-09-14T11:43:41.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.307+0000 7fd366820800 20 remove_watcher() i=3 2024-09-14T11:43:41.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.308+0000 7fd366820800 20 remove_watcher() i=4 2024-09-14T11:43:41.307 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.309+0000 7fd366820800 20 remove_watcher() i=5 2024-09-14T11:43:41.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.310+0000 7fd366820800 20 remove_watcher() i=6 2024-09-14T11:43:41.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.311+0000 7fd366820800 20 remove_watcher() i=7 2024-09-14T11:43:41.319 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:41.319 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:43:41.319 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: myver id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:43:41.319 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:41.320 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:43:41.351 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:41.351 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:41.389 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.391+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 realm 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.390 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.392+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.393+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.393+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.393+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:41.391 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.393+0000 7f9c43121800 20 searching for the correct realm 2024-09-14T11:43:41.394 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.396+0000 7f9c3e643640 0 -- 172.21.15.116:0/553358495 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x561912d36b80 msgr2=0x561912d39000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:41.398 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.400+0000 7f9c3ee44640 0 -- 172.21.15.116:0/553358495 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9c280c6710 msgr2=0x7f9c280b3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.403 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.404 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.405+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 zone default found 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 4 Realm: () 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 zonegroup default 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.405 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 started sync module instance, tier type = 2024-09-14T11:43:41.406 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.406+0000 7f9c43121800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=0 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=1 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=2 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=3 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=4 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=5 2024-09-14T11:43:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.415+0000 7f9c43121800 20 add_watcher() i=6 2024-09-14T11:43:41.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.416+0000 7f9c43121800 20 add_watcher() i=7 2024-09-14T11:43:41.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.416+0000 7f9c43121800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9c43121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9c43121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9c43121800 5 note: GC not initialized 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9a6ffff640 20 reqs_thread_entry: start 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9c43121800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.418+0000 7f9c43121800 20 Filter name: none 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9a6dffb640 20 reqs_thread_entry: start 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:43:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : miss 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 adding default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.418 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:41.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.419 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.419+0000 7f9c43121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.426+0000 7f9c43121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.426+0000 7f9c43121800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.426+0000 7f9c43121800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.426+0000 7f9c43121800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.427+0000 7f9b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94665690022896 notifier 7958 bl.length()=821 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.427+0000 7f9b227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.427+0000 7f9b227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.427+0000 7f9b227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.428+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:41.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.428+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:41.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.428+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:41.426 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.428+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.433+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.0 2024-09-14T11:43:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.434+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1 2024-09-14T11:43:41.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.434+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2 2024-09-14T11:43:41.434 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.434+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.435+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.4 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.435+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.5 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.435+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.6 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.436+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.7 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.436+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.8 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.437+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.9 2024-09-14T11:43:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.437+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.10 2024-09-14T11:43:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.437+0000 7f9c43121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.438+0000 7f9c43121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9c43121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9c43121800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9c43121800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9c43121800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94665690022896 notifier 7958 bl.length()=821 2024-09-14T11:43:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9b227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9b227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.439+0000 7f9b227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.441+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:41.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.441+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:41.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.441+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:41.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.441+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:41.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.444+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.0 2024-09-14T11:43:41.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.444+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1 2024-09-14T11:43:41.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.444+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2 2024-09-14T11:43:41.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.444+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3 2024-09-14T11:43:41.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.445+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.4 2024-09-14T11:43:41.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.445+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.5 2024-09-14T11:43:41.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.445+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.6 2024-09-14T11:43:41.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.446+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.7 2024-09-14T11:43:41.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.446+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.8 2024-09-14T11:43:41.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.446+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.9 2024-09-14T11:43:41.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.446+0000 7f9c43121800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.10 2024-09-14T11:43:41.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.447+0000 7f9c43121800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:41.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.447+0000 7f9c43121800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:41.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9c43121800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9c43121800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9c43121800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9c43121800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:41.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9b21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94665690022896 notifier 7958 bl.length()=789 2024-09-14T11:43:41.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9b21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:41.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9b21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:41.447 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.448+0000 7f9b21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:41.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.450+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:41.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.450+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:41.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.450+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:41.448 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.450+0000 7f9c43121800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:41.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.452+0000 7f9c43121800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:43:41.452 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.454+0000 7f9af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.456+0000 7f9c43121800 20 remove_watcher() i=0 2024-09-14T11:43:41.454 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.456+0000 7f9c43121800 2 removed watcher, disabling cache 2024-09-14T11:43:41.455 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.457+0000 7f9c43121800 20 remove_watcher() i=1 2024-09-14T11:43:41.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.458+0000 7f9c43121800 20 remove_watcher() i=2 2024-09-14T11:43:41.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.459+0000 7f9c43121800 20 remove_watcher() i=3 2024-09-14T11:43:41.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.460+0000 7f9c43121800 20 remove_watcher() i=4 2024-09-14T11:43:41.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.461+0000 7f9c43121800 20 remove_watcher() i=5 2024-09-14T11:43:41.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.462+0000 7f9c43121800 20 remove_watcher() i=6 2024-09-14T11:43:41.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.463+0000 7f9c43121800 20 remove_watcher() i=7 2024-09-14T11:43:41.472 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:43:41.500 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:41.500 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:41.537 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.539+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.539 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 20 realm 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.541+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.542+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.542+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.540 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.542+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.542+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.543+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:41.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.543+0000 7f1bad087800 20 searching for the correct realm 2024-09-14T11:43:41.542 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.544+0000 7f1baab71640 0 -- 172.21.15.116:0/2775111067 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f1ba401a070 msgr2=0x7f1ba4064090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:41.747 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.749+0000 7f1bab372640 0 -- 172.21.15.116:0/2775111067 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f1b980030f0 msgr2=0x7f1b94015740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:41.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:41.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:41.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:41.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:41.753 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.754+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 zone default found 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 4 Realm: () 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 zonegroup default 2024-09-14T11:43:41.754 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.755+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.756+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.756+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.756+0000 7f1bad087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:41.755 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.756+0000 7f1bad087800 20 started sync module instance, tier type = 2024-09-14T11:43:41.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.756+0000 7f1bad087800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=0 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=1 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=2 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=3 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=4 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=5 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=6 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 20 add_watcher() i=7 2024-09-14T11:43:41.763 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.765+0000 7f1bad087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.767+0000 7f1a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 5 note: GC not initialized 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f19dbfff640 20 reqs_thread_entry: start 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 Filter name: none 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f19d9ffb640 20 reqs_thread_entry: start 2024-09-14T11:43:41.766 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.767 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.768+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.769+0000 7f1bad087800 20 rados->read ofs=0 len=0 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.770+0000 7f1bad087800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:41.768 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.770+0000 7f1bad087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:41.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.771+0000 7f1a617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:41.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.773+0000 7f1bad087800 20 remove_watcher() i=0 2024-09-14T11:43:41.771 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.773+0000 7f1bad087800 2 removed watcher, disabling cache 2024-09-14T11:43:41.772 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.775+0000 7f1bad087800 20 remove_watcher() i=1 2024-09-14T11:43:41.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.776+0000 7f1bad087800 20 remove_watcher() i=2 2024-09-14T11:43:41.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.777+0000 7f1bad087800 20 remove_watcher() i=3 2024-09-14T11:43:41.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.778+0000 7f1bad087800 20 remove_watcher() i=4 2024-09-14T11:43:41.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.779+0000 7f1bad087800 20 remove_watcher() i=5 2024-09-14T11:43:41.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.780+0000 7f1bad087800 20 remove_watcher() i=6 2024-09-14T11:43:41.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:41.781+0000 7f1bad087800 20 remove_watcher() i=7 2024-09-14T11:43:41.788 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:41.789 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:43:41.789 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: myver id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:43:41.789 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:41.864 INFO:tasks.workunit.client.0.smithi116.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:43:42.175 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:43:42.202 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:42.202 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:42.239 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.242+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 20 realm 2024-09-14T11:43:42.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.241 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.243+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.244+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.244+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.244+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.244+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.242 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.245+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:42.243 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.245+0000 7efdc3e92800 20 searching for the correct realm 2024-09-14T11:43:42.246 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.248+0000 7efdb917b640 0 -- 172.21.15.116:0/2787993156 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7efdb4063070 msgr2=0x7efdb40c0a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:42.450 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.452+0000 7efdc197c640 0 -- 172.21.15.116:0/2787993156 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7efdac04e040 msgr2=0x7efdac05ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.456 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.457 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 zone default found 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 4 Realm: () 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 zonegroup default 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.458+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.458 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 started sync module instance, tier type = 2024-09-14T11:43:42.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.459+0000 7efdc3e92800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=0 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=1 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=2 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=3 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=4 2024-09-14T11:43:42.466 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=5 2024-09-14T11:43:42.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.468+0000 7efdc3e92800 20 add_watcher() i=6 2024-09-14T11:43:42.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.469+0000 7efdc3e92800 20 add_watcher() i=7 2024-09-14T11:43:42.467 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.469+0000 7efdc3e92800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:42.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efc737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efdc3e92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efdc3e92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efdc3e92800 5 note: GC not initialized 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efc727fc640 20 reqs_thread_entry: start 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.471+0000 7efdc3e92800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.472+0000 7efdc3e92800 20 Filter name: none 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.472+0000 7efbe7fff640 20 reqs_thread_entry: start 2024-09-14T11:43:42.470 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.472+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.472+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.472+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.473+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.473+0000 7efdc3e92800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.473+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.473+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:42.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.473+0000 7efdc3e92800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.474+0000 7efdc3e92800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:42.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.474+0000 7efdc3e92800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:42.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.475+0000 7efc737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.478+0000 7efdc3e92800 20 remove_watcher() i=0 2024-09-14T11:43:42.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.478+0000 7efdc3e92800 2 removed watcher, disabling cache 2024-09-14T11:43:42.476 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.479+0000 7efdc3e92800 20 remove_watcher() i=1 2024-09-14T11:43:42.478 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.480+0000 7efdc3e92800 20 remove_watcher() i=2 2024-09-14T11:43:42.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.481+0000 7efdc3e92800 20 remove_watcher() i=3 2024-09-14T11:43:42.480 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.482+0000 7efdc3e92800 20 remove_watcher() i=4 2024-09-14T11:43:42.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.483+0000 7efdc3e92800 20 remove_watcher() i=5 2024-09-14T11:43:42.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.484+0000 7efdc3e92800 20 remove_watcher() i=6 2024-09-14T11:43:42.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.485+0000 7efdc3e92800 20 remove_watcher() i=7 2024-09-14T11:43:42.493 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:42.493 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:43:42.493 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: a-bucket id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:43:42.493 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:42.494 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:43:42.523 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:42.523 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:42.559 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.562+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 realm 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.562 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.564+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.565+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.565+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.565+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:42.563 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.565+0000 7f34e9326800 20 searching for the correct realm 2024-09-14T11:43:42.566 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.568+0000 7f34e48d5640 0 -- 172.21.15.116:0/1203827713 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f34d802b060 msgr2=0x7f34d804dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:42.569 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.571+0000 7f34e50d6640 0 -- 172.21.15.116:0/1203827713 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f34dc071b70 msgr2=0x7f34dc088120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.778+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 zone default found 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 4 Realm: () 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 zonegroup default 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 started sync module instance, tier type = 2024-09-14T11:43:42.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.779+0000 7f34e9326800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=0 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=1 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=2 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=3 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=4 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=5 2024-09-14T11:43:42.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.788+0000 7f34e9326800 20 add_watcher() i=6 2024-09-14T11:43:42.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.789+0000 7f34e9326800 20 add_watcher() i=7 2024-09-14T11:43:42.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.789+0000 7f34e9326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:42.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.791+0000 7f339bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.791+0000 7f34e9326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.791+0000 7f34e9326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.791+0000 7f34e9326800 5 note: GC not initialized 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.791+0000 7f339afe5640 20 reqs_thread_entry: start 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f34e9326800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f34e9326800 20 Filter name: none 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f3398fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:42.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.792+0000 7f34e9326800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.793+0000 7f34e9326800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:42.791 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.793+0000 7f34e9326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:42.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.794+0000 7f339bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.797+0000 7f34e9326800 20 remove_watcher() i=0 2024-09-14T11:43:42.794 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.797+0000 7f34e9326800 2 removed watcher, disabling cache 2024-09-14T11:43:42.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.798+0000 7f34e9326800 20 remove_watcher() i=1 2024-09-14T11:43:42.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.799+0000 7f34e9326800 20 remove_watcher() i=2 2024-09-14T11:43:42.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.800+0000 7f34e9326800 20 remove_watcher() i=3 2024-09-14T11:43:42.798 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.801+0000 7f34e9326800 20 remove_watcher() i=4 2024-09-14T11:43:42.799 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.802+0000 7f34e9326800 20 remove_watcher() i=5 2024-09-14T11:43:42.800 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.802+0000 7f34e9326800 20 remove_watcher() i=6 2024-09-14T11:43:42.801 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.803+0000 7f34e9326800 20 remove_watcher() i=7 2024-09-14T11:43:42.812 INFO:tasks.workunit.client.0.smithi116.stderr:rados -p default.rgw.buckets.index setomapval .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:43:42.838 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:42.838 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:42.854 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:43:42.883 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:42.883 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:42.919 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.921+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 realm 2024-09-14T11:43:42.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.921 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:42.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.923+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.924+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.922 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.924+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.924+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:42.923 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.924+0000 7ff042b35800 20 searching for the correct realm 2024-09-14T11:43:42.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.928+0000 7ff037fff640 0 -- 172.21.15.116:0/2735745205 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x560ca6246090 msgr2=0x560ca62484e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:42.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.931+0000 7ff03e821640 0 -- 172.21.15.116:0/2735745205 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff028008070 msgr2=0x7ff028075840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.934 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:42.935 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.936+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 zone default found 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 4 Realm: () 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 zonegroup default 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.936 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:42.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 started sync module instance, tier type = 2024-09-14T11:43:42.937 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.937+0000 7ff042b35800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=0 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=1 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=2 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=3 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=4 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=5 2024-09-14T11:43:42.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.946+0000 7ff042b35800 20 add_watcher() i=6 2024-09-14T11:43:42.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.947+0000 7ff042b35800 20 add_watcher() i=7 2024-09-14T11:43:42.945 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.947+0000 7ff042b35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:42.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.948+0000 7feef57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.948+0000 7ff042b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.948+0000 7ff042b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 5 note: GC not initialized 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7fee6ffff640 20 reqs_thread_entry: start 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 20 Filter name: none 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7fee6dffb640 20 reqs_thread_entry: start 2024-09-14T11:43:42.947 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.949+0000 7ff042b35800 20 rados->read ofs=0 len=0 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 INFO: main: starting shard=0 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:42.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 INFO: main: starting shard=1 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.950+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 INFO: main: starting shard=2 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:42.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:42.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 INFO: main: starting shard=3 2024-09-14T11:43:42.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.951+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.952+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.952+0000 7ff042b35800 20 INFO: main: starting shard=4 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.952+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.952+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: starting shard=5 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: starting shard=6 2024-09-14T11:43:42.952 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:42.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:42.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 INFO: main: starting shard=7 2024-09-14T11:43:42.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:42.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.953+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 INFO: main: starting shard=8 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 INFO: main: starting shard=9 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.954+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:42.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 INFO: main: starting shard=10 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 INFO: main: starting shard=11 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.955+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 20 INFO: main: starting shard=12 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:42.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:42.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:42.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.956+0000 7ff042b35800 20 INFO: main: done 2024-09-14T11:43:42.956 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.957+0000 7feef57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:42.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.959+0000 7ff042b35800 20 remove_watcher() i=0 2024-09-14T11:43:42.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.959+0000 7ff042b35800 2 removed watcher, disabling cache 2024-09-14T11:43:42.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.960+0000 7ff042b35800 20 remove_watcher() i=1 2024-09-14T11:43:42.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.961+0000 7ff042b35800 20 remove_watcher() i=2 2024-09-14T11:43:42.960 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.962+0000 7ff042b35800 20 remove_watcher() i=3 2024-09-14T11:43:42.961 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.963+0000 7ff042b35800 20 remove_watcher() i=4 2024-09-14T11:43:42.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.964+0000 7ff042b35800 20 remove_watcher() i=5 2024-09-14T11:43:42.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.965+0000 7ff042b35800 20 remove_watcher() i=6 2024-09-14T11:43:42.964 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:42.966+0000 7ff042b35800 20 remove_watcher() i=7 2024-09-14T11:43:42.976 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:43:43.008 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:43.008 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:43.044 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.047+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 realm 2024-09-14T11:43:43.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.048+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.049+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.049+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.047 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.049+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:43.048 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.049+0000 7f5a32b39800 20 searching for the correct realm 2024-09-14T11:43:43.050 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.053+0000 7f5a27fff640 0 -- 172.21.15.116:0/3269380672 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x556493c4c730 msgr2=0x556493c4eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:43.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.056+0000 7f5a2e7c7640 0 -- 172.21.15.116:0/3269380672 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f5a18076290 msgr2=0x7f5a18082040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.060 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 zone default found 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 4 Realm: () 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 zonegroup default 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.061+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.061 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 started sync module instance, tier type = 2024-09-14T11:43:43.062 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.062+0000 7f5a32b39800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=0 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=1 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=2 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=3 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=4 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=5 2024-09-14T11:43:43.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.071+0000 7f5a32b39800 20 add_watcher() i=6 2024-09-14T11:43:43.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.072+0000 7f5a32b39800 20 add_watcher() i=7 2024-09-14T11:43:43.070 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.072+0000 7f5a32b39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:43.071 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.073+0000 7f58e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 5 note: GC not initialized 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f585f7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 20 Filter name: none 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f585d7fa640 20 reqs_thread_entry: start 2024-09-14T11:43:43.072 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:43:43.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.074+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:43.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : miss 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.075+0000 7f5a32b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:43.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.079+0000 7f5a32b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.079+0000 7f5a32b39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.079+0000 7f5a32b39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.077 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.079+0000 7f5a32b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:43.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.080+0000 7f59117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497064 cookie 93890464243120 notifier 8051 bl.length()=827 2024-09-14T11:43:43.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.080+0000 7f59117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.080+0000 7f59117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.078 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.080+0000 7f59117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.081+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:43.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.081+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:43.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.081+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:43.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.081+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.086+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.086+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.086+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.086+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.087+0000 7f5a32b39800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.087+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:43.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.087+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.087+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.087+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:43.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.088+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.089+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.089+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.089+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:43.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.089+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:43.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.090+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:43.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.090+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:43.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.090+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:43.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.090+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:43.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.091+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:43.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.091+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:43.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.091+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:43.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.091+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:43.089 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.092+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:43.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.092+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:43.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.092+0000 7f5a32b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:43.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.092+0000 7f5a32b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:43.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.093+0000 7f5a32b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.093+0000 7f5a32b39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.091 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.093+0000 7f5a32b39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.093+0000 7f5a32b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:43.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.094+0000 7f5911ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497065 cookie 93890464243120 notifier 8051 bl.length()=827 2024-09-14T11:43:43.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.094+0000 7f5911ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.094+0000 7f5911ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.092 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.094+0000 7f5911ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.095+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:43.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.095+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:43.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.095+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:43.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.095+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:43.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:43.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.0 2024-09-14T11:43:43.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:43.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.1 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.098+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.2 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.3 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.4 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:43.097 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.5 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.099+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.6 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.7 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.8 2024-09-14T11:43:43.098 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:43.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.100+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.9 2024-09-14T11:43:43.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:43.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.10 2024-09-14T11:43:43.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:43.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.11 2024-09-14T11:43:43.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:43.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.101+0000 7f5a32b39800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.2.12 2024-09-14T11:43:43.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.102+0000 7f5a32b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:43.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.102+0000 7f5a32b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5a32b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5a32b39800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5a32b39800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5a32b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17, ofs0, ns] 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5911ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497066 cookie 93890464243120 notifier 8051 bl.length()=795 2024-09-14T11:43:43.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5911ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 info.flags=0x17 2024-09-14T11:43:43.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5911ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17 to cache LRU end 2024-09-14T11:43:43.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.103+0000 7f5911ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:43.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.105+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_sources= new_sources= 2024-09-14T11:43:43.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.105+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential sources added=[] removed=[] 2024-09-14T11:43:43.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.105+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): orig_dests= new_dests= 2024-09-14T11:43:43.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.105+0000 7f5a32b39800 20 handle_bi_update(): bucket=:a-bucket[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17]): potential dests added=[] removed=[] 2024-09-14T11:43:43.105 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.108+0000 7f5a32b39800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:43:43.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.109+0000 7f58e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.112+0000 7f5a32b39800 20 remove_watcher() i=0 2024-09-14T11:43:43.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.112+0000 7f5a32b39800 2 removed watcher, disabling cache 2024-09-14T11:43:43.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.113+0000 7f5a32b39800 20 remove_watcher() i=1 2024-09-14T11:43:43.112 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.114+0000 7f5a32b39800 20 remove_watcher() i=2 2024-09-14T11:43:43.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.115+0000 7f5a32b39800 20 remove_watcher() i=3 2024-09-14T11:43:43.114 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.116+0000 7f5a32b39800 20 remove_watcher() i=4 2024-09-14T11:43:43.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.117+0000 7f5a32b39800 20 remove_watcher() i=5 2024-09-14T11:43:43.116 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.118+0000 7f5a32b39800 20 remove_watcher() i=6 2024-09-14T11:43:43.117 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.119+0000 7f5a32b39800 20 remove_watcher() i=7 2024-09-14T11:43:43.129 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:43:43.157 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:43.157 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:43.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.195+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 realm 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.197+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.198+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.198+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.198+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:43.196 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.198+0000 7f205752c800 20 searching for the correct realm 2024-09-14T11:43:43.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.202+0000 7f2053a50640 0 -- 172.21.15.116:0/1859420130 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55a05fa27670 msgr2=0x55a05fa29b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:43.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.205+0000 7f205324f640 0 -- 172.21.15.116:0/1859420130 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f203c0ce970 msgr2=0x7f203c0aa770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.207 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.208 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 zone default found 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 4 Realm: () 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 zonegroup default 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.209+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.209 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 started sync module instance, tier type = 2024-09-14T11:43:43.210 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.210+0000 7f205752c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=0 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=1 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=2 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=3 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=4 2024-09-14T11:43:43.217 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=5 2024-09-14T11:43:43.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.219+0000 7f205752c800 20 add_watcher() i=6 2024-09-14T11:43:43.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.220+0000 7f205752c800 20 add_watcher() i=7 2024-09-14T11:43:43.218 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.220+0000 7f205752c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:43.219 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.221+0000 7f1f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 5 note: GC not initialized 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f1f08fe1640 20 reqs_thread_entry: start 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 Filter name: none 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f1e827fc640 20 reqs_thread_entry: start 2024-09-14T11:43:43.220 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:43:43.221 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.222+0000 7f205752c800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 INFO: main: starting shard=0 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17.3.0 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.223+0000 7f205752c800 20 INFO: main: done 2024-09-14T11:43:43.222 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.224+0000 7f1f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.227+0000 7f205752c800 20 remove_watcher() i=0 2024-09-14T11:43:43.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.227+0000 7f205752c800 2 removed watcher, disabling cache 2024-09-14T11:43:43.225 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.228+0000 7f205752c800 20 remove_watcher() i=1 2024-09-14T11:43:43.226 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.229+0000 7f205752c800 20 remove_watcher() i=2 2024-09-14T11:43:43.227 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.230+0000 7f205752c800 20 remove_watcher() i=3 2024-09-14T11:43:43.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.231+0000 7f205752c800 20 remove_watcher() i=4 2024-09-14T11:43:43.229 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.232+0000 7f205752c800 20 remove_watcher() i=5 2024-09-14T11:43:43.230 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.233+0000 7f205752c800 20 remove_watcher() i=6 2024-09-14T11:43:43.231 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.233+0000 7f205752c800 20 remove_watcher() i=7 2024-09-14T11:43:43.241 INFO:tasks.workunit.client.0.smithi116.stderr: test: PUT succeeds during reshard 2024-09-14T11:43:43.243 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:43:43.271 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:43.271 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:43.493 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.496+0000 7f932cf63640 0 --2- 172.21.15.116:0/196242715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a06045a2e0 0x55a060544860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:43:43.508 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.510+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.512+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.512+0000 7f9331b2e800 20 realm 2024-09-14T11:43:43.510 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.512+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.513+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.513+0000 7f9331b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:43.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.513+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.513+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.511 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.513+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.514+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.514+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.514+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:43.512 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.514+0000 7f9331b2e800 20 searching for the correct realm 2024-09-14T11:43:43.516 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.516+0000 7f932cf63640 0 -- 172.21.15.116:0/3422526172 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f9320080040 msgr2=0x7f93200bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:43.721 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.723+0000 7f932d764640 0 -- 172.21.15.116:0/3422526172 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9318048b90 msgr2=0x7f9318062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:43.928 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.929+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 zone default found 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 4 Realm: () 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 zonegroup default 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.930+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.931+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.929 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.931+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.931+0000 7f9331b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:43.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.931+0000 7f9331b2e800 20 started sync module instance, tier type = 2024-09-14T11:43:43.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.931+0000 7f9331b2e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:43.938 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=0 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=1 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=2 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=3 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=4 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=5 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.941+0000 7f9331b2e800 20 add_watcher() i=6 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.942+0000 7f9331b2e800 20 add_watcher() i=7 2024-09-14T11:43:43.939 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.942+0000 7f9331b2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:43.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.943+0000 7f91e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:43.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:43.941 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 5 note: GC not initialized 2024-09-14T11:43:43.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f91e27e4640 20 reqs_thread_entry: start 2024-09-14T11:43:43.942 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 Filter name: none 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9153fff640 20 reqs_thread_entry: start 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.944+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.945+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.943 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.945+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.945+0000 7f9331b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.945+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.946+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.946+0000 7f9331b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.946+0000 7f9331b2e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:43.944 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.946+0000 7f9331b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:43.946 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.948+0000 7f91e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:43.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.951+0000 7f9331b2e800 20 remove_watcher() i=0 2024-09-14T11:43:43.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.951+0000 7f9331b2e800 2 removed watcher, disabling cache 2024-09-14T11:43:43.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.952+0000 7f9331b2e800 20 remove_watcher() i=1 2024-09-14T11:43:43.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.953+0000 7f9331b2e800 20 remove_watcher() i=2 2024-09-14T11:43:43.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.954+0000 7f9331b2e800 20 remove_watcher() i=3 2024-09-14T11:43:43.953 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.955+0000 7f9331b2e800 20 remove_watcher() i=4 2024-09-14T11:43:43.954 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.956+0000 7f9331b2e800 20 remove_watcher() i=5 2024-09-14T11:43:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.957+0000 7f9331b2e800 20 remove_watcher() i=6 2024-09-14T11:43:43.955 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:43.958+0000 7f9331b2e800 20 remove_watcher() i=7 2024-09-14T11:43:43.967 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:43.967 INFO:tasks.workunit.client.0.smithi116.stderr:BUCKET_STATS: 2024-09-14T11:43:43.967 INFO:tasks.workunit.client.0.smithi116.stderr:bucket: myver id: 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:43:43.967 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:43.968 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:43:44.001 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:44.002 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:44.039 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.041+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 realm 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:44.041 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.043+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.044+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.044+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.044+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:44.042 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.044+0000 7fbd23c98800 20 searching for the correct realm 2024-09-14T11:43:44.046 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.048+0000 7fbd21f83640 0 -- 172.21.15.116:0/614394440 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55b741446980 msgr2=0x55b741448e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:44.049 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.051+0000 7fbd1bfff640 0 -- 172.21.15.116:0/614394440 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fbd14082040 msgr2=0x7fbd14069050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:44.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:44.053 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.055+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.054 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:44.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.055 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 zone default found 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 4 Realm: () 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 zonegroup default 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.056+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.057+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.057+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.057+0000 7fbd23c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.057+0000 7fbd23c98800 20 started sync module instance, tier type = 2024-09-14T11:43:44.056 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.057+0000 7fbd23c98800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=0 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=1 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=2 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=3 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=4 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=5 2024-09-14T11:43:44.064 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.066+0000 7fbd23c98800 20 add_watcher() i=6 2024-09-14T11:43:44.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.067+0000 7fbd23c98800 20 add_watcher() i=7 2024-09-14T11:43:44.065 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.067+0000 7fbd23c98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:44.066 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.068+0000 7fbbd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 5 note: GC not initialized 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbbd67e4640 20 reqs_thread_entry: start 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 Filter name: none 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbb47fff640 20 reqs_thread_entry: start 2024-09-14T11:43:44.067 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:43:44.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.068 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : miss 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.069+0000 7fbd23c98800 20 rados->read ofs=0 len=0 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 10 adding default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:44.069 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.070+0000 7fbd23c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbd23c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbd23c98800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbd23c98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbd23c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbbf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94245562380912 notifier 8766 bl.length()=821 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbbf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:44.073 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbbf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:44.074 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.075+0000 7fbbf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:44.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.077+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:44.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.077+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:44.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.077+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:44.075 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.077+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:44.079 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:44.082+0000 7fbd23c98800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:43:45.036 INFO:tasks.workunit.client.0.smithi116.stderr:put object successful 2024-09-14T11:43:49.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:49.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:49.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:49.080 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:49.081 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:49.082 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.082+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.083+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.083+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.084+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.084+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.084+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.084+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:49.083 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.085+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:49.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.085+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:49.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.086+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:49.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.086+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:49.084 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.087+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:49.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.087+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:49.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.087+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:49.085 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.087+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:49.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.088+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:49.086 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.088+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:49.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.089+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:49.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.089+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:49.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.089+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:49.087 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.089+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:49.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.090+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:49.088 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.090+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:49.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.093+0000 7fbd23c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:49.090 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.093+0000 7fbd23c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbd23c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbd23c98800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbd23c98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbd23c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbbf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94245562380912 notifier 8766 bl.length()=821 2024-09-14T11:43:49.093 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbbf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:49.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbbf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:49.094 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.095+0000 7fbbf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:49.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.098+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:49.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.098+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:49.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.098+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:49.096 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.098+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:49.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.101+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:49.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.101+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.0 2024-09-14T11:43:49.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.101+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:49.099 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.101+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.1 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.2 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.3 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:49.100 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.102+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.4 2024-09-14T11:43:49.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.103+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:49.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.103+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.5 2024-09-14T11:43:49.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:49.101 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.6 2024-09-14T11:43:49.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:49.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.7 2024-09-14T11:43:49.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:49.102 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.104+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.8 2024-09-14T11:43:49.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.105+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:49.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.105+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.9 2024-09-14T11:43:49.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.105+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:49.103 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.105+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.10 2024-09-14T11:43:49.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.106+0000 7fbd23c98800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:49.104 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.106+0000 7fbd23c98800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.1.11 2024-09-14T11:43:49.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.108+0000 7fbd23c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:49.106 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.108+0000 7fbd23c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:49.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbd23c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:49.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbd23c98800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:49.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbd23c98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:49.108 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbd23c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:49.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbbf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94245562380912 notifier 8766 bl.length()=789 2024-09-14T11:43:49.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbbf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:49.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbbf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:49.109 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.110+0000 7fbbf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:49.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.112+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:49.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.112+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:49.110 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.112+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:49.111 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.112+0000 7fbd23c98800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:49.113 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.115+0000 7fbd23c98800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:43:49.115 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.118+0000 7fbbd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:49.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.120+0000 7fbd23c98800 20 remove_watcher() i=0 2024-09-14T11:43:49.118 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.120+0000 7fbd23c98800 2 removed watcher, disabling cache 2024-09-14T11:43:49.119 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.121+0000 7fbd23c98800 20 remove_watcher() i=1 2024-09-14T11:43:49.120 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.123+0000 7fbd23c98800 20 remove_watcher() i=2 2024-09-14T11:43:49.122 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.124+0000 7fbd23c98800 20 remove_watcher() i=3 2024-09-14T11:43:49.123 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.125+0000 7fbd23c98800 20 remove_watcher() i=4 2024-09-14T11:43:49.124 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.126+0000 7fbd23c98800 20 remove_watcher() i=5 2024-09-14T11:43:49.125 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.127+0000 7fbd23c98800 20 remove_watcher() i=6 2024-09-14T11:43:49.126 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:49.129+0000 7fbd23c98800 20 remove_watcher() i=7 2024-09-14T11:43:50.041 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:43:50.041 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T11:43:50.369 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:43:50.758 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:43:52.235 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:43:52.237 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:43:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:52.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.309+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.308 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 20 realm 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.310+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.311+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.309 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.311+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.312+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.312+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.312+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:52.310 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.312+0000 7f2e65014800 20 searching for the correct realm 2024-09-14T11:43:52.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.315+0000 7f2e57eca640 0 -- 172.21.15.116:0/77618208 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x555b8d7a7090 msgr2=0x555b8d7a9480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:52.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.319+0000 7f2e606cb640 0 -- 172.21.15.116:0/77618208 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f2e4804eb60 msgr2=0x7f2e4806c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:52.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.324+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 zone default found 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 4 Realm: () 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 zonegroup default 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.325+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.326+0000 7f2e65014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.326+0000 7f2e65014800 20 started sync module instance, tier type = 2024-09-14T11:43:52.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.326+0000 7f2e65014800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=0 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=1 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=2 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=3 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=4 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=5 2024-09-14T11:43:52.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.335+0000 7f2e65014800 20 add_watcher() i=6 2024-09-14T11:43:52.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.336+0000 7f2e65014800 20 add_watcher() i=7 2024-09-14T11:43:52.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.336+0000 7f2e65014800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.337+0000 7f2d16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 5 note: GC not initialized 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2d15fdb640 20 reqs_thread_entry: start 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:52.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 20 Filter name: none 2024-09-14T11:43:52.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2c877fe640 20 reqs_thread_entry: start 2024-09-14T11:43:52.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.338+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 INFO: main: starting shard=0 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.339+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 INFO: main: starting shard=1 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:52.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 INFO: main: starting shard=2 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.340+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 INFO: main: starting shard=3 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 INFO: main: starting shard=4 2024-09-14T11:43:52.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:52.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.341+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:52.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 INFO: main: starting shard=5 2024-09-14T11:43:52.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:52.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 INFO: main: starting shard=6 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.342+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 INFO: main: starting shard=7 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:52.342 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 INFO: main: starting shard=8 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.343+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 INFO: main: starting shard=9 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:52.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 INFO: main: starting shard=10 2024-09-14T11:43:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.344+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:52.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.345+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.345+0000 7f2e65014800 20 INFO: main: starting shard=11 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.345+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.345+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 20 INFO: main: starting shard=12 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.346+0000 7f2e65014800 20 INFO: main: done 2024-09-14T11:43:52.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.347+0000 7f2d16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:52.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.349+0000 7f2e65014800 20 remove_watcher() i=0 2024-09-14T11:43:52.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.349+0000 7f2e65014800 2 removed watcher, disabling cache 2024-09-14T11:43:52.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.350+0000 7f2e65014800 20 remove_watcher() i=1 2024-09-14T11:43:52.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.351+0000 7f2e65014800 20 remove_watcher() i=2 2024-09-14T11:43:52.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.352+0000 7f2e65014800 20 remove_watcher() i=3 2024-09-14T11:43:52.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.353+0000 7f2e65014800 20 remove_watcher() i=4 2024-09-14T11:43:52.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.354+0000 7f2e65014800 20 remove_watcher() i=5 2024-09-14T11:43:52.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.355+0000 7f2e65014800 20 remove_watcher() i=6 2024-09-14T11:43:52.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.356+0000 7f2e65014800 20 remove_watcher() i=7 2024-09-14T11:43:52.473 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:43:52.474 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:43:52.505 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:52.505 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:52.541 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.544+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.545+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.545+0000 7f325962f800 20 realm 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.545+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.546+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.546+0000 7f325962f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.546+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.546+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.544 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.546+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.547+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.547+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.547+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:52.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.547+0000 7f325962f800 20 searching for the correct realm 2024-09-14T11:43:52.549 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.551+0000 7f325791a640 0 -- 172.21.15.116:0/3118802196 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f324c01d070 msgr2=0x7f324c049310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:52.756 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.758+0000 7f3257119640 0 -- 172.21.15.116:0/3118802196 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x56055f73d810 msgr2=0x56055f73fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:52.758 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.760+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.759 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:52.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 zone default found 2024-09-14T11:43:52.760 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 4 Realm: () 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 zonegroup default 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.761+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 started sync module instance, tier type = 2024-09-14T11:43:52.761 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.762+0000 7f325962f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:52.769 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=0 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=1 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=2 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=3 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=4 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=5 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=6 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 20 add_watcher() i=7 2024-09-14T11:43:52.770 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.772+0000 7f325962f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.774+0000 7f310dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 5 note: GC not initialized 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f310cfe1640 20 reqs_thread_entry: start 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 Filter name: none 2024-09-14T11:43:52.773 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f30867fc640 20 reqs_thread_entry: start 2024-09-14T11:43:52.774 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.775+0000 7f325962f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 INFO: main: starting shard=0 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 INFO: main: starting shard=1 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.776+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:52.775 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 INFO: main: starting shard=2 2024-09-14T11:43:52.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:52.776 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 INFO: main: starting shard=3 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.777+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 INFO: main: starting shard=4 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 INFO: main: starting shard=5 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:52.777 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.778+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:52.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 INFO: main: starting shard=6 2024-09-14T11:43:52.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:52.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:52.778 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 INFO: main: starting shard=7 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.779+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.780+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.780+0000 7f325962f800 20 INFO: main: starting shard=8 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.780+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.780+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 INFO: main: starting shard=9 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:52.779 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:52.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:43:52.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 INFO: main: starting shard=10 2024-09-14T11:43:52.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:52.780 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.781+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 INFO: main: starting shard=11 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 INFO: main: starting shard=12 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:52.781 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.782+0000 7f325962f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:52.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.783+0000 7f325962f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:52.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.783+0000 7f325962f800 20 INFO: main: done 2024-09-14T11:43:52.782 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.784+0000 7f310dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:52.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.786+0000 7f325962f800 20 remove_watcher() i=0 2024-09-14T11:43:52.784 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.786+0000 7f325962f800 2 removed watcher, disabling cache 2024-09-14T11:43:52.785 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.788+0000 7f325962f800 20 remove_watcher() i=1 2024-09-14T11:43:52.786 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.789+0000 7f325962f800 20 remove_watcher() i=2 2024-09-14T11:43:52.787 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.790+0000 7f325962f800 20 remove_watcher() i=3 2024-09-14T11:43:52.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.791+0000 7f325962f800 20 remove_watcher() i=4 2024-09-14T11:43:52.789 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.792+0000 7f325962f800 20 remove_watcher() i=5 2024-09-14T11:43:52.790 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.793+0000 7f325962f800 20 remove_watcher() i=6 2024-09-14T11:43:52.792 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.794+0000 7f325962f800 20 remove_watcher() i=7 2024-09-14T11:43:52.910 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:43:52.911 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:43:52.941 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:52.941 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:52.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.980+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 realm 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.980 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.982+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.981 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.983+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.983+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.983+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:52.982 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.983+0000 7f02e0f2a800 20 searching for the correct realm 2024-09-14T11:43:52.985 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.987+0000 7f02d444e640 0 -- 172.21.15.116:0/2211510686 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f02cc043020 msgr2=0x7f02cc075a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:43:52.989 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.991+0000 7f02d444e640 0 -- 172.21.15.116:0/2211510686 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f01a80870d0 msgr2=0x7f01a8089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.993 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.994 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.995+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 zone default found 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 4 Realm: () 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 zonegroup default 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.995 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.996+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.997+0000 7f02e0f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.997+0000 7f02e0f2a800 20 started sync module instance, tier type = 2024-09-14T11:43:52.996 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:52.997+0000 7f02e0f2a800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=0 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=1 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=2 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=3 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=4 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=5 2024-09-14T11:43:53.004 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.006+0000 7f02e0f2a800 20 add_watcher() i=6 2024-09-14T11:43:53.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.007+0000 7f02e0f2a800 20 add_watcher() i=7 2024-09-14T11:43:53.005 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.007+0000 7f02e0f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:53.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f01937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:53.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f02e0f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:53.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f02e0f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:53.007 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f02e0f2a800 5 note: GC not initialized 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f01927e4640 20 reqs_thread_entry: start 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f02e0f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f02e0f2a800 20 Filter name: none 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.009+0000 7f018b7fe640 20 reqs_thread_entry: start 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:53.008 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 INFO: main: starting shard=0 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.010+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 INFO: main: starting shard=1 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:53.010 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 INFO: main: starting shard=2 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.011+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 INFO: main: starting shard=3 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:53.011 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:53.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 INFO: main: starting shard=4 2024-09-14T11:43:53.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:53.012 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.012+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 INFO: main: starting shard=5 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 INFO: main: starting shard=6 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.013+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:53.013 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 INFO: main: starting shard=7 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 INFO: main: starting shard=8 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:53.014 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.014+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 INFO: main: starting shard=9 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 INFO: main: starting shard=10 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:53.015 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.015+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 INFO: main: starting shard=11 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 INFO: main: starting shard=12 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.016+0000 7f02e0f2a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.017+0000 7f02e0f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.017+0000 7f02e0f2a800 20 INFO: main: done 2024-09-14T11:43:53.016 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.018+0000 7f01937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:53.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.020+0000 7f02e0f2a800 20 remove_watcher() i=0 2024-09-14T11:43:53.018 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.020+0000 7f02e0f2a800 2 removed watcher, disabling cache 2024-09-14T11:43:53.019 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.021+0000 7f02e0f2a800 20 remove_watcher() i=1 2024-09-14T11:43:53.020 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.022+0000 7f02e0f2a800 20 remove_watcher() i=2 2024-09-14T11:43:53.021 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.024+0000 7f02e0f2a800 20 remove_watcher() i=3 2024-09-14T11:43:53.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.025+0000 7f02e0f2a800 20 remove_watcher() i=4 2024-09-14T11:43:53.023 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.026+0000 7f02e0f2a800 20 remove_watcher() i=5 2024-09-14T11:43:53.024 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.027+0000 7f02e0f2a800 20 remove_watcher() i=6 2024-09-14T11:43:53.025 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.028+0000 7f02e0f2a800 20 remove_watcher() i=7 2024-09-14T11:43:53.061 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:43:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:43:53.856 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:43:53.887 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:53.888 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.926+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 realm 2024-09-14T11:43:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.927+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.928+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.928+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.928+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.929+0000 7f316211f800 20 searching for the correct realm 2024-09-14T11:43:53.930 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.932+0000 7f315e593640 0 -- 172.21.15.116:0/800479769 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f31480682f0 msgr2=0x7f314806a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:53.933 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:53.935+0000 7f315dd92640 0 -- 172.21.15.116:0/800479769 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f3148087130 msgr2=0x7f314805faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.140 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.141+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 zone default found 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 4 Realm: () 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 zonegroup default 2024-09-14T11:43:54.141 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.142+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.143+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.143+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.143+0000 7f316211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.143+0000 7f316211f800 20 started sync module instance, tier type = 2024-09-14T11:43:54.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.143+0000 7f316211f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:54.150 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=0 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=1 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=2 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=3 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=4 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=5 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=6 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 20 add_watcher() i=7 2024-09-14T11:43:54.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.153+0000 7f316211f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:54.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f300f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 5 note: GC not initialized 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f300e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 20 Filter name: none 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f2f7ffff640 20 reqs_thread_entry: start 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.156+0000 7f316211f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:43:54.155 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : miss 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 adding default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:54.156 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.157 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.157+0000 7f316211f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f316211f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f316211f800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f316211f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f316211f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f3040ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94050947092304 notifier 8174 bl.length()=821 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f3040ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f3040ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.161 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.163+0000 7f3040ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.165+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:54.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.165+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:54.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.165+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:54.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.165+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:54.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.0 2024-09-14T11:43:54.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.0 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.1 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.1 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.2 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.2 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.3 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.3 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.4 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.4 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.5 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.5 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.6 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.6 2024-09-14T11:43:54.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.7 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.7 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.8 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.8 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.10 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.10 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.11 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.11 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.12 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.12 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.13 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.13 2024-09-14T11:43:54.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.14 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.14 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.15 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.15 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.16 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.16 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:54.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.170+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:54.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.171+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:54.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.171+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:54.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.171+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:54.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.171+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.172+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.172+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.172+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.172+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.173+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.173+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.173+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.173+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.174+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.174+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.174+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:54.173 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.174+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.175+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.175+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.175+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.175+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.176+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:54.174 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.176+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:54.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.179+0000 7f316211f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:54.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.179+0000 7f316211f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:54.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f316211f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f316211f800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f316211f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f316211f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:54.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f30417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94050947092304 notifier 8174 bl.length()=821 2024-09-14T11:43:54.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f30417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f30417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.180+0000 7f30417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.182+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:54.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.182+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:54.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.182+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:54.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.182+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.0 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.1 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:54.183 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.185+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.2 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.3 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.4 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:54.184 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.186+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.5 2024-09-14T11:43:54.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.187+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:54.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.187+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.6 2024-09-14T11:43:54.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.187+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:54.185 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.187+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.7 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.8 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.9 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:54.186 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.188+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.10 2024-09-14T11:43:54.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:54.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.11 2024-09-14T11:43:54.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:54.187 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.2.12 2024-09-14T11:43:54.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:43:54.188 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.189+0000 7f316211f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f316211f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f316211f800 10 moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f316211f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f316211f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18, ofs0, ns] 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f3040ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94050947092304 notifier 8174 bl.length()=789 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f3040ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f3040ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.189 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.191+0000 7f3040ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.190 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.193+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_sources= new_sources= 2024-09-14T11:43:54.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.193+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential sources added=[] removed=[] 2024-09-14T11:43:54.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.193+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): orig_dests= new_dests= 2024-09-14T11:43:54.191 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.193+0000 7f316211f800 20 handle_bi_update(): bucket=:myver[38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18]): potential dests added=[] removed=[] 2024-09-14T11:43:54.193 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.195+0000 7f316211f800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:43:54.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.197+0000 7f300f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.199+0000 7f316211f800 20 remove_watcher() i=0 2024-09-14T11:43:54.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.199+0000 7f316211f800 2 removed watcher, disabling cache 2024-09-14T11:43:54.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.200+0000 7f316211f800 20 remove_watcher() i=1 2024-09-14T11:43:54.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.201+0000 7f316211f800 20 remove_watcher() i=2 2024-09-14T11:43:54.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.203+0000 7f316211f800 20 remove_watcher() i=3 2024-09-14T11:43:54.201 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.204+0000 7f316211f800 20 remove_watcher() i=4 2024-09-14T11:43:54.202 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.205+0000 7f316211f800 20 remove_watcher() i=5 2024-09-14T11:43:54.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.205+0000 7f316211f800 20 remove_watcher() i=6 2024-09-14T11:43:54.204 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.206+0000 7f316211f800 20 remove_watcher() i=7 2024-09-14T11:43:54.216 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:43:54.250 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:54.251 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:54.288 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.290+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 realm 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.290 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.292+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.293+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:54.291 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.293+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.294+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:54.292 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.294+0000 7fd813146800 20 searching for the correct realm 2024-09-14T11:43:54.294 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.296+0000 7fd810c37640 0 -- 172.21.15.116:0/1048535684 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7fd800003cb0 msgr2=0x7fd80c060350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:54.297 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.299+0000 7fd811438640 0 -- 172.21.15.116:0/1048535684 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fd7fc084020 msgr2=0x7fd7fc0037a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.303 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.305+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 zone default found 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 4 Realm: () 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 zonegroup default 2024-09-14T11:43:54.305 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.306+0000 7fd813146800 20 started sync module instance, tier type = 2024-09-14T11:43:54.306 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.307+0000 7fd813146800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=0 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=1 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=2 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=3 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=4 2024-09-14T11:43:54.313 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=5 2024-09-14T11:43:54.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.315+0000 7fd813146800 20 add_watcher() i=6 2024-09-14T11:43:54.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.316+0000 7fd813146800 20 add_watcher() i=7 2024-09-14T11:43:54.314 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.316+0000 7fd813146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:54.315 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.317+0000 7fd6c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:54.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:54.316 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 5 note: GC not initialized 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd6c5fe3640 20 reqs_thread_entry: start 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 Filter name: none 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd6377fe640 20 reqs_thread_entry: start 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.318+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 : miss 2024-09-14T11:43:54.317 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.318 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 info.flags=0x17 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 adding default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 to cache LRU end 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.0 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.319+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.0 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.1 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.1 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.2 2024-09-14T11:43:54.319 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.320+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.2 2024-09-14T11:43:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:43:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.3 2024-09-14T11:43:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.3 2024-09-14T11:43:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:43:54.320 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.4 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.321+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.4 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.322+0000 7fd813146800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.322+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.5 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.322+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.5 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.6 2024-09-14T11:43:54.321 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.6 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.7 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.323+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.7 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.8 2024-09-14T11:43:54.322 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.8 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.324+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.325+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.10 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.325+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.10 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.325+0000 7fd813146800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.325+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.11 2024-09-14T11:43:54.323 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.325+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.11 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.12 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.12 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.13 2024-09-14T11:43:54.324 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.326+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.13 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.14 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.14 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.15 2024-09-14T11:43:54.325 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.15 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 10 bucket_obj is .dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.16 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.327+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.16 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:x state=0x558027593de8 s->prefetch_data=0 2024-09-14T11:43:54.326 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to hi6e5g4jdvpdg693itluefqi5xoidu9u 2024-09-14T11:43:54.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 20 get_obj_state_impl: setting s->olh_tag to d1v5jhsa62ea1bbwk42hn91dqvm6howg 2024-09-14T11:43:54.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.328+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d1v5jhsa62ea1bbwk42hn91dqvm6howg 2024-09-14T11:43:54.327 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.329+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.328 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.331+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.331+0000 7fd813146800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:43:54.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.331+0000 7fd813146800 20 olh_log_entry: epoch=2 op=3 key=x[jJYk4g-MKVRjM2I3b4uGsUetBgvD1f1] 2024-09-14T11:43:54.329 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.331+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:jJYk4g-MKVRjM2I3b4uGsUetBgvD1f1_x state=0x5580275d08b8 s->prefetch_data=0 2024-09-14T11:43:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.332+0000 7fd813146800 10 manifest: total_size = 9 2024-09-14T11:43:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.332+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8092514778154312245 2024-09-14T11:43:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.332+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:jJYk4g-MKVRjM2I3b4uGsUetBgvD1f1_x state=0x5580275d08b8 s->prefetch_data=0 2024-09-14T11:43:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.332+0000 7fd813146800 20 prepare_atomic_modification: state is not atomic. state=0x5580275d08b8 2024-09-14T11:43:54.330 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.332+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.334+0000 7fd813146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:43:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.334+0000 7fd813146800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:43:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.334+0000 7fd813146800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:43:54.332 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.334+0000 7fd813146800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:jJYk4g-MKVRjM2I3b4uGsUetBgvD1f1_.oeAsOZYnNJcDtxIZOrVKw1FtnQs31r1_0 2024-09-14T11:43:54.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.335+0000 7fd6e7fff640 20 handle_completion(): completion ok for obj=x[jJYk4g-MKVRjM2I3b4uGsUetBgvD1f1] 2024-09-14T11:43:54.333 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.335+0000 7fd813146800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:43:54.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.336+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:x state=0x558027593de8 s->prefetch_data=0 2024-09-14T11:43:54.334 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.336+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d1v5jhsa62ea1bbwk42hn91dqvm6howg 2024-09-14T11:43:54.335 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.338+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.336 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.339+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.339+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.339+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:y state=0x558027598398 s->prefetch_data=0 2024-09-14T11:43:54.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.340+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to sk61295y2xgadk0v5jddqnd9ee8f3o7z 2024-09-14T11:43:54.337 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.340+0000 7fd813146800 20 get_obj_state_impl: setting s->olh_tag to r7g229mok62dw0msvlm6apq4lkl23q38 2024-09-14T11:43:54.338 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.340+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=r7g229mok62dw0msvlm6apq4lkl23q38 2024-09-14T11:43:54.339 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.341+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.342+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.342+0000 7fd813146800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:43:54.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.342+0000 7fd813146800 20 olh_log_entry: epoch=2 op=3 key=y[pd5RXQmDI7mx9LBiQ5cccYX2qaUvpIq] 2024-09-14T11:43:54.340 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.342+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:pd5RXQmDI7mx9LBiQ5cccYX2qaUvpIq_y state=0x5580275d08b8 s->prefetch_data=0 2024-09-14T11:43:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.343+0000 7fd813146800 10 manifest: total_size = 12 2024-09-14T11:43:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.343+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11715072492509076528 2024-09-14T11:43:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.343+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:pd5RXQmDI7mx9LBiQ5cccYX2qaUvpIq_y state=0x5580275d08b8 s->prefetch_data=0 2024-09-14T11:43:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.343+0000 7fd813146800 20 prepare_atomic_modification: state is not atomic. state=0x5580275d08b8 2024-09-14T11:43:54.341 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.343+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.345+0000 7fd813146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:43:54.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.345+0000 7fd813146800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:43:54.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.345+0000 7fd813146800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:43:54.343 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.345+0000 7fd813146800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:pd5RXQmDI7mx9LBiQ5cccYX2qaUvpIq_.SuHsTzRHJXB8LmAQk8YeeCo0J7rTuAJ_0 2024-09-14T11:43:54.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.346+0000 7fd6e7fff640 20 handle_completion(): completion ok for obj=y[pd5RXQmDI7mx9LBiQ5cccYX2qaUvpIq] 2024-09-14T11:43:54.344 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.346+0000 7fd813146800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:43:54.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.347+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:y state=0x558027598398 s->prefetch_data=0 2024-09-14T11:43:54.345 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.347+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=r7g229mok62dw0msvlm6apq4lkl23q38 2024-09-14T11:43:54.346 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.349+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.347 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.350+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.350+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.350+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:z state=0x558027598378 s->prefetch_data=0 2024-09-14T11:43:54.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.350+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to 4agzx1fve02vnai3vh2lwqjz6redskbe 2024-09-14T11:43:54.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.350+0000 7fd813146800 20 get_obj_state_impl: setting s->olh_tag to g5nvdyzf9eg7jvw13q9tsa2b4xlxzf7l 2024-09-14T11:43:54.348 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.351+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g5nvdyzf9eg7jvw13q9tsa2b4xlxzf7l 2024-09-14T11:43:54.349 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.352+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.350 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.353+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.353+0000 7fd813146800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:43:54.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.353+0000 7fd813146800 20 olh_log_entry: epoch=2 op=3 key=z[.XbaMfKvt7e1DQvloJ-5Az-fISv4yLJ] 2024-09-14T11:43:54.351 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.353+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:.XbaMfKvt7e1DQvloJ-5Az-fISv4yLJ_z state=0x5580275cd888 s->prefetch_data=0 2024-09-14T11:43:54.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.354+0000 7fd813146800 10 manifest: total_size = 9 2024-09-14T11:43:54.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.354+0000 7fd813146800 20 get_obj_state: setting s->obj_tag to 38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17674306343604730366 2024-09-14T11:43:54.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.354+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:_:.XbaMfKvt7e1DQvloJ-5Az-fISv4yLJ_z state=0x5580275cd888 s->prefetch_data=0 2024-09-14T11:43:54.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.354+0000 7fd813146800 20 prepare_atomic_modification: state is not atomic. state=0x5580275cd888 2024-09-14T11:43:54.352 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.354+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.356+0000 7fd813146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:43:54.353 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.356+0000 7fd813146800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:43:54.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.356+0000 7fd813146800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:43:54.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.356+0000 7fd813146800 5 delete_objs_inline: removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:.XbaMfKvt7e1DQvloJ-5Az-fISv4yLJ_.VFjICUo3m3RQEXXpt4AANWvsFDhaNFp_0 2024-09-14T11:43:54.354 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.357+0000 7fd6e7fff640 20 handle_completion(): completion ok for obj=z[.XbaMfKvt7e1DQvloJ-5Az-fISv4yLJ] 2024-09-14T11:43:54.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.357+0000 7fd813146800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:43:54.355 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.358+0000 7fd813146800 20 get_obj_state: octx=0x5580272ca380 obj=myver:z state=0x558027598378 s->prefetch_data=0 2024-09-14T11:43:54.356 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.358+0000 7fd813146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g5nvdyzf9eg7jvw13q9tsa2b4xlxzf7l 2024-09-14T11:43:54.357 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.360+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.361+0000 7fd813146800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18.3.9 2024-09-14T11:43:54.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.361+0000 7fd813146800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:43:54.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.361+0000 7fd813146800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:43:54.359 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.362+0000 7fd6c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.364+0000 7fd813146800 20 remove_watcher() i=0 2024-09-14T11:43:54.362 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.364+0000 7fd813146800 2 removed watcher, disabling cache 2024-09-14T11:43:54.363 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.365+0000 7fd813146800 20 remove_watcher() i=1 2024-09-14T11:43:54.364 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.366+0000 7fd813146800 20 remove_watcher() i=2 2024-09-14T11:43:54.365 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.367+0000 7fd813146800 20 remove_watcher() i=3 2024-09-14T11:43:54.366 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.368+0000 7fd813146800 20 remove_watcher() i=4 2024-09-14T11:43:54.367 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.369+0000 7fd813146800 20 remove_watcher() i=5 2024-09-14T11:43:54.368 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.370+0000 7fd813146800 20 remove_watcher() i=6 2024-09-14T11:43:54.369 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.371+0000 7fd813146800 20 remove_watcher() i=7 2024-09-14T11:43:54.513 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:43:54.541 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:43:54.541 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:43:54.577 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.579+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.579 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 20 realm 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.581+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.582+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.580 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.582+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.582+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:54.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.583+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.583+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:43:54.581 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.583+0000 7f6ad2142800 20 searching for the correct realm 2024-09-14T11:43:54.583 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.585+0000 7f6acd6ec640 0 -- 172.21.15.116:0/3041937304 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f6ac0086070 msgr2=0x7f6ac005a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:54.587 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.589+0000 7f6acdeed640 0 -- 172.21.15.116:0/3041937304 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6ac403c0b0 msgr2=0x7f6ac4046a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:43:54.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:43:54.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:43:54.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:43:54.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:43:54.795 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.796+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 zone default found 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 4 Realm: () 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 zonegroup default 2024-09-14T11:43:54.796 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.797+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.798+0000 7f6ad2142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.798+0000 7f6ad2142800 20 started sync module instance, tier type = 2024-09-14T11:43:54.797 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.798+0000 7f6ad2142800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=0 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=1 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=2 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=3 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=4 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=5 2024-09-14T11:43:54.804 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.806+0000 7f6ad2142800 20 add_watcher() i=6 2024-09-14T11:43:54.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.807+0000 7f6ad2142800 20 add_watcher() i=7 2024-09-14T11:43:54.805 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.807+0000 7f6ad2142800 2 all 8 watchers are set, enabling cache 2024-09-14T11:43:54.806 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.808+0000 7f697f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:43:54.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:43:54.807 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 5 note: GC not initialized 2024-09-14T11:43:54.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f697e7fc640 20 reqs_thread_entry: start 2024-09-14T11:43:54.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 20 init_complete bucket index max shards: 11 2024-09-14T11:43:54.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 20 Filter name: none 2024-09-14T11:43:54.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f68effff640 20 reqs_thread_entry: start 2024-09-14T11:43:54.808 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.809+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.810+0000 7f6ad2142800 20 rados->read ofs=0 len=0 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.811+0000 7f6ad2142800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:43:54.809 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.811+0000 7f6ad2142800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:43:54.810 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.813+0000 7f697f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:43:54.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.814+0000 7f6ad2142800 20 remove_watcher() i=0 2024-09-14T11:43:54.812 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.815+0000 7f6ad2142800 2 removed watcher, disabling cache 2024-09-14T11:43:54.814 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.816+0000 7f6ad2142800 20 remove_watcher() i=1 2024-09-14T11:43:54.815 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.817+0000 7f6ad2142800 20 remove_watcher() i=2 2024-09-14T11:43:54.816 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.818+0000 7f6ad2142800 20 remove_watcher() i=3 2024-09-14T11:43:54.817 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.819+0000 7f6ad2142800 20 remove_watcher() i=4 2024-09-14T11:43:54.818 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.821+0000 7f6ad2142800 20 remove_watcher() i=5 2024-09-14T11:43:54.819 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.822+0000 7f6ad2142800 20 remove_watcher() i=6 2024-09-14T11:43:54.820 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T11:43:54.822+0000 7f6ad2142800 20 remove_watcher() i=7 2024-09-14T11:43:54.831 INFO:tasks.workunit.client.0.smithi116.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:43:54.831 INFO:tasks.workunit.client.0.smithi116.stderr:Deleting bucket a-bucket 2024-09-14T11:43:54.909 INFO:tasks.workunit.client.0.smithi116.stderr:Deleting bucket myver 2024-09-14T11:43:55.144 INFO:tasks.workunit.client.0.smithi116.stderr:Completed resharding tests 2024-09-14T11:43:55.144 INFO:tasks.workunit.client.0.smithi116.stdout:connected to http://localhost:80 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ deactivate 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ hash -r 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T11:43:55.219 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:43:55.220 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:43:55.220 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset -f deactivate 2024-09-14T11:43:55.220 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo OK. 2024-09-14T11:43:55.221 INFO:tasks.workunit.client.0.smithi116.stdout:OK. 2024-09-14T11:43:55.221 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:43:55.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:43:55.299 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:43:55.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:43:55.707 DEBUG:teuthology.parallel:result is None 2024-09-14T11:43:55.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:43:55.746 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:43:55.747 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:43:55.815 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:43:55.815 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:43:55.831 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:43:55.831 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:43:55.831 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:43:55.831 DEBUG:teuthology.orchestra.run.smithi116:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:43:55.885 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:44:00.610 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:44:00.611 DEBUG:teuthology.orchestra.run.smithi116:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:44:02.493 INFO:teuthology.orchestra.run.smithi116.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:44:03.057 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:30:31 ago on Sat 14 Sep 2024 11:13:32 AM UTC. 2024-09-14T11:44:03.199 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:44:03.200 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout:Install 5 Packages 2024-09-14T11:44:03.201 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:03.202 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 46 M 2024-09-14T11:44:03.202 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 166 M 2024-09-14T11:44:03.202 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T11:44:03.504 INFO:teuthology.orchestra.run.smithi116.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.8 MB/s | 426 kB 00:00 2024-09-14T11:44:03.629 INFO:teuthology.orchestra.run.smithi116.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.9 MB/s | 3.5 MB 00:00 2024-09-14T11:44:03.679 INFO:teuthology.orchestra.run.smithi116.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 517 kB/s | 26 kB 00:00 2024-09-14T11:44:03.796 INFO:teuthology.orchestra.run.smithi116.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 18 MB/s | 9.3 MB 00:00 2024-09-14T11:44:04.405 INFO:teuthology.orchestra.run.smithi116.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 36 MB/s | 32 MB 00:00 2024-09-14T11:44:04.405 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:44:04.405 INFO:teuthology.orchestra.run.smithi116.stdout:Total 38 MB/s | 46 MB 00:01 2024-09-14T11:44:04.831 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T11:44:04.851 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T11:44:04.852 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T11:44:05.336 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T11:44:05.336 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T11:44:05.861 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:44:06.007 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T11:44:06.189 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:44:06.796 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:44:06.832 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:44:07.070 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:44:07.099 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:44:07.328 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:44:07.370 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:44:07.378 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:44:07.388 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:44:07.431 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:44:10.371 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:44:10.371 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:44:10.371 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:44:10.371 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:44:10.372 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:44:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:44:10.779 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:10.780 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T11:44:11.231 INFO:teuthology.orchestra.run.smithi116.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:44:11.312 INFO:teuthology.orchestra.run.smithi116.stderr:--2024-09-14 11:44:11-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:44:11.723 INFO:teuthology.orchestra.run.smithi116.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-14T11:44:11.731 INFO:teuthology.orchestra.run.smithi116.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-14T11:44:11.812 INFO:teuthology.orchestra.run.smithi116.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:44:11.812 INFO:teuthology.orchestra.run.smithi116.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:44:11.812 INFO:teuthology.orchestra.run.smithi116.stderr:--2024-09-14 11:44:11-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:44:11.812 INFO:teuthology.orchestra.run.smithi116.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-14T11:44:11.822 INFO:teuthology.orchestra.run.smithi116.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-14T11:44:11.964 INFO:teuthology.orchestra.run.smithi116.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:44:11.964 INFO:teuthology.orchestra.run.smithi116.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114411Z&X-Amz-Expires=300&X-Amz-Signature=cef3dd56f6efac1f9f382a0da2166d2cefb4ef2306edaa0333248db868ec2e6b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:44:11.964 INFO:teuthology.orchestra.run.smithi116.stderr:--2024-09-14 11:44:11-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114411Z&X-Amz-Expires=300&X-Amz-Signature=cef3dd56f6efac1f9f382a0da2166d2cefb4ef2306edaa0333248db868ec2e6b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:44:11.965 INFO:teuthology.orchestra.run.smithi116.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.110.133, ... 2024-09-14T11:44:11.977 INFO:teuthology.orchestra.run.smithi116.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-14T11:44:12.050 INFO:teuthology.orchestra.run.smithi116.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:44:12.050 INFO:teuthology.orchestra.run.smithi116.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:44:12.050 INFO:teuthology.orchestra.run.smithi116.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:44:12.050 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T11:44:12.064 INFO:teuthology.orchestra.run.smithi116.stderr: 0K .......... .......... .......... .......... .......... 0% 3.32M 27s 2024-09-14T11:44:12.077 INFO:teuthology.orchestra.run.smithi116.stderr: 50K .......... .......... .......... .......... .......... 0% 3.73M 26s 2024-09-14T11:44:12.087 INFO:teuthology.orchestra.run.smithi116.stderr: 100K .......... .......... .......... .......... .......... 0% 5.20M 23s 2024-09-14T11:44:12.088 INFO:teuthology.orchestra.run.smithi116.stderr: 150K .......... .......... .......... .......... .......... 0% 22.5M 18s 2024-09-14T11:44:12.090 INFO:teuthology.orchestra.run.smithi116.stderr: 200K .......... .......... .......... .......... .......... 0% 25.6M 15s 2024-09-14T11:44:12.093 INFO:teuthology.orchestra.run.smithi116.stderr: 250K .......... .......... .......... .......... .......... 0% 23.4M 13s 2024-09-14T11:44:12.100 INFO:teuthology.orchestra.run.smithi116.stderr: 300K .......... .......... .......... .......... .......... 0% 6.78M 13s 2024-09-14T11:44:12.101 INFO:teuthology.orchestra.run.smithi116.stderr: 350K .......... .......... .......... .......... .......... 0% 50.0M 12s 2024-09-14T11:44:12.103 INFO:teuthology.orchestra.run.smithi116.stderr: 400K .......... .......... .......... .......... .......... 0% 35.4M 11s 2024-09-14T11:44:12.103 INFO:teuthology.orchestra.run.smithi116.stderr: 450K .......... .......... .......... .......... .......... 0% 84.7M 10s 2024-09-14T11:44:12.104 INFO:teuthology.orchestra.run.smithi116.stderr: 500K .......... .......... .......... .......... .......... 0% 51.5M 9s 2024-09-14T11:44:12.105 INFO:teuthology.orchestra.run.smithi116.stderr: 550K .......... .......... .......... .......... .......... 0% 44.4M 9s 2024-09-14T11:44:12.111 INFO:teuthology.orchestra.run.smithi116.stderr: 600K .......... .......... .......... .......... .......... 0% 8.14M 9s 2024-09-14T11:44:12.112 INFO:teuthology.orchestra.run.smithi116.stderr: 650K .......... .......... .......... .......... .......... 0% 344M 8s 2024-09-14T11:44:12.113 INFO:teuthology.orchestra.run.smithi116.stderr: 700K .......... .......... .......... .......... .......... 0% 35.1M 8s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 750K .......... .......... .......... .......... .......... 0% 37.7M 7s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 800K .......... .......... .......... .......... .......... 0% 173M 7s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 850K .......... .......... .......... .......... .......... 0% 66.1M 7s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 900K .......... .......... .......... .......... .......... 1% 220M 6s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 950K .......... .......... .......... .......... .......... 1% 70.9M 6s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 1000K .......... .......... .......... .......... .......... 1% 53.0M 6s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 1050K .......... .......... .......... .......... .......... 1% 136M 6s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 1100K .......... .......... .......... .......... .......... 1% 72.5M 5s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 1150K .......... .......... .......... .......... .......... 1% 227M 5s 2024-09-14T11:44:12.120 INFO:teuthology.orchestra.run.smithi116.stderr: 1200K .......... .......... .......... .......... .......... 1% 92.1M 5s 2024-09-14T11:44:13.465 INFO:teuthology.orchestra.run.smithi116.stderr: 1250K .......... .......... .......... .......... .......... 1% 10.2M 5s 2024-09-14T11:44:13.465 INFO:teuthology.orchestra.run.smithi116.stderr: 1300K .......... .......... .......... .......... .......... 1% 247M 5s 2024-09-14T11:44:13.465 INFO:teuthology.orchestra.run.smithi116.stderr: 1350K .......... .......... .......... .......... .......... 1% 357M 5s 2024-09-14T11:44:13.465 INFO:teuthology.orchestra.run.smithi116.stderr: 1400K .......... .......... .......... .......... .......... 1% 40.4M 5s 2024-09-14T11:44:13.465 INFO:teuthology.orchestra.run.smithi116.stderr: 1450K .......... .......... .......... .......... .......... 1% 225M 5s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1500K .......... .......... .......... .......... .......... 1% 53.6M 5s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1550K .......... .......... .......... .......... .......... 1% 252M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1600K .......... .......... .......... .......... .......... 1% 350M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1650K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1700K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1750K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1800K .......... .......... .......... .......... .......... 1% 256M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1850K .......... .......... .......... .......... .......... 2% 132M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1900K .......... .......... .......... .......... .......... 2% 126M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 1950K .......... .......... .......... .......... .......... 2% 186M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2000K .......... .......... .......... .......... .......... 2% 143M 4s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2050K .......... .......... .......... .......... .......... 2% 284M 3s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2100K .......... .......... .......... .......... .......... 2% 170M 3s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2150K .......... .......... .......... .......... .......... 2% 155M 3s 2024-09-14T11:44:13.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2200K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2250K .......... .......... .......... .......... .......... 2% 270M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2300K .......... .......... .......... .......... .......... 2% 178M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2350K .......... .......... .......... .......... .......... 2% 157M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2400K .......... .......... .......... .......... .......... 2% 202M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2450K .......... .......... .......... .......... .......... 2% 204M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2500K .......... .......... .......... .......... .......... 2% 257M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2550K .......... .......... .......... .......... .......... 2% 11.5M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2600K .......... .......... .......... .......... .......... 2% 330M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2650K .......... .......... .......... .......... .......... 2% 287M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2700K .......... .......... .......... .......... .......... 2% 276M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2750K .......... .......... .......... .......... .......... 3% 365M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2800K .......... .......... .......... .......... .......... 3% 66.5M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2850K .......... .......... .......... .......... .......... 3% 237M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2900K .......... .......... .......... .......... .......... 3% 300M 3s 2024-09-14T11:44:13.467 INFO:teuthology.orchestra.run.smithi116.stderr: 2950K .......... .......... .......... .......... .......... 3% 332M 3s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3000K .......... .......... .......... .......... .......... 3% 295M 3s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3050K .......... .......... .......... .......... .......... 3% 139M 3s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3100K .......... .......... .......... .......... .......... 3% 131M 3s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3150K .......... .......... .......... .......... .......... 3% 315M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3200K .......... .......... .......... .......... .......... 3% 349M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3250K .......... .......... .......... .......... .......... 3% 329M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3300K .......... .......... .......... .......... .......... 3% 244M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3350K .......... .......... .......... .......... .......... 3% 227M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3400K .......... .......... .......... .......... .......... 3% 277M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3450K .......... .......... .......... .......... .......... 3% 307M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3500K .......... .......... .......... .......... .......... 3% 246M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3550K .......... .......... .......... .......... .......... 3% 303M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3600K .......... .......... .......... .......... .......... 3% 281M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3650K .......... .......... .......... .......... .......... 3% 264M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3700K .......... .......... .......... .......... .......... 4% 275M 2s 2024-09-14T11:44:13.468 INFO:teuthology.orchestra.run.smithi116.stderr: 3750K .......... .......... .......... .......... .......... 4% 308M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 3800K .......... .......... .......... .......... .......... 4% 291M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 3850K .......... .......... .......... .......... .......... 4% 281M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 3900K .......... .......... .......... .......... .......... 4% 256M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 3950K .......... .......... .......... .......... .......... 4% 371M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4000K .......... .......... .......... .......... .......... 4% 358M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4050K .......... .......... .......... .......... .......... 4% 335M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4100K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4150K .......... .......... .......... .......... .......... 4% 332M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4200K .......... .......... .......... .......... .......... 4% 329M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4250K .......... .......... .......... .......... .......... 4% 347M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4300K .......... .......... .......... .......... .......... 4% 243M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4350K .......... .......... .......... .......... .......... 4% 331M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4400K .......... .......... .......... .......... .......... 4% 342M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4450K .......... .......... .......... .......... .......... 4% 332M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4500K .......... .......... .......... .......... .......... 4% 294M 2s 2024-09-14T11:44:13.469 INFO:teuthology.orchestra.run.smithi116.stderr: 4550K .......... .......... .......... .......... .......... 4% 315M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4600K .......... .......... .......... .......... .......... 5% 343M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4650K .......... .......... .......... .......... .......... 5% 329M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4700K .......... .......... .......... .......... .......... 5% 276M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4750K .......... .......... .......... .......... .......... 5% 318M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4800K .......... .......... .......... .......... .......... 5% 319M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4850K .......... .......... .......... .......... .......... 5% 321M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4900K .......... .......... .......... .......... .......... 5% 308M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 4950K .......... .......... .......... .......... .......... 5% 362M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5000K .......... .......... .......... .......... .......... 5% 354M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5050K .......... .......... .......... .......... .......... 5% 352M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5100K .......... .......... .......... .......... .......... 5% 14.8M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5150K .......... .......... .......... .......... .......... 5% 308M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5200K .......... .......... .......... .......... .......... 5% 327M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5250K .......... .......... .......... .......... .......... 5% 316M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5300K .......... .......... .......... .......... .......... 5% 277M 2s 2024-09-14T11:44:13.470 INFO:teuthology.orchestra.run.smithi116.stderr: 5350K .......... .......... .......... .......... .......... 5% 350M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5400K .......... .......... .......... .......... .......... 5% 328M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5450K .......... .......... .......... .......... .......... 5% 346M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5500K .......... .......... .......... .......... .......... 5% 283M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5550K .......... .......... .......... .......... .......... 6% 301M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5600K .......... .......... .......... .......... .......... 6% 328M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5650K .......... .......... .......... .......... .......... 6% 334M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5700K .......... .......... .......... .......... .......... 6% 288M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5750K .......... .......... .......... .......... .......... 6% 240M 2s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5800K .......... .......... .......... .......... .......... 6% 311M 1s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5850K .......... .......... .......... .......... .......... 6% 308M 1s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5900K .......... .......... .......... .......... .......... 6% 255M 1s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 5950K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 6000K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-14T11:44:13.471 INFO:teuthology.orchestra.run.smithi116.stderr: 6050K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6100K .......... .......... .......... .......... .......... 6% 285M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6150K .......... .......... .......... .......... .......... 6% 375M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6200K .......... .......... .......... .......... .......... 6% 322M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6250K .......... .......... .......... .......... .......... 6% 325M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6300K .......... .......... .......... .......... .......... 6% 320M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6350K .......... .......... .......... .......... .......... 6% 292M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6400K .......... .......... .......... .......... .......... 6% 332M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6450K .......... .......... .......... .......... .......... 6% 331M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6500K .......... .......... .......... .......... .......... 7% 311M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6550K .......... .......... .......... .......... .......... 7% 353M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6600K .......... .......... .......... .......... .......... 7% 301M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6650K .......... .......... .......... .......... .......... 7% 320M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6700K .......... .......... .......... .......... .......... 7% 273M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6750K .......... .......... .......... .......... .......... 7% 354M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6800K .......... .......... .......... .......... .......... 7% 306M 1s 2024-09-14T11:44:13.472 INFO:teuthology.orchestra.run.smithi116.stderr: 6850K .......... .......... .......... .......... .......... 7% 290M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 6900K .......... .......... .......... .......... .......... 7% 246M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 6950K .......... .......... .......... .......... .......... 7% 336M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7000K .......... .......... .......... .......... .......... 7% 320M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7050K .......... .......... .......... .......... .......... 7% 186M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7100K .......... .......... .......... .......... .......... 7% 287M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7150K .......... .......... .......... .......... .......... 7% 324M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7200K .......... .......... .......... .......... .......... 7% 355M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7250K .......... .......... .......... .......... .......... 7% 352M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7300K .......... .......... .......... .......... .......... 7% 298M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7350K .......... .......... .......... .......... .......... 7% 317M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7400K .......... .......... .......... .......... .......... 8% 335M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7450K .......... .......... .......... .......... .......... 8% 341M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7500K .......... .......... .......... .......... .......... 8% 311M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7550K .......... .......... .......... .......... .......... 8% 369M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7600K .......... .......... .......... .......... .......... 8% 283M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7650K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-14T11:44:13.473 INFO:teuthology.orchestra.run.smithi116.stderr: 7700K .......... .......... .......... .......... .......... 8% 345M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 7750K .......... .......... .......... .......... .......... 8% 379M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 7800K .......... .......... .......... .......... .......... 8% 278M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 7850K .......... .......... .......... .......... .......... 8% 325M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 7900K .......... .......... .......... .......... .......... 8% 273M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 7950K .......... .......... .......... .......... .......... 8% 334M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8000K .......... .......... .......... .......... .......... 8% 16.8M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8050K .......... .......... .......... .......... .......... 8% 272M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8100K .......... .......... .......... .......... .......... 8% 267M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8150K .......... .......... .......... .......... .......... 8% 334M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8200K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8250K .......... .......... .......... .......... .......... 8% 255M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8300K .......... .......... .......... .......... .......... 8% 263M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8350K .......... .......... .......... .......... .......... 9% 360M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8400K .......... .......... .......... .......... .......... 9% 321M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8450K .......... .......... .......... .......... .......... 9% 308M 1s 2024-09-14T11:44:13.474 INFO:teuthology.orchestra.run.smithi116.stderr: 8500K .......... .......... .......... .......... .......... 9% 313M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8550K .......... .......... .......... .......... .......... 9% 373M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8600K .......... .......... .......... .......... .......... 9% 341M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8650K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8700K .......... .......... .......... .......... .......... 9% 239M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8750K .......... .......... .......... .......... .......... 9% 339M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8800K .......... .......... .......... .......... .......... 9% 382M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8850K .......... .......... .......... .......... .......... 9% 382M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8900K .......... .......... .......... .......... .......... 9% 317M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 8950K .......... .......... .......... .......... .......... 9% 352M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9000K .......... .......... .......... .......... .......... 9% 297M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9050K .......... .......... .......... .......... .......... 9% 311M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9100K .......... .......... .......... .......... .......... 9% 302M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9150K .......... .......... .......... .......... .......... 9% 131M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9200K .......... .......... .......... .......... .......... 9% 381M 1s 2024-09-14T11:44:13.475 INFO:teuthology.orchestra.run.smithi116.stderr: 9250K .......... .......... .......... .......... .......... 10% 339M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9300K .......... .......... .......... .......... .......... 10% 314M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9350K .......... .......... .......... .......... .......... 10% 351M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9400K .......... .......... .......... .......... .......... 10% 380M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9450K .......... .......... .......... .......... .......... 10% 397M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9500K .......... .......... .......... .......... .......... 10% 247M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9550K .......... .......... .......... .......... .......... 10% 290M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9600K .......... .......... .......... .......... .......... 10% 311M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9650K .......... .......... .......... .......... .......... 10% 373M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9700K .......... .......... .......... .......... .......... 10% 350M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9750K .......... .......... .......... .......... .......... 10% 394M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9800K .......... .......... .......... .......... .......... 10% 80.1M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9850K .......... .......... .......... .......... .......... 10% 336M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9900K .......... .......... .......... .......... .......... 10% 288M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 9950K .......... .......... .......... .......... .......... 10% 377M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 10000K .......... .......... .......... .......... .......... 10% 358M 1s 2024-09-14T11:44:13.476 INFO:teuthology.orchestra.run.smithi116.stderr: 10050K .......... .......... .......... .......... .......... 10% 84.4M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10100K .......... .......... .......... .......... .......... 10% 301M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10150K .......... .......... .......... .......... .......... 10% 393M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10200K .......... .......... .......... .......... .......... 11% 341M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10250K .......... .......... .......... .......... .......... 11% 395M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10300K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10350K .......... .......... .......... .......... .......... 11% 318M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10400K .......... .......... .......... .......... .......... 11% 380M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10450K .......... .......... .......... .......... .......... 11% 367M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10500K .......... .......... .......... .......... .......... 11% 337M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10550K .......... .......... .......... .......... .......... 11% 371M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10600K .......... .......... .......... .......... .......... 11% 416M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10650K .......... .......... .......... .......... .......... 11% 414M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10700K .......... .......... .......... .......... .......... 11% 306M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10750K .......... .......... .......... .......... .......... 11% 413M 1s 2024-09-14T11:44:13.477 INFO:teuthology.orchestra.run.smithi116.stderr: 10800K .......... .......... .......... .......... .......... 11% 364M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 10850K .......... .......... .......... .......... .......... 11% 362M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 10900K .......... .......... .......... .......... .......... 11% 364M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 10950K .......... .......... .......... .......... .......... 11% 397M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11000K .......... .......... .......... .......... .......... 11% 52.3M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11050K .......... .......... .......... .......... .......... 11% 319M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11100K .......... .......... .......... .......... .......... 12% 31.7M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11150K .......... .......... .......... .......... .......... 12% 133M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11200K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11250K .......... .......... .......... .......... .......... 12% 346M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11300K .......... .......... .......... .......... .......... 12% 234M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11350K .......... .......... .......... .......... .......... 12% 321M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11400K .......... .......... .......... .......... .......... 12% 370M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11450K .......... .......... .......... .......... .......... 12% 362M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11500K .......... .......... .......... .......... .......... 12% 320M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11550K .......... .......... .......... .......... .......... 12% 333M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11600K .......... .......... .......... .......... .......... 12% 353M 1s 2024-09-14T11:44:13.478 INFO:teuthology.orchestra.run.smithi116.stderr: 11650K .......... .......... .......... .......... .......... 12% 355M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11700K .......... .......... .......... .......... .......... 12% 293M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11750K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11800K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11850K .......... .......... .......... .......... .......... 12% 311M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11900K .......... .......... .......... .......... .......... 12% 307M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 11950K .......... .......... .......... .......... .......... 12% 124M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12000K .......... .......... .......... .......... .......... 12% 302M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12050K .......... .......... .......... .......... .......... 13% 351M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12100K .......... .......... .......... .......... .......... 13% 318M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12150K .......... .......... .......... .......... .......... 13% 135M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12200K .......... .......... .......... .......... .......... 13% 286M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12250K .......... .......... .......... .......... .......... 13% 336M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12300K .......... .......... .......... .......... .......... 13% 272M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12350K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12400K .......... .......... .......... .......... .......... 13% 226M 1s 2024-09-14T11:44:13.479 INFO:teuthology.orchestra.run.smithi116.stderr: 12450K .......... .......... .......... .......... .......... 13% 332M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12500K .......... .......... .......... .......... .......... 13% 329M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12550K .......... .......... .......... .......... .......... 13% 378M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12600K .......... .......... .......... .......... .......... 13% 375M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12650K .......... .......... .......... .......... .......... 13% 371M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12700K .......... .......... .......... .......... .......... 13% 300M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12750K .......... .......... .......... .......... .......... 13% 74.7M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12800K .......... .......... .......... .......... .......... 13% 363M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12850K .......... .......... .......... .......... .......... 13% 288M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12900K .......... .......... .......... .......... .......... 13% 324M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 12950K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13000K .......... .......... .......... .......... .......... 14% 392M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13050K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13100K .......... .......... .......... .......... .......... 14% 320M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13150K .......... .......... .......... .......... .......... 14% 202M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13200K .......... .......... .......... .......... .......... 14% 330M 1s 2024-09-14T11:44:13.480 INFO:teuthology.orchestra.run.smithi116.stderr: 13250K .......... .......... .......... .......... .......... 14% 331M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13300K .......... .......... .......... .......... .......... 14% 334M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13350K .......... .......... .......... .......... .......... 14% 390M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13400K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13450K .......... .......... .......... .......... .......... 14% 385M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13500K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13550K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13600K .......... .......... .......... .......... .......... 14% 384M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13650K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13700K .......... .......... .......... .......... .......... 14% 286M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13750K .......... .......... .......... .......... .......... 14% 375M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13800K .......... .......... .......... .......... .......... 14% 386M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13850K .......... .......... .......... .......... .......... 14% 73.8M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13900K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 13950K .......... .......... .......... .......... .......... 15% 334M 1s 2024-09-14T11:44:13.481 INFO:teuthology.orchestra.run.smithi116.stderr: 14000K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14050K .......... .......... .......... .......... .......... 15% 343M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14100K .......... .......... .......... .......... .......... 15% 69.3M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14150K .......... .......... .......... .......... .......... 15% 61.2M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14200K .......... .......... .......... .......... .......... 15% 333M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14250K .......... .......... .......... .......... .......... 15% 103M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14300K .......... .......... .......... .......... .......... 15% 153M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14350K .......... .......... .......... .......... .......... 15% 331M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14400K .......... .......... .......... .......... .......... 15% 350M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14450K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14500K .......... .......... .......... .......... .......... 15% 252M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14550K .......... .......... .......... .......... .......... 15% 389M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14600K .......... .......... .......... .......... .......... 15% 368M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14650K .......... .......... .......... .......... .......... 15% 384M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14700K .......... .......... .......... .......... .......... 15% 322M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14750K .......... .......... .......... .......... .......... 15% 301M 1s 2024-09-14T11:44:13.482 INFO:teuthology.orchestra.run.smithi116.stderr: 14800K .......... .......... .......... .......... .......... 15% 256M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 14850K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 14900K .......... .......... .......... .......... .......... 16% 110M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 14950K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15000K .......... .......... .......... .......... .......... 16% 338M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15050K .......... .......... .......... .......... .......... 16% 312M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15100K .......... .......... .......... .......... .......... 16% 119M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15150K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15200K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15250K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15300K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15350K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15400K .......... .......... .......... .......... .......... 16% 353M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15450K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15500K .......... .......... .......... .......... .......... 16% 303M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15550K .......... .......... .......... .......... .......... 16% 223M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15600K .......... .......... .......... .......... .......... 16% 335M 1s 2024-09-14T11:44:13.483 INFO:teuthology.orchestra.run.smithi116.stderr: 15650K .......... .......... .......... .......... .......... 16% 339M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15700K .......... .......... .......... .......... .......... 16% 286M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15750K .......... .......... .......... .......... .......... 17% 90.7M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15800K .......... .......... .......... .......... .......... 17% 292M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15850K .......... .......... .......... .......... .......... 17% 348M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15900K .......... .......... .......... .......... .......... 17% 152M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 15950K .......... .......... .......... .......... .......... 17% 233M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16000K .......... .......... .......... .......... .......... 17% 362M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16050K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16100K .......... .......... .......... .......... .......... 17% 316M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16150K .......... .......... .......... .......... .......... 17% 190M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16200K .......... .......... .......... .......... .......... 17% 358M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16250K .......... .......... .......... .......... .......... 17% 367M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16300K .......... .......... .......... .......... .......... 17% 333M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16350K .......... .......... .......... .......... .......... 17% 320M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16400K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-14T11:44:13.484 INFO:teuthology.orchestra.run.smithi116.stderr: 16450K .......... .......... .......... .......... .......... 17% 342M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16500K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16550K .......... .......... .......... .......... .......... 17% 354M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16600K .......... .......... .......... .......... .......... 17% 379M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16650K .......... .......... .......... .......... .......... 17% 358M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16700K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16750K .......... .......... .......... .......... .......... 18% 391M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16800K .......... .......... .......... .......... .......... 18% 411M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16850K .......... .......... .......... .......... .......... 18% 401M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16900K .......... .......... .......... .......... .......... 18% 122M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 16950K .......... .......... .......... .......... .......... 18% 151M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17000K .......... .......... .......... .......... .......... 18% 270M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17050K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17100K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17150K .......... .......... .......... .......... .......... 18% 148M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17200K .......... .......... .......... .......... .......... 18% 258M 1s 2024-09-14T11:44:13.485 INFO:teuthology.orchestra.run.smithi116.stderr: 17250K .......... .......... .......... .......... .......... 18% 66.3M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17300K .......... .......... .......... .......... .......... 18% 82.7M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17350K .......... .......... .......... .......... .......... 18% 142M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17400K .......... .......... .......... .......... .......... 18% 375M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17450K .......... .......... .......... .......... .......... 18% 231M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17500K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17550K .......... .......... .......... .......... .......... 18% 334M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17600K .......... .......... .......... .......... .......... 18% 173M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17650K .......... .......... .......... .......... .......... 19% 291M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17700K .......... .......... .......... .......... .......... 19% 316M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17750K .......... .......... .......... .......... .......... 19% 362M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17800K .......... .......... .......... .......... .......... 19% 329M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17850K .......... .......... .......... .......... .......... 19% 416M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17900K .......... .......... .......... .......... .......... 19% 307M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 17950K .......... .......... .......... .......... .......... 19% 398M 1s 2024-09-14T11:44:13.486 INFO:teuthology.orchestra.run.smithi116.stderr: 18000K .......... .......... .......... .......... .......... 19% 113M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18050K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18100K .......... .......... .......... .......... .......... 19% 82.1M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18150K .......... .......... .......... .......... .......... 19% 356M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18200K .......... .......... .......... .......... .......... 19% 366M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18250K .......... .......... .......... .......... .......... 19% 345M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18300K .......... .......... .......... .......... .......... 19% 319M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18350K .......... .......... .......... .......... .......... 19% 334M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18400K .......... .......... .......... .......... .......... 19% 356M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18450K .......... .......... .......... .......... .......... 19% 353M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18500K .......... .......... .......... .......... .......... 19% 339M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18550K .......... .......... .......... .......... .......... 20% 379M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18600K .......... .......... .......... .......... .......... 20% 411M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18650K .......... .......... .......... .......... .......... 20% 386M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18700K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18750K .......... .......... .......... .......... .......... 20% 425M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18800K .......... .......... .......... .......... .......... 20% 79.9M 1s 2024-09-14T11:44:13.487 INFO:teuthology.orchestra.run.smithi116.stderr: 18850K .......... .......... .......... .......... .......... 20% 285M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 18900K .......... .......... .......... .......... .......... 20% 238M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 18950K .......... .......... .......... .......... .......... 20% 338M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19000K .......... .......... .......... .......... .......... 20% 339M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19050K .......... .......... .......... .......... .......... 20% 173M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19100K .......... .......... .......... .......... .......... 20% 226M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19150K .......... .......... .......... .......... .......... 20% 290M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19200K .......... .......... .......... .......... .......... 20% 382M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19250K .......... .......... .......... .......... .......... 20% 251M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19300K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19350K .......... .......... .......... .......... .......... 20% 356M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19400K .......... .......... .......... .......... .......... 20% 350M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19450K .......... .......... .......... .......... .......... 20% 255M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19500K .......... .......... .......... .......... .......... 21% 319M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19550K .......... .......... .......... .......... .......... 21% 387M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19600K .......... .......... .......... .......... .......... 21% 404M 1s 2024-09-14T11:44:13.488 INFO:teuthology.orchestra.run.smithi116.stderr: 19650K .......... .......... .......... .......... .......... 21% 377M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19700K .......... .......... .......... .......... .......... 21% 350M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19750K .......... .......... .......... .......... .......... 21% 250M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19800K .......... .......... .......... .......... .......... 21% 312M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19850K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19900K .......... .......... .......... .......... .......... 21% 166M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 19950K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20000K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20050K .......... .......... .......... .......... .......... 21% 306M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20100K .......... .......... .......... .......... .......... 21% 132M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20150K .......... .......... .......... .......... .......... 21% 212M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20200K .......... .......... .......... .......... .......... 21% 318M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20250K .......... .......... .......... .......... .......... 21% 386M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20300K .......... .......... .......... .......... .......... 21% 67.5M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20350K .......... .......... .......... .......... .......... 21% 127M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20400K .......... .......... .......... .......... .......... 22% 115M 1s 2024-09-14T11:44:13.489 INFO:teuthology.orchestra.run.smithi116.stderr: 20450K .......... .......... .......... .......... .......... 22% 99.2M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20500K .......... .......... .......... .......... .......... 22% 269M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20550K .......... .......... .......... .......... .......... 22% 394M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20600K .......... .......... .......... .......... .......... 22% 411M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20650K .......... .......... .......... .......... .......... 22% 184M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20700K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20750K .......... .......... .......... .......... .......... 22% 376M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20800K .......... .......... .......... .......... .......... 22% 422M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20850K .......... .......... .......... .......... .......... 22% 388M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20900K .......... .......... .......... .......... .......... 22% 341M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 20950K .......... .......... .......... .......... .......... 22% 398M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21000K .......... .......... .......... .......... .......... 22% 121M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21050K .......... .......... .......... .......... .......... 22% 377M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21100K .......... .......... .......... .......... .......... 22% 192M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21150K .......... .......... .......... .......... .......... 22% 133M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21200K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21250K .......... .......... .......... .......... .......... 22% 362M 1s 2024-09-14T11:44:13.490 INFO:teuthology.orchestra.run.smithi116.stderr: 21300K .......... .......... .......... .......... .......... 22% 224M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21350K .......... .......... .......... .......... .......... 23% 163M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21400K .......... .......... .......... .......... .......... 23% 343M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21450K .......... .......... .......... .......... .......... 23% 345M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21500K .......... .......... .......... .......... .......... 23% 326M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21550K .......... .......... .......... .......... .......... 23% 406M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21600K .......... .......... .......... .......... .......... 23% 353M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21650K .......... .......... .......... .......... .......... 23% 363M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21700K .......... .......... .......... .......... .......... 23% 352M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21750K .......... .......... .......... .......... .......... 23% 390M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21800K .......... .......... .......... .......... .......... 23% 118M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21850K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21900K .......... .......... .......... .......... .......... 23% 130M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 21950K .......... .......... .......... .......... .......... 23% 368M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 22000K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 22050K .......... .......... .......... .......... .......... 23% 401M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 22100K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi116.stderr: 22150K .......... .......... .......... .......... .......... 23% 376M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22200K .......... .......... .......... .......... .......... 23% 107M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22250K .......... .......... .......... .......... .......... 24% 365M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22300K .......... .......... .......... .......... .......... 24% 216M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22350K .......... .......... .......... .......... .......... 24% 290M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22400K .......... .......... .......... .......... .......... 24% 359M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22450K .......... .......... .......... .......... .......... 24% 343M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22500K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22550K .......... .......... .......... .......... .......... 24% 273M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22600K .......... .......... .......... .......... .......... 24% 255M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22650K .......... .......... .......... .......... .......... 24% 347M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22700K .......... .......... .......... .......... .......... 24% 306M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22750K .......... .......... .......... .......... .......... 24% 394M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22800K .......... .......... .......... .......... .......... 24% 361M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22850K .......... .......... .......... .......... .......... 24% 413M 1s 2024-09-14T11:44:13.492 INFO:teuthology.orchestra.run.smithi116.stderr: 22900K .......... .......... .......... .......... .......... 24% 98.6M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 22950K .......... .......... .......... .......... .......... 24% 422M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23000K .......... .......... .......... .......... .......... 24% 406M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23050K .......... .......... .......... .......... .......... 24% 407M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23100K .......... .......... .......... .......... .......... 24% 319M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23150K .......... .......... .......... .......... .......... 24% 393M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23200K .......... .......... .......... .......... .......... 25% 347M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23250K .......... .......... .......... .......... .......... 25% 304M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23300K .......... .......... .......... .......... .......... 25% 221M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23350K .......... .......... .......... .......... .......... 25% 88.8M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23400K .......... .......... .......... .......... .......... 25% 82.4M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23450K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23500K .......... .......... .......... .......... .......... 25% 86.1M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23550K .......... .......... .......... .......... .......... 25% 398M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23600K .......... .......... .......... .......... .......... 25% 215M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23650K .......... .......... .......... .......... .......... 25% 130M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23700K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-14T11:44:13.493 INFO:teuthology.orchestra.run.smithi116.stderr: 23750K .......... .......... .......... .......... .......... 25% 397M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 23800K .......... .......... .......... .......... .......... 25% 398M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 23850K .......... .......... .......... .......... .......... 25% 360M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 23900K .......... .......... .......... .......... .......... 25% 304M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 23950K .......... .......... .......... .......... .......... 25% 113M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24000K .......... .......... .......... .......... .......... 25% 345M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24050K .......... .......... .......... .......... .......... 25% 332M 1s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24100K .......... .......... .......... .......... .......... 25% 307M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24150K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24200K .......... .......... .......... .......... .......... 26% 219M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24250K .......... .......... .......... .......... .......... 26% 232M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24300K .......... .......... .......... .......... .......... 26% 273M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24350K .......... .......... .......... .......... .......... 26% 305M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24400K .......... .......... .......... .......... .......... 26% 137M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24450K .......... .......... .......... .......... .......... 26% 240M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24500K .......... .......... .......... .......... .......... 26% 327M 0s 2024-09-14T11:44:13.494 INFO:teuthology.orchestra.run.smithi116.stderr: 24550K .......... .......... .......... .......... .......... 26% 333M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24600K .......... .......... .......... .......... .......... 26% 343M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24650K .......... .......... .......... .......... .......... 26% 356M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24700K .......... .......... .......... .......... .......... 26% 318M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24750K .......... .......... .......... .......... .......... 26% 425M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24800K .......... .......... .......... .......... .......... 26% 382M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24850K .......... .......... .......... .......... .......... 26% 104M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24900K .......... .......... .......... .......... .......... 26% 206M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 24950K .......... .......... .......... .......... .......... 26% 445M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25000K .......... .......... .......... .......... .......... 26% 75.9M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25050K .......... .......... .......... .......... .......... 27% 305M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25100K .......... .......... .......... .......... .......... 27% 293M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25150K .......... .......... .......... .......... .......... 27% 349M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25200K .......... .......... .......... .......... .......... 27% 415M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25250K .......... .......... .......... .......... .......... 27% 422M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25300K .......... .......... .......... .......... .......... 27% 131M 0s 2024-09-14T11:44:13.495 INFO:teuthology.orchestra.run.smithi116.stderr: 25350K .......... .......... .......... .......... .......... 27% 323M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25400K .......... .......... .......... .......... .......... 27% 370M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25450K .......... .......... .......... .......... .......... 27% 363M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25500K .......... .......... .......... .......... .......... 27% 300M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25550K .......... .......... .......... .......... .......... 27% 348M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25600K .......... .......... .......... .......... .......... 27% 395M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25650K .......... .......... .......... .......... .......... 27% 304M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25700K .......... .......... .......... .......... .......... 27% 352M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25750K .......... .......... .......... .......... .......... 27% 365M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25800K .......... .......... .......... .......... .......... 27% 300M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25850K .......... .......... .......... .......... .......... 27% 327M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25900K .......... .......... .......... .......... .......... 27% 318M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 25950K .......... .......... .......... .......... .......... 27% 318M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 26000K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 26050K .......... .......... .......... .......... .......... 28% 256M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 26100K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 26150K .......... .......... .......... .......... .......... 28% 381M 0s 2024-09-14T11:44:13.496 INFO:teuthology.orchestra.run.smithi116.stderr: 26200K .......... .......... .......... .......... .......... 28% 390M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26250K .......... .......... .......... .......... .......... 28% 96.1M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26300K .......... .......... .......... .......... .......... 28% 245M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26350K .......... .......... .......... .......... .......... 28% 372M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26400K .......... .......... .......... .......... .......... 28% 362M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26450K .......... .......... .......... .......... .......... 28% 82.8M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26500K .......... .......... .......... .......... .......... 28% 312M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26550K .......... .......... .......... .......... .......... 28% 371M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26600K .......... .......... .......... .......... .......... 28% 105M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26650K .......... .......... .......... .......... .......... 28% 154M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26700K .......... .......... .......... .......... .......... 28% 156M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26750K .......... .......... .......... .......... .......... 28% 107M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26800K .......... .......... .......... .......... .......... 28% 139M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26850K .......... .......... .......... .......... .......... 28% 370M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26900K .......... .......... .......... .......... .......... 29% 350M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 26950K .......... .......... .......... .......... .......... 29% 320M 0s 2024-09-14T11:44:13.497 INFO:teuthology.orchestra.run.smithi116.stderr: 27000K .......... .......... .......... .......... .......... 29% 353M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27050K .......... .......... .......... .......... .......... 29% 416M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27100K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27150K .......... .......... .......... .......... .......... 29% 260M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27200K .......... .......... .......... .......... .......... 29% 384M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27250K .......... .......... .......... .......... .......... 29% 296M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27300K .......... .......... .......... .......... .......... 29% 339M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27350K .......... .......... .......... .......... .......... 29% 118M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27400K .......... .......... .......... .......... .......... 29% 387M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27450K .......... .......... .......... .......... .......... 29% 359M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27500K .......... .......... .......... .......... .......... 29% 102M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27550K .......... .......... .......... .......... .......... 29% 371M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27600K .......... .......... .......... .......... .......... 29% 375M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27650K .......... .......... .......... .......... .......... 29% 388M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27700K .......... .......... .......... .......... .......... 29% 301M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27750K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-14T11:44:13.498 INFO:teuthology.orchestra.run.smithi116.stderr: 27800K .......... .......... .......... .......... .......... 29% 384M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 27850K .......... .......... .......... .......... .......... 30% 365M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 27900K .......... .......... .......... .......... .......... 30% 316M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 27950K .......... .......... .......... .......... .......... 30% 120M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28000K .......... .......... .......... .......... .......... 30% 401M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28050K .......... .......... .......... .......... .......... 30% 103M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28100K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28150K .......... .......... .......... .......... .......... 30% 213M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28200K .......... .......... .......... .......... .......... 30% 338M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28250K .......... .......... .......... .......... .......... 30% 93.4M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28300K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28350K .......... .......... .......... .......... .......... 30% 355M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28400K .......... .......... .......... .......... .......... 30% 367M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28450K .......... .......... .......... .......... .......... 30% 376M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28500K .......... .......... .......... .......... .......... 30% 325M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28550K .......... .......... .......... .......... .......... 30% 361M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28600K .......... .......... .......... .......... .......... 30% 374M 0s 2024-09-14T11:44:13.499 INFO:teuthology.orchestra.run.smithi116.stderr: 28650K .......... .......... .......... .......... .......... 30% 317M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28700K .......... .......... .......... .......... .......... 30% 341M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28750K .......... .......... .......... .......... .......... 31% 374M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28800K .......... .......... .......... .......... .......... 31% 393M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28850K .......... .......... .......... .......... .......... 31% 376M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28900K .......... .......... .......... .......... .......... 31% 332M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 28950K .......... .......... .......... .......... .......... 31% 398M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29000K .......... .......... .......... .......... .......... 31% 383M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29050K .......... .......... .......... .......... .......... 31% 396M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29100K .......... .......... .......... .......... .......... 31% 310M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29150K .......... .......... .......... .......... .......... 31% 397M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29200K .......... .......... .......... .......... .......... 31% 220M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29250K .......... .......... .......... .......... .......... 31% 130M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29300K .......... .......... .......... .......... .......... 31% 231M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29350K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29400K .......... .......... .......... .......... .......... 31% 316M 0s 2024-09-14T11:44:13.500 INFO:teuthology.orchestra.run.smithi116.stderr: 29450K .......... .......... .......... .......... .......... 31% 66.7M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29500K .......... .......... .......... .......... .......... 31% 321M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29550K .......... .......... .......... .......... .......... 31% 143M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29600K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29650K .......... .......... .......... .......... .......... 31% 408M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29700K .......... .......... .......... .......... .......... 32% 314M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29750K .......... .......... .......... .......... .......... 32% 148M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29800K .......... .......... .......... .......... .......... 32% 126M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29850K .......... .......... .......... .......... .......... 32% 270M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29900K .......... .......... .......... .......... .......... 32% 102M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 29950K .......... .......... .......... .......... .......... 32% 342M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30000K .......... .......... .......... .......... .......... 32% 321M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30050K .......... .......... .......... .......... .......... 32% 332M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30100K .......... .......... .......... .......... .......... 32% 346M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30150K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30200K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-14T11:44:13.501 INFO:teuthology.orchestra.run.smithi116.stderr: 30250K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30300K .......... .......... .......... .......... .......... 32% 249M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30350K .......... .......... .......... .......... .......... 32% 349M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30400K .......... .......... .......... .......... .......... 32% 211M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30450K .......... .......... .......... .......... .......... 32% 214M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30500K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30550K .......... .......... .......... .......... .......... 32% 354M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30600K .......... .......... .......... .......... .......... 32% 117M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30650K .......... .......... .......... .......... .......... 33% 271M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30700K .......... .......... .......... .......... .......... 33% 92.4M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30750K .......... .......... .......... .......... .......... 33% 243M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30800K .......... .......... .......... .......... .......... 33% 364M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30850K .......... .......... .......... .......... .......... 33% 330M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30900K .......... .......... .......... .......... .......... 33% 418M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 30950K .......... .......... .......... .......... .......... 33% 308M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 31000K .......... .......... .......... .......... .......... 33% 375M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 31050K .......... .......... .......... .......... .......... 33% 373M 0s 2024-09-14T11:44:13.502 INFO:teuthology.orchestra.run.smithi116.stderr: 31100K .......... .......... .......... .......... .......... 33% 284M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31150K .......... .......... .......... .......... .......... 33% 188M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31200K .......... .......... .......... .......... .......... 33% 337M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31250K .......... .......... .......... .......... .......... 33% 368M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31300K .......... .......... .......... .......... .......... 33% 47.4M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31350K .......... .......... .......... .......... .......... 33% 285M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31400K .......... .......... .......... .......... .......... 33% 289M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31450K .......... .......... .......... .......... .......... 33% 308M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31500K .......... .......... .......... .......... .......... 33% 391M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31550K .......... .......... .......... .......... .......... 34% 197M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31600K .......... .......... .......... .......... .......... 34% 402M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31650K .......... .......... .......... .......... .......... 34% 325M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31700K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31750K .......... .......... .......... .......... .......... 34% 283M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31800K .......... .......... .......... .......... .......... 34% 339M 0s 2024-09-14T11:44:13.503 INFO:teuthology.orchestra.run.smithi116.stderr: 31850K .......... .......... .......... .......... .......... 34% 351M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 31900K .......... .......... .......... .......... .......... 34% 408M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 31950K .......... .......... .......... .......... .......... 34% 341M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32000K .......... .......... .......... .......... .......... 34% 402M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32050K .......... .......... .......... .......... .......... 34% 389M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32100K .......... .......... .......... .......... .......... 34% 395M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32150K .......... .......... .......... .......... .......... 34% 328M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32200K .......... .......... .......... .......... .......... 34% 394M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32250K .......... .......... .......... .......... .......... 34% 379M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32300K .......... .......... .......... .......... .......... 34% 364M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32350K .......... .......... .......... .......... .......... 34% 325M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32400K .......... .......... .......... .......... .......... 34% 400M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32450K .......... .......... .......... .......... .......... 34% 392M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32500K .......... .......... .......... .......... .......... 35% 68.6M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32550K .......... .......... .......... .......... .......... 35% 209M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32600K .......... .......... .......... .......... .......... 35% 229M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32650K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:44:13.504 INFO:teuthology.orchestra.run.smithi116.stderr: 32700K .......... .......... .......... .......... .......... 35% 343M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 32750K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 32800K .......... .......... .......... .......... .......... 35% 270M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 32850K .......... .......... .......... .......... .......... 35% 124M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 32900K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 32950K .......... .......... .......... .......... .......... 35% 95.1M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33000K .......... .......... .......... .......... .......... 35% 153M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33050K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33100K .......... .......... .......... .......... .......... 35% 422M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33150K .......... .......... .......... .......... .......... 35% 362M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33200K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33250K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33300K .......... .......... .......... .......... .......... 35% 233M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33350K .......... .......... .......... .......... .......... 35% 280M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33400K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33450K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-14T11:44:13.505 INFO:teuthology.orchestra.run.smithi116.stderr: 33500K .......... .......... .......... .......... .......... 36% 388M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33550K .......... .......... .......... .......... .......... 36% 161M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33600K .......... .......... .......... .......... .......... 36% 379M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33650K .......... .......... .......... .......... .......... 36% 209M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33700K .......... .......... .......... .......... .......... 36% 153M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33750K .......... .......... .......... .......... .......... 36% 81.6M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33800K .......... .......... .......... .......... .......... 36% 389M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33850K .......... .......... .......... .......... .......... 36% 373M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33900K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 33950K .......... .......... .......... .......... .......... 36% 98.6M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34000K .......... .......... .......... .......... .......... 36% 349M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34050K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34100K .......... .......... .......... .......... .......... 36% 362M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34150K .......... .......... .......... .......... .......... 36% 339M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34200K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34250K .......... .......... .......... .......... .......... 36% 376M 0s 2024-09-14T11:44:13.506 INFO:teuthology.orchestra.run.smithi116.stderr: 34300K .......... .......... .......... .......... .......... 36% 393M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34350K .......... .......... .......... .......... .......... 37% 37.6M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34400K .......... .......... .......... .......... .......... 37% 385M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34450K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34500K .......... .......... .......... .......... .......... 37% 389M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34550K .......... .......... .......... .......... .......... 37% 374M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34600K .......... .......... .......... .......... .......... 37% 163M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34650K .......... .......... .......... .......... .......... 37% 385M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34700K .......... .......... .......... .......... .......... 37% 376M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34750K .......... .......... .......... .......... .......... 37% 333M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34800K .......... .......... .......... .......... .......... 37% 370M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34850K .......... .......... .......... .......... .......... 37% 142M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34900K .......... .......... .......... .......... .......... 37% 327M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 34950K .......... .......... .......... .......... .......... 37% 362M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 35000K .......... .......... .......... .......... .......... 37% 352M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 35050K .......... .......... .......... .......... .......... 37% 387M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 35100K .......... .......... .......... .......... .......... 37% 355M 0s 2024-09-14T11:44:13.507 INFO:teuthology.orchestra.run.smithi116.stderr: 35150K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35200K .......... .......... .......... .......... .......... 37% 395M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35250K .......... .......... .......... .......... .......... 37% 380M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35300K .......... .......... .......... .......... .......... 38% 349M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35350K .......... .......... .......... .......... .......... 38% 361M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35400K .......... .......... .......... .......... .......... 38% 396M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35450K .......... .......... .......... .......... .......... 38% 335M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35500K .......... .......... .......... .......... .......... 38% 97.0M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35550K .......... .......... .......... .......... .......... 38% 286M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35600K .......... .......... .......... .......... .......... 38% 381M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35650K .......... .......... .......... .......... .......... 38% 373M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35700K .......... .......... .......... .......... .......... 38% 359M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35750K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35800K .......... .......... .......... .......... .......... 38% 385M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35850K .......... .......... .......... .......... .......... 38% 343M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35900K .......... .......... .......... .......... .......... 38% 404M 0s 2024-09-14T11:44:13.508 INFO:teuthology.orchestra.run.smithi116.stderr: 35950K .......... .......... .......... .......... .......... 38% 155M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36000K .......... .......... .......... .......... .......... 38% 97.1M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36050K .......... .......... .......... .......... .......... 38% 172M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36100K .......... .......... .......... .......... .......... 38% 181M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36150K .......... .......... .......... .......... .......... 38% 324M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36200K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36250K .......... .......... .......... .......... .......... 39% 346M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36300K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36350K .......... .......... .......... .......... .......... 39% 119M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36400K .......... .......... .......... .......... .......... 39% 340M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36450K .......... .......... .......... .......... .......... 39% 349M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36500K .......... .......... .......... .......... .......... 39% 373M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36550K .......... .......... .......... .......... .......... 39% 345M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36600K .......... .......... .......... .......... .......... 39% 379M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36650K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36700K .......... .......... .......... .......... .......... 39% 374M 0s 2024-09-14T11:44:13.509 INFO:teuthology.orchestra.run.smithi116.stderr: 36750K .......... .......... .......... .......... .......... 39% 155M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 36800K .......... .......... .......... .......... .......... 39% 106M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 36850K .......... .......... .......... .......... .......... 39% 377M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 36900K .......... .......... .......... .......... .......... 39% 236M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 36950K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37000K .......... .......... .......... .......... .......... 39% 104M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37050K .......... .......... .......... .......... .......... 39% 387M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37100K .......... .......... .......... .......... .......... 39% 157M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37150K .......... .......... .......... .......... .......... 40% 303M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37200K .......... .......... .......... .......... .......... 40% 187M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37250K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37300K .......... .......... .......... .......... .......... 40% 43.7M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37350K .......... .......... .......... .......... .......... 40% 263M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37400K .......... .......... .......... .......... .......... 40% 395M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37450K .......... .......... .......... .......... .......... 40% 412M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37500K .......... .......... .......... .......... .......... 40% 397M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37550K .......... .......... .......... .......... .......... 40% 162M 0s 2024-09-14T11:44:13.510 INFO:teuthology.orchestra.run.smithi116.stderr: 37600K .......... .......... .......... .......... .......... 40% 371M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37650K .......... .......... .......... .......... .......... 40% 215M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37700K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37750K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37800K .......... .......... .......... .......... .......... 40% 415M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37850K .......... .......... .......... .......... .......... 40% 232M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37900K .......... .......... .......... .......... .......... 40% 398M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 37950K .......... .......... .......... .......... .......... 40% 287M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38000K .......... .......... .......... .......... .......... 40% 136M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38050K .......... .......... .......... .......... .......... 41% 287M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38100K .......... .......... .......... .......... .......... 41% 401M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38150K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38200K .......... .......... .......... .......... .......... 41% 352M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38250K .......... .......... .......... .......... .......... 41% 392M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38300K .......... .......... .......... .......... .......... 41% 381M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38350K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38400K .......... .......... .......... .......... .......... 41% 396M 0s 2024-09-14T11:44:13.511 INFO:teuthology.orchestra.run.smithi116.stderr: 38450K .......... .......... .......... .......... .......... 41% 232M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38500K .......... .......... .......... .......... .......... 41% 365M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38550K .......... .......... .......... .......... .......... 41% 354M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38600K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38650K .......... .......... .......... .......... .......... 41% 299M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38700K .......... .......... .......... .......... .......... 41% 386M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38750K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38800K .......... .......... .......... .......... .......... 41% 397M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38850K .......... .......... .......... .......... .......... 41% 398M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38900K .......... .......... .......... .......... .......... 41% 124M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 38950K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39000K .......... .......... .......... .......... .......... 42% 397M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39050K .......... .......... .......... .......... .......... 42% 139M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39100K .......... .......... .......... .......... .......... 42% 213M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39150K .......... .......... .......... .......... .......... 42% 99.4M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39200K .......... .......... .......... .......... .......... 42% 367M 0s 2024-09-14T11:44:13.512 INFO:teuthology.orchestra.run.smithi116.stderr: 39250K .......... .......... .......... .......... .......... 42% 417M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39300K .......... .......... .......... .......... .......... 42% 381M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39350K .......... .......... .......... .......... .......... 42% 167M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39400K .......... .......... .......... .......... .......... 42% 429M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39450K .......... .......... .......... .......... .......... 42% 434M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39500K .......... .......... .......... .......... .......... 42% 228M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39550K .......... .......... .......... .......... .......... 42% 301M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39600K .......... .......... .......... .......... .......... 42% 338M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39650K .......... .......... .......... .......... .......... 42% 358M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39700K .......... .......... .......... .......... .......... 42% 409M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39750K .......... .......... .......... .......... .......... 42% 158M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39800K .......... .......... .......... .......... .......... 42% 336M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39850K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39900K .......... .......... .......... .......... .......... 43% 146M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 39950K .......... .......... .......... .......... .......... 43% 182M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 40000K .......... .......... .......... .......... .......... 43% 239M 0s 2024-09-14T11:44:13.513 INFO:teuthology.orchestra.run.smithi116.stderr: 40050K .......... .......... .......... .......... .......... 43% 109M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40100K .......... .......... .......... .......... .......... 43% 244M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40150K .......... .......... .......... .......... .......... 43% 299M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40200K .......... .......... .......... .......... .......... 43% 274M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40250K .......... .......... .......... .......... .......... 43% 253M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40300K .......... .......... .......... .......... .......... 43% 215M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40350K .......... .......... .......... .......... .......... 43% 43.7M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40400K .......... .......... .......... .......... .......... 43% 396M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40450K .......... .......... .......... .......... .......... 43% 258M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40500K .......... .......... .......... .......... .......... 43% 386M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40550K .......... .......... .......... .......... .......... 43% 348M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40600K .......... .......... .......... .......... .......... 43% 346M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40650K .......... .......... .......... .......... .......... 43% 398M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40700K .......... .......... .......... .......... .......... 43% 181M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40750K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40800K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40850K .......... .......... .......... .......... .......... 44% 387M 0s 2024-09-14T11:44:13.514 INFO:teuthology.orchestra.run.smithi116.stderr: 40900K .......... .......... .......... .......... .......... 44% 145M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 40950K .......... .......... .......... .......... .......... 44% 363M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41000K .......... .......... .......... .......... .......... 44% 406M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41050K .......... .......... .......... .......... .......... 44% 392M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41100K .......... .......... .......... .......... .......... 44% 194M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41150K .......... .......... .......... .......... .......... 44% 389M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41200K .......... .......... .......... .......... .......... 44% 381M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41250K .......... .......... .......... .......... .......... 44% 184M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41300K .......... .......... .......... .......... .......... 44% 339M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41350K .......... .......... .......... .......... .......... 44% 394M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41400K .......... .......... .......... .......... .......... 44% 385M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41450K .......... .......... .......... .......... .......... 44% 235M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41500K .......... .......... .......... .......... .......... 44% 152M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41550K .......... .......... .......... .......... .......... 44% 402M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41600K .......... .......... .......... .......... .......... 44% 382M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41650K .......... .......... .......... .......... .......... 44% 399M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41700K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-14T11:44:13.515 INFO:teuthology.orchestra.run.smithi116.stderr: 41750K .......... .......... .......... .......... .......... 44% 407M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 41800K .......... .......... .......... .......... .......... 45% 374M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 41850K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 41900K .......... .......... .......... .......... .......... 45% 337M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 41950K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42000K .......... .......... .......... .......... .......... 45% 253M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42050K .......... .......... .......... .......... .......... 45% 88.4M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42100K .......... .......... .......... .......... .......... 45% 257M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42150K .......... .......... .......... .......... .......... 45% 249M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42200K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42250K .......... .......... .......... .......... .......... 45% 235M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42300K .......... .......... .......... .......... .......... 45% 260M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42350K .......... .......... .......... .......... .......... 45% 372M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42400K .......... .......... .......... .......... .......... 45% 378M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42450K .......... .......... .......... .......... .......... 45% 324M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42500K .......... .......... .......... .......... .......... 45% 30.0M 0s 2024-09-14T11:44:13.516 INFO:teuthology.orchestra.run.smithi116.stderr: 42550K .......... .......... .......... .......... .......... 45% 204M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42600K .......... .......... .......... .......... .......... 45% 247M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42650K .......... .......... .......... .......... .......... 45% 248M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42700K .......... .......... .......... .......... .......... 46% 255M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42750K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42800K .......... .......... .......... .......... .......... 46% 290M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42850K .......... .......... .......... .......... .......... 46% 389M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42900K .......... .......... .......... .......... .......... 46% 325M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 42950K .......... .......... .......... .......... .......... 46% 399M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43000K .......... .......... .......... .......... .......... 46% 187M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43050K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43100K .......... .......... .......... .......... .......... 46% 249M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43150K .......... .......... .......... .......... .......... 46% 271M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43200K .......... .......... .......... .......... .......... 46% 144M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43250K .......... .......... .......... .......... .......... 46% 377M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43300K .......... .......... .......... .......... .......... 46% 318M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43350K .......... .......... .......... .......... .......... 46% 354M 0s 2024-09-14T11:44:13.517 INFO:teuthology.orchestra.run.smithi116.stderr: 43400K .......... .......... .......... .......... .......... 46% 347M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43450K .......... .......... .......... .......... .......... 46% 405M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43500K .......... .......... .......... .......... .......... 46% 394M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43550K .......... .......... .......... .......... .......... 46% 232M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43600K .......... .......... .......... .......... .......... 46% 337M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43650K .......... .......... .......... .......... .......... 47% 296M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43700K .......... .......... .......... .......... .......... 47% 256M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43750K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43800K .......... .......... .......... .......... .......... 47% 148M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43850K .......... .......... .......... .......... .......... 47% 314M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43900K .......... .......... .......... .......... .......... 47% 365M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 43950K .......... .......... .......... .......... .......... 47% 259M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 44000K .......... .......... .......... .......... .......... 47% 207M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 44050K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 44100K .......... .......... .......... .......... .......... 47% 387M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 44150K .......... .......... .......... .......... .......... 47% 370M 0s 2024-09-14T11:44:13.518 INFO:teuthology.orchestra.run.smithi116.stderr: 44200K .......... .......... .......... .......... .......... 47% 165M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44250K .......... .......... .......... .......... .......... 47% 364M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44300K .......... .......... .......... .......... .......... 47% 286M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44350K .......... .......... .......... .......... .......... 47% 389M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44400K .......... .......... .......... .......... .......... 47% 165M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44450K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44500K .......... .......... .......... .......... .......... 47% 373M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44550K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44600K .......... .......... .......... .......... .......... 48% 145M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44650K .......... .......... .......... .......... .......... 48% 393M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44700K .......... .......... .......... .......... .......... 48% 365M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44750K .......... .......... .......... .......... .......... 48% 349M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44800K .......... .......... .......... .......... .......... 48% 361M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44850K .......... .......... .......... .......... .......... 48% 431M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44900K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 44950K .......... .......... .......... .......... .......... 48% 160M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 45000K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-14T11:44:13.519 INFO:teuthology.orchestra.run.smithi116.stderr: 45050K .......... .......... .......... .......... .......... 48% 364M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45100K .......... .......... .......... .......... .......... 48% 102M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45150K .......... .......... .......... .......... .......... 48% 384M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45200K .......... .......... .......... .......... .......... 48% 260M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45250K .......... .......... .......... .......... .......... 48% 363M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45300K .......... .......... .......... .......... .......... 48% 373M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45350K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45400K .......... .......... .......... .......... .......... 48% 317M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45450K .......... .......... .......... .......... .......... 48% 85.3M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45500K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45550K .......... .......... .......... .......... .......... 49% 26.7M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45600K .......... .......... .......... .......... .......... 49% 48.2M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45650K .......... .......... .......... .......... .......... 49% 120M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45700K .......... .......... .......... .......... .......... 49% 331M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45750K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-14T11:44:13.520 INFO:teuthology.orchestra.run.smithi116.stderr: 45800K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 45850K .......... .......... .......... .......... .......... 49% 385M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 45900K .......... .......... .......... .......... .......... 49% 316M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 45950K .......... .......... .......... .......... .......... 49% 377M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46000K .......... .......... .......... .......... .......... 49% 293M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46050K .......... .......... .......... .......... .......... 49% 380M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46100K .......... .......... .......... .......... .......... 49% 395M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46150K .......... .......... .......... .......... .......... 49% 376M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46200K .......... .......... .......... .......... .......... 49% 290M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46250K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46300K .......... .......... .......... .......... .......... 49% 384M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46350K .......... .......... .......... .......... .......... 49% 354M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46400K .......... .......... .......... .......... .......... 49% 358M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46450K .......... .......... .......... .......... .......... 50% 374M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46500K .......... .......... .......... .......... .......... 50% 397M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46550K .......... .......... .......... .......... .......... 50% 332M 0s 2024-09-14T11:44:13.521 INFO:teuthology.orchestra.run.smithi116.stderr: 46600K .......... .......... .......... .......... .......... 50% 220M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46650K .......... .......... .......... .......... .......... 50% 172M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46700K .......... .......... .......... .......... .......... 50% 255M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46750K .......... .......... .......... .......... .......... 50% 274M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46800K .......... .......... .......... .......... .......... 50% 252M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46850K .......... .......... .......... .......... .......... 50% 271M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46900K .......... .......... .......... .......... .......... 50% 277M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 46950K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47000K .......... .......... .......... .......... .......... 50% 232M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47050K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47100K .......... .......... .......... .......... .......... 50% 276M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47150K .......... .......... .......... .......... .......... 50% 286M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47200K .......... .......... .......... .......... .......... 50% 250M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47250K .......... .......... .......... .......... .......... 50% 288M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47300K .......... .......... .......... .......... .......... 50% 269M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47350K .......... .......... .......... .......... .......... 51% 282M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47400K .......... .......... .......... .......... .......... 51% 226M 0s 2024-09-14T11:44:13.522 INFO:teuthology.orchestra.run.smithi116.stderr: 47450K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47500K .......... .......... .......... .......... .......... 51% 284M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47550K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47600K .......... .......... .......... .......... .......... 51% 257M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47650K .......... .......... .......... .......... .......... 51% 282M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47700K .......... .......... .......... .......... .......... 51% 257M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47750K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47800K .......... .......... .......... .......... .......... 51% 231M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47850K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47900K .......... .......... .......... .......... .......... 51% 293M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 47950K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48000K .......... .......... .......... .......... .......... 51% 263M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48050K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48100K .......... .......... .......... .......... .......... 51% 284M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48150K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48200K .......... .......... .......... .......... .......... 51% 238M 0s 2024-09-14T11:44:13.523 INFO:teuthology.orchestra.run.smithi116.stderr: 48250K .......... .......... .......... .......... .......... 51% 285M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48300K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48350K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48400K .......... .......... .......... .......... .......... 52% 265M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48450K .......... .......... .......... .......... .......... 52% 301M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48500K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48550K .......... .......... .......... .......... .......... 52% 291M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48600K .......... .......... .......... .......... .......... 52% 40.8M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48650K .......... .......... .......... .......... .......... 52% 60.3M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48700K .......... .......... .......... .......... .......... 52% 121M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48750K .......... .......... .......... .......... .......... 52% 272M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48800K .......... .......... .......... .......... .......... 52% 253M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48850K .......... .......... .......... .......... .......... 52% 277M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48900K .......... .......... .......... .......... .......... 52% 298M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 48950K .......... .......... .......... .......... .......... 52% 300M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 49000K .......... .......... .......... .......... .......... 52% 226M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 49050K .......... .......... .......... .......... .......... 52% 279M 0s 2024-09-14T11:44:13.524 INFO:teuthology.orchestra.run.smithi116.stderr: 49100K .......... .......... .......... .......... .......... 52% 275M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49150K .......... .......... .......... .......... .......... 52% 286M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49200K .......... .......... .......... .......... .......... 53% 255M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49250K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49300K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49350K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49400K .......... .......... .......... .......... .......... 53% 226M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49450K .......... .......... .......... .......... .......... 53% 281M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49500K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49550K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49600K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49650K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49700K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49750K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49800K .......... .......... .......... .......... .......... 53% 235M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49850K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-14T11:44:13.525 INFO:teuthology.orchestra.run.smithi116.stderr: 49900K .......... .......... .......... .......... .......... 53% 287M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 49950K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50000K .......... .......... .......... .......... .......... 53% 265M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50050K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50100K .......... .......... .......... .......... .......... 53% 288M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50150K .......... .......... .......... .......... .......... 54% 291M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50200K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50250K .......... .......... .......... .......... .......... 54% 278M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50300K .......... .......... .......... .......... .......... 54% 285M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50350K .......... .......... .......... .......... .......... 54% 283M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50400K .......... .......... .......... .......... .......... 54% 251M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50450K .......... .......... .......... .......... .......... 54% 279M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50500K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50550K .......... .......... .......... .......... .......... 54% 299M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50600K .......... .......... .......... .......... .......... 54% 242M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50650K .......... .......... .......... .......... .......... 54% 276M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50700K .......... .......... .......... .......... .......... 54% 276M 0s 2024-09-14T11:44:13.526 INFO:teuthology.orchestra.run.smithi116.stderr: 50750K .......... .......... .......... .......... .......... 54% 277M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 50800K .......... .......... .......... .......... .......... 54% 254M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 50850K .......... .......... .......... .......... .......... 54% 271M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 50900K .......... .......... .......... .......... .......... 54% 261M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 50950K .......... .......... .......... .......... .......... 54% 274M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51000K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51050K .......... .......... .......... .......... .......... 55% 273M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51100K .......... .......... .......... .......... .......... 55% 279M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51150K .......... .......... .......... .......... .......... 55% 297M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51200K .......... .......... .......... .......... .......... 55% 253M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51250K .......... .......... .......... .......... .......... 55% 244M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51300K .......... .......... .......... .......... .......... 55% 264M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51350K .......... .......... .......... .......... .......... 55% 245M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51400K .......... .......... .......... .......... .......... 55% 279M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51450K .......... .......... .......... .......... .......... 55% 41.1M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51500K .......... .......... .......... .......... .......... 55% 223M 0s 2024-09-14T11:44:13.527 INFO:teuthology.orchestra.run.smithi116.stderr: 51550K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51600K .......... .......... .......... .......... .......... 55% 278M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51650K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51700K .......... .......... .......... .......... .......... 55% 256M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51750K .......... .......... .......... .......... .......... 55% 118M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51800K .......... .......... .......... .......... .......... 55% 222M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51850K .......... .......... .......... .......... .......... 55% 122M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51900K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 51950K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52000K .......... .......... .......... .......... .......... 56% 244M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52050K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52100K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52150K .......... .......... .......... .......... .......... 56% 211M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52200K .......... .......... .......... .......... .......... 56% 223M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52250K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52300K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-14T11:44:13.528 INFO:teuthology.orchestra.run.smithi116.stderr: 52350K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52400K .......... .......... .......... .......... .......... 56% 259M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52450K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52500K .......... .......... .......... .......... .......... 56% 285M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52550K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52600K .......... .......... .......... .......... .......... 56% 243M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52650K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52700K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52750K .......... .......... .......... .......... .......... 56% 288M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52800K .......... .......... .......... .......... .......... 56% 257M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52850K .......... .......... .......... .......... .......... 56% 266M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52900K .......... .......... .......... .......... .......... 56% 300M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 52950K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 53000K .......... .......... .......... .......... .......... 57% 228M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 53050K .......... .......... .......... .......... .......... 57% 274M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 53100K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 53150K .......... .......... .......... .......... .......... 57% 255M 0s 2024-09-14T11:44:13.529 INFO:teuthology.orchestra.run.smithi116.stderr: 53200K .......... .......... .......... .......... .......... 57% 258M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53250K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53300K .......... .......... .......... .......... .......... 57% 274M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53350K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53400K .......... .......... .......... .......... .......... 57% 157M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53450K .......... .......... .......... .......... .......... 57% 286M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53500K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53550K .......... .......... .......... .......... .......... 57% 285M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53600K .......... .......... .......... .......... .......... 57% 250M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53650K .......... .......... .......... .......... .......... 57% 278M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53700K .......... .......... .......... .......... .......... 57% 260M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53750K .......... .......... .......... .......... .......... 57% 291M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53800K .......... .......... .......... .......... .......... 57% 295M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53850K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53900K .......... .......... .......... .......... .......... 58% 238M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 53950K .......... .......... .......... .......... .......... 58% 311M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 54000K .......... .......... .......... .......... .......... 58% 245M 0s 2024-09-14T11:44:13.530 INFO:teuthology.orchestra.run.smithi116.stderr: 54050K .......... .......... .......... .......... .......... 58% 281M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54100K .......... .......... .......... .......... .......... 58% 249M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54150K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54200K .......... .......... .......... .......... .......... 58% 270M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54250K .......... .......... .......... .......... .......... 58% 290M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54300K .......... .......... .......... .......... .......... 58% 247M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54350K .......... .......... .......... .......... .......... 58% 41.4M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54400K .......... .......... .......... .......... .......... 58% 196M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54450K .......... .......... .......... .......... .......... 58% 274M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54500K .......... .......... .......... .......... .......... 58% 233M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54550K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54600K .......... .......... .......... .......... .......... 58% 292M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54650K .......... .......... .......... .......... .......... 58% 230M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54700K .......... .......... .......... .......... .......... 58% 151M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54750K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54800K .......... .......... .......... .......... .......... 59% 272M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54850K .......... .......... .......... .......... .......... 59% 264M 0s 2024-09-14T11:44:13.531 INFO:teuthology.orchestra.run.smithi116.stderr: 54900K .......... .......... .......... .......... .......... 59% 258M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 54950K .......... .......... .......... .......... .......... 59% 193M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55000K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55050K .......... .......... .......... .......... .......... 59% 285M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55100K .......... .......... .......... .......... .......... 59% 242M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55150K .......... .......... .......... .......... .......... 59% 209M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55200K .......... .......... .......... .......... .......... 59% 284M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55250K .......... .......... .......... .......... .......... 59% 278M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55300K .......... .......... .......... .......... .......... 59% 261M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55350K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55400K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55450K .......... .......... .......... .......... .......... 59% 283M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55500K .......... .......... .......... .......... .......... 59% 231M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55550K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-14T11:44:13.532 INFO:teuthology.orchestra.run.smithi116.stderr: 55600K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55650K .......... .......... .......... .......... .......... 59% 289M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55700K .......... .......... .......... .......... .......... 60% 259M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55750K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55800K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55850K .......... .......... .......... .......... .......... 60% 281M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55900K .......... .......... .......... .......... .......... 60% 236M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 55950K .......... .......... .......... .......... .......... 60% 267M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56000K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56050K .......... .......... .......... .......... .......... 60% 267M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56100K .......... .......... .......... .......... .......... 60% 253M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56150K .......... .......... .......... .......... .......... 60% 297M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56200K .......... .......... .......... .......... .......... 60% 242M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56250K .......... .......... .......... .......... .......... 60% 282M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56300K .......... .......... .......... .......... .......... 60% 229M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56350K .......... .......... .......... .......... .......... 60% 293M 0s 2024-09-14T11:44:13.533 INFO:teuthology.orchestra.run.smithi116.stderr: 56400K .......... .......... .......... .......... .......... 60% 280M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56450K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56500K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56550K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56600K .......... .......... .......... .......... .......... 60% 279M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56650K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56700K .......... .......... .......... .......... .......... 61% 240M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56750K .......... .......... .......... .......... .......... 61% 281M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56800K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56850K .......... .......... .......... .......... .......... 61% 199M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56900K .......... .......... .......... .......... .......... 61% 259M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 56950K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 57000K .......... .......... .......... .......... .......... 61% 296M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 57050K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 57100K .......... .......... .......... .......... .......... 61% 172M 0s 2024-09-14T11:44:13.534 INFO:teuthology.orchestra.run.smithi116.stderr: 57150K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57200K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57250K .......... .......... .......... .......... .......... 61% 290M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57300K .......... .......... .......... .......... .......... 61% 34.0M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57350K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57400K .......... .......... .......... .......... .......... 61% 416M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57450K .......... .......... .......... .......... .......... 61% 420M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57500K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57550K .......... .......... .......... .......... .......... 62% 430M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57600K .......... .......... .......... .......... .......... 62% 414M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57650K .......... .......... .......... .......... .......... 62% 436M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57700K .......... .......... .......... .......... .......... 62% 232M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57750K .......... .......... .......... .......... .......... 62% 369M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57800K .......... .......... .......... .......... .......... 62% 89.4M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57850K .......... .......... .......... .......... .......... 62% 241M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57900K .......... .......... .......... .......... .......... 62% 340M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 57950K .......... .......... .......... .......... .......... 62% 415M 0s 2024-09-14T11:44:13.535 INFO:teuthology.orchestra.run.smithi116.stderr: 58000K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58050K .......... .......... .......... .......... .......... 62% 381M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58100K .......... .......... .......... .......... .......... 62% 259M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58150K .......... .......... .......... .......... .......... 62% 130M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58200K .......... .......... .......... .......... .......... 62% 419M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58250K .......... .......... .......... .......... .......... 62% 361M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58300K .......... .......... .......... .......... .......... 62% 139M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58350K .......... .......... .......... .......... .......... 62% 346M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58400K .......... .......... .......... .......... .......... 62% 441M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58450K .......... .......... .......... .......... .......... 62% 152M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58500K .......... .......... .......... .......... .......... 63% 242M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58550K .......... .......... .......... .......... .......... 63% 443M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58600K .......... .......... .......... .......... .......... 63% 168M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58650K .......... .......... .......... .......... .......... 63% 429M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58700K .......... .......... .......... .......... .......... 63% 331M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58750K .......... .......... .......... .......... .......... 63% 435M 0s 2024-09-14T11:44:13.536 INFO:teuthology.orchestra.run.smithi116.stderr: 58800K .......... .......... .......... .......... .......... 63% 149M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 58850K .......... .......... .......... .......... .......... 63% 266M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 58900K .......... .......... .......... .......... .......... 63% 433M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 58950K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59000K .......... .......... .......... .......... .......... 63% 354M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59050K .......... .......... .......... .......... .......... 63% 429M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59100K .......... .......... .......... .......... .......... 63% 420M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59150K .......... .......... .......... .......... .......... 63% 237M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59200K .......... .......... .......... .......... .......... 63% 348M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59250K .......... .......... .......... .......... .......... 63% 356M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59300K .......... .......... .......... .......... .......... 63% 386M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59350K .......... .......... .......... .......... .......... 63% 111M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59400K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59450K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59500K .......... .......... .......... .......... .......... 64% 407M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59550K .......... .......... .......... .......... .......... 64% 357M 0s 2024-09-14T11:44:13.537 INFO:teuthology.orchestra.run.smithi116.stderr: 59600K .......... .......... .......... .......... .......... 64% 114M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59650K .......... .......... .......... .......... .......... 64% 315M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59700K .......... .......... .......... .......... .......... 64% 423M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59750K .......... .......... .......... .......... .......... 64% 405M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59800K .......... .......... .......... .......... .......... 64% 406M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59850K .......... .......... .......... .......... .......... 64% 140M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59900K .......... .......... .......... .......... .......... 64% 421M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 59950K .......... .......... .......... .......... .......... 64% 452M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60000K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60050K .......... .......... .......... .......... .......... 64% 418M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60100K .......... .......... .......... .......... .......... 64% 16.6M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60150K .......... .......... .......... .......... .......... 64% 379M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60200K .......... .......... .......... .......... .......... 64% 377M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60250K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60300K .......... .......... .......... .......... .......... 64% 95.8M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60350K .......... .......... .......... .......... .......... 65% 411M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60400K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-14T11:44:13.538 INFO:teuthology.orchestra.run.smithi116.stderr: 60450K .......... .......... .......... .......... .......... 65% 390M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60500K .......... .......... .......... .......... .......... 65% 416M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60550K .......... .......... .......... .......... .......... 65% 412M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60600K .......... .......... .......... .......... .......... 65% 390M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60650K .......... .......... .......... .......... .......... 65% 419M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60700K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60750K .......... .......... .......... .......... .......... 65% 409M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60800K .......... .......... .......... .......... .......... 65% 421M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60850K .......... .......... .......... .......... .......... 65% 419M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60900K .......... .......... .......... .......... .......... 65% 392M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 60950K .......... .......... .......... .......... .......... 65% 389M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61000K .......... .......... .......... .......... .......... 65% 424M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61050K .......... .......... .......... .......... .......... 65% 428M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61100K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61150K .......... .......... .......... .......... .......... 65% 413M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61200K .......... .......... .......... .......... .......... 65% 439M 0s 2024-09-14T11:44:13.539 INFO:teuthology.orchestra.run.smithi116.stderr: 61250K .......... .......... .......... .......... .......... 65% 414M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61300K .......... .......... .......... .......... .......... 66% 371M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61350K .......... .......... .......... .......... .......... 66% 432M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61400K .......... .......... .......... .......... .......... 66% 417M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61450K .......... .......... .......... .......... .......... 66% 497M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61500K .......... .......... .......... .......... .......... 66% 156M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61550K .......... .......... .......... .......... .......... 66% 251M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61600K .......... .......... .......... .......... .......... 66% 319M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61650K .......... .......... .......... .......... .......... 66% 433M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61700K .......... .......... .......... .......... .......... 66% 170M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61750K .......... .......... .......... .......... .......... 66% 393M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61800K .......... .......... .......... .......... .......... 66% 436M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61850K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61900K .......... .......... .......... .......... .......... 66% 421M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 61950K .......... .......... .......... .......... .......... 66% 292M 0s 2024-09-14T11:44:13.540 INFO:teuthology.orchestra.run.smithi116.stderr: 62000K .......... .......... .......... .......... .......... 66% 299M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62050K .......... .......... .......... .......... .......... 66% 227M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62100K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62150K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62200K .......... .......... .......... .......... .......... 67% 434M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62250K .......... .......... .......... .......... .......... 67% 371M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62300K .......... .......... .......... .......... .......... 67% 427M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62350K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62400K .......... .......... .......... .......... .......... 67% 278M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62450K .......... .......... .......... .......... .......... 67% 118M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62500K .......... .......... .......... .......... .......... 67% 385M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62550K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62600K .......... .......... .......... .......... .......... 67% 436M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62650K .......... .......... .......... .......... .......... 67% 341M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62700K .......... .......... .......... .......... .......... 67% 214M 0s 2024-09-14T11:44:13.541 INFO:teuthology.orchestra.run.smithi116.stderr: 62750K .......... .......... .......... .......... .......... 67% 156M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 62800K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 62850K .......... .......... .......... .......... .......... 67% 114M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 62900K .......... .......... .......... .......... .......... 67% 399M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 62950K .......... .......... .......... .......... .......... 67% 395M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63000K .......... .......... .......... .......... .......... 67% 432M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63050K .......... .......... .......... .......... .......... 67% 385M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63100K .......... .......... .......... .......... .......... 67% 426M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63150K .......... .......... .......... .......... .......... 68% 16.9M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63200K .......... .......... .......... .......... .......... 68% 43.1M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63250K .......... .......... .......... .......... .......... 68% 371M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63300K .......... .......... .......... .......... .......... 68% 405M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63350K .......... .......... .......... .......... .......... 68% 370M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63400K .......... .......... .......... .......... .......... 68% 416M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63450K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63500K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-14T11:44:13.542 INFO:teuthology.orchestra.run.smithi116.stderr: 63550K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63600K .......... .......... .......... .......... .......... 68% 429M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63650K .......... .......... .......... .......... .......... 68% 433M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63700K .......... .......... .......... .......... .......... 68% 456M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63750K .......... .......... .......... .......... .......... 68% 379M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63800K .......... .......... .......... .......... .......... 68% 428M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63850K .......... .......... .......... .......... .......... 68% 435M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63900K .......... .......... .......... .......... .......... 68% 419M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 63950K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64000K .......... .......... .......... .......... .......... 68% 417M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64050K .......... .......... .......... .......... .......... 68% 441M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64100K .......... .......... .......... .......... .......... 69% 436M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64150K .......... .......... .......... .......... .......... 69% 386M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64200K .......... .......... .......... .......... .......... 69% 439M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64250K .......... .......... .......... .......... .......... 69% 450M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64300K .......... .......... .......... .......... .......... 69% 434M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64350K .......... .......... .......... .......... .......... 69% 351M 0s 2024-09-14T11:44:13.543 INFO:teuthology.orchestra.run.smithi116.stderr: 64400K .......... .......... .......... .......... .......... 69% 441M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64450K .......... .......... .......... .......... .......... 69% 442M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64500K .......... .......... .......... .......... .......... 69% 417M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64550K .......... .......... .......... .......... .......... 69% 393M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64600K .......... .......... .......... .......... .......... 69% 410M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64650K .......... .......... .......... .......... .......... 69% 422M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64700K .......... .......... .......... .......... .......... 69% 427M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64750K .......... .......... .......... .......... .......... 69% 356M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64800K .......... .......... .......... .......... .......... 69% 375M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64850K .......... .......... .......... .......... .......... 69% 430M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64900K .......... .......... .......... .......... .......... 69% 441M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 64950K .......... .......... .......... .......... .......... 69% 376M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 65000K .......... .......... .......... .......... .......... 70% 448M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 65050K .......... .......... .......... .......... .......... 70% 417M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 65100K .......... .......... .......... .......... .......... 70% 441M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 65150K .......... .......... .......... .......... .......... 70% 141M 0s 2024-09-14T11:44:13.544 INFO:teuthology.orchestra.run.smithi116.stderr: 65200K .......... .......... .......... .......... .......... 70% 412M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65250K .......... .......... .......... .......... .......... 70% 429M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65300K .......... .......... .......... .......... .......... 70% 401M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65350K .......... .......... .......... .......... .......... 70% 387M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65400K .......... .......... .......... .......... .......... 70% 449M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65450K .......... .......... .......... .......... .......... 70% 423M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65500K .......... .......... .......... .......... .......... 70% 132M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65550K .......... .......... .......... .......... .......... 70% 167M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65600K .......... .......... .......... .......... .......... 70% 444M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65650K .......... .......... .......... .......... .......... 70% 435M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65700K .......... .......... .......... .......... .......... 70% 414M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65750K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65800K .......... .......... .......... .......... .......... 70% 436M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65850K .......... .......... .......... .......... .......... 70% 213M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65900K .......... .......... .......... .......... .......... 70% 102M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 65950K .......... .......... .......... .......... .......... 71% 306M 0s 2024-09-14T11:44:13.545 INFO:teuthology.orchestra.run.smithi116.stderr: 66000K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66050K .......... .......... .......... .......... .......... 71% 398M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66100K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66150K .......... .......... .......... .......... .......... 71% 16.6M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66200K .......... .......... .......... .......... .......... 71% 429M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66250K .......... .......... .......... .......... .......... 71% 464M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66300K .......... .......... .......... .......... .......... 71% 36.9M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66350K .......... .......... .......... .......... .......... 71% 337M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66400K .......... .......... .......... .......... .......... 71% 441M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66450K .......... .......... .......... .......... .......... 71% 408M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66500K .......... .......... .......... .......... .......... 71% 449M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66550K .......... .......... .......... .......... .......... 71% 382M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66600K .......... .......... .......... .......... .......... 71% 458M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66650K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66700K .......... .......... .......... .......... .......... 71% 241M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66750K .......... .......... .......... .......... .......... 71% 375M 0s 2024-09-14T11:44:13.546 INFO:teuthology.orchestra.run.smithi116.stderr: 66800K .......... .......... .......... .......... .......... 71% 412M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 66850K .......... .......... .......... .......... .......... 72% 438M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 66900K .......... .......... .......... .......... .......... 72% 428M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 66950K .......... .......... .......... .......... .......... 72% 411M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67000K .......... .......... .......... .......... .......... 72% 187M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67050K .......... .......... .......... .......... .......... 72% 443M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67100K .......... .......... .......... .......... .......... 72% 406M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67150K .......... .......... .......... .......... .......... 72% 278M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67200K .......... .......... .......... .......... .......... 72% 444M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67250K .......... .......... .......... .......... .......... 72% 422M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67300K .......... .......... .......... .......... .......... 72% 424M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67350K .......... .......... .......... .......... .......... 72% 388M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67400K .......... .......... .......... .......... .......... 72% 433M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67450K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67500K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67550K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67600K .......... .......... .......... .......... .......... 72% 427M 0s 2024-09-14T11:44:13.547 INFO:teuthology.orchestra.run.smithi116.stderr: 67650K .......... .......... .......... .......... .......... 72% 427M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67700K .......... .......... .......... .......... .......... 72% 435M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67750K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67800K .......... .......... .......... .......... .......... 73% 423M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67850K .......... .......... .......... .......... .......... 73% 415M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67900K .......... .......... .......... .......... .......... 73% 416M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 67950K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68000K .......... .......... .......... .......... .......... 73% 422M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68050K .......... .......... .......... .......... .......... 73% 425M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68100K .......... .......... .......... .......... .......... 73% 421M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68150K .......... .......... .......... .......... .......... 73% 404M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68200K .......... .......... .......... .......... .......... 73% 400M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68250K .......... .......... .......... .......... .......... 73% 439M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68300K .......... .......... .......... .......... .......... 73% 426M 0s 2024-09-14T11:44:13.548 INFO:teuthology.orchestra.run.smithi116.stderr: 68350K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68400K .......... .......... .......... .......... .......... 73% 419M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68450K .......... .......... .......... .......... .......... 73% 444M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68500K .......... .......... .......... .......... .......... 73% 249M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68550K .......... .......... .......... .......... .......... 73% 403M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68600K .......... .......... .......... .......... .......... 73% 447M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68650K .......... .......... .......... .......... .......... 73% 434M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68700K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68750K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68800K .......... .......... .......... .......... .......... 74% 413M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68850K .......... .......... .......... .......... .......... 74% 416M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68900K .......... .......... .......... .......... .......... 74% 444M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 68950K .......... .......... .......... .......... .......... 74% 134M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 69000K .......... .......... .......... .......... .......... 74% 184M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 69050K .......... .......... .......... .......... .......... 74% 405M 0s 2024-09-14T11:44:13.549 INFO:teuthology.orchestra.run.smithi116.stderr: 69100K .......... .......... .......... .......... .......... 74% 439M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69150K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69200K .......... .......... .......... .......... .......... 74% 16.7M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69250K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69300K .......... .......... .......... .......... .......... 74% 383M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69350K .......... .......... .......... .......... .......... 74% 49.9M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69400K .......... .......... .......... .......... .......... 74% 148M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69450K .......... .......... .......... .......... .......... 74% 407M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69500K .......... .......... .......... .......... .......... 74% 295M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69550K .......... .......... .......... .......... .......... 74% 222M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69600K .......... .......... .......... .......... .......... 74% 277M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69650K .......... .......... .......... .......... .......... 75% 282M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69700K .......... .......... .......... .......... .......... 75% 422M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69750K .......... .......... .......... .......... .......... 75% 163M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69800K .......... .......... .......... .......... .......... 75% 287M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69850K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69900K .......... .......... .......... .......... .......... 75% 441M 0s 2024-09-14T11:44:13.550 INFO:teuthology.orchestra.run.smithi116.stderr: 69950K .......... .......... .......... .......... .......... 75% 309M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70000K .......... .......... .......... .......... .......... 75% 438M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70050K .......... .......... .......... .......... .......... 75% 452M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70100K .......... .......... .......... .......... .......... 75% 447M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70150K .......... .......... .......... .......... .......... 75% 187M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70200K .......... .......... .......... .......... .......... 75% 438M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70250K .......... .......... .......... .......... .......... 75% 401M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70300K .......... .......... .......... .......... .......... 75% 396M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70350K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70400K .......... .......... .......... .......... .......... 75% 430M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70450K .......... .......... .......... .......... .......... 75% 438M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70500K .......... .......... .......... .......... .......... 75% 438M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70550K .......... .......... .......... .......... .......... 75% 396M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70600K .......... .......... .......... .......... .......... 76% 427M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70650K .......... .......... .......... .......... .......... 76% 432M 0s 2024-09-14T11:44:13.551 INFO:teuthology.orchestra.run.smithi116.stderr: 70700K .......... .......... .......... .......... .......... 76% 449M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 70750K .......... .......... .......... .......... .......... 76% 346M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 70800K .......... .......... .......... .......... .......... 76% 425M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 70850K .......... .......... .......... .......... .......... 76% 427M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 70900K .......... .......... .......... .......... .......... 76% 447M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 70950K .......... .......... .......... .......... .......... 76% 406M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71000K .......... .......... .......... .......... .......... 76% 426M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71050K .......... .......... .......... .......... .......... 76% 463M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71100K .......... .......... .......... .......... .......... 76% 458M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71150K .......... .......... .......... .......... .......... 76% 362M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71200K .......... .......... .......... .......... .......... 76% 430M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71250K .......... .......... .......... .......... .......... 76% 423M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71300K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71350K .......... .......... .......... .......... .......... 76% 379M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71400K .......... .......... .......... .......... .......... 76% 412M 0s 2024-09-14T11:44:13.552 INFO:teuthology.orchestra.run.smithi116.stderr: 71450K .......... .......... .......... .......... .......... 76% 412M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71500K .......... .......... .......... .......... .......... 77% 419M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71550K .......... .......... .......... .......... .......... 77% 303M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71600K .......... .......... .......... .......... .......... 77% 406M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71650K .......... .......... .......... .......... .......... 77% 417M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71700K .......... .......... .......... .......... .......... 77% 439M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71750K .......... .......... .......... .......... .......... 77% 395M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71800K .......... .......... .......... .......... .......... 77% 413M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71850K .......... .......... .......... .......... .......... 77% 426M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71900K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 71950K .......... .......... .......... .......... .......... 77% 209M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72000K .......... .......... .......... .......... .......... 77% 316M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72050K .......... .......... .......... .......... .......... 77% 436M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72100K .......... .......... .......... .......... .......... 77% 265M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72150K .......... .......... .......... .......... .......... 77% 208M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72200K .......... .......... .......... .......... .......... 77% 259M 0s 2024-09-14T11:44:13.553 INFO:teuthology.orchestra.run.smithi116.stderr: 72250K .......... .......... .......... .......... .......... 77% 18.0M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72300K .......... .......... .......... .......... .......... 77% 163M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72350K .......... .......... .......... .......... .......... 77% 268M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72400K .......... .......... .......... .......... .......... 77% 57.7M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72450K .......... .......... .......... .......... .......... 78% 58.3M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72500K .......... .......... .......... .......... .......... 78% 324M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72550K .......... .......... .......... .......... .......... 78% 398M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72600K .......... .......... .......... .......... .......... 78% 431M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72650K .......... .......... .......... .......... .......... 78% 448M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72700K .......... .......... .......... .......... .......... 78% 281M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72750K .......... .......... .......... .......... .......... 78% 412M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72800K .......... .......... .......... .......... .......... 78% 447M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72850K .......... .......... .......... .......... .......... 78% 154M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72900K .......... .......... .......... .......... .......... 78% 366M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 72950K .......... .......... .......... .......... .......... 78% 120M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 73000K .......... .......... .......... .......... .......... 78% 350M 0s 2024-09-14T11:44:13.554 INFO:teuthology.orchestra.run.smithi116.stderr: 73050K .......... .......... .......... .......... .......... 78% 422M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73100K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73150K .......... .......... .......... .......... .......... 78% 420M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73200K .......... .......... .......... .......... .......... 78% 380M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73250K .......... .......... .......... .......... .......... 78% 395M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73300K .......... .......... .......... .......... .......... 78% 375M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73350K .......... .......... .......... .......... .......... 79% 413M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73400K .......... .......... .......... .......... .......... 79% 439M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73450K .......... .......... .......... .......... .......... 79% 425M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73500K .......... .......... .......... .......... .......... 79% 323M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73550K .......... .......... .......... .......... .......... 79% 406M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73600K .......... .......... .......... .......... .......... 79% 431M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73650K .......... .......... .......... .......... .......... 79% 413M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73700K .......... .......... .......... .......... .......... 79% 312M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73750K .......... .......... .......... .......... .......... 79% 340M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73800K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-14T11:44:13.555 INFO:teuthology.orchestra.run.smithi116.stderr: 73850K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 73900K .......... .......... .......... .......... .......... 79% 287M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 73950K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74000K .......... .......... .......... .......... .......... 79% 366M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74050K .......... .......... .......... .......... .......... 79% 422M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74100K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74150K .......... .......... .......... .......... .......... 79% 377M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74200K .......... .......... .......... .......... .......... 79% 412M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74250K .......... .......... .......... .......... .......... 79% 401M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74300K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74350K .......... .......... .......... .......... .......... 80% 340M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74400K .......... .......... .......... .......... .......... 80% 379M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74450K .......... .......... .......... .......... .......... 80% 396M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74500K .......... .......... .......... .......... .......... 80% 380M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74550K .......... .......... .......... .......... .......... 80% 431M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74600K .......... .......... .......... .......... .......... 80% 422M 0s 2024-09-14T11:44:13.556 INFO:teuthology.orchestra.run.smithi116.stderr: 74650K .......... .......... .......... .......... .......... 80% 382M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74700K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74750K .......... .......... .......... .......... .......... 80% 407M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74800K .......... .......... .......... .......... .......... 80% 424M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74850K .......... .......... .......... .......... .......... 80% 432M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74900K .......... .......... .......... .......... .......... 80% 392M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 74950K .......... .......... .......... .......... .......... 80% 458M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75000K .......... .......... .......... .......... .......... 80% 432M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75050K .......... .......... .......... .......... .......... 80% 415M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75100K .......... .......... .......... .......... .......... 80% 358M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75150K .......... .......... .......... .......... .......... 80% 444M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75200K .......... .......... .......... .......... .......... 81% 427M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75250K .......... .......... .......... .......... .......... 81% 446M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75300K .......... .......... .......... .......... .......... 81% 51.3M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75350K .......... .......... .......... .......... .......... 81% 30.6M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75400K .......... .......... .......... .......... .......... 81% 149M 0s 2024-09-14T11:44:13.557 INFO:teuthology.orchestra.run.smithi116.stderr: 75450K .......... .......... .......... .......... .......... 81% 51.2M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75500K .......... .......... .......... .......... .......... 81% 61.8M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75550K .......... .......... .......... .......... .......... 81% 99.0M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75600K .......... .......... .......... .......... .......... 81% 390M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75650K .......... .......... .......... .......... .......... 81% 360M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75700K .......... .......... .......... .......... .......... 81% 342M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75750K .......... .......... .......... .......... .......... 81% 396M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75800K .......... .......... .......... .......... .......... 81% 399M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75850K .......... .......... .......... .......... .......... 81% 425M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75900K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 75950K .......... .......... .......... .......... .......... 81% 121M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 76000K .......... .......... .......... .......... .......... 81% 387M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 76050K .......... .......... .......... .......... .......... 81% 408M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 76100K .......... .......... .......... .......... .......... 81% 389M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 76150K .......... .......... .......... .......... .......... 82% 164M 0s 2024-09-14T11:44:13.558 INFO:teuthology.orchestra.run.smithi116.stderr: 76200K .......... .......... .......... .......... .......... 82% 420M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76250K .......... .......... .......... .......... .......... 82% 410M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76300K .......... .......... .......... .......... .......... 82% 336M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76350K .......... .......... .......... .......... .......... 82% 420M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76400K .......... .......... .......... .......... .......... 82% 407M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76450K .......... .......... .......... .......... .......... 82% 413M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76500K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76550K .......... .......... .......... .......... .......... 82% 411M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76600K .......... .......... .......... .......... .......... 82% 399M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76650K .......... .......... .......... .......... .......... 82% 362M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76700K .......... .......... .......... .......... .......... 82% 315M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76750K .......... .......... .......... .......... .......... 82% 323M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76800K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76850K .......... .......... .......... .......... .......... 82% 371M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76900K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 76950K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 77000K .......... .......... .......... .......... .......... 82% 401M 0s 2024-09-14T11:44:13.559 INFO:teuthology.orchestra.run.smithi116.stderr: 77050K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77100K .......... .......... .......... .......... .......... 83% 283M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77150K .......... .......... .......... .......... .......... 83% 365M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77200K .......... .......... .......... .......... .......... 83% 441M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77250K .......... .......... .......... .......... .......... 83% 421M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77300K .......... .......... .......... .......... .......... 83% 210M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77350K .......... .......... .......... .......... .......... 83% 384M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77400K .......... .......... .......... .......... .......... 83% 360M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77450K .......... .......... .......... .......... .......... 83% 419M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77500K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77550K .......... .......... .......... .......... .......... 83% 416M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77600K .......... .......... .......... .......... .......... 83% 252M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77650K .......... .......... .......... .......... .......... 83% 424M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77700K .......... .......... .......... .......... .......... 83% 387M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77750K .......... .......... .......... .......... .......... 83% 433M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77800K .......... .......... .......... .......... .......... 83% 404M 0s 2024-09-14T11:44:13.560 INFO:teuthology.orchestra.run.smithi116.stderr: 77850K .......... .......... .......... .......... .......... 83% 427M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 77900K .......... .......... .......... .......... .......... 83% 356M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 77950K .......... .......... .......... .......... .......... 83% 454M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78000K .......... .......... .......... .......... .......... 84% 428M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78050K .......... .......... .......... .......... .......... 84% 445M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78100K .......... .......... .......... .......... .......... 84% 394M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78150K .......... .......... .......... .......... .......... 84% 443M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78200K .......... .......... .......... .......... .......... 84% 440M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78250K .......... .......... .......... .......... .......... 84% 439M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78300K .......... .......... .......... .......... .......... 84% 77.6M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78350K .......... .......... .......... .......... .......... 84% 416M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78400K .......... .......... .......... .......... .......... 84% 38.3M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78450K .......... .......... .......... .......... .......... 84% 99.4M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78500K .......... .......... .......... .......... .......... 84% 49.4M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78550K .......... .......... .......... .......... .......... 84% 56.6M 0s 2024-09-14T11:44:13.561 INFO:teuthology.orchestra.run.smithi116.stderr: 78600K .......... .......... .......... .......... .......... 84% 64.4M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78650K .......... .......... .......... .......... .......... 84% 387M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78700K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78750K .......... .......... .......... .......... .......... 84% 434M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78800K .......... .......... .......... .......... .......... 84% 405M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78850K .......... .......... .......... .......... .......... 84% 417M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78900K .......... .......... .......... .......... .......... 84% 382M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 78950K .......... .......... .......... .......... .......... 85% 141M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79000K .......... .......... .......... .......... .......... 85% 394M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79050K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79100K .......... .......... .......... .......... .......... 85% 299M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79150K .......... .......... .......... .......... .......... 85% 392M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79200K .......... .......... .......... .......... .......... 85% 415M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79250K .......... .......... .......... .......... .......... 85% 412M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79300K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79350K .......... .......... .......... .......... .......... 85% 305M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79400K .......... .......... .......... .......... .......... 85% 418M 0s 2024-09-14T11:44:13.562 INFO:teuthology.orchestra.run.smithi116.stderr: 79450K .......... .......... .......... .......... .......... 85% 441M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79500K .......... .......... .......... .......... .......... 85% 326M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79550K .......... .......... .......... .......... .......... 85% 298M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79600K .......... .......... .......... .......... .......... 85% 375M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79650K .......... .......... .......... .......... .......... 85% 414M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79700K .......... .......... .......... .......... .......... 85% 376M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79750K .......... .......... .......... .......... .......... 85% 376M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79800K .......... .......... .......... .......... .......... 85% 418M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79850K .......... .......... .......... .......... .......... 86% 231M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79900K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 79950K .......... .......... .......... .......... .......... 86% 406M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80000K .......... .......... .......... .......... .......... 86% 418M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80050K .......... .......... .......... .......... .......... 86% 457M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80100K .......... .......... .......... .......... .......... 86% 383M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80150K .......... .......... .......... .......... .......... 86% 277M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80200K .......... .......... .......... .......... .......... 86% 400M 0s 2024-09-14T11:44:13.563 INFO:teuthology.orchestra.run.smithi116.stderr: 80250K .......... .......... .......... .......... .......... 86% 430M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80300K .......... .......... .......... .......... .......... 86% 176M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80350K .......... .......... .......... .......... .......... 86% 418M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80400K .......... .......... .......... .......... .......... 86% 404M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80450K .......... .......... .......... .......... .......... 86% 420M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80500K .......... .......... .......... .......... .......... 86% 379M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80550K .......... .......... .......... .......... .......... 86% 85.7M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80600K .......... .......... .......... .......... .......... 86% 407M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80650K .......... .......... .......... .......... .......... 86% 422M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80700K .......... .......... .......... .......... .......... 86% 353M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80750K .......... .......... .......... .......... .......... 86% 424M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80800K .......... .......... .......... .......... .......... 87% 424M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80850K .......... .......... .......... .......... .......... 87% 414M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80900K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 80950K .......... .......... .......... .......... .......... 87% 351M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 81000K .......... .......... .......... .......... .......... 87% 385M 0s 2024-09-14T11:44:13.564 INFO:teuthology.orchestra.run.smithi116.stderr: 81050K .......... .......... .......... .......... .......... 87% 417M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81100K .......... .......... .......... .......... .......... 87% 322M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81150K .......... .......... .......... .......... .......... 87% 417M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81200K .......... .......... .......... .......... .......... 87% 425M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81250K .......... .......... .......... .......... .......... 87% 356M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81300K .......... .......... .......... .......... .......... 87% 300M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81350K .......... .......... .......... .......... .......... 87% 368M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81400K .......... .......... .......... .......... .......... 87% 425M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81450K .......... .......... .......... .......... .......... 87% 375M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81500K .......... .......... .......... .......... .......... 87% 49.1M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81550K .......... .......... .......... .......... .......... 87% 41.3M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81600K .......... .......... .......... .......... .......... 87% 47.8M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81650K .......... .......... .......... .......... .......... 87% 60.0M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81700K .......... .......... .......... .......... .......... 87% 267M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81750K .......... .......... .......... .......... .......... 88% 274M 0s 2024-09-14T11:44:13.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81800K .......... .......... .......... .......... .......... 88% 324M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81850K .......... .......... .......... .......... .......... 88% 400M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81900K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81950K .......... .......... .......... .......... .......... 88% 130M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82000K .......... .......... .......... .......... .......... 88% 414M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82050K .......... .......... .......... .......... .......... 88% 435M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82100K .......... .......... .......... .......... .......... 88% 382M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82150K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82200K .......... .......... .......... .......... .......... 88% 418M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82250K .......... .......... .......... .......... .......... 88% 301M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82300K .......... .......... .......... .......... .......... 88% 427M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82350K .......... .......... .......... .......... .......... 88% 261M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82400K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82450K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82500K .......... .......... .......... .......... .......... 88% 392M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82550K .......... .......... .......... .......... .......... 88% 353M 0s 2024-09-14T11:44:13.566 INFO:teuthology.orchestra.run.smithi116.stderr: 82600K .......... .......... .......... .......... .......... 88% 419M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82650K .......... .......... .......... .......... .......... 89% 429M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82700K .......... .......... .......... .......... .......... 89% 384M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82750K .......... .......... .......... .......... .......... 89% 336M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82800K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82850K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82900K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 82950K .......... .......... .......... .......... .......... 89% 364M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83000K .......... .......... .......... .......... .......... 89% 363M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83050K .......... .......... .......... .......... .......... 89% 268M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83100K .......... .......... .......... .......... .......... 89% 478M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83150K .......... .......... .......... .......... .......... 89% 327M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83200K .......... .......... .......... .......... .......... 89% 389M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83250K .......... .......... .......... .......... .......... 89% 394M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83300K .......... .......... .......... .......... .......... 89% 428M 0s 2024-09-14T11:44:13.567 INFO:teuthology.orchestra.run.smithi116.stderr: 83350K .......... .......... .......... .......... .......... 89% 381M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83400K .......... .......... .......... .......... .......... 89% 235M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83450K .......... .......... .......... .......... .......... 89% 346M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83500K .......... .......... .......... .......... .......... 89% 429M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83550K .......... .......... .......... .......... .......... 89% 96.9M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83600K .......... .......... .......... .......... .......... 90% 296M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83650K .......... .......... .......... .......... .......... 90% 249M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83700K .......... .......... .......... .......... .......... 90% 407M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83750K .......... .......... .......... .......... .......... 90% 399M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83800K .......... .......... .......... .......... .......... 90% 390M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83850K .......... .......... .......... .......... .......... 90% 215M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83900K .......... .......... .......... .......... .......... 90% 314M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 83950K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 84000K .......... .......... .......... .......... .......... 90% 422M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 84050K .......... .......... .......... .......... .......... 90% 453M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 84100K .......... .......... .......... .......... .......... 90% 412M 0s 2024-09-14T11:44:13.568 INFO:teuthology.orchestra.run.smithi116.stderr: 84150K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84200K .......... .......... .......... .......... .......... 90% 421M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84250K .......... .......... .......... .......... .......... 90% 440M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84300K .......... .......... .......... .......... .......... 90% 183M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84350K .......... .......... .......... .......... .......... 90% 158M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84400K .......... .......... .......... .......... .......... 90% 417M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84450K .......... .......... .......... .......... .......... 90% 87.1M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84500K .......... .......... .......... .......... .......... 91% 361M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84550K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84600K .......... .......... .......... .......... .......... 91% 49.6M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84650K .......... .......... .......... .......... .......... 91% 52.1M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84700K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84750K .......... .......... .......... .......... .......... 91% 38.5M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84800K .......... .......... .......... .......... .......... 91% 424M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84850K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84900K .......... .......... .......... .......... .......... 91% 406M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84950K .......... .......... .......... .......... .......... 91% 382M 0s 2024-09-14T11:44:13.569 INFO:teuthology.orchestra.run.smithi116.stderr: 85000K .......... .......... .......... .......... .......... 91% 165M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85050K .......... .......... .......... .......... .......... 91% 302M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85100K .......... .......... .......... .......... .......... 91% 427M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85150K .......... .......... .......... .......... .......... 91% 320M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85200K .......... .......... .......... .......... .......... 91% 389M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85250K .......... .......... .......... .......... .......... 91% 295M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85300K .......... .......... .......... .......... .......... 91% 181M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85350K .......... .......... .......... .......... .......... 91% 224M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85400K .......... .......... .......... .......... .......... 91% 329M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85450K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85500K .......... .......... .......... .......... .......... 92% 393M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85550K .......... .......... .......... .......... .......... 92% 366M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85600K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85650K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85700K .......... .......... .......... .......... .......... 92% 242M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85750K .......... .......... .......... .......... .......... 92% 429M 0s 2024-09-14T11:44:13.570 INFO:teuthology.orchestra.run.smithi116.stderr: 85800K .......... .......... .......... .......... .......... 92% 413M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 85850K .......... .......... .......... .......... .......... 92% 365M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 85900K .......... .......... .......... .......... .......... 92% 442M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 85950K .......... .......... .......... .......... .......... 92% 453M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86000K .......... .......... .......... .......... .......... 92% 414M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86050K .......... .......... .......... .......... .......... 92% 397M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86100K .......... .......... .......... .......... .......... 92% 433M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86150K .......... .......... .......... .......... .......... 92% 423M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86200K .......... .......... .......... .......... .......... 92% 443M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86250K .......... .......... .......... .......... .......... 92% 198M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86300K .......... .......... .......... .......... .......... 92% 423M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86350K .......... .......... .......... .......... .......... 93% 409M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86400K .......... .......... .......... .......... .......... 93% 432M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86450K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86500K .......... .......... .......... .......... .......... 93% 427M 0s 2024-09-14T11:44:13.571 INFO:teuthology.orchestra.run.smithi116.stderr: 86550K .......... .......... .......... .......... .......... 93% 394M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86600K .......... .......... .......... .......... .......... 93% 172M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86650K .......... .......... .......... .......... .......... 93% 313M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86700K .......... .......... .......... .......... .......... 93% 428M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86750K .......... .......... .......... .......... .......... 93% 209M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86800K .......... .......... .......... .......... .......... 93% 408M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86850K .......... .......... .......... .......... .......... 93% 389M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86900K .......... .......... .......... .......... .......... 93% 203M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86950K .......... .......... .......... .......... .......... 93% 342M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87000K .......... .......... .......... .......... .......... 93% 130M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87050K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87100K .......... .......... .......... .......... .......... 93% 427M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87150K .......... .......... .......... .......... .......... 93% 261M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87200K .......... .......... .......... .......... .......... 93% 418M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87250K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87300K .......... .......... .......... .......... .......... 94% 433M 0s 2024-09-14T11:44:13.572 INFO:teuthology.orchestra.run.smithi116.stderr: 87350K .......... .......... .......... .......... .......... 94% 414M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87400K .......... .......... .......... .......... .......... 94% 428M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87450K .......... .......... .......... .......... .......... 94% 369M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87500K .......... .......... .......... .......... .......... 94% 85.5M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87550K .......... .......... .......... .......... .......... 94% 258M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87600K .......... .......... .......... .......... .......... 94% 45.3M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87650K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87700K .......... .......... .......... .......... .......... 94% 76.9M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87750K .......... .......... .......... .......... .......... 94% 313M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87800K .......... .......... .......... .......... .......... 94% 40.0M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87850K .......... .......... .......... .......... .......... 94% 180M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87900K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 87950K .......... .......... .......... .......... .......... 94% 366M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 88000K .......... .......... .......... .......... .......... 94% 422M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 88050K .......... .......... .......... .......... .......... 94% 164M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 88100K .......... .......... .......... .......... .......... 94% 201M 0s 2024-09-14T11:44:13.573 INFO:teuthology.orchestra.run.smithi116.stderr: 88150K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88200K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88250K .......... .......... .......... .......... .......... 95% 424M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88300K .......... .......... .......... .......... .......... 95% 169M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88350K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88400K .......... .......... .......... .......... .......... 95% 264M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88450K .......... .......... .......... .......... .......... 95% 386M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88500K .......... .......... .......... .......... .......... 95% 200M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88550K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88600K .......... .......... .......... .......... .......... 95% 248M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88650K .......... .......... .......... .......... .......... 95% 366M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88700K .......... .......... .......... .......... .......... 95% 394M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88750K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88800K .......... .......... .......... .......... .......... 95% 443M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88850K .......... .......... .......... .......... .......... 95% 204M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88900K .......... .......... .......... .......... .......... 95% 357M 0s 2024-09-14T11:44:13.574 INFO:teuthology.orchestra.run.smithi116.stderr: 88950K .......... .......... .......... .......... .......... 95% 325M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89000K .......... .......... .......... .......... .......... 95% 420M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89050K .......... .......... .......... .......... .......... 95% 456M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89100K .......... .......... .......... .......... .......... 95% 378M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89150K .......... .......... .......... .......... .......... 96% 360M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89200K .......... .......... .......... .......... .......... 96% 426M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89250K .......... .......... .......... .......... .......... 96% 287M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89300K .......... .......... .......... .......... .......... 96% 408M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89350K .......... .......... .......... .......... .......... 96% 185M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89400K .......... .......... .......... .......... .......... 96% 431M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89450K .......... .......... .......... .......... .......... 96% 404M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89500K .......... .......... .......... .......... .......... 96% 412M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89550K .......... .......... .......... .......... .......... 96% 309M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89600K .......... .......... .......... .......... .......... 96% 403M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89650K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89700K .......... .......... .......... .......... .......... 96% 337M 0s 2024-09-14T11:44:13.575 INFO:teuthology.orchestra.run.smithi116.stderr: 89750K .......... .......... .......... .......... .......... 96% 313M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 89800K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 89850K .......... .......... .......... .......... .......... 96% 377M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 89900K .......... .......... .......... .......... .......... 96% 354M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 89950K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90000K .......... .......... .......... .......... .......... 96% 408M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90050K .......... .......... .......... .......... .......... 96% 413M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90100K .......... .......... .......... .......... .......... 97% 271M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90150K .......... .......... .......... .......... .......... 97% 233M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90200K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90250K .......... .......... .......... .......... .......... 97% 408M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90300K .......... .......... .......... .......... .......... 97% 424M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90350K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90400K .......... .......... .......... .......... .......... 97% 415M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90450K .......... .......... .......... .......... .......... 97% 263M 0s 2024-09-14T11:44:13.576 INFO:teuthology.orchestra.run.smithi116.stderr: 90500K .......... .......... .......... .......... .......... 97% 65.8M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90550K .......... .......... .......... .......... .......... 97% 375M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90600K .......... .......... .......... .......... .......... 97% 343M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90650K .......... .......... .......... .......... .......... 97% 57.6M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90700K .......... .......... .......... .......... .......... 97% 87.5M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90750K .......... .......... .......... .......... .......... 97% 287M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90800K .......... .......... .......... .......... .......... 97% 412M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90850K .......... .......... .......... .......... .......... 97% 41.1M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90900K .......... .......... .......... .......... .......... 97% 120M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 90950K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91000K .......... .......... .......... .......... .......... 98% 427M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91050K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91100K .......... .......... .......... .......... .......... 98% 203M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91150K .......... .......... .......... .......... .......... 98% 106M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91200K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91250K .......... .......... .......... .......... .......... 98% 428M 0s 2024-09-14T11:44:13.577 INFO:teuthology.orchestra.run.smithi116.stderr: 91300K .......... .......... .......... .......... .......... 98% 416M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91350K .......... .......... .......... .......... .......... 98% 388M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91400K .......... .......... .......... .......... .......... 98% 337M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91450K .......... .......... .......... .......... .......... 98% 284M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91500K .......... .......... .......... .......... .......... 98% 422M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91550K .......... .......... .......... .......... .......... 98% 209M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91600K .......... .......... .......... .......... .......... 98% 241M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91650K .......... .......... .......... .......... .......... 98% 55.6M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91700K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91750K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91800K .......... .......... .......... .......... .......... 98% 412M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91850K .......... .......... .......... .......... .......... 98% 403M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91900K .......... .......... .......... .......... .......... 98% 432M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 91950K .......... .......... .......... .......... .......... 99% 333M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 92000K .......... .......... .......... .......... .......... 99% 360M 0s 2024-09-14T11:44:13.578 INFO:teuthology.orchestra.run.smithi116.stderr: 92050K .......... .......... .......... .......... .......... 99% 425M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92100K .......... .......... .......... .......... .......... 99% 421M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92150K .......... .......... .......... .......... .......... 99% 390M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92200K .......... .......... .......... .......... .......... 99% 304M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92250K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92300K .......... .......... .......... .......... .......... 99% 439M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92350K .......... .......... .......... .......... .......... 99% 336M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92400K .......... .......... .......... .......... .......... 99% 393M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92450K .......... .......... .......... .......... .......... 99% 419M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92500K .......... .......... .......... .......... .......... 99% 417M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92550K .......... .......... .......... .......... .......... 99% 380M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92600K .......... .......... .......... .......... .......... 99% 422M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92650K .......... .......... .......... .......... .......... 99% 421M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92700K .......... .......... .......... .......... .......... 99% 317M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92750K .......... .......... .......... .......... .......... 99% 333M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92800K .......... .......... .......... .......... .......... 99% 436M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92850K .......... .......... .......... .......... .......... 99% 432M 0s 2024-09-14T11:44:13.579 INFO:teuthology.orchestra.run.smithi116.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:44:13.580 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T11:44:13.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14 11:44:12 (198 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:44:13.580 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:44:13.607 INFO:teuthology.orchestra.run.smithi116.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:44:13.608 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:44:13.609 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:44:13.610 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:44:13.611 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:44:13.612 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:44:13.613 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:44:13.614 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:44:13.615 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:44:13.616 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:44:13.617 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:44:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:44:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:44:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:44:13.621 INFO:teuthology.orchestra.run.smithi116.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:44:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.636 INFO:teuthology.orchestra.run.smithi116.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:44:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.636 INFO:teuthology.orchestra.run.smithi116.stdout:Here are the highlights of this release: 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Advanced control of transitive versions 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Support for optional features and dependencies 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Rules to tweak published metadata 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Support for Java 13 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - New Zinc compiler for Scala 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - VS2019 support 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout:------------------------------------------------------------ 2024-09-14T11:44:13.637 INFO:teuthology.orchestra.run.smithi116.stdout:Gradle 6.0.1 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:------------------------------------------------------------ 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:Kotlin: 1.3.50 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:Groovy: 2.5.8 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:44:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:13.640 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:44:13.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:44:13.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:44:13.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:44:13.640 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:44:13.640 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:44:13.859 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:44:13.859 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:44:13.859 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'PCBVVABRKQXWVTMZPCWN', 'access_secret': 'XRe1sDoiGJHXnmKdpP5WSFt6lS2glEf3gG1j2NJIt3kN1H6u4sSbew==', 'region': 'mexico', 'endpoint': 'smithi116.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi116.front.sepia.ceph.com'} 2024-09-14T11:44:13.859 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:44:13.859 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'PCBVVABRKQXWVTMZPCWN', '--secret', 'XRe1sDoiGJHXnmKdpP5WSFt6lS2glEf3gG1j2NJIt3kN1H6u4sSbew==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:44:13.860 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key PCBVVABRKQXWVTMZPCWN --secret XRe1sDoiGJHXnmKdpP5WSFt6lS2glEf3gG1j2NJIt3kN1H6u4sSbew== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:44:13.923 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:13.923 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:13.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.959+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:13.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:13.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 realm 2024-09-14T11:44:13.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:13.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:13.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:13.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:13.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:13.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.960+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:13.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.961+0000 7f25ce126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:13.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.961+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:13.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.962+0000 7f25ce126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:13.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.962+0000 7f25ce126800 20 searching for the correct realm 2024-09-14T11:44:13.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:13.966+0000 7f25ca50a640 0 -- 172.21.15.116:0/2435908758 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f25c0088940 msgr2=0x7f25c0064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.173+0000 7f25c9d09640 0 -- 172.21.15.116:0/2435908758 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x555c03ebf690 msgr2=0x555c03ec1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.176+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 zone default found 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 4 Realm: () 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 zonegroup default 2024-09-14T11:44:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.177+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.178+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.178+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.178+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.178+0000 7f25ce126800 20 started sync module instance, tier type = 2024-09-14T11:44:14.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.178+0000 7f25ce126800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:44:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=0 2024-09-14T11:44:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=1 2024-09-14T11:44:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=2 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=3 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=4 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=5 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.188+0000 7f25ce126800 20 add_watcher() i=6 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.189+0000 7f25ce126800 20 add_watcher() i=7 2024-09-14T11:44:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.189+0000 7f25ce126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f247b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f25ce126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f25ce126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f25ce126800 5 note: GC not initialized 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f247a7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f25ce126800 20 init_complete bucket index max shards: 11 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.191+0000 7f25ce126800 20 Filter name: none 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f23ebfff640 20 reqs_thread_entry: start 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:44:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:44:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache get: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN : miss 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.192+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN info.flags=0x0 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.193+0000 7f25ce126800 10 adding default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN to cache LRU end 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.193+0000 7f25ce126800 10 cache get: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN : hit (negative entry) 2024-09-14T11:44:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.193+0000 7f25ce126800 10 cache get: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN : hit (negative entry) 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f25ce126800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f25ce126800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f24ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 93853691190992 notifier 8940 bl.length()=670 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f24ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:44:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.194+0000 7f24ad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f25ce126800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f25ce126800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f24ad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 93853691188880 notifier 8940 bl.length()=200 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f24ad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:44:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.197+0000 7f24ad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f25ce126800 10 cache put: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN info.flags=0x7 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f25ce126800 10 moving default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN to cache LRU end 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f25ce126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:PCBVVABRKQXWVTMZPCWN, ofs0, ns] 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f24acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 93853691194272 notifier 8940 bl.length()=189 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f24acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN info.flags=0x7 2024-09-14T11:44:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.200+0000 7f24acff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PCBVVABRKQXWVTMZPCWN to cache LRU end 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "tester.client.0", 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:44:14.199 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "tester.client.0", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "PCBVVABRKQXWVTMZPCWN", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "XRe1sDoiGJHXnmKdpP5WSFt6lS2glEf3gG1j2NJIt3kN1H6u4sSbew==", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:44:14.193822Z" 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:44:14.200 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:44:14.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:44:14.193810Z", 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:44:14.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.202+0000 7f247b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.204+0000 7f25ce126800 20 remove_watcher() i=0 2024-09-14T11:44:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.204+0000 7f25ce126800 2 removed watcher, disabling cache 2024-09-14T11:44:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.205+0000 7f25ce126800 20 remove_watcher() i=1 2024-09-14T11:44:14.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.207+0000 7f25ce126800 20 remove_watcher() i=2 2024-09-14T11:44:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.208+0000 7f25ce126800 20 remove_watcher() i=3 2024-09-14T11:44:14.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.209+0000 7f25ce126800 20 remove_watcher() i=4 2024-09-14T11:44:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.210+0000 7f25ce126800 20 remove_watcher() i=5 2024-09-14T11:44:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.211+0000 7f25ce126800 20 remove_watcher() i=6 2024-09-14T11:44:14.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.212+0000 7f25ce126800 20 remove_watcher() i=7 2024-09-14T11:44:14.221 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:44:14.221 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:44:14.253 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:44:14.253 DEBUG:teuthology.orchestra.run.smithi116:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:44:14.320 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:44:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:14.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.451+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 20 realm 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.452+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.453+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.453+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.454+0000 7fab5ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.454+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.454+0000 7fab5ad46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.454+0000 7fab5ad46800 20 searching for the correct realm 2024-09-14T11:44:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.457+0000 7fab50036640 0 -- 172.21.15.116:0/1434463473 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55f35a62fcf0 msgr2=0x55f35a632190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.461+0000 7fab58837640 0 -- 172.21.15.116:0/1434463473 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fab4009abc0 msgr2=0x7fab4005a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.465+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:14.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 zone default found 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 4 Realm: () 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 zonegroup default 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.466+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.467+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.467+0000 7fab5ad46800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.467+0000 7fab5ad46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.467+0000 7fab5ad46800 20 started sync module instance, tier type = 2024-09-14T11:44:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.467+0000 7fab5ad46800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:44:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=0 2024-09-14T11:44:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=1 2024-09-14T11:44:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=2 2024-09-14T11:44:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=3 2024-09-14T11:44:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=4 2024-09-14T11:44:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=5 2024-09-14T11:44:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.476+0000 7fab5ad46800 20 add_watcher() i=6 2024-09-14T11:44:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.478+0000 7fab5ad46800 20 add_watcher() i=7 2024-09-14T11:44:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.478+0000 7fab5ad46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.480+0000 7faa0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.480+0000 7fab5ad46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.480+0000 7fab5ad46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.516+0000 7faa0dfe3640 20 reqs_thread_entry: start 2024-09-14T11:44:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.516+0000 7fab5ad46800 20 init_complete bucket index max shards: 11 2024-09-14T11:44:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.516+0000 7fab5ad46800 20 Filter name: none 2024-09-14T11:44:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.517+0000 7fa97f7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.517+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:44:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.518+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12978238226944810239', time=2024-09-14T13:35:24.446623+0000, chain.objs.size()=1 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.qNn4TGq6EovLYW9XbXPyTV4NtwW7GOf_0 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8984518682680850059', time=2024-09-14T13:35:24.637100+0000, chain.objs.size()=5 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1 2024-09-14T11:44:14.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1_1 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2_1 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.3 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_muO1H4O0xZVFbQwrg9VRuXvkPP43I0Z', time=2024-09-14T13:35:24.667148+0000, chain.objs.size()=3 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_0 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_1 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.zur-6MLutOWTBRk4AuOGn1sO7zefVFu_2 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13514958335792485688', time=2024-09-14T13:35:24.670808+0000, chain.objs.size()=5 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.1_1 2024-09-14T11:44:14.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.519+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.2_1 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-FROZEN.2~cWU9wzj4M9z7rEKpd9UCfS-x8k1HWa6.3 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17130854142961564523', time=2024-09-14T13:36:40.542697+0000, chain.objs.size()=1 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.PHzUR1NNAOYt-0uvld-9uBAx10FDUWi_0 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3581210445010313160', time=2024-09-14T13:37:52.697889+0000, chain.objs.size()=1 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.3u9SbOk6SQQuCNTBLjNU_zdIkDrzAR8_0 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15616593511488764448', time=2024-09-14T13:39:06.914253+0000, chain.objs.size()=1 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.yE8GmU_5FeWx5qIRIdtuGEwZsOl9X0G_0 2024-09-14T11:44:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11548406416871847890', time=2024-09-14T13:39:09.624886+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.gBQGI2KsZ-xrqinfcGv-MIsAU3gIMRX_0 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1989811356740979863', time=2024-09-14T13:39:11.823315+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.Lc_6iabDDnmmvRKpqNkDAuUu1fRZuuy_0 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.884611857924284213', time=2024-09-14T13:39:48.015385+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.AAarBi0hqklYVCGq3xakpdXY_-ilo4k_0 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11938963261830961168', time=2024-09-14T13:40:23.547894+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.03yKvQLgdyRH87T2equF-BR187YcD-W_0 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9295073744064280372', time=2024-09-14T13:40:23.572874+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.7ub4eAFr8CijxQvmrAeHToDc8x51lt4_0 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8768204705130206510', time=2024-09-14T13:40:23.635452+0000, chain.objs.size()=1 2024-09-14T11:44:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.522+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.usFt6klgb4FKkRDnV2uYpv_QI3Moqq0_0 2024-09-14T11:44:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6469801007929952851', time=2024-09-14T13:40:56.219940+0000, chain.objs.size()=1 2024-09-14T11:44:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.nRDwrjw25TRioYs7M4wd7tvtMjTR_1J_0 2024-09-14T11:44:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1268492203432133908', time=2024-09-14T13:40:59.157564+0000, chain.objs.size()=1 2024-09-14T11:44:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.g55jD35NqcHTJd9L9zySFiBTFEC4-Uj_0 2024-09-14T11:44:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16086620661578949081', time=2024-09-14T13:41:01.262247+0000, chain.objs.size()=1 2024-09-14T11:44:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.VPYygyeIgJslzyqL3_g85no_t365JzO_0 2024-09-14T11:44:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4063522534652674991', time=2024-09-14T13:43:42.145898+0000, chain.objs.size()=1 2024-09-14T11:44:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.525+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.9Sk8EC5mZZXFr3GLLZy4XxVEDX361Y7_0 2024-09-14T11:44:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.527+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.529+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:44:14.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.530+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3297210566770157508', time=2024-09-14T13:36:40.628570+0000, chain.objs.size()=1 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.fYpjQzH2d8P39B2UbKJK4FCJk9JJ8Ya_0 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6912360751044402060', time=2024-09-14T13:38:33.657833+0000, chain.objs.size()=1 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.HJwSH67dhxFq6sAxvxB6Jy7HBZBSlDH_0 2024-09-14T11:44:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16504759310862945899', time=2024-09-14T13:38:33.680270+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.YUUHpGc5vLsM23MDmrLoyxrH3DBbujs_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17059488169530548680', time=2024-09-14T13:39:11.779829+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.c7emCXnJhFEqdiUrftdphkBbY9gz1of_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16581834178023565338', time=2024-09-14T13:39:45.120837+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.6-qKVtGkTl0MAmRX3lZWcWts7FHPW9S_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2091075379093109075', time=2024-09-14T13:40:20.898812+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.2SEoVpRfy4yxdfYdgRGS5IjHdCL00h1_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7751816330955533291', time=2024-09-14T13:41:01.308891+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_._Xv4tgjIiZ1iddD9auCUMcaRJx_sDlO_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5094937280885496032', time=2024-09-14T13:41:34.522856+0000, chain.objs.size()=1 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.haDvs46huuwcNYUzvWjKJJ0g_A8vdtn_0 2024-09-14T11:44:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11899852294230893303', time=2024-09-14T13:41:34.533616+0000, chain.objs.size()=1 2024-09-14T11:44:14.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.tzNl0IfkWv2FJlgYCIwqRdckMnHNsza_0 2024-09-14T11:44:14.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7782002486389937493', time=2024-09-14T13:41:34.589658+0000, chain.objs.size()=1 2024-09-14T11:44:14.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.531+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.xUFHs4KUBOn2B-E9b6DoEwNHrYxOJE0_0 2024-09-14T11:44:14.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.533+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.535+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:44:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11046883574160937437', time=2024-09-14T13:36:42.542346+0000, chain.objs.size()=1 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.QJGvU1hn1JKXfc5gBVTsLBwSK8Pjo-T_0 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15360627290996324419', time=2024-09-14T13:37:52.773231+0000, chain.objs.size()=1 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.zhQNghrau7om_76GH-NhZHhkwZUrGm4_0 2024-09-14T11:44:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9182275458123357347', time=2024-09-14T13:37:55.578811+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.8EC_YfNRA197sD-bVjzIEi4zmyQPoXe_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10383412252595727653', time=2024-09-14T13:37:55.636584+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.CnEmatrNwHwB3D3lEp40eGBcMZd-n-1_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17845300648422753975', time=2024-09-14T13:37:55.664920+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.rSgYnmdDxSd8vxvFxYSofLjBEb0_E1g_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7108121553665755386', time=2024-09-14T13:38:30.947195+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.ewk4w2xpEziJ0gmyiy3e8jEcqRQNEMp_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11508304457270170062', time=2024-09-14T13:40:20.899216+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.3Nr7JxOlnsSi931kA8TD4O5MHeQDKUj_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15104723902072155070', time=2024-09-14T13:40:20.941939+0000, chain.objs.size()=1 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.j09MOk9j5YQqVNb1zXLEb-G9fUBmFkc_0 2024-09-14T11:44:14.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4042273107863948149', time=2024-09-14T13:41:01.356528+0000, chain.objs.size()=1 2024-09-14T11:44:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.UjbwEML7EkTe7K-SQ24DAGSICYX6ogc_0 2024-09-14T11:44:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.62922010239317475', time=2024-09-14T13:41:34.611060+0000, chain.objs.size()=1 2024-09-14T11:44:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.537+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.26wyXNw1xxv6eoyI4MIWfo1HQpKaajn_0 2024-09-14T11:44:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.540+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.542+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:44:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.543+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.543+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2621080930486492875', time=2024-09-14T13:35:24.438875+0000, chain.objs.size()=1 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.r3FQnoWcDtFsfxIj5H0P9-0OrfHgBuy_0 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6955681760137817235', time=2024-09-14T13:35:24.492686+0000, chain.objs.size()=4 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.1 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.2 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.3 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12__multipart_foo.2~Qp7pwKnbGTPNLvXyDvWtQv0fu80DOWY.4 2024-09-14T11:44:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7225582234890446546', time=2024-09-14T13:35:24.812386+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.zeXAgi8BKGq9lXKE0KsGSC_0oRt9va6_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3511113764607129715', time=2024-09-14T13:36:42.611446+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.bO7NY3YRz2H4cr7e5LbZP8w1rRIwjrC_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14428720946840212907', time=2024-09-14T13:37:55.636291+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.Q4QjgB3GJlrMwTuuProOJZPDFSYifA8_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11684998129505770953', time=2024-09-14T13:37:57.859938+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.RN5PldsY1coGH0okgvQu9Lw2BznMkpv_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16674331027628283805', time=2024-09-14T13:38:30.946382+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.tm4wyQF2jENQHhLG7bz8_HLI9O_JUSh_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10666046247532675873', time=2024-09-14T13:39:06.869641+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.kYqQLozOa4pW0bR3058BuV-bp2Vt_-t_0 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14692216666848901255', time=2024-09-14T13:39:09.608109+0000, chain.objs.size()=1 2024-09-14T11:44:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.544+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.sQiuyr7LStwx9mvu6tk-_3eSorDvFU1_0 2024-09-14T11:44:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.545+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16744407143567129322', time=2024-09-14T13:39:45.108672+0000, chain.objs.size()=1 2024-09-14T11:44:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.546+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.fxHFKH2vA-0-cfgd_m2iuqMQwD8VbPA_0 2024-09-14T11:44:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.546+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3895645182859852203', time=2024-09-14T13:41:01.343650+0000, chain.objs.size()=1 2024-09-14T11:44:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.546+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.Gy8G_Q-YfLWwf8ijrvx2IMNe90uuwxB_0 2024-09-14T11:44:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.546+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5868182479750949601', time=2024-09-14T13:41:34.585487+0000, chain.objs.size()=1 2024-09-14T11:44:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.546+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.BrPpIIFzGR7bnduMvlTILDG4k02Teld_0 2024-09-14T11:44:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.547+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.550+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:44:14.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.551+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:44:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_1JW7FxgzBb-1p0sAQ0I14HZASltIcDT', time=2024-09-14T13:35:24.589164+0000, chain.objs.size()=2 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.lXI-zbqkesnrJmEbyds2R5y46ZBoEhL_0 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.lXI-zbqkesnrJmEbyds2R5y46ZBoEhL_1 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10250765165431647465', time=2024-09-14T13:35:24.596405+0000, chain.objs.size()=1 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.rQfw0BgcEZ13Grbrg_ugnmjmefMEi-U_0 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6180310280271205311', time=2024-09-14T13:36:40.638908+0000, chain.objs.size()=1 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.D64znkJYK4bsbVCgCnc3jdmlWkgkGu__0 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7804101266787863071', time=2024-09-14T13:36:42.503312+0000, chain.objs.size()=1 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.PshYUoiEPWw-gRXsHtx9_fSZ2_oqXgX_0 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16097873467315837742', time=2024-09-14T13:37:52.681912+0000, chain.objs.size()=1 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.zUlcDbofmMU4SY17IL9UhTRPN4hdxKn_0 2024-09-14T11:44:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18092142803067465577', time=2024-09-14T13:38:30.862600+0000, chain.objs.size()=1 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.jBmFVY_yKVVULXw8kdo9r2bqTnGx9UA_0 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2389437860623844813', time=2024-09-14T13:38:32.921572+0000, chain.objs.size()=1 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.H1Eqwh_ffbotbFVovpSBg1EoErDzSqu_0 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.777419340593728078', time=2024-09-14T13:39:09.678003+0000, chain.objs.size()=1 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.fhgaVRzJmGHPAatqOA00L0xWHGrVevV_0 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8932376005868528811', time=2024-09-14T13:39:45.042325+0000, chain.objs.size()=1 2024-09-14T11:44:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.af_4dgi6vD5PtXofEj3ZVGO1W4iFBh-_0 2024-09-14T11:44:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15781186261338522064', time=2024-09-14T13:39:48.015399+0000, chain.objs.size()=1 2024-09-14T11:44:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.Nsg3AC-TvfFYeCfh4jCzTsONDaHw5zE_0 2024-09-14T11:44:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17737408763209603918', time=2024-09-14T13:40:20.863572+0000, chain.objs.size()=1 2024-09-14T11:44:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.552+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.HpQiPQRFZEVEPqdbiQpRYtkqKZm8Dw9_0 2024-09-14T11:44:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7028042090703652892', time=2024-09-14T13:40:23.594221+0000, chain.objs.size()=1 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.d09LYx2H15ZdmNCF9EHSVK2h02-Ih26_0 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17547465489923286905', time=2024-09-14T13:40:59.134553+0000, chain.objs.size()=1 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.xsllEIKMf0pwLuqMHYQ_3rvm8iXgOVT_0 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.659760135837142980', time=2024-09-14T13:41:01.261028+0000, chain.objs.size()=1 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.FOEj9h6PQZfAgT0CzdAHQ-4dlBeoeEi_0 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11373221398064570777', time=2024-09-14T13:41:01.321727+0000, chain.objs.size()=1 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.9Dcew1FV4UyS33H6Yans8M-nUgC0Sel_0 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16267562175610870988', time=2024-09-14T13:41:34.603669+0000, chain.objs.size()=1 2024-09-14T11:44:14.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.555+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.OoRCkTELSzp-mMmQrpAj64sg3F1NR3e_0 2024-09-14T11:44:14.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.557+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.559+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:44:14.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.561+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.561+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10538667979715335097', time=2024-09-14T13:36:40.558536+0000, chain.objs.size()=1 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.SiMOHTPkOmvfjOJpBQZs1j388cSqMTk_0 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15242462916823160607', time=2024-09-14T13:36:42.529636+0000, chain.objs.size()=1 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.aV0LHu9rS7RnbrW-EmwU9z1exDvGZwR_0 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5557194576766197615', time=2024-09-14T13:36:42.569609+0000, chain.objs.size()=1 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.X01wPhbmzPWNBquKfrJ3tGMrij80W9f_0 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14813043610868900171', time=2024-09-14T13:36:42.570497+0000, chain.objs.size()=1 2024-09-14T11:44:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.GMLZgPFn5NXOKQuXD91dF1t-Q1Rp6Xi_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5152700473193761308', time=2024-09-14T13:37:20.251092+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.q59yTEKyDgamKSgu_PGLUoOJi9XE3QM_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2403789930424686128', time=2024-09-14T13:37:52.777975+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.JvHeb0l0GfVOxGzOlQprvdhFLV6lv6y_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3916320312192384649', time=2024-09-14T13:37:55.634493+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.8VeG7t5MKhsHX_X34t2Ti1HzhgaFOCL_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5703401999706574825', time=2024-09-14T13:38:30.872622+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.sFfnqP59uKBEaDSQ0nn9D0jdBUpewJU_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15077559327020316700', time=2024-09-14T13:38:30.905477+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.W5O8ThRSSeNiiLvr3CQR1NyLOY4SfdU_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15845264475084299698', time=2024-09-14T13:39:06.954814+0000, chain.objs.size()=1 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.XCjDqE31LkeYbJ_Iu0osk-RxLepPJtM_0 2024-09-14T11:44:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.326121770325558369', time=2024-09-14T13:39:09.627669+0000, chain.objs.size()=1 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.YEaZ8rIhyxnUvGHu7eoVhYMf2_GgGZW_0 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11083283580138995908', time=2024-09-14T13:39:45.071230+0000, chain.objs.size()=1 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.562+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.TYy0DrqPbVB2giRHcDbSjoeZBYELY9v_0 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15872334886536258118', time=2024-09-14T13:39:47.979101+0000, chain.objs.size()=1 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.w0H8NDhqEh1wqSf8RApKj7f2QUGOPG1_0 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5604596249040651856', time=2024-09-14T13:40:20.864427+0000, chain.objs.size()=1 2024-09-14T11:44:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.dcQxeZbigxNGWv4bpcQ26mqgCIiMewK_0 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9260184820337574828', time=2024-09-14T13:40:23.590200+0000, chain.objs.size()=1 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.MkE9PYtsBFjU7pSR8brcxnNeT1nz98z_0 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5002919207916788909', time=2024-09-14T13:40:56.201311+0000, chain.objs.size()=1 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.OY2H8mNXpxS4wXOLc1NGHukwbBU51mB_0 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3428403010142306868', time=2024-09-14T13:40:59.123053+0000, chain.objs.size()=1 2024-09-14T11:44:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.7N-q6uOcdcmyJuAInWkUF2-MNO2Bx9h_0 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12277979509647308055', time=2024-09-14T13:40:59.196721+0000, chain.objs.size()=1 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.wcohGsS_FUlSFTyn6cZ4CrBt6cGllyW_0 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14845570853184774506', time=2024-09-14T13:41:01.309554+0000, chain.objs.size()=1 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.564+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.DQK4B8Z2NHWQLP-saEfJmvkJRJuYOcO_0 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.566+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.568+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:44:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.569+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:44:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11884228792491768402', time=2024-09-14T13:37:20.265749+0000, chain.objs.size()=1 2024-09-14T11:44:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.qNAzj7TNrXLN7WXoV9N7fxWoiKiz5Z8_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6437619650627057314', time=2024-09-14T13:37:20.266525+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.9YgG1gCssTq5QsMeEAuxlQtdv1WKo70_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18240637591017980672', time=2024-09-14T13:37:20.293206+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.8ixcOU53fXf8MlmoROTuyYSztisH2DP_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9067863971989557146', time=2024-09-14T13:37:20.293736+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.iqbB4OmPwLuXumlYlPf8sd0csOuJjUG_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16567041690239787359', time=2024-09-14T13:37:52.699092+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.Fxqo8G7d0BI1Yjnto8kZwt3QJ0eIcdL_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13877462575607403331', time=2024-09-14T13:37:52.743466+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.jJup8ugLAeBmEkpYJMjyEHyNGkTGHf1_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8442946910744448160', time=2024-09-14T13:37:52.750021+0000, chain.objs.size()=1 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.570+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.PMr0Z2sVPBt-OdDpoo4woZEwkyRvz20_0 2024-09-14T11:44:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3391614952979874944', time=2024-09-14T13:37:57.824087+0000, chain.objs.size()=1 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.ZrX9SbsB-pt90f4j5XUURtfhM3xCK5x_0 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12591359266424239094', time=2024-09-14T13:38:33.684671+0000, chain.objs.size()=1 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.qW_JfjddDijOxyJ6YwSojxvNgBK7nA__0 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4094150836807863716', time=2024-09-14T13:39:09.654826+0000, chain.objs.size()=1 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.eYbVXEQwubfrhjx2Ast23R6NT1nHalO_0 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2386825918100205990', time=2024-09-14T13:40:20.908158+0000, chain.objs.size()=1 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.NL-0NiwxYFboRP-7FrwcMBLpdxse34C_0 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9278494596033501435', time=2024-09-14T13:40:56.244137+0000, chain.objs.size()=1 2024-09-14T11:44:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.571+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.UkhSu89vf8Qc6nB7uZLVjyPba9Xsw7L_0 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18305687587373799378', time=2024-09-14T13:40:59.140583+0000, chain.objs.size()=1 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_._fFgskr9reLQh6eYGKz0UWQsvrbBfr3_0 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16773313532614008651', time=2024-09-14T13:41:01.273400+0000, chain.objs.size()=1 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.Srp69aFBB_yXzbVutBlbi4IrHP3KKUs_0 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7881137828982902349', time=2024-09-14T13:41:01.314917+0000, chain.objs.size()=1 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.UJcTuCtOLUqj72Yr4iIcT_TY4erQLXC_0 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5388208872072008414', time=2024-09-14T13:41:34.553704+0000, chain.objs.size()=1 2024-09-14T11:44:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.C4ap3hD733GQWolmylyQhrK7boIiO6l_0 2024-09-14T11:44:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5063563892710569468', time=2024-09-14T13:41:34.604142+0000, chain.objs.size()=1 2024-09-14T11:44:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.rRBur_13Rnws53eeRoD2H4LeJV4Lb8a_0 2024-09-14T11:44:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15477595202472052487', time=2024-09-14T13:43:42.173077+0000, chain.objs.size()=1 2024-09-14T11:44:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.573+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.otVyg7-S3QBeUjr2DicHmByT1LyGK9C_0 2024-09-14T11:44:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.574+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.576+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:44:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.577+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:44:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17317022595786374630', time=2024-09-14T13:37:55.637263+0000, chain.objs.size()=1 2024-09-14T11:44:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.-9Jxgitln3n84G47dTxLwnKehZVW_GN_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9474160161304748311', time=2024-09-14T13:37:55.664092+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.o_S-TqurfPSwbqUVwc7kZEEebXEPAzn_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3290364382570583324', time=2024-09-14T13:39:06.893287+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.atbrCXzqQWdxSwQeq_Gwe-j4oPt-ccC_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3213639944533901231', time=2024-09-14T13:39:06.919369+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.fgnJdIIQvvLua2Oy9Oa5FYk4dk-YE0e_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12863077340462878928', time=2024-09-14T13:39:08.720442+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.ZUK4F1k5aLFiMBQEvny2CtwiYxJCKHB_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9728102987542750021', time=2024-09-14T13:39:47.969492+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.5_xzj6Gh7G4IJw3wrmZxNwzeoqRTXal_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1367852395765062835', time=2024-09-14T13:40:20.900117+0000, chain.objs.size()=1 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.lQ4gGDWDvKC458QbEYef4ggQkzbSXcz_0 2024-09-14T11:44:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5769243517484409783', time=2024-09-14T13:40:22.478892+0000, chain.objs.size()=1 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.Gx5uHcJfX0FiP1XKoScdzI_Y_TGgvJj_0 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7018744397296798962', time=2024-09-14T13:40:56.200612+0000, chain.objs.size()=1 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.WMLZiaehVd2W9B95ZiQGAwEwqtiPhWL_0 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12221753008533280925', time=2024-09-14T13:41:34.617533+0000, chain.objs.size()=1 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.PKaTFN3nNZFiFwHEi78Mhf0a78ra9Vo_0 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.759126826506425879', time=2024-09-14T13:43:42.147600+0000, chain.objs.size()=1 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.578+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.PXakdX3vGE50UJdxMBvAKr-wa5G5ZcV_0 2024-09-14T11:44:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.580+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.582+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:44:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.583+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16405708541132821089', time=2024-09-14T13:35:24.442949+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.ws4K4Fqds3TlYCMrifLbw_lFc8H63C3_0 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6713393371613959217', time=2024-09-14T13:37:15.771042+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.Z502249qo3LCR3yYAGSXN6jtGliXhXt_0 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8072850571775077249', time=2024-09-14T13:37:20.296867+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.qL_-6fQiY8QC6UIeZ0yb7gTqhSE9Qjg_0 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7937003204273218934', time=2024-09-14T13:37:52.697654+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.uAeaLCXMEuZBuqIOjY6i_voBpm4cKph_0 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11504568459321852490', time=2024-09-14T13:37:52.744750+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.xv9ACERnzbCLKL9NaRwoYjjwUP9Ae_D_0 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12972302733262390183', time=2024-09-14T13:37:55.604973+0000, chain.objs.size()=1 2024-09-14T11:44:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.3iDKhp9t7KdYrhUtwneb9mb0rZal1kA_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15358834226902989421', time=2024-09-14T13:37:57.814463+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.9Csx5NO4VhWT9uKxBoERkTBSqFQA3rp_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10586959640602576546', time=2024-09-14T13:37:57.859359+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.Hiz1mMhVyNWL3wOdB3HXMtC9OznbIWp_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6490470281028766772', time=2024-09-14T13:37:57.896301+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.eYZvxuejRKcm75-AmMkizEU7r-ZwvPz_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11208577526966529496', time=2024-09-14T13:37:59.418668+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.HqpIzDnzqWpBZmuZBq91x7hVxSkQu3A_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16425457599549955021', time=2024-09-14T13:38:30.901426+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.YqeAq1sH6oz1XCXXvk7QBxMd2KzKkBR_0 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15207506303882159697', time=2024-09-14T13:39:11.771066+0000, chain.objs.size()=1 2024-09-14T11:44:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.584+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.U8zFDEkaLa02oCIIUP1twlzvLjIeP2P_0 2024-09-14T11:44:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.586+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17458117934700591439', time=2024-09-14T13:39:11.828098+0000, chain.objs.size()=1 2024-09-14T11:44:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.586+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_._2axzQgrTQGantWeGujmW635EfsojE3_0 2024-09-14T11:44:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7523669559335606235', time=2024-09-14T13:39:48.045422+0000, chain.objs.size()=1 2024-09-14T11:44:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.xbExGrhznsN6HgqZK4cwIwE6Oqnf0sK_0 2024-09-14T11:44:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14791281474789487326', time=2024-09-14T13:40:59.136059+0000, chain.objs.size()=1 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.zWMOjrsZAjDhBuejED1w3vhFhPl0A5B_0 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10790762344938299415', time=2024-09-14T13:41:01.266616+0000, chain.objs.size()=1 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.4qjjzRsZ0DQoYtgXabd9AWWioBOEQq5_0 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13056455864996556322', time=2024-09-14T13:43:50.129826+0000, chain.objs.size()=1 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.587+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:kmGdfhblvhhdQ3qZul9xGaShh6vs4H._.YF3TfJD4CMx3m5jTT5LW6GPVbbZr4IZ_0 2024-09-14T11:44:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.588+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.590+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:44:14.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.591+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10258439071468374122', time=2024-09-14T13:35:24.720161+0000, chain.objs.size()=3 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_0 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_1 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.VHG0V2byKNj36y2s0ZYFdJ7cU4VBAep_2 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5532601526131972155', time=2024-09-14T13:37:15.771042+0000, chain.objs.size()=1 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.QIvtXMurdn0bcb5drcGQZ-pBe48PFIU_0 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4114651915523681418', time=2024-09-14T13:37:20.232787+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.f_vZyovUalAClsgsgD1ZGaPXpDWu7hc_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5080739985737303333', time=2024-09-14T13:37:20.265578+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.DRO-MDRVdyqcc8jJ5gWiWdGNSw5G_EF_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1840528599334197778', time=2024-09-14T13:37:57.887076+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.SBrB_TSFy9DayadaXtfks8A-viF7q8f_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3966014971633162729', time=2024-09-14T13:38:30.946411+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.eG_g2uxgarYIfaghVLf3SKnPZEvvgxG_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3775664197250869442', time=2024-09-14T13:38:30.947094+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.09xuhUHOTJPwVloOxuxinGfrZH5FjUD_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15953755721231397502', time=2024-09-14T13:38:33.600580+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.5-7KC_ITWWxuSKvBBAJFY3W9WlaWA-j_0 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17190501378219872948', time=2024-09-14T13:39:06.916026+0000, chain.objs.size()=1 2024-09-14T11:44:14.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.samu0hcl_f0eeKbaNhFZbwhpAz5r6U2_0 2024-09-14T11:44:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2151942497688827274', time=2024-09-14T13:39:09.619920+0000, chain.objs.size()=1 2024-09-14T11:44:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.592+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.nfqa7TVSwagHkanqlLKNlKzhl-fZ31S_0 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.594+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10102000086631599625', time=2024-09-14T13:39:09.623994+0000, chain.objs.size()=1 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.594+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.Zm7a91tM5Ukt2u5cb08B38iT1N4rdm9_0 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17939720288328189070', time=2024-09-14T13:39:11.810490+0000, chain.objs.size()=1 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.i6Dloi4MYncJkktyXIBhLIJnR4bFb3U_0 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5824021787242858743', time=2024-09-14T13:39:11.812471+0000, chain.objs.size()=1 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.36Nsn2kYaxcxfv_SlJA3pUaVa9aXpba_0 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15202138647974571413', time=2024-09-14T13:39:45.089316+0000, chain.objs.size()=1 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.j7JV3tNGeNmhPIfbshr6PW-ZKea6CAV_0 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4278322758461418887', time=2024-09-14T13:40:23.572205+0000, chain.objs.size()=1 2024-09-14T11:44:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_._REHddLibILfzaaD61ewkGz1PQb75Qv_0 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4332308430900107836', time=2024-09-14T13:40:56.183085+0000, chain.objs.size()=1 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.Qa2gn5bsQctW6hdIQRUdiaKmDSisY7J_0 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11519325384498128789', time=2024-09-14T13:40:56.214080+0000, chain.objs.size()=1 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.pfDe5fMcYaTU9iZPbsmtEDoTlJiyLkC_0 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8181414064132431685', time=2024-09-14T13:40:56.271958+0000, chain.objs.size()=1 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.Tm-iHlHw80Y5jzE-prmWkwkftVuPINA_0 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5005803397662873160', time=2024-09-14T13:40:59.118314+0000, chain.objs.size()=1 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.595+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.vKYu90gbDJ9igp93Skax0h8zL3WLHCF_0 2024-09-14T11:44:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.597+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.599+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:44:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.600+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15021743481680431301', time=2024-09-14T13:36:40.595361+0000, chain.objs.size()=1 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.HEwlC0f69XnPbbitKUIy2FYgmTDmWPr_0 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1927918933381430473', time=2024-09-14T13:36:42.500047+0000, chain.objs.size()=1 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.NjTd4SonqFm27bk-e1q3yXnndOmx5tW_0 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14420693792011454115', time=2024-09-14T13:37:15.792186+0000, chain.objs.size()=1 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.HhJ3_vQVM4uStypHwfizLIvENuIrtx__0 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11726319656762275158', time=2024-09-14T13:37:15.792873+0000, chain.objs.size()=1 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.6xpXB6nALxZzsrj93TrN887a_yaC1ui_0 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12983584837347959123', time=2024-09-14T13:37:15.816787+0000, chain.objs.size()=1 2024-09-14T11:44:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.Xd7O4kBSVJC99RQFP5-tpqVtPehbqS-_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13422158725131385116', time=2024-09-14T13:37:15.843603+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_._XlbQzW8tEO84lJR6993vS4s4OlOZtu_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5958147561613958353', time=2024-09-14T13:37:18.531402+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.A1HMYrhWdd9PL6xH8e8Onv2geplXQpo_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5823303811268856382', time=2024-09-14T13:37:18.532172+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.We-wGNaUI1s16wciLSM4PcwdawAzeOl_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2081299357877838478', time=2024-09-14T13:37:18.532800+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.u3KJBdZ4md__N0IA9DmdwElqreWmpVf_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4333291131402468766', time=2024-09-14T13:37:57.849969+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.ZKRI4Hzfx_rkpNjSE3muppnF5GZ3J1I_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.974810413889059478', time=2024-09-14T13:37:57.883252+0000, chain.objs.size()=1 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.kgv5l7QLuktqVGjypb3QSV8arxc5HrH_0 2024-09-14T11:44:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12622156276215032305', time=2024-09-14T13:38:30.894510+0000, chain.objs.size()=1 2024-09-14T11:44:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.601+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.ATuTeoSYeE7Z1-fXezY2mL7swpEpytN_0 2024-09-14T11:44:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.499754221467731501', time=2024-09-14T13:38:33.619016+0000, chain.objs.size()=1 2024-09-14T11:44:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.I1OwsocnKUOJZa2RDFQomUg1ZoU-c31_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3362344867551259635', time=2024-09-14T13:39:09.624303+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.Q79TSEuOG01Ib1qti7IPGi4FfVccEJB_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6535748414660141139', time=2024-09-14T13:39:45.073046+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.HR5_39AaVjK7a0tVO2fStZoQ1vk0_78_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4325545750108164910', time=2024-09-14T13:40:23.619298+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.m2Kqh3u8REZgTEMpLhIedGpp2zdwtte_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12118016270406898592', time=2024-09-14T13:40:56.203372+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.xK4fJ1u6lPrfedRrbi0ZX2dLgOGfjk3_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14310921340651511122', time=2024-09-14T13:40:59.157647+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.OS7Xgf8wo4IsBKwecC3z_XtjTw1Dwlu_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9145742100957169388', time=2024-09-14T13:41:01.259828+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.MS08GU9qBea2JnHxSSbtX5LLX5YHRqI_0 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11673126250928242846', time=2024-09-14T13:41:01.296177+0000, chain.objs.size()=1 2024-09-14T11:44:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.bjCwcZu8yGEpLvmFJEEHu3UkCl1DmPv_0 2024-09-14T11:44:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9314945283022250706', time=2024-09-14T13:43:42.142014+0000, chain.objs.size()=1 2024-09-14T11:44:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.603+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.vwn1H7SJY5x4qqjrc5ax5RFpUFTmAiZ_0 2024-09-14T11:44:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.605+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.607+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:44:14.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.608+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13647679975582309030', time=2024-09-14T13:35:24.430487+0000, chain.objs.size()=1 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.DLU7K34pMzT9Zi1NLkVdfHwMZeP9GFi_0 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14150917670420073028', time=2024-09-14T13:35:24.434513+0000, chain.objs.size()=1 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.sqi5yWUEW3scFOGvKokGspKmxZp0LNg_0 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9687744725909490290', time=2024-09-14T13:37:21.851291+0000, chain.objs.size()=1 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.vk7_Z4M--krwhKpYNdz7c7mZNJQV4g0_0 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.825483342810429738', time=2024-09-14T13:37:57.816531+0000, chain.objs.size()=1 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.mruKXvXCtEDsyC_v4KY2cf_qwyRDwKs_0 2024-09-14T11:44:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1205326155536338419', time=2024-09-14T13:38:30.880687+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.VYR47VR_tR_ni8AL6Mg3zKBurFsU86q_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4566852421684869472', time=2024-09-14T13:39:06.870568+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.RWiIkFo4HXKZAhz2v-UfV7RZ6CcrKPV_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12403656211923114804', time=2024-09-14T13:39:09.633900+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.GQddd80idrTKP4FVCAjyyieD2RC3kgf_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13384285727117525385', time=2024-09-14T13:39:45.061860+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.4AQFg5iCpKQzLKPr5Foyy0rxK7zao3R_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16712735392416765203', time=2024-09-14T13:39:47.967244+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.POOvQ6cdebDU_Saq9m2zC17iUJAmgxa_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13139315074020194606', time=2024-09-14T13:39:48.014160+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.P-NZi_pXAz7Husf3PC5pJ5qF51WJ1s3_0 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.141946386901289768', time=2024-09-14T13:40:20.868476+0000, chain.objs.size()=1 2024-09-14T11:44:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.609+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.jT3Pia23vAcY5df1Q2iqv4RQThHwzPM_0 2024-09-14T11:44:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.611+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.613+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:44:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2345506808929211863', time=2024-09-14T13:35:24.426313+0000, chain.objs.size()=1 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.AVdlQzqgj3SOlS0QbWLraEISUe0-nry_0 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13202332529917145666', time=2024-09-14T13:35:24.695040+0000, chain.objs.size()=3 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.1 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.2 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-STANDARD.2~RHMtblHDPzN9SU4Ukw1oc7Asc5h33AX.3 2024-09-14T11:44:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9448354219594588045', time=2024-09-14T13:36:42.529469+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.b64pnqhdBuA-iOdEAixE-Y8U7j1TN1w_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14126402790949820415', time=2024-09-14T13:37:20.244093+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.RcIjflPocWaA7pEyTeV-b8spCMJ-lDe_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2881581761395745728', time=2024-09-14T13:37:54.703238+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.t00s-YX22C6luSYklG6QzW55_hSKbXd_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18040521569430172683', time=2024-09-14T13:38:30.893877+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.615+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.h2uLre3HfDQ6cnVfwz58jexK2HMRJ2X_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6097791443626899780', time=2024-09-14T13:38:30.894532+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.oltsU6cesD5yateGEIfB8SpD1vE5R9C_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.688950538261432918', time=2024-09-14T13:39:11.845746+0000, chain.objs.size()=1 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.IbzhDSWpdojiLorhfe3C74GH4OTjOfv_0 2024-09-14T11:44:14.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5416124101612242446', time=2024-09-14T13:39:47.088873+0000, chain.objs.size()=1 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.SrXD6stgFlKSXoLlYfdnBagBlcIixN5_0 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3613042805572073502', time=2024-09-14T13:39:47.990986+0000, chain.objs.size()=1 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.616+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.sQEgUNBouqrRI4OcNUM2AaefsmB5sip_0 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9294923863565147337', time=2024-09-14T13:40:20.902447+0000, chain.objs.size()=1 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.0nvNDuW99P7i60JRtP1ZY5Tm6mmDx2W_0 2024-09-14T11:44:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9607137299960984134', time=2024-09-14T13:40:23.596887+0000, chain.objs.size()=1 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.jEBggpr774Cgg2k8egIV_E3ZjGnFMPi_0 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10895973732970832724', time=2024-09-14T13:40:23.619259+0000, chain.objs.size()=1 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.jSEWAeVb2R8My4bMpEZNnMcz3GXZPkm_0 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8854038870154058737', time=2024-09-14T13:41:01.349048+0000, chain.objs.size()=1 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.618+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.Kvvfpm9c0WC2LFmTE1QfJFEd4_rdG3G_0 2024-09-14T11:44:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.619+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.621+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:44:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2885563259448366613', time=2024-09-14T13:36:40.543784+0000, chain.objs.size()=1 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.qnT1JFU2KoSTaRFEhQTEzbOV4G_xy_I_0 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4777539097638154320', time=2024-09-14T13:36:40.600628+0000, chain.objs.size()=1 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.5Teff2MOqswsh1QXDFces0Op3QI-uaE_0 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15006028930217100106', time=2024-09-14T13:36:42.569612+0000, chain.objs.size()=1 2024-09-14T11:44:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.gcBuLpwf42KXOcBlmnN0iMzcCBYJFUg_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17633024536516604849', time=2024-09-14T13:36:42.570480+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.FbnUb0-AjZoU21OJsxiR5exEOhRRrut_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13972112023831331668', time=2024-09-14T13:37:15.783329+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.623+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.nBWaGbEm4GF1TFc0T7MgIlOtQIHUJFF_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12847445648157026285', time=2024-09-14T13:37:18.537679+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.rgpax4vOROMW9GKvdiKThKXLFnpjpHC_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5662747958540905692', time=2024-09-14T13:37:52.673814+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.cE0pePML0XSoHhA0vQ3Gngf20ZR6nM9_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11835738859330186016', time=2024-09-14T13:37:52.708834+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.oRrDjG0JmEcU6adOGMqy5KndOgBMO4d_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3125541070629673463', time=2024-09-14T13:37:55.582858+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.9q2DHGQodMxuGQ1ktT0qz1saBSHoMmX_0 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8588837040492877814', time=2024-09-14T13:37:55.634473+0000, chain.objs.size()=1 2024-09-14T11:44:14.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.AIxF_AixoJ-qvrqzrQ65zm_d9iZRaO2_0 2024-09-14T11:44:14.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8165702169127160851', time=2024-09-14T13:39:11.855528+0000, chain.objs.size()=1 2024-09-14T11:44:14.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.oeiQi9795BwPy9kY9VoeKBfyOUoRoOn_0 2024-09-14T11:44:14.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3343758684924510139', time=2024-09-14T13:39:45.027225+0000, chain.objs.size()=1 2024-09-14T11:44:14.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.624+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.Jrokpf3Al30Qk-TLG3r8AXMn5RPyd_w_0 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.625+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1890410080576901399', time=2024-09-14T13:40:23.542142+0000, chain.objs.size()=1 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.625+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.0K31Zg3JMSuYLXkb8njWLznCuISy2WG_0 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.625+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10606107246420304703', time=2024-09-14T13:40:23.632405+0000, chain.objs.size()=1 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.625+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.yboxipAaanzPchJ5UZuA-k6mzMljT4i_0 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.626+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14868173160161465865', time=2024-09-14T13:40:56.201114+0000, chain.objs.size()=1 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.626+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.WVXi7XG7SPav24RA-F8pFqpiD_HjU13_0 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.626+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2700713447064281585', time=2024-09-14T13:43:54.493791+0000, chain.objs.size()=1 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.626+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:nsfsVpmfDyLG6XTzjN925wStxn8RpdN_.KzVgEHuwzcTiRIQ42ognWZqgAvtZVlj_0 2024-09-14T11:44:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.627+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.629+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:44:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.630+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_HNXvjI4rU8QgsXV9Ck0Ff-pWsY_nGvw', time=2024-09-14T13:35:24.578099+0000, chain.objs.size()=2 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.7UBj6myz72h_QpVp__HVG8IgW2hwLNJ_0 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.7UBj6myz72h_QpVp__HVG8IgW2hwLNJ_1 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_1PL6gciAn7X3McXXt9zQyEEQhcya-ED', time=2024-09-14T13:35:24.633361+0000, chain.objs.size()=3 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_0 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_1 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.ppkR8GdaJ8Q5OrLMbWbaooh9U0yUPb4_2 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14701863030576838330', time=2024-09-14T13:36:42.561103+0000, chain.objs.size()=1 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.nqWKQJfnX13nJ1rcnZkkE1nxGgPncNP_0 2024-09-14T11:44:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15274593986107948243', time=2024-09-14T13:37:18.497894+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.AptjSkBr-mc9ed2aY_-5tgi3lxgFR6x_0 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1282878512980214661', time=2024-09-14T13:37:20.287129+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.F9dtFEyB8BlLcXI0kkcHwpHv1eA0Qy1_0 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.205641763593777027', time=2024-09-14T13:37:55.637852+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.4Ui71NTbpL2ZDn4PoKNZ9DxU3_jpL2f_0 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9187755958737266228', time=2024-09-14T13:37:55.664553+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.Jms4_1b7g6dqZXcZBj-F4HGeSElBLWu_0 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.178331416211172211', time=2024-09-14T13:37:57.825666+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.tYJfY6UY6zQV2B3CFXIsx8zpzUPlQ-Y_0 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1290613515404829168', time=2024-09-14T13:38:33.618974+0000, chain.objs.size()=1 2024-09-14T11:44:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.631+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.zBeakg7lw-oJlVbwPJpWLFZDLhqNDNq_0 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14578612430430435078', time=2024-09-14T13:39:11.810621+0000, chain.objs.size()=1 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.kpbXdYL8F1CTIXuPnC1RnP3h01Tcj59_0 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3795778478922561437', time=2024-09-14T13:39:47.967472+0000, chain.objs.size()=1 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.uHDkmdmI7VsP9KzyJnWqi_RwRDegawc_0 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6174640374412342736', time=2024-09-14T13:40:56.266422+0000, chain.objs.size()=1 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.OVl5soGbZ9ELGaInRsxOpaF13mr2Tuc_0 2024-09-14T11:44:14.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14509135922388106209', time=2024-09-14T13:40:59.157659+0000, chain.objs.size()=1 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.aaTS8-rdnU7ZV7a0ltk3hmrRaI9GvYh_0 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8348346762688436150', time=2024-09-14T13:41:01.296268+0000, chain.objs.size()=1 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.ppLrvlycJkmJZ9zYIPPAxwytYmq2BRD_0 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4416084450817208104', time=2024-09-14T13:41:03.492247+0000, chain.objs.size()=1 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.634+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.fkhjp2BqeQLFNpCLYRRK-MxxTW6TxxA_0 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.635+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5739262733960844136', time=2024-09-14T13:41:34.524555+0000, chain.objs.size()=1 2024-09-14T11:44:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.635+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.sak1TQ_eXjfqh3feUaUWciuO-BlnFcv_0 2024-09-14T11:44:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.636+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.638+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:44:14.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.640+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.640+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17972684688721312415', time=2024-09-14T13:35:24.546729+0000, chain.objs.size()=4 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.1 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.2 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.3 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9__multipart_foo.2~H-PNtQhICTOg78NMaRWLzTeBtzQZZt_.4 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1004780058327775414', time=2024-09-14T13:35:24.780748+0000, chain.objs.size()=1 2024-09-14T11:44:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.3NPfFBrAcyk_izSmC8tqYhPKVC3qXYH_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12858718769248200326', time=2024-09-14T13:36:40.641778+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.Jj9RpjFJn13EsYR7PnCtnJ-mf2UoiYk_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12367990408432481562', time=2024-09-14T13:36:42.595566+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.SYE5jINAxGzLZFGgdEk79xouShHxzVx_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13350387217714791141', time=2024-09-14T13:37:15.780374+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.7hFsV_t0KNobFMyodjmjMZG3Hs7u-uU_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2952967015085828605', time=2024-09-14T13:37:15.817125+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.FIKm6sj0Ayw8v3o_7EWAk-B-sDWNLmO_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10025813674768443952', time=2024-09-14T13:37:20.247651+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.g28lReOf77UbGpxjb1Zu4u5xd2xZDJL_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15461937291333169167', time=2024-09-14T13:38:30.873742+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.4C1An4VtpRoNrCJS7kWMK1lUM0uxygJ_0 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7516697342629446387', time=2024-09-14T13:38:30.913567+0000, chain.objs.size()=1 2024-09-14T11:44:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.641+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.sAq_cppXn9pYSEtAtkeUhlUd2Z9H510_0 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.642+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17732736515193740612', time=2024-09-14T13:38:33.662063+0000, chain.objs.size()=1 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.642+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.ZqJSGxOVjIcqvtHvB0_veUpTh4fkq-7_0 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.642+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17212079385462928314', time=2024-09-14T13:39:45.027020+0000, chain.objs.size()=1 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.642+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.ejv1Hbb913P8egkUDU-dU_faiHKV0ol_0 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1192793688639447082', time=2024-09-14T13:39:47.995081+0000, chain.objs.size()=1 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.v6KMRakzP2xpBwjLhUc_pvZSFpijdin_0 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16831047845336181983', time=2024-09-14T13:40:58.040580+0000, chain.objs.size()=1 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.i6RaBJBYe0x9z26T4HMVYWx6POcQyDc_0 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15870219525574920074', time=2024-09-14T13:41:34.551476+0000, chain.objs.size()=1 2024-09-14T11:44:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.643+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.U7TLZEGd19UXQRYg5HlLLkRRzE0egBv_0 2024-09-14T11:44:14.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.644+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.646+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:44:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.648+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.648+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5515538864079182556', time=2024-09-14T13:37:20.318055+0000, chain.objs.size()=1 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.bVLSjYo78PtHZpeitOgPgRzNkLs1AlR_0 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11970764172248587325', time=2024-09-14T13:37:57.826689+0000, chain.objs.size()=1 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.kaDnMcixCoJfYSzH1-CaOh6ndYdkqqY_0 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4162876389711750309', time=2024-09-14T13:39:06.893364+0000, chain.objs.size()=1 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.12nxKP3YJa2FTFSEY9AOCw81mZJ3kvZ_0 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12189210738009219690', time=2024-09-14T13:39:06.946744+0000, chain.objs.size()=1 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.JVie5potW4OzVirq1fQdYS-3yqpmdUX_0 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9156227364262099995', time=2024-09-14T13:39:11.747206+0000, chain.objs.size()=1 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.PPzBP_rHYKOL9NmqaQ4EXsvuTbnBEqj_0 2024-09-14T11:44:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12621458849672881507', time=2024-09-14T13:39:11.844736+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.M-pjIYvpWJQ_7CwPdUCgJ_AQizCqlgt_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12426413362272469275', time=2024-09-14T13:39:11.845481+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.n1wQ1DHYRO9_2d9eIn_E4vGaM2kMKVm_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1254373051530441779', time=2024-09-14T13:39:45.071719+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.Fh1_Uqhk8Ce1pwt6H7qcqL17JZPpHjV_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13035576746743477053', time=2024-09-14T13:40:20.879495+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.ivIxsxG1VXudvkpgRSJIt5K3ms3AtGB_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17576057225056258609', time=2024-09-14T13:40:59.160677+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.zfOl5JQ-D1aJkMK-q-NF6tMuQHpNp2I_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14675459690748110747', time=2024-09-14T13:41:01.297115+0000, chain.objs.size()=1 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.649+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.OyrUa9jdA762p2HuhILECVCJU-1HAc7_0 2024-09-14T11:44:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.651+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.653+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:44:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.654+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_9B7sGTLuiWiOuCJCvR9YV8yOtHy9v92', time=2024-09-14T13:35:24.567152+0000, chain.objs.size()=1 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.ZyyeJSEKehfK4YolKGdQ1CI0Ei_wvq8_0 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16541480387486248753', time=2024-09-14T13:35:24.655441+0000, chain.objs.size()=5 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1_1 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2_1 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.3 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11514220080130881703', time=2024-09-14T13:35:24.663422+0000, chain.objs.size()=5 2024-09-14T11:44:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.1_1 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.655+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.2_1 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.656+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-LUKEWARM.2~jmqXQgu_2icQzp6CNTptLL5CFITIOaf.3 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.656+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3957053898922350161', time=2024-09-14T13:36:40.608830+0000, chain.objs.size()=1 2024-09-14T11:44:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.656+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.SzTZLeI5EVpokW3ftoAGdwU0obp9q9o_0 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12512912711266687764', time=2024-09-14T13:36:42.575833+0000, chain.objs.size()=1 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.Y6wG5p2veZRqd3koBJmwHX8pwzjxuiW_0 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16856437315840973794', time=2024-09-14T13:37:15.853710+0000, chain.objs.size()=1 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.AIl1BprFwrYsdLWkRJ6uR8oPrJDXcWw_0 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6386107013940172177', time=2024-09-14T13:37:18.513329+0000, chain.objs.size()=1 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.bcHnOf3ZIydCNRWhY6Hm4t-HQtwwJML_0 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7365857948044201886', time=2024-09-14T13:37:20.292075+0000, chain.objs.size()=1 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.1IKCooWuZVXyJBvQOU7qxIpJf3IQPHG_0 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16236671912760389899', time=2024-09-14T13:39:09.621250+0000, chain.objs.size()=1 2024-09-14T11:44:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.mWlYYyFicMLu2g4N8nGtbbM_pU1rKhY_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11123482759233681499', time=2024-09-14T13:39:09.682249+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.658+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.w6ITVBGklW82tUma9qODhfnkH2hH3YT_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11595520736405670301', time=2024-09-14T13:39:45.089287+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.HYxwDPbrVTmHOv5Y7xvnchaTbRQpg_R_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15978459443301485123', time=2024-09-14T13:40:20.909523+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.6sYiyll-iWI5v8ycMvFhfHnhk2O0Tgc_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6079134904590292292', time=2024-09-14T13:40:23.571478+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.FOuyEJO0wo6OU1qPS4j6-7EMd1QHlpy_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6299044805077188776', time=2024-09-14T13:40:56.244333+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.gZnZx6LfmtK3uyNX-0xZvoHbYzeC6gH_0 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280035401276142051', time=2024-09-14T13:41:01.353726+0000, chain.objs.size()=1 2024-09-14T11:44:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.659+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.fWD24qKTnBd3sqPUH5fs41G3Pf98t_N_0 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11944276326129550545', time=2024-09-14T13:41:34.553680+0000, chain.objs.size()=1 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.JfS_I4A4Axr4hkRKf9mG7NELoj9mSUv_0 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8908950645720686607', time=2024-09-14T13:41:34.573661+0000, chain.objs.size()=1 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.jCI7EAMvcjgazMkUqSwDKeXoChB_GhK_0 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9389384387584223452', time=2024-09-14T13:41:34.584197+0000, chain.objs.size()=1 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.FLFnUIC5VMqzJRfjc200Wfv6phARg2a_0 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14902656661572616833', time=2024-09-14T13:43:42.167949+0000, chain.objs.size()=1 2024-09-14T11:44:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.661+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.mw3VwaH9eAn-H274Co8DCtGduskd3Vk_0 2024-09-14T11:44:14.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.662+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.664+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:44:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.665+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1827293423044024457', time=2024-09-14T13:35:24.592587+0000, chain.objs.size()=2 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_0 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_1 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_a7xYstjH7-ahfAnW2P6kxDFPFGEilFp', time=2024-09-14T13:35:24.603881+0000, chain.objs.size()=1 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.FjFrMCaYPFdbT2Uzj8vAeKyNAbK3cKp_0 2024-09-14T11:44:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5145098834842279007', time=2024-09-14T13:35:24.808533+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.6G08GSXLPGUareECt96nlfXLVMmYLRF_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1769216697817088022', time=2024-09-14T13:36:42.569667+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.QhaqHHYHZgF_G1yWFWBDOvE8fX4suBS_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18152887456154850545', time=2024-09-14T13:37:15.845864+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.L6DTCwfdijWOnhZsMOiDqZnzA3L8kMm_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11358175342017304370', time=2024-09-14T13:37:18.498896+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.VSVkhGW6vQWkx1IBYHVTUKxJzFuRfoj_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1676714625491267859', time=2024-09-14T13:37:18.511326+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.pCFKY2vli0XimczPBlYMWDt1VGs64yn_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15274529835974416227', time=2024-09-14T13:37:18.537642+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.utvAJmFIms48JMQbY-yl0LbGaSW5uvL_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15431455319858831056', time=2024-09-14T13:37:52.753298+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.lXoyONSxIWe5_x9qauq8sM06GWqjv1V_0 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6340215109646793627', time=2024-09-14T13:37:55.578936+0000, chain.objs.size()=1 2024-09-14T11:44:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.CJLWv9gE1A3AK1yD39T0ulnnt1h6PHb_0 2024-09-14T11:44:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2801534588250471348', time=2024-09-14T13:38:33.602823+0000, chain.objs.size()=1 2024-09-14T11:44:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.666+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.cCyWVbK0ZAI1wNw12qbCh7nM0WM_ccf_0 2024-09-14T11:44:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18211157568092580536', time=2024-09-14T13:39:06.905117+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.BO2T3EZiQuB6CCHYg_zx9E0p11nnpRP_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16323874402795481425', time=2024-09-14T13:39:09.627578+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.DidRRx5ct8Qd02kxHcrHgLPU5jhQ1bB_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2520108167178319500', time=2024-09-14T13:39:45.071916+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.nbSqU_YfMYYGN9JT2zn172UBPmUrHpm_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17516626483613634826', time=2024-09-14T13:39:45.072588+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.6uuQICxgQ1BZGCTkQUCZUOVEi-2fIM7_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2187095903276340198', time=2024-09-14T13:40:20.898037+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.L0EMa04hSmAZNJELIFj1IDPrHMpXh3G_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.668+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2726016920913416205', time=2024-09-14T13:40:59.123070+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.669+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.rfHGIl4vwkMdeAZ0YqWKRgJZRh9aI55_0 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.669+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.513470560266936255', time=2024-09-14T13:43:42.145775+0000, chain.objs.size()=1 2024-09-14T11:44:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.669+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.lXo1a3FuoRzf6xfRg3cWNHmEnAB6JSw_0 2024-09-14T11:44:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.670+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.672+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:44:14.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.673+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625968665515299749', time=2024-09-14T13:35:24.521936+0000, chain.objs.size()=4 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.1 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.2 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.3 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10__multipart_foo.2~AMv__azhjJJvsNYUzaZgeArlvL8b0HQ.4 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14733421709385850640', time=2024-09-14T13:36:40.560375+0000, chain.objs.size()=1 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.60n3THz26gdaOLeOaGGSnpja5gyC1KP_0 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11528376774635509984', time=2024-09-14T13:36:40.619185+0000, chain.objs.size()=1 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.hECntfny8BpDYroGMjgjo5UYpZT-FIV_0 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4085308117142016884', time=2024-09-14T13:37:18.496342+0000, chain.objs.size()=1 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.3aQUtgqtZRSE-N0TZa5PBJFBb0vyaK6_0 2024-09-14T11:44:14.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12859060533207826623', time=2024-09-14T13:37:18.496974+0000, chain.objs.size()=1 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.6r-hdfgnjXkkq2I00o07kAXPLQt6cn1_0 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4900416335503265833', time=2024-09-14T13:37:52.705054+0000, chain.objs.size()=1 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.Eb1QRblz3yQoH-DvEjMjzo4zVKKcr1S_0 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1705710125069444423', time=2024-09-14T13:37:55.635655+0000, chain.objs.size()=1 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.XL_Oz864oeBY4eP3z8kEUQ0rjw04p0o_0 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2289129978488457021', time=2024-09-14T13:38:30.928284+0000, chain.objs.size()=1 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.WbF_0c9iP7xh9vLIuVqGpsvi_kkynTC_0 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10797959585331943221', time=2024-09-14T13:39:06.866689+0000, chain.objs.size()=1 2024-09-14T11:44:14.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.674+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.lqQiriShZUPDP1mvSyRtMr5EhR0dEZr_0 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10497573071739134623', time=2024-09-14T13:39:06.959919+0000, chain.objs.size()=1 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.d1jlEjn5OBr7EO1a8eh5aPspBrWX3wh_0 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1158537933946337670', time=2024-09-14T13:39:09.687229+0000, chain.objs.size()=1 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.BVPhg9JUji_HRzOzv7BNmFmcWYbsDA__0 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7042222650380798556', time=2024-09-14T13:39:45.074632+0000, chain.objs.size()=1 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.tIMV9vd9o4PCuvK1wyM8tZAym9QtMFA_0 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5201533750875286593', time=2024-09-14T13:40:20.944037+0000, chain.objs.size()=1 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.qGhIa0PwDFG7PfwnjHMvOt7sUZJrK4S_0 2024-09-14T11:44:14.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7532612889397692923', time=2024-09-14T13:40:59.137579+0000, chain.objs.size()=1 2024-09-14T11:44:14.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.7mtz6--kk_q9R-xvrhR_bImhopVSFgF_0 2024-09-14T11:44:14.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4802122228967804179', time=2024-09-14T13:43:42.149443+0000, chain.objs.size()=1 2024-09-14T11:44:14.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.676+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.086UYInsEuiwqo8U5F3gUMHqbclRVWm_0 2024-09-14T11:44:14.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.678+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.680+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:44:14.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.681+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.681+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10418199150723411620', time=2024-09-14T13:35:24.418093+0000, chain.objs.size()=1 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.cWKLKsGm8JyQWHdLNn9UsGSgSkHXbtB_0 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5043628950949224762', time=2024-09-14T13:35:24.468902+0000, chain.objs.size()=4 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.1 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.2 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.3 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11__multipart_foo.2~jy6dXjfSRcT5TlMtzQx4g5slhBlhtTa.4 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11802149778972757248', time=2024-09-14T13:36:40.622045+0000, chain.objs.size()=1 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.yLoJx76dSMQMtYQVZ5x5I6t2M11FEAU_0 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2655869772102086807', time=2024-09-14T13:37:17.596963+0000, chain.objs.size()=1 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.8WzxFDcrndUO4Q6r1rPQxBs8PQze9I4_0 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11279574785307250698', time=2024-09-14T13:37:55.603630+0000, chain.objs.size()=1 2024-09-14T11:44:14.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.LcIdeMlvgEcCjUFo1glABozEhKFudkH_0 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17090623217367665427', time=2024-09-14T13:38:33.589905+0000, chain.objs.size()=1 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.bMl7hCVy2zOeYHFztmw2WOp-1vGcchy_0 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5568512634304367487', time=2024-09-14T13:38:35.619561+0000, chain.objs.size()=1 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.r8NMydx41EZl-37enr8UzQIxFldN3xE_0 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11648535349941970839', time=2024-09-14T13:39:11.810415+0000, chain.objs.size()=1 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.HYEuB5P33cAh3b7EZyNS2H1XznUrFrA_0 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5578510230321394524', time=2024-09-14T13:39:45.088140+0000, chain.objs.size()=1 2024-09-14T11:44:14.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.682+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.XOcITnCMpU496AEpR1GhJU7tYIZOGDH_0 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1595618735532206876', time=2024-09-14T13:40:23.619439+0000, chain.objs.size()=1 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.Q12JzICEGWhyIm6gQaNqExTawQcUBRM_0 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7841093394475859032', time=2024-09-14T13:40:56.214252+0000, chain.objs.size()=1 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.jUmpjnagMFpiifTdDF_yQt5kbO0CFCz_0 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8093466784432698446', time=2024-09-14T13:40:59.156955+0000, chain.objs.size()=1 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.ob5MfJq05uN6EY7hctuVW8GkgFZqwXK_0 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1921166702326675039', time=2024-09-14T13:40:59.191860+0000, chain.objs.size()=1 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.GeYNZjTutV_rNdC2_Vs8Qzo8Lb-ojQA_0 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11379230666977553195', time=2024-09-14T13:41:01.310916+0000, chain.objs.size()=1 2024-09-14T11:44:14.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.IZvrRkDMDOBRtPQLdYHtemjmQnGzzHi_0 2024-09-14T11:44:14.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11477718458726388178', time=2024-09-14T13:41:01.314484+0000, chain.objs.size()=1 2024-09-14T11:44:14.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.r_6PZI0BcQ46mhPxoMQO-Hv4jKp_EyJ_0 2024-09-14T11:44:14.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11764390714447930979', time=2024-09-14T13:41:34.582893+0000, chain.objs.size()=1 2024-09-14T11:44:14.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.684+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.33ikj9rfUdzQcLs4Q-i4lEXucT_wBNP_0 2024-09-14T11:44:14.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.686+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.688+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:44:14.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.689+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.689+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6078791145602745158', time=2024-09-14T13:35:24.727682+0000, chain.objs.size()=3 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_0 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_1 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.c5Nxk2TzLU35MYnq3ezLfSFls1L5upl_2 2024-09-14T11:44:14.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8511441040409500855', time=2024-09-14T13:37:18.511318+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.vL3HygZNWM_VV5w5PfI-tfrL3ZLaut2_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8521214229071690751', time=2024-09-14T13:37:18.537603+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.GNETA_qtKI-WgMqYKjyarGA5C2SYp2H_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12237286607313441434', time=2024-09-14T13:37:20.298407+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.7cJGZGMC0fnXokpbaVfHrTIcr7ei4xI_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5696392697815092120', time=2024-09-14T13:37:52.759161+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.AEmtCU32vtmDRVpAwKo56J1A8uG7nLp_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14041638109069118495', time=2024-09-14T13:37:57.831781+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.WMDL-EYQQLULUdn1_XLRLtdNUqmX1R3_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11765879387532056851', time=2024-09-14T13:38:33.624170+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.o2Qnye8lP1YwaX6n59z6AhXVyDGHe5E_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7547190779608686259', time=2024-09-14T13:39:44.128511+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.vtuk5kqVRdM8PGWe1DnBWEYPAMA8lAw_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1323835609409827960', time=2024-09-14T13:40:20.949404+0000, chain.objs.size()=1 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.HU8bEYZoXtbx569Vv9Z_RqYmU19rII5_0 2024-09-14T11:44:14.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17415035306747477882', time=2024-09-14T13:41:01.308891+0000, chain.objs.size()=1 2024-09-14T11:44:14.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.690+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.fyS8HfOXYtnSpACUhD2SgeN4E9wz5oZ_0 2024-09-14T11:44:14.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.693+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3374474151975602487', time=2024-09-14T13:43:42.145788+0000, chain.objs.size()=1 2024-09-14T11:44:14.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.693+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.PNHYzciUiaYapR-WU_EJBUnaCrfT5ko_0 2024-09-14T11:44:14.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.694+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.696+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:44:14.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.697+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.697+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:44:14.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_77GuXfpn5rVJchr_e-TERGyHAIuO_xf', time=2024-09-14T13:35:24.643790+0000, chain.objs.size()=3 2024-09-14T11:44:14.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wHZB95JVYPWzGzz0zz2nb_1jcmx-CO0_2 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8187056202810453776', time=2024-09-14T13:36:40.573007+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.H3RoMTv0prnUru9-U1j2AlfVsp31JQN_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17514220338205924252', time=2024-09-14T13:36:40.626671+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.bnh6HWBW8b3sAWi8fq8YEi2hcmPnFtP_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1413471024183278970', time=2024-09-14T13:36:42.561103+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.aJ_v1NU30vrrhkr7F3SFGtEdjpZkJsv_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5425919892716700167', time=2024-09-14T13:37:18.485739+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.EtEb-BciHOisUeMwUGipljBhSEcJgt8_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16199194490772490933', time=2024-09-14T13:37:18.568507+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.9CbxjKp6k6tighZpnS7Un6URRYPbSwF_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10201730175180055537', time=2024-09-14T13:38:30.937943+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.RNZIfH8Oz9AjZoTrmcsVygqU_GBIXs4_0 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4001126616926866615', time=2024-09-14T13:40:23.646948+0000, chain.objs.size()=1 2024-09-14T11:44:14.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.6wkcXfQfRxHUOagJTK61jcRblAGvNay_0 2024-09-14T11:44:14.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10209133927807278441', time=2024-09-14T13:40:59.118842+0000, chain.objs.size()=1 2024-09-14T11:44:14.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.698+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.1KUM6t96gOCzAhUAh0fdZir_NDOCxfj_0 2024-09-14T11:44:14.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.700+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.702+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:44:14.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16879144405807251576', time=2024-09-14T13:36:40.587504+0000, chain.objs.size()=1 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.TSRL-AzKCWUh_-BCVxZLUl1WXEDG43I_0 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15422504806407745889', time=2024-09-14T13:36:40.588054+0000, chain.objs.size()=1 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.f2gaIf7FvonkB4vM2-brThHX_qwDOcU_0 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11749215610803426090', time=2024-09-14T13:36:42.541735+0000, chain.objs.size()=1 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.pHM-_fEGba5s2atyILhXrqqob5YRM87_0 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5078147280522722484', time=2024-09-14T13:36:42.603094+0000, chain.objs.size()=1 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.3w9WJ-R35hG_GGKc_GDoLLBsUlNKVaK_0 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14557384220946200682', time=2024-09-14T13:37:15.783234+0000, chain.objs.size()=1 2024-09-14T11:44:14.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.QlGAtWTyMGpNs8EyNfXUsqZgHG-ysyK_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13850762811996147252', time=2024-09-14T13:37:20.332360+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.TtH-i1w46-xIh3lktHBZ0xVIB-36gbO_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.485514693575630104', time=2024-09-14T13:37:52.729040+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.GpcWhmKEjCl6HLHkRecTNpET1wZoKEh_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12249736633815442554', time=2024-09-14T13:37:52.752427+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.ZM5FhUp4679ufwEF2VTOj-70p__CQKU_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4292529517644091151', time=2024-09-14T13:37:57.811024+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.JJCE0znPMYwVy2wM4VTfNm9CnQeQnnZ_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6096561935192459660', time=2024-09-14T13:37:57.859028+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.Cxcku1IDssaUZnQiGdhJQIkdeT8SyK7_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9304095344075377551', time=2024-09-14T13:38:30.880278+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.eyR7XHP9KCqP6T3UWomabpSVSux04oZ_0 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2386782568656061732', time=2024-09-14T13:39:11.757930+0000, chain.objs.size()=1 2024-09-14T11:44:14.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.704+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.4AUn6mTU_95iMMeOilgnwT8VfgKwOBx_0 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3442750348999650224', time=2024-09-14T13:39:45.070917+0000, chain.objs.size()=1 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.0xEDWyDfch4YptmJkCTC163JKVirfak_0 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6790184092252123155', time=2024-09-14T13:39:45.107983+0000, chain.objs.size()=1 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.bDj1iiUVptolW58l0wMJ2CKAzHSRBX9_0 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11108546217119516280', time=2024-09-14T13:39:48.018344+0000, chain.objs.size()=1 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.JjC2hRL4jKkdzFoV_hiLz-odwJzc1i3_0 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3527931182108169908', time=2024-09-14T13:39:48.019030+0000, chain.objs.size()=1 2024-09-14T11:44:14.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.HmzCODcTpOCMFfXKIx_mO00xaf3O4Y-_0 2024-09-14T11:44:14.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11669590990584803061', time=2024-09-14T13:40:20.866232+0000, chain.objs.size()=1 2024-09-14T11:44:14.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.9a0gOMsPa2u_O9fl0AmI7cHuTj_lJs7_0 2024-09-14T11:44:14.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1238290768532006611', time=2024-09-14T13:43:42.146866+0000, chain.objs.size()=1 2024-09-14T11:44:14.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.707+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.vLyfLgYjo6YiRbBWOMUgcPaHLyPbPe7_0 2024-09-14T11:44:14.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.709+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.711+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:44:14.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.712+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.712+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18169783031934877673', time=2024-09-14T13:36:39.865893+0000, chain.objs.size()=1 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.vO2MfFzZJGkHRw2-ij2hRU_EmeBYryD_0 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13637081285598435063', time=2024-09-14T13:36:40.561192+0000, chain.objs.size()=1 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.LBX8Y0uwrFzBl4LPzkAFkVJJ12ATJXa_0 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4946109207307143084', time=2024-09-14T13:36:42.542624+0000, chain.objs.size()=1 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.RZAuY0ZEu7UHp-drAHWxFiTxQBjp-fb_0 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1422154244695463780', time=2024-09-14T13:37:18.516616+0000, chain.objs.size()=1 2024-09-14T11:44:14.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_._5xVkRvU1fB17FK_wIeMf8oEN7agCqg_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12022597460818128510', time=2024-09-14T13:37:20.283191+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.KTMl0POBU5r-FBjLxQiTxH-hXqLwDuj_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2152059426941009477', time=2024-09-14T13:37:55.604461+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.vxfL66ZmGap17Cz8LxNgoV1A9Hfqvvb_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14388010042010048787', time=2024-09-14T13:38:33.656734+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.2WJYoUWBLl3Kf_YXQFv6ppXPRM1-T-e_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15164065296758431788', time=2024-09-14T13:38:33.657237+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.Eu6uSgPXgDzP_JZe2VzSdPybe_lAo67_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12754731639011482746', time=2024-09-14T13:39:06.880716+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.Uy_nsCXu4VERrIbfsB8Yl565mlsuiny_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10464318232647228487', time=2024-09-14T13:39:06.898017+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.KEEndvFBdkRkpb3QdpyuayMbjeM51Px_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9451080413437327374', time=2024-09-14T13:39:06.915005+0000, chain.objs.size()=1 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.p6DoAYWRyJbT9HEqFkVVY8JZbSOr6q8_0 2024-09-14T11:44:14.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.810020008097607742', time=2024-09-14T13:39:09.606138+0000, chain.objs.size()=1 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.713+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.IZuTBO5WCufFnJrM80vCMlYAbkirh5u_0 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.714+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13720760186955032053', time=2024-09-14T13:39:09.624903+0000, chain.objs.size()=1 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.714+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.Fgy4id9EdzyM0-JwipU3z0XXsOu1xEc_0 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.715+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7693011910167544217', time=2024-09-14T13:40:23.617762+0000, chain.objs.size()=1 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.715+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.JMZw5N_r6cL2PKgh_q_6ogEnhcV5h2E_0 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.715+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13781364077830207424', time=2024-09-14T13:43:54.487986+0000, chain.objs.size()=1 2024-09-14T11:44:14.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.715+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:krc3JnGuPKmQbsMAytjc3Ir3Mco9WBy_.WdK_yZTkokk5K5_gGWM5NMGGL0o4AV6_0 2024-09-14T11:44:14.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.716+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.718+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:44:14.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.719+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_eK_ZW85mt9-e6Et0OTTp36NGK5D7Pe2', time=2024-09-14T13:35:24.570615+0000, chain.objs.size()=2 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.dJ2I4ew0kWOdqe6zu1hAlZv0Y0K_BZ6_0 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.dJ2I4ew0kWOdqe6zu1hAlZv0Y0K_BZ6_1 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_Cl_ZScq-SE4DzkaVaRWMPTcNIDc7EJT', time=2024-09-14T13:35:24.581784+0000, chain.objs.size()=2 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.4KM0RRA-_MbZdY4UJFTk4s-SEKwD9dC_0 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.4KM0RRA-_MbZdY4UJFTk4s-SEKwD9dC_1 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6088725132656354335', time=2024-09-14T13:35:24.600166+0000, chain.objs.size()=2 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_0 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.8wTzK4UAgTXisysR02utVxZNl4Q4I-k_1 2024-09-14T11:44:14.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17732506580172737449', time=2024-09-14T13:36:40.571866+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.imkqLhMcIQTeHucHApFzE-peamI4sl0_0 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4405195292069545004', time=2024-09-14T13:37:15.775756+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.3WJ6ypQLru4LlkB6jrtV55Zs8o_1OQp_0 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9283340643408543290', time=2024-09-14T13:37:15.782698+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.saE2JjIl17MfdepMRdo1Ghyqu4n6P4C_0 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1560874793856084268', time=2024-09-14T13:37:20.251677+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.dtsWy0QG29sehed9QCHAqlT3nNLLK-X_0 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16526332718160030939', time=2024-09-14T13:37:57.831789+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.wed8iHDQFdxhqBQJDwxgSzFoSZ2tek__0 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4016667147838489408', time=2024-09-14T13:38:33.602823+0000, chain.objs.size()=1 2024-09-14T11:44:14.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.720+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.K600VMTGhALeMgZ0bhy_tmeJde7fz9M_0 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6997317866145713210', time=2024-09-14T13:38:33.657773+0000, chain.objs.size()=1 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.GOFzet7XIdJVSVHEPOBA2IiIjVlZXrl_0 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10264778872913596841', time=2024-09-14T13:39:09.627582+0000, chain.objs.size()=1 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.TH2XovkoXHhLRTFydzAL5Zy-DocYecT_0 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14338304224156916919', time=2024-09-14T13:39:09.628328+0000, chain.objs.size()=1 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.HXc-01aLQfsrJOYwpD-B0KWa9TMBe3u_0 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7731825369497354821', time=2024-09-14T13:39:11.779811+0000, chain.objs.size()=1 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.-uUx-KeNZzWuxSoQbf_jar0RRYWj6di_0 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13749802282998037811', time=2024-09-14T13:39:47.979099+0000, chain.objs.size()=1 2024-09-14T11:44:14.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.5TyBQxxdy7cR_vzqeJ_f8sZVHbiAWWd_0 2024-09-14T11:44:14.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9213516961852947016', time=2024-09-14T13:39:48.034333+0000, chain.objs.size()=1 2024-09-14T11:44:14.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.HRe_HCUD916uNZIAHQ6YMHVURpQXvgh_0 2024-09-14T11:44:14.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18999338091452131', time=2024-09-14T13:40:56.242661+0000, chain.objs.size()=1 2024-09-14T11:44:14.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.rk9iyISRG34ELkBtZzC3JVjJgruL-sJ_0 2024-09-14T11:44:14.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10594634706289547823', time=2024-09-14T13:40:56.264490+0000, chain.objs.size()=1 2024-09-14T11:44:14.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.1xES5hfliHewj7dwgJX5xfNggiw3Lvq_0 2024-09-14T11:44:14.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14320758973654795095', time=2024-09-14T13:41:34.589695+0000, chain.objs.size()=1 2024-09-14T11:44:14.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.YGK4WVyevjJuusveuXnL6GJpxTrK4dz_0 2024-09-14T11:44:14.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18349697536087591901', time=2024-09-14T13:41:34.612734+0000, chain.objs.size()=1 2024-09-14T11:44:14.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.724+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.wI1h0eWsZ_6AeA-FfKhwCEOcAm58Xd6_0 2024-09-14T11:44:14.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.731+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.734+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:44:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.736+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.736+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:44:14.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_ChZcAu8xrWQc-aQYOZ2H1jYU0ZqmYo5', time=2024-09-14T13:35:24.629151+0000, chain.objs.size()=3 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_0 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.wjQtySMCGvQMqEH_Oi9ygB_tGATDgAp_2 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7377678731143434958', time=2024-09-14T13:35:24.647844+0000, chain.objs.size()=5 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1_1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2_1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.3 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1508267662088255927', time=2024-09-14T13:35:24.776991+0000, chain.objs.size()=1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.JCvpKMUrfpt4mhGHnOneSPjMKHTQw-2_0 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8125609123799863426', time=2024-09-14T13:35:24.819645+0000, chain.objs.size()=1 2024-09-14T11:44:14.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.SzKUo6hgKjous9YZNPXBrsFG5Y_lear_0 2024-09-14T11:44:14.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6225707226512659162', time=2024-09-14T13:36:44.316902+0000, chain.objs.size()=1 2024-09-14T11:44:14.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.tr7k44g-Y0_TF8PmZcTcod98UtLIwC0_0 2024-09-14T11:44:14.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11233088197335894229', time=2024-09-14T13:37:20.336318+0000, chain.objs.size()=1 2024-09-14T11:44:14.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.737+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.QcJ1B0sVC25oA6wGG-4t7QaSpD7-HnD_0 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5015044626840316361', time=2024-09-14T13:37:52.753653+0000, chain.objs.size()=1 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.-C2Mc4ZoEoZ1rvjAMBkx4NTIbfPJ9Yz_0 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2214778760382540106', time=2024-09-14T13:37:57.829784+0000, chain.objs.size()=1 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.p9s0snJL2PLlLrcAFBkW7m9sYtaaW8W_0 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10748421914616780800', time=2024-09-14T13:38:30.948333+0000, chain.objs.size()=1 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.IpuPSioPRhnMXYaSxd76X3GFkx3hjsh_0 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2404257104115766719', time=2024-09-14T13:38:33.660889+0000, chain.objs.size()=1 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.-JGP2kuy31hrEzldE28y1q6WYmNEMK9_0 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4295696155239772580', time=2024-09-14T13:38:33.663473+0000, chain.objs.size()=1 2024-09-14T11:44:14.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.IryQv6K-EIJpO8XXCyLINgdbtAcQpHh_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15714383932530460411', time=2024-09-14T13:39:47.966698+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.2mNVkjkTMA0r5iNHloamaBdcarQK1u2_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7678397828131416472', time=2024-09-14T13:39:48.006324+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.aOweBeO2ih-V8HaCjJEHtjxu2lX3kt7_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.739+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16035821151810043431', time=2024-09-14T13:40:20.899079+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.e_erVE194IJokjjg-ZrCPoY2U6JfaG3_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6573836300159329862', time=2024-09-14T13:40:23.580177+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.HMIAQqYAS-BLVc66Vu6qkf_Kb58fg1S_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10902415390362558039', time=2024-09-14T13:40:23.636667+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.tgiTvFSDMHCfoWPmPUK5uwJXqX85tPv_0 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.830508676408290751', time=2024-09-14T13:40:56.208005+0000, chain.objs.size()=1 2024-09-14T11:44:14.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.740+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.OH7vm91RP-1r75Nb0zlekBCosw1eB6p_0 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.741+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3108730035499979586', time=2024-09-14T13:40:56.228001+0000, chain.objs.size()=1 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.741+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.HP-NpRaXs-8UVCSlMZwWBGAJ3fMRMJL_0 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.741+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5872560612547254580', time=2024-09-14T13:43:42.150577+0000, chain.objs.size()=1 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.741+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.-Si6Lj8K_5OLF46Cp99QWlxw7wVQiUJ_0 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.743+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2914430969864570153', time=2024-09-14T13:43:54.494559+0000, chain.objs.size()=1 2024-09-14T11:44:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.743+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18__shadow:A9FW3lTML5XqEzz-ZbxHBpvLYGy1e4Y_.L4I3OBEGHsf6J4f8MIV759mqFV--3xl_0 2024-09-14T11:44:14.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.744+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.746+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:44:14.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.747+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:44:14.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12284550966261413596', time=2024-09-14T13:35:24.574326+0000, chain.objs.size()=2 2024-09-14T11:44:14.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_0 2024-09-14T11:44:14.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10991639449276702834', time=2024-09-14T13:35:24.608040+0000, chain.objs.size()=2 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_0 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.aJZ_lvcDEybNtFIitVzWa8Z4SzM_3KT_1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18109497673359411239', time=2024-09-14T13:35:24.691393+0000, chain.objs.size()=5 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.1_1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.2 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.2_1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-FROZEN.2~LOqaOq_0mhaX5hQoHIkpPw_ntmEmzvk.3 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12233156021189354671', time=2024-09-14T13:35:24.723699+0000, chain.objs.size()=1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13__shadow_.FwO5cIcgM67q8LWCLohEZYqcMSaR5kt_0 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5975564655731529690', time=2024-09-14T13:35:24.784206+0000, chain.objs.size()=1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.yU33_YOsUQyfGnuTGVJ8uO4JO8fx0j7_0 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7068912226249922409', time=2024-09-14T13:35:24.815898+0000, chain.objs.size()=1 2024-09-14T11:44:14.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.748+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8__shadow_.bxmUQKU3cpAm-synEPM5xTywMSMahlz_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11133362008648244159', time=2024-09-14T13:37:15.783202+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.XJeq48AhPJQBe8MKefa71HEzn56jFeb_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5404965646307773146', time=2024-09-14T13:37:15.798319+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.R2kbLv3tiTI1Tc-4hVBxmb1eVVe8r9n_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17184423500962418086', time=2024-09-14T13:37:52.752448+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.916ByT9Y91sHmsJ3diLPncx4QOOIvT__0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9651375152160351282', time=2024-09-14T13:39:11.771097+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.jBQJgB__r8e7uh6j2PwlTcrPGxyYlcJ_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10709307599063506708', time=2024-09-14T13:39:11.812666+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.L3kP53JGc0MIvvoCP9Co2Wc0U1ip-rA_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18049436180968701402', time=2024-09-14T13:39:45.070877+0000, chain.objs.size()=1 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.9E1Dm8ubTkLTE6yB36CQ6-FzuT2UGmr_0 2024-09-14T11:44:14.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5581453472034935369', time=2024-09-14T13:39:48.043369+0000, chain.objs.size()=1 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.blWhzfdaZq7nmz1gmP9-aC91h8kX1Qi_0 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7390980546520165322', time=2024-09-14T13:39:49.806694+0000, chain.objs.size()=1 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.HYU7VBNtBsQ0Ne4gJuDo5In40scJR20_0 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3760136083186865895', time=2024-09-14T13:40:25.159991+0000, chain.objs.size()=1 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.f1gCrlQjhPL4B6ajLnzQAhYK-g7enIe_0 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14247889921706614656', time=2024-09-14T13:40:59.121754+0000, chain.objs.size()=1 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.-9ijOshKITP7gZsWkh9yyaGScl3B2JC_0 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18387836242185017675', time=2024-09-14T13:43:42.147259+0000, chain.objs.size()=1 2024-09-14T11:44:14.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.751+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.YaHmlG5QHpGqXV_LNBybJgwUkTuEFfu_0 2024-09-14T11:44:14.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.754+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.757+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:44:14.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.758+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18367135338552031517', time=2024-09-14T13:35:24.585567+0000, chain.objs.size()=1 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15__shadow_.rQfw0BgcEZ13Grbrg_ugnmjmefMEi-U_0 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1481429337452754576', time=2024-09-14T13:37:15.815515+0000, chain.objs.size()=1 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.T4ZkbV2YVSPKF7EvBE3zU_4OUrOe0-y_0 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1094139029662895834', time=2024-09-14T13:37:18.576819+0000, chain.objs.size()=1 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.HOyNOJZBjgv5YDeeEceB_zpguOsS3wa_0 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6529174733235566290', time=2024-09-14T13:37:55.604477+0000, chain.objs.size()=1 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.5ZGCK7bL7Ks0RmhOAOvwPj_d-uwo_fA_0 2024-09-14T11:44:14.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13614000421030778566', time=2024-09-14T13:37:55.626156+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.nc0Zcoe-4WstBvm4VCufmTqM3Y5f9r3_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17981329771772952398', time=2024-09-14T13:38:33.630131+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.t3tZcyeT7RinoO180AeRUvVeFiiGgeU_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14309092784818172587', time=2024-09-14T13:39:06.874496+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.pKEgO1TgHHwPL2arUvkDwY-XPAwsmhV_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4879213563161880416', time=2024-09-14T13:39:06.912827+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.OcM7MBZ5iYIy0_SAcyNR7ZUf3hrRrIs_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16216665573051467496', time=2024-09-14T13:39:06.914195+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.XRuzgQhkD0W8fskcwXwraClaSuEO-NO_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5730742074937950520', time=2024-09-14T13:39:47.967829+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.zqFE295AQL6GEExr5JQvqmLZTJQ90eT_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4349397401980963944', time=2024-09-14T13:40:20.890974+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.-paUh4xioACRUZC9y1GJLwG6NT6Zxbc_0 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7587749993596852271', time=2024-09-14T13:40:56.197569+0000, chain.objs.size()=1 2024-09-14T11:44:14.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.759+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.i7962J4EglplaPDaQxB5Tiq-iZ1Qws8_0 2024-09-14T11:44:14.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.761+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6125959524165470938', time=2024-09-14T13:40:59.120985+0000, chain.objs.size()=1 2024-09-14T11:44:14.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.761+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.tvuox1OtYNF3crzRCsWujuYhEYtOOeS_0 2024-09-14T11:44:14.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.762+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.764+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:44:14.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.766+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.766+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1187540105808404899', time=2024-09-14T13:36:40.638895+0000, chain.objs.size()=1 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.19__shadow_.CgsARCfahBIuphF-9gX1uMy0O6ltmn2_0 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13710387265841299235', time=2024-09-14T13:37:18.544232+0000, chain.objs.size()=1 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.wduTr4QCrqyvLKpExrD0mZmZXajbx4K_0 2024-09-14T11:44:14.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13953399424295398615', time=2024-09-14T13:37:55.577755+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25__shadow_.wIVIQOZt8p69FmF-YaSWmNwwFPOXPSv_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3769600463431398038', time=2024-09-14T13:37:57.816445+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.Pv508I57KhJ_vpMlkvIjJe_ucktGoSm_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4922219173158747581', time=2024-09-14T13:37:57.817126+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.bcWVqGxQ3a8Aa3jQai6Wdgmk2EcvF0f_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10259140793011430920', time=2024-09-14T13:37:57.900107+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.xLM07GfJ2pEzhlJmLQpY0Z-aNWM2QQ-_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13970782121898214251', time=2024-09-14T13:38:33.611230+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.aXkE1n6nKkoUycpp8gd5tJlLjyn2-wU_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16947925744330405750', time=2024-09-14T13:39:09.623928+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.bi0F1pBtQVfxz_lQ81lbBaz2zxw5C6V_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17231138275889425782', time=2024-09-14T13:39:11.757052+0000, chain.objs.size()=1 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.m5KVNIXrbVlNaMFGEB3hgFVpuCHgsry_0 2024-09-14T11:44:14.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7047448382278448976', time=2024-09-14T13:39:11.770428+0000, chain.objs.size()=1 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.sLnprBEG42SjUemiw_OX76JjOmrF6vZ_0 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1811961667831458224', time=2024-09-14T13:40:23.633158+0000, chain.objs.size()=1 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_.F4h_4yuBGiSeYDUHRxY3qHBWfIOHAIE_0 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2285009513534022053', time=2024-09-14T13:41:01.360016+0000, chain.objs.size()=1 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.767+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.38__shadow_.Fg1K0NJAo8G8eQ12kgNiUeBcAuoW0VE_0 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.768+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15424278502194495280', time=2024-09-14T13:41:34.530393+0000, chain.objs.size()=1 2024-09-14T11:44:14.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.768+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.OKPdkZRQbYoidY6xn9npGHDCem-jyKb_0 2024-09-14T11:44:14.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.770+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.772+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:44:14.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.401965015911291936', time=2024-09-14T13:35:24.412573+0000, chain.objs.size()=1 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.FMnWZK_52bK0I9AKwT6vkq--9a6lBlO_0 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_v2JIM0fdWN7ReUGlbBKNm-Vnjie8xlQ', time=2024-09-14T13:35:24.640551+0000, chain.objs.size()=3 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_0 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_1 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.2q30-uWM2m11SqQvd3zNq5N45sQAuWA_2 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18329699399830399958', time=2024-09-14T13:35:24.659394+0000, chain.objs.size()=5 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.1_1 2024-09-14T11:44:14.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.774+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.2_1 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__multipart_foo-STANDARD.2~T2qzs9YhBl4YU5zOt7v9A8eCrVJntoL.3 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.214946395574594600', time=2024-09-14T13:35:24.788010+0000, chain.objs.size()=1 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7__shadow_.ZjBkyyw7UocnpzEDXad60BztEryp9b1_0 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10261392399991542708', time=2024-09-14T13:36:42.604974+0000, chain.objs.size()=1 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.5o7822pp1XZp0l31V96rhHJk0D6ysc5_0 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5877546649034326146', time=2024-09-14T13:37:20.255185+0000, chain.objs.size()=1 2024-09-14T11:44:14.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.775+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.hu2UD523KWqoixUotJoeaiKin2ZszDw_0 2024-09-14T11:44:14.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15543313881076458586', time=2024-09-14T13:37:20.332130+0000, chain.objs.size()=1 2024-09-14T11:44:14.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23__shadow_.Nepj_KNPkcOql5hvRywoklP4w9Rt--F_0 2024-09-14T11:44:14.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17599402769054764162', time=2024-09-14T13:37:52.721250+0000, chain.objs.size()=1 2024-09-14T11:44:14.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.24__shadow_.pYQnmkJjsDBTO4n56rqEQgZsB3ImkF7_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17881414596602936969', time=2024-09-14T13:38:30.906404+0000, chain.objs.size()=1 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27__shadow_.BDu2BsSRtSGrf_5gklscmwsjepQeHzz_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10805994325132302009', time=2024-09-14T13:40:20.872960+0000, chain.objs.size()=1 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.kAXVDEywQ2m0EU-FAaLg8ZX_nQmydGi_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7003659102121238533', time=2024-09-14T13:40:20.890936+0000, chain.objs.size()=1 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.34__shadow_.1ngY5H54osAlqlTA6Be422RG82Lxpfm_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12969967625022181202', time=2024-09-14T13:40:23.618355+0000, chain.objs.size()=1 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.777+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.35__shadow_._eqmXVw-spsmdjyuibh_KSCIt3bikEJ_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.778+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5622212981242852238', time=2024-09-14T13:40:59.120989+0000, chain.objs.size()=1 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.778+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.lN_hZuz7I9WEdImlg7PnJBLzoB4q1sL_0 2024-09-14T11:44:14.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.778+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4650196093925752257', time=2024-09-14T13:41:34.530364+0000, chain.objs.size()=1 2024-09-14T11:44:14.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.778+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.39__shadow_.XYvzwmzeg0G7fN5UNdrdjFJEqtms42s_0 2024-09-14T11:44:14.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.779+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.781+0000 7fab5ad46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:44:14.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:14.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16689403257411088182', time=2024-09-14T13:35:24.422405+0000, chain.objs.size()=1 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4__shadow_.A__X9RmrWPOSpZAetHLdU4zzP87whJ__0 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='_NwuLCy0OpChmLmZSZvlHChyQwQubVRT', time=2024-09-14T13:35:24.651298+0000, chain.objs.size()=3 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_0 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_1 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16__shadow_.NCKcHzmdGietTBBXsryGNrwa3Ku8oRL_2 2024-09-14T11:44:14.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1651983449775389086', time=2024-09-14T13:35:24.698612+0000, chain.objs.size()=5 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.1_1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.2 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__shadow_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.2_1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14__multipart_foo-LUKEWARM.2~Xed24AjvJtqqAaba4_FkGHqbYKnRRpk.3 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.783+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.975626846316330530', time=2024-09-14T13:36:42.529421+0000, chain.objs.size()=1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.784+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.20__shadow_.8Hac9C5pkJ5ZbT_B_YdvWODmbfQogSe_0 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.784+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16113394829638417057', time=2024-09-14T13:37:15.792260+0000, chain.objs.size()=1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.784+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.eLU4dlIY_beZoIx6aMWne_qZ94B4_2q_0 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.784+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15111648551643280968', time=2024-09-14T13:37:15.816751+0000, chain.objs.size()=1 2024-09-14T11:44:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.784+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21__shadow_.uHmj4FvMrYQFRD9mdEt4qQ8bvueIsLN_0 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3705100536431646176', time=2024-09-14T13:37:18.570259+0000, chain.objs.size()=1 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.22__shadow_.GYceu3duyAVdvWyfadmNzQ_IW8noQM1_0 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14358018246104143350', time=2024-09-14T13:37:57.811885+0000, chain.objs.size()=1 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.26__shadow_.jw1vtWgqDMHpKdGVDQ6_kbKEK8u0-iY_0 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3391653214995446045', time=2024-09-14T13:38:33.659601+0000, chain.objs.size()=1 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.28__shadow_.919Hvned4DvisQHaZn9NYfPYARKwV_Z_0 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13397390416985156714', time=2024-09-14T13:39:06.894597+0000, chain.objs.size()=1 2024-09-14T11:44:14.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.29__shadow_.xfz-CPUkGWC3ubS3WsJ9moy7D7_O3GI_0 2024-09-14T11:44:14.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6845185422882625225', time=2024-09-14T13:39:09.603783+0000, chain.objs.size()=1 2024-09-14T11:44:14.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.30__shadow_.Drwz_-dqXnX8D0ChWutyKwNVCSitZaf_0 2024-09-14T11:44:14.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14229206951234431644', time=2024-09-14T13:39:11.838685+0000, chain.objs.size()=1 2024-09-14T11:44:14.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.786+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.31__shadow_.IWwVR6NTdeHCICouaPINQa4KUTeiEAd_0 2024-09-14T11:44:14.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.81937720874206472', time=2024-09-14T13:39:45.107634+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32__shadow_.4rvjOBSxBl_C5kr12zw8Hce423ASFiq_0 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12138057874220759708', time=2024-09-14T13:39:47.967416+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33__shadow_.IkjTVOSC4TapYmN6Ku2e8_se-IGh1lD_0 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10492573282659162045', time=2024-09-14T13:40:56.181307+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.lt7BnXiNkJNsDR3CPnS0y5DLIsPommJ_0 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16741292456154923222', time=2024-09-14T13:40:56.182047+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.36__shadow_.nYdBd3HLi1vc0aSBDf7VKeMGM-RR-us_0 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6699095902012135427', time=2024-09-14T13:40:59.190736+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.37__shadow_.Lb1kz0Xdry-cqUfNBjPl_9EBX0zmm5V_0 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10018365294934307255', time=2024-09-14T13:43:42.142058+0000, chain.objs.size()=1 2024-09-14T11:44:14.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.787+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17__shadow_.TpcR0GgiMmfuOjhCXV3LVNc7gIIcJ0s_0 2024-09-14T11:44:14.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.789+0000 7fab5ad46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:14.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.792+0000 7faa0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:14.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.794+0000 7fab5ad46800 20 remove_watcher() i=0 2024-09-14T11:44:14.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.794+0000 7fab5ad46800 2 removed watcher, disabling cache 2024-09-14T11:44:14.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.795+0000 7fab5ad46800 20 remove_watcher() i=1 2024-09-14T11:44:14.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.796+0000 7fab5ad46800 20 remove_watcher() i=2 2024-09-14T11:44:14.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.797+0000 7fab5ad46800 20 remove_watcher() i=3 2024-09-14T11:44:14.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.799+0000 7fab5ad46800 20 remove_watcher() i=4 2024-09-14T11:44:14.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.800+0000 7fab5ad46800 20 remove_watcher() i=5 2024-09-14T11:44:14.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.801+0000 7fab5ad46800 20 remove_watcher() i=6 2024-09-14T11:44:14.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.802+0000 7fab5ad46800 20 remove_watcher() i=7 2024-09-14T11:44:14.810 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:44:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:14.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.940+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 realm 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.942+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.943+0000 7fabcaf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:14.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.943+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.943+0000 7fabcaf35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:14.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.943+0000 7fabcaf35800 20 searching for the correct realm 2024-09-14T11:44:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.947+0000 7fabbe420640 0 -- 172.21.15.116:0/1591461084 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fabb809b910 msgr2=0x7fabb8064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.951+0000 7fabbe420640 0 -- 172.21.15.116:0/1591461084 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7faa90087080 msgr2=0x7faa900894b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.954+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 zone default found 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 4 Realm: () 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 zonegroup default 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.955+0000 7fabcaf35800 20 rados->read ofs=0 len=0 2024-09-14T11:44:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.956+0000 7fabcaf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.956+0000 7fabcaf35800 20 started sync module instance, tier type = 2024-09-14T11:44:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.956+0000 7fabcaf35800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:44:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=0 2024-09-14T11:44:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=1 2024-09-14T11:44:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=2 2024-09-14T11:44:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=3 2024-09-14T11:44:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=4 2024-09-14T11:44:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=5 2024-09-14T11:44:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.964+0000 7fabcaf35800 20 add_watcher() i=6 2024-09-14T11:44:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.965+0000 7fabcaf35800 20 add_watcher() i=7 2024-09-14T11:44:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.965+0000 7fabcaf35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.967+0000 7faa7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.967+0000 7fabcaf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:14.967+0000 7fabcaf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.000+0000 7fa9f7fff640 20 reqs_thread_entry: start 2024-09-14T11:44:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.001+0000 7fabcaf35800 20 init_complete bucket index max shards: 11 2024-09-14T11:44:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.001+0000 7fabcaf35800 20 Filter name: none 2024-09-14T11:44:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.001+0000 7fa9f5ffb640 20 reqs_thread_entry: start 2024-09-14T11:44:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.001+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:44:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.002+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.002+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.003+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.004+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:44:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.005+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.005+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.006+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.007+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:44:15.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.008+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.008+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.009+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.010+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:44:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.011+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.011+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.011+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.012+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:44:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.014+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.014+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.015+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.016+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:44:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.017+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.017+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.018+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.018+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:44:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.020+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.020+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.020+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.021+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:44:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.023+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.023+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.023+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.025+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:44:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.026+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.026+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.027+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.028+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:44:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.029+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.030+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.030+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.031+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:44:15.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.032+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.033+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.033+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.034+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:44:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.035+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.035+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.036+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.037+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:44:15.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.039+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.039+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.039+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.040+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:44:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.042+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.042+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.042+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.043+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:44:15.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.045+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.045+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.046+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.047+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:44:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.048+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.048+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.049+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.050+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:44:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.051+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.051+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.051+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.052+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:44:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.054+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.054+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.054+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.055+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:44:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.057+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.057+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.057+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.058+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:44:15.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.059+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.060+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.060+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.061+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:44:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.063+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.063+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.063+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.064+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:44:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.065+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.066+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.066+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.067+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:44:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.068+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.069+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.069+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.070+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:44:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.071+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.072+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.072+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.073+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:44:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.074+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.074+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.075+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.076+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:44:15.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.077+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.077+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.078+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.079+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:44:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.080+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.081+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.081+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.082+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:44:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.083+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.083+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.084+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.085+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:44:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.086+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.086+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.087+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.088+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:44:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.089+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.089+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.089+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.090+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:44:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.091+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.092+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.092+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.093+0000 7fabcaf35800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:44:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.095+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.096+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.096+0000 7fabcaf35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:15.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.098+0000 7faa7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.100+0000 7fabcaf35800 20 remove_watcher() i=0 2024-09-14T11:44:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.100+0000 7fabcaf35800 2 removed watcher, disabling cache 2024-09-14T11:44:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.101+0000 7fabcaf35800 20 remove_watcher() i=1 2024-09-14T11:44:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.102+0000 7fabcaf35800 20 remove_watcher() i=2 2024-09-14T11:44:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.103+0000 7fabcaf35800 20 remove_watcher() i=3 2024-09-14T11:44:15.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.104+0000 7fabcaf35800 20 remove_watcher() i=4 2024-09-14T11:44:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.105+0000 7fabcaf35800 20 remove_watcher() i=5 2024-09-14T11:44:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.106+0000 7fabcaf35800 20 remove_watcher() i=6 2024-09-14T11:44:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:44:15.107+0000 7fabcaf35800 20 remove_watcher() i=7 2024-09-14T11:44:15.115 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:44:15.623 INFO:teuthology.orchestra.run.smithi116.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:44:19.222 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:44:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileJava 2024-09-14T11:44:36.723 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processResources 2024-09-14T11:44:36.723 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :classes 2024-09-14T11:44:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:37.521 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileTestJava 2024-09-14T11:44:37.522 INFO:teuthology.orchestra.run.smithi116.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:44:37.522 INFO:teuthology.orchestra.run.smithi116.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:44:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:37.523 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:44:37.523 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :testClasses 2024-09-14T11:44:43.122 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:43.122 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :test 2024-09-14T11:44:43.122 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:43.122 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:44:47.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:47.322 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:44:47.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:47.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:44:47.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:47.821 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:44:48.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:48.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:44:53.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:53.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:44:53.421 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:53.422 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:44:53.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:53.521 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:44:53.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:53.621 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:44:53.622 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:53.622 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:44:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:44:54.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:45:06.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:06.622 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:45:07.421 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:07.422 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:45:07.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:07.622 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:45:07.622 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14 11:45:07,601 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:45:34.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:34.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:45:35.421 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:35.422 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:45:35.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:35.521 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:45:35.921 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:35.922 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:45:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:36.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:45:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:45:40.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:40.522 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:45:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:41.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:45:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:41.022 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:45:41.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:41.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:45:55.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:55.621 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:45:56.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:45:56.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:46:03.921 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:46:03.922 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:46:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:46:04.521 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:46:06.422 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:46:06.422 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:46:06.921 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:46:06.922 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:47:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:17.423 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:47:17.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:17.822 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:47:31.322 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:31.322 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:47:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:31.723 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:47:35.521 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:35.521 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:47:36.021 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:36.021 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:47:38.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:38.321 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:47:52.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:52.621 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:47:52.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:52.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:47:53.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:53.121 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:47:53.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:53.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:47:53.621 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:53.621 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:47:53.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:53.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:47:54.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:54.121 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:47:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:54.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:47:54.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:54.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:47:54.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:54.821 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:47:55.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:55.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:47:55.321 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:55.321 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:47:55.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:55.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:47:55.821 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:55.821 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:47:56.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:47:56.221 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:48:04.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:04.721 INFO:teuthology.orchestra.run.smithi116.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:48:05.221 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:05.221 INFO:teuthology.orchestra.run.smithi116.stdout:---------------------------------------------------------------------- 2024-09-14T11:48:05.222 INFO:teuthology.orchestra.run.smithi116.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:48:05.222 INFO:teuthology.orchestra.run.smithi116.stdout:---------------------------------------------------------------------- 2024-09-14T11:48:05.266 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:05.266 INFO:teuthology.orchestra.run.smithi116.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:48:05.266 INFO:teuthology.orchestra.run.smithi116.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:48:05.267 INFO:teuthology.orchestra.run.smithi116.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:48:05.267 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:05.267 INFO:teuthology.orchestra.run.smithi116.stdout:BUILD SUCCESSFUL in 3m 50s 2024-09-14T11:48:05.267 INFO:teuthology.orchestra.run.smithi116.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:48:05.585 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:05.638 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:05.639 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:05.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.676+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 realm 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:05.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.678+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.679+0000 7f5507346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:05.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.679+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.679+0000 7f5507346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:05.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.679+0000 7f5507346800 20 searching for the correct realm 2024-09-14T11:48:05.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.682+0000 7f54fc636640 0 -- 172.21.15.116:0/1760784899 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x564205377610 msgr2=0x564205379a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:05.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.686+0000 7f5504e37640 0 -- 172.21.15.116:0/1760784899 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f54ec071280 msgr2=0x7f54ec0840d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:05.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.689+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 zone default found 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 4 Realm: () 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 zonegroup default 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.690+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.691+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.691+0000 7f5507346800 20 rados->read ofs=0 len=0 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.691+0000 7f5507346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.691+0000 7f5507346800 20 started sync module instance, tier type = 2024-09-14T11:48:05.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.691+0000 7f5507346800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=0 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=1 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=2 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=3 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=4 2024-09-14T11:48:05.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=5 2024-09-14T11:48:05.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.699+0000 7f5507346800 20 add_watcher() i=6 2024-09-14T11:48:05.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.700+0000 7f5507346800 20 add_watcher() i=7 2024-09-14T11:48:05.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.700+0000 7f5507346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:05.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.702+0000 7f53bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:05.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.702+0000 7f5507346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:05.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.702+0000 7f5507346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:05.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.737+0000 7f53b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:48:05.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.737+0000 7f5507346800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:05.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.737+0000 7f5507346800 20 Filter name: none 2024-09-14T11:48:05.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.737+0000 7f532b7fe640 20 reqs_thread_entry: start 2024-09-14T11:48:05.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.737+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:05.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.738+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.739+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.739+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.740+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:05.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.742+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.742+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.743+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.744+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:05.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.745+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10655201763236953338', time=2024-09-14T13:46:04.122805+0000, chain.objs.size()=9 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.1 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.1_1 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.2 2024-09-14T11:48:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.2_1 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.3 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.3_1 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.4 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.4_1 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file2.mpg.2~sFUNOUrcJ4oS9tuNYoWrXcPYdrtJxhD.5 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5406797545799300196', time=2024-09-14T13:47:17.518121+0000, chain.objs.size()=16 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.1 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.746+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.1_1 2024-09-14T11:48:05.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.747+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.1_2 2024-09-14T11:48:05.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.749+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.2 2024-09-14T11:48:05.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.749+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.2_1 2024-09-14T11:48:05.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.750+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.2_2 2024-09-14T11:48:05.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.750+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.3 2024-09-14T11:48:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.3_1 2024-09-14T11:48:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.3_2 2024-09-14T11:48:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.4 2024-09-14T11:48:05.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.4_1 2024-09-14T11:48:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.4_2 2024-09-14T11:48:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.5 2024-09-14T11:48:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.5_1 2024-09-14T11:48:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.751+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.5_2 2024-09-14T11:48:05.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.753+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~XTWvUiJ62qpZuFtsW_F2e2adOcohc9H.6 2024-09-14T11:48:05.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.756+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.758+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:05.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.760+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.760+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16979038447425325838', time=2024-09-14T13:45:34.818428+0000, chain.objs.size()=7 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.1 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.1_1 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.1_2 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.2 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.2_1 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.2_2 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~b0xweJhmr22kIUojXeNrOyTFXYvBmf6.3 2024-09-14T11:48:05.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2750044380058317343', time=2024-09-14T13:47:31.406978+0000, chain.objs.size()=9 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__multipart_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.1 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__shadow_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.1_1 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__multipart_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.2 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__shadow_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.2_1 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.761+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__multipart_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.3 2024-09-14T11:48:05.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.763+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__shadow_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.3_1 2024-09-14T11:48:05.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.765+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__multipart_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.4 2024-09-14T11:48:05.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.765+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__shadow_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.4_1 2024-09-14T11:48:05.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.765+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__multipart_key1.2~spowrXEskxg35_tPjggJx36bjXm3CY3.5 2024-09-14T11:48:05.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.767+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.769+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:05.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.771+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.771+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.772+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.773+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:05.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.774+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.775+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.775+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.776+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:05.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.777+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.777+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3982216181059184584', time=2024-09-14T13:46:04.050638+0000, chain.objs.size()=9 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.1 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.1_1 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.2 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.2_1 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.3 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.3_1 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.4 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.4_1 2024-09-14T11:48:05.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__multipart_file.mpg.2~6dVs86v6vClz5RSeQv5WjM5jw1V0ZRK.5 2024-09-14T11:48:05.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15183071618521340269', time=2024-09-14T13:47:55.400839+0000, chain.objs.size()=1 2024-09-14T11:48:05.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.778+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.64__shadow_.2IK4G-hERsTgJXW9SeUDSXqoFMMbLim_0 2024-09-14T11:48:05.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.782+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.784+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:05.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.786+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.786+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:48:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6792628063732812871', time=2024-09-14T13:45:16.351931+0000, chain.objs.size()=9 2024-09-14T11:48:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.1 2024-09-14T11:48:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.1_1 2024-09-14T11:48:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.2 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.2_1 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.3 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.3_1 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.4 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.4_1 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~r6Uc5goxsAnXJC0X8PSg8OcZQdkYbr0.5 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13525461004588587860', time=2024-09-14T13:45:19.010248+0000, chain.objs.size()=9 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.1 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.1_1 2024-09-14T11:48:05.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.787+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.2 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.2_1 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.3 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.3_1 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.4 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.4_1 2024-09-14T11:48:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.790+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~ruJtUXXoluPYkv6TWGGP0sbgHVqcMLZ.5 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5911117228675352319', time=2024-09-14T13:47:17.292671+0000, chain.objs.size()=16 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.1 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.1_1 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.1_2 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.2 2024-09-14T11:48:05.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.791+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.2_1 2024-09-14T11:48:05.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.2_2 2024-09-14T11:48:05.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.3 2024-09-14T11:48:05.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.3_1 2024-09-14T11:48:05.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.3_2 2024-09-14T11:48:05.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.4 2024-09-14T11:48:05.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.4_1 2024-09-14T11:48:05.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.793+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.4_2 2024-09-14T11:48:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.795+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.5 2024-09-14T11:48:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.795+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.5_1 2024-09-14T11:48:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.795+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.5_2 2024-09-14T11:48:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.795+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~TETr0i7UtvAfKpZAIJIm7HBp6AQgQYZ.6 2024-09-14T11:48:05.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.797+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.800+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:05.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:48:05.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8479044673213733699', time=2024-09-14T13:45:23.555219+0000, chain.objs.size()=7 2024-09-14T11:48:05.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.1 2024-09-14T11:48:05.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.1_1 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.801+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.1_2 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.2 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.2_1 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.2_2 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~wyuQ637r5lj66-Nbunjv39VX-oHXzkv.3 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5700472650173481243', time=2024-09-14T13:45:40.674013+0000, chain.objs.size()=9 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__multipart_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.1 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__shadow_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.1_1 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__multipart_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.2 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__shadow_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.2_1 2024-09-14T11:48:05.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.802+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__multipart_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.3 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__shadow_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.3_1 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__multipart_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.4 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__shadow_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.4_1 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51__multipart_key1.2~Oz-P7Qd_Mxn8aDR6dkElz_ja1u4vZB6.5 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2334970978431097659', time=2024-09-14T13:46:52.305980+0000, chain.objs.size()=21 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.1 2024-09-14T11:48:05.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.805+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.1_1 2024-09-14T11:48:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.807+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.2 2024-09-14T11:48:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.807+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.2_1 2024-09-14T11:48:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.807+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.3 2024-09-14T11:48:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.807+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.3_1 2024-09-14T11:48:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.807+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.4 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.4_1 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.5 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.5_1 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.6 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.6_1 2024-09-14T11:48:05.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.7 2024-09-14T11:48:05.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.808+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.7_1 2024-09-14T11:48:05.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.810+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.8 2024-09-14T11:48:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.810+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.8_1 2024-09-14T11:48:05.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.810+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.9 2024-09-14T11:48:05.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.810+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.9_1 2024-09-14T11:48:05.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.812+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.10 2024-09-14T11:48:05.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.812+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.10_1 2024-09-14T11:48:05.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.812+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~_uRMqzVX87GfK39uJeIvluyVJkSfu7P.11 2024-09-14T11:48:05.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.814+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.816+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:05.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.817+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.817+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6789544439914659416', time=2024-09-14T13:44:53.140499+0000, chain.objs.size()=9 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__multipart_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__shadow_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.1_1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__multipart_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.2 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__shadow_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.2_1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__multipart_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.3 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__shadow_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.3_1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__multipart_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.4 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__shadow_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.4_1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.42__multipart_key1.2~V71sGBWIly5AvYUqHlDyYGdvwx2WAy7.5 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4467114380942236101', time=2024-09-14T13:47:09.291734+0000, chain.objs.size()=16 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.1_1 2024-09-14T11:48:05.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.818+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.1_2 2024-09-14T11:48:05.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.2 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.2_1 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.2_2 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.3 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.3_1 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.3_2 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.4 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.4_1 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.4_2 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.5 2024-09-14T11:48:05.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.821+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.5_1 2024-09-14T11:48:05.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.825+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.5_2 2024-09-14T11:48:05.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.825+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~Tj1NTrIkc9lgQO_R2B5eSQ4seNg63mC.6 2024-09-14T11:48:05.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.827+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.829+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:05.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.830+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18256586046083168980', time=2024-09-14T13:45:34.597578+0000, chain.objs.size()=7 2024-09-14T11:48:05.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.1 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.1_1 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.1_2 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.2 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.2_1 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.2_2 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.831+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~lqDeqHiteASPZL8QHY6alrU_ySnyKpy.3 2024-09-14T11:48:05.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.834+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.836+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:05.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.838+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.838+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.838+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.839+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:05.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8025506111060208187', time=2024-09-14T13:45:55.676005+0000, chain.objs.size()=9 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__multipart_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.1 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.841+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__shadow_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.1_1 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__multipart_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.2 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__shadow_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.2_1 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__multipart_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.3 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__shadow_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.3_1 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__multipart_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.4 2024-09-14T11:48:05.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__shadow_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.4_1 2024-09-14T11:48:05.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.842+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52__multipart_key1.2~AyNim-MTZWiTlOhJZdfrNoIOIYz_jWR.5 2024-09-14T11:48:05.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.845+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.847+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:05.847 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.848+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14485005688166525397', time=2024-09-14T13:47:00.366733+0000, chain.objs.size()=19 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.1 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.1_1 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.2 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.2_1 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.3 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.3_1 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.4 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.4_1 2024-09-14T11:48:05.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.5 2024-09-14T11:48:05.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.5_1 2024-09-14T11:48:05.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.849+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.6 2024-09-14T11:48:05.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.850+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.6_1 2024-09-14T11:48:05.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.851+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.7 2024-09-14T11:48:05.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.852+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.7_1 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.8 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.8_1 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.9 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.9_1 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~-Xid_RR1C0bcuXBei6ZmhOWphSVTZrE.10 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8317226790304482657', time=2024-09-14T13:47:35.656719+0000, chain.objs.size()=9 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.853+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__multipart_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.1 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.854+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__shadow_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.1_1 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.855+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__multipart_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.2 2024-09-14T11:48:05.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.855+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__shadow_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.2_1 2024-09-14T11:48:05.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.855+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__multipart_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.3 2024-09-14T11:48:05.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.856+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__shadow_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.3_1 2024-09-14T11:48:05.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.856+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__multipart_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.4 2024-09-14T11:48:05.856 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.856+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__shadow_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.4_1 2024-09-14T11:48:05.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.858+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.57__multipart_key1.2~jSRtnJnoHM4-HoRKPV88TayC_9pKMDi.5 2024-09-14T11:48:05.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.860+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.862+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:05.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.863+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12482399139323200564', time=2024-09-14T13:45:35.127382+0000, chain.objs.size()=6 2024-09-14T11:48:05.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_0 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_1 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_2 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_3 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_4 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.46__shadow_.TGCc9dHmK5b2fufjlrcKBle3MCNn6ZK_5 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.164790141648912823', time=2024-09-14T13:47:54.883719+0000, chain.objs.size()=1 2024-09-14T11:48:05.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.864+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.63__shadow_.yloIR1DITeK6hgGHQvm_QCiM-anlpHO_0 2024-09-14T11:48:05.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.868+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.870+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:05.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.871+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17824285775928521505', time=2024-09-14T13:45:06.777205+0000, chain.objs.size()=9 2024-09-14T11:48:05.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.1 2024-09-14T11:48:05.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.1_1 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.2 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.2_1 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.3 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.3_1 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.4 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.4_1 2024-09-14T11:48:05.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.872+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.5 2024-09-14T11:48:05.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.875+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.877+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:05.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.879+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.879+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.880+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.881+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:05.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.882+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.882+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.883+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.883+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4903718237709980373', time=2024-09-14T13:46:04.156361+0000, chain.objs.size()=1 2024-09-14T11:48:05.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.883+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_.ibzSKy9A7BzKLKV9m4LcP17QGvBdTqB_0 2024-09-14T11:48:05.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.884+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.886+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:05.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.887+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR', time=2024-09-14T13:44:47.213280+0000, chain.objs.size()=9 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__multipart_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.1 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__shadow_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.1_1 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__multipart_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.2 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__shadow_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.2_1 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__multipart_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.3 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__shadow_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.3_1 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__multipart_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.4 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__shadow_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.4_1 2024-09-14T11:48:05.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.888+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.40__multipart_key1.2~gSEFkynTKdqHg7WlhrMVwscn1o3W3PR.5 2024-09-14T11:48:05.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.891+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.893+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:05.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.895+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.895+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.895+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.896+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:05.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6908815083913750231', time=2024-09-14T13:46:04.190605+0000, chain.objs.size()=1 2024-09-14T11:48:05.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_.l1TmIeH8zQ17ZFd_sY6za8F8c62loGI_0 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1', time=2024-09-14T13:46:06.702823+0000, chain.objs.size()=5 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.54__multipart_key1.2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1.7 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.54__shadow_key1.2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1.7_1 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.54__multipart_key1.2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1.10 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.54__shadow_key1.2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1.10_1 2024-09-14T11:48:05.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.898+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.54__multipart_key1.2~iWfIxlSUnKEPU3y-CgXbKoJg9HsA6d1.13 2024-09-14T11:48:05.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.900+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.902+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:05.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.904+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.904+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.904+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.906+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:05.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.907+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.907+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.907+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.908+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:05.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.910+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.910+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.910+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.911+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:05.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16289745653426662886', time=2024-09-14T13:45:07.087443+0000, chain.objs.size()=9 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.1 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.1_1 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.2 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.2_1 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.3 2024-09-14T11:48:05.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.3_1 2024-09-14T11:48:05.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.4 2024-09-14T11:48:05.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__shadow_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.4_1 2024-09-14T11:48:05.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44__multipart_key1.2~NbUQJfgtfOWpmI6eGRGHQn5Xyo_O5tI.5 2024-09-14T11:48:05.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17913694406064117097', time=2024-09-14T13:47:52.807592+0000, chain.objs.size()=1 2024-09-14T11:48:05.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.913+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.59__shadow_.EKIQsdbKelz4t3LqDampOUZAXdqve_m_0 2024-09-14T11:48:05.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.917+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.919+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:05.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.920+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.920+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.700211017017440148', time=2024-09-14T13:47:53.335125+0000, chain.objs.size()=1 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.60__shadow_.9en5BlfMy2keKjtrs7RgR59vJVA0KEB_0 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503666408943215005', time=2024-09-14T13:48:04.852423+0000, chain.objs.size()=21 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.1 2024-09-14T11:48:05.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.1_1 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.2 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.2_1 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.3 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.3_1 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.4 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.4_1 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.5 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.5_1 2024-09-14T11:48:05.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.921+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.6 2024-09-14T11:48:05.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.922+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.6_1 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.924+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.7 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.924+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.7_1 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.8 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.8_1 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.9 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.9_1 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.10 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__shadow_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.10_1 2024-09-14T11:48:05.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.925+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.66__multipart_key1.2~cqqR1hXZUrte14m8ato7nCm095zlBNX.11 2024-09-14T11:48:05.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.928+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.930+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:05.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.932+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.932+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:45.548104+0000, chain.objs.size()=50 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.1 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.2 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.3 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.4 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.5 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.6 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.7 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.8 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.9 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.10 2024-09-14T11:48:05.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.11 2024-09-14T11:48:05.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.933+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.12 2024-09-14T11:48:05.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.13 2024-09-14T11:48:05.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.14 2024-09-14T11:48:05.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.15 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.16 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.17 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.18 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.19 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.20 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.21 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.22 2024-09-14T11:48:05.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.935+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.23 2024-09-14T11:48:05.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.24 2024-09-14T11:48:05.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.25 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.26 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.27 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.28 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.937+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.29 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.938+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.30 2024-09-14T11:48:05.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.938+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.31 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.32 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.33 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.34 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.35 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.36 2024-09-14T11:48:05.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.939+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.37 2024-09-14T11:48:05.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.940+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.38 2024-09-14T11:48:05.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.940+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.39 2024-09-14T11:48:05.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.940+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.40 2024-09-14T11:48:05.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.940+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.41 2024-09-14T11:48:05.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.940+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.42 2024-09-14T11:48:05.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.941+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.43 2024-09-14T11:48:05.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.941+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.44 2024-09-14T11:48:05.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.941+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.45 2024-09-14T11:48:05.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.941+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.46 2024-09-14T11:48:05.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.941+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.47 2024-09-14T11:48:05.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.48 2024-09-14T11:48:05.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.49 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.50 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:46.873154+0000, chain.objs.size()=4 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.52 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.53 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.55 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.58 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:48.043251+0000, chain.objs.size()=8 2024-09-14T11:48:05.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.942+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.51 2024-09-14T11:48:05.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.944+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.54 2024-09-14T11:48:05.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.944+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.56 2024-09-14T11:48:05.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.944+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.57 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.59 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.60 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.61 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.62 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:48.932303+0000, chain.objs.size()=4 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.63 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.64 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.65 2024-09-14T11:48:05.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.945+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.66 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:50.355529+0000, chain.objs.size()=6 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.67 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.68 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.69 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.70 2024-09-14T11:48:05.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.946+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.71 2024-09-14T11:48:05.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.72 2024-09-14T11:48:05.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:51.281252+0000, chain.objs.size()=10 2024-09-14T11:48:05.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.73 2024-09-14T11:48:05.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.74 2024-09-14T11:48:05.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.75 2024-09-14T11:48:05.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.76 2024-09-14T11:48:05.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.947+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.77 2024-09-14T11:48:05.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.948+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.78 2024-09-14T11:48:05.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.949+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.79 2024-09-14T11:48:05.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.949+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.80 2024-09-14T11:48:05.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.81 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.82 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:52.274576+0000, chain.objs.size()=3 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.83 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.84 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.85 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7', time=2024-09-14T13:47:52.397055+0000, chain.objs.size()=7 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.86 2024-09-14T11:48:05.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.950+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.87 2024-09-14T11:48:05.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.951+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.88 2024-09-14T11:48:05.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.951+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.89 2024-09-14T11:48:05.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.951+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.90 2024-09-14T11:48:05.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.951+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.91 2024-09-14T11:48:05.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.951+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.58__multipart_key1.2~QhG01rYNDb5wD_QIHNTG8o03gx7sac7.92 2024-09-14T11:48:05.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.953+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.955+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:05.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.956+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11077490972546733466', time=2024-09-14T13:45:21.421936+0000, chain.objs.size()=9 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.1 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.1_1 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.2 2024-09-14T11:48:05.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.2_1 2024-09-14T11:48:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.3 2024-09-14T11:48:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.3_1 2024-09-14T11:48:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.4 2024-09-14T11:48:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__shadow_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.4_1 2024-09-14T11:48:05.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.957+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.47__multipart_key1.2~xDawwJ70gtJE0weAV604llcikfNCRFu.5 2024-09-14T11:48:05.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.960+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.962+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.963+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.963+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.964+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.964+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3825478100949301253', time=2024-09-14T13:47:53.853708+0000, chain.objs.size()=1 2024-09-14T11:48:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.964+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.61__shadow_.nfUwwCnUkZpy6l_yVN52PA6ur4rOZbJ_0 2024-09-14T11:48:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.965+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.967+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.968+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.968+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16251949907446615730', time=2024-09-14T13:46:43.179499+0000, chain.objs.size()=21 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.1 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.1_1 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.2 2024-09-14T11:48:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.2_1 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.3 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.3_1 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.4 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.4_1 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.5 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.5_1 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.6 2024-09-14T11:48:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.969+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.6_1 2024-09-14T11:48:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.7 2024-09-14T11:48:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.7_1 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.8 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.8_1 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.9 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.9_1 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.10 2024-09-14T11:48:05.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__shadow_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.10_1 2024-09-14T11:48:05.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.972+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55__multipart_key1.2~GA7-OkEW5LbUAj-wcjZ40Rj9WpjsUJF.11 2024-09-14T11:48:05.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.976+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.978+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:05.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.980+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.980+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.981+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:05.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.981+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10396540423233328890', time=2024-09-14T13:46:04.084877+0000, chain.objs.size()=1 2024-09-14T11:48:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.981+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.53__shadow_.IDSQ__wF6q3ACGxSZaWN5zxn0WJbD8f_0 2024-09-14T11:48:05.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.982+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.984+0000 7f5507346800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:05.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.985+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:05.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.985+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:05.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.986+0000 7f5507346800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:48:05.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.986+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7053696343719298697', time=2024-09-14T13:47:30.156534+0000, chain.objs.size()=1 2024-09-14T11:48:05.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.986+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.56__shadow_.ocThU0t0t_rDa4YR_gGI9RI9n0pMmId_0 2024-09-14T11:48:05.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.986+0000 7f5507346800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6061685297315845729', time=2024-09-14T13:47:54.373934+0000, chain.objs.size()=1 2024-09-14T11:48:05.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.986+0000 7f5507346800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.62__shadow_.EvqRurs-HdG5I04QAfkY3VhwasY5toO_0 2024-09-14T11:48:05.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.987+0000 7f5507346800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:05.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.990+0000 7f53bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:05.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.992+0000 7f5507346800 20 remove_watcher() i=0 2024-09-14T11:48:05.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.992+0000 7f5507346800 2 removed watcher, disabling cache 2024-09-14T11:48:05.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.993+0000 7f5507346800 20 remove_watcher() i=1 2024-09-14T11:48:05.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.994+0000 7f5507346800 20 remove_watcher() i=2 2024-09-14T11:48:05.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.995+0000 7f5507346800 20 remove_watcher() i=3 2024-09-14T11:48:05.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.996+0000 7f5507346800 20 remove_watcher() i=4 2024-09-14T11:48:05.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.997+0000 7f5507346800 20 remove_watcher() i=5 2024-09-14T11:48:05.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.998+0000 7f5507346800 20 remove_watcher() i=6 2024-09-14T11:48:05.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:05.998+0000 7f5507346800 20 remove_watcher() i=7 2024-09-14T11:48:06.009 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:06.061 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:06.061 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:06.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.099+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.100+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.100+0000 7f942b720800 20 realm 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.101+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.102+0000 7f942b720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:06.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.102+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.102+0000 7f942b720800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:06.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.102+0000 7f942b720800 20 searching for the correct realm 2024-09-14T11:48:06.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.106+0000 7f941eb01640 0 -- 172.21.15.116:0/1943225841 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f94180b9070 msgr2=0x7f94180a56f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:06.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.109+0000 7f9427b03640 0 -- 172.21.15.116:0/1943225841 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f941004d920 msgr2=0x7f94100163c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:06.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:06.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:06.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:06.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:06.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.112+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 zone default found 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 4 Realm: () 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 zonegroup default 2024-09-14T11:48:06.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.113+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.114+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.114+0000 7f942b720800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.114+0000 7f942b720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.114+0000 7f942b720800 20 started sync module instance, tier type = 2024-09-14T11:48:06.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.114+0000 7f942b720800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=0 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=1 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=2 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=3 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=4 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=5 2024-09-14T11:48:06.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.122+0000 7f942b720800 20 add_watcher() i=6 2024-09-14T11:48:06.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.123+0000 7f942b720800 20 add_watcher() i=7 2024-09-14T11:48:06.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.123+0000 7f942b720800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:06.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.124+0000 7f92ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:06.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.125+0000 7f942b720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:06.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.125+0000 7f942b720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:06.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.158+0000 7f92dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:48:06.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.158+0000 7f942b720800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:06.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.158+0000 7f942b720800 20 Filter name: none 2024-09-14T11:48:06.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.158+0000 7f92567fc640 20 reqs_thread_entry: start 2024-09-14T11:48:06.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.158+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:06.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.159+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.160+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.160+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.161+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:06.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.163+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.163+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.163+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.165+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:06.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.166+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.166+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.167+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.167+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.169+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.169+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.169+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.170+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:06.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.172+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.172+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.172+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.173+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.175+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.175+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.175+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.176+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:06.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.178+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.178+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.179+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.180+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:06.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.181+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.182+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.182+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.183+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:06.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.184+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.184+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.184+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.185+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:06.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.187+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.187+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.187+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.188+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:06.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.190+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.190+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.190+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.192+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:06.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.194+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.194+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.194+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.195+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:06.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.196+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.197+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.197+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.198+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:06.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.199+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.200+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.200+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.201+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:06.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.203+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.203+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.203+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.204+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:06.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.206+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.207+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.207+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.208+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:06.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.209+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.210+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.210+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.211+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:06.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.212+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.212+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.213+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.212 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.213+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:06.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.215+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.215+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.215+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.217+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:06.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.218+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.218+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.219+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.220+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:06.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.221+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.221+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.221+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.222+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:06.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.223+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.224+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.224+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.225+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:06.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.226+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.227+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.227+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.228+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:06.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.229+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.230+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.230+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.231+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:06.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.232+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.232+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.233+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.234+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:06.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.235+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.235+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.236+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.237+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:06.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.238+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.239+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.239+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.240+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:06.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.241+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.241+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.242+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.243+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:06.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.245+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.245+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.246+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.247+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:06.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.248+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.249+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.249+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.250+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:06.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.251+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.252+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.252+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.254+0000 7f942b720800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:06.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.255+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.256+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.256+0000 7f942b720800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.258+0000 7f92ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:06.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.260+0000 7f942b720800 20 remove_watcher() i=0 2024-09-14T11:48:06.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.260+0000 7f942b720800 2 removed watcher, disabling cache 2024-09-14T11:48:06.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.261+0000 7f942b720800 20 remove_watcher() i=1 2024-09-14T11:48:06.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.261+0000 7f942b720800 20 remove_watcher() i=2 2024-09-14T11:48:06.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.262+0000 7f942b720800 20 remove_watcher() i=3 2024-09-14T11:48:06.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.263+0000 7f942b720800 20 remove_watcher() i=4 2024-09-14T11:48:06.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.264+0000 7f942b720800 20 remove_watcher() i=5 2024-09-14T11:48:06.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.265+0000 7f942b720800 20 remove_watcher() i=6 2024-09-14T11:48:06.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.266+0000 7f942b720800 20 remove_watcher() i=7 2024-09-14T11:48:06.275 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:06.326 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:06.326 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:06.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.364+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 20 realm 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.365+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.366+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.366+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.366+0000 7fbe74e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:06.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.366+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.367+0000 7fbe74e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:06.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.367+0000 7fbe74e0f800 20 searching for the correct realm 2024-09-14T11:48:06.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.369+0000 7fbe73101640 0 -- 172.21.15.116:0/4292678448 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fbe5c046bb0 msgr2=0x7fbe5c03fcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:48:06.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.373+0000 7fbe72900640 0 -- 172.21.15.116:0/4292678448 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fbe5c045320 msgr2=0x7fbe5c062950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.579+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 zone default found 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 4 Realm: () 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 zonegroup default 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.580+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.581+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.581+0000 7fbe74e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.581+0000 7fbe74e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.581+0000 7fbe74e0f800 20 started sync module instance, tier type = 2024-09-14T11:48:06.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.581+0000 7fbe74e0f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=0 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=1 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=2 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=3 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=4 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=5 2024-09-14T11:48:06.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=6 2024-09-14T11:48:06.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 20 add_watcher() i=7 2024-09-14T11:48:06.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.590+0000 7fbe74e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:06.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.592+0000 7fbd297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:06.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.592+0000 7fbe74e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:06.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.592+0000 7fbe74e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:06.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.627+0000 7fbca3fff640 20 reqs_thread_entry: start 2024-09-14T11:48:06.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.627+0000 7fbe74e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:06.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.627+0000 7fbe74e0f800 20 Filter name: none 2024-09-14T11:48:06.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.627+0000 7fbca1ffb640 20 reqs_thread_entry: start 2024-09-14T11:48:06.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.627+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:06.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.628+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.629+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.629+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.630+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:06.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.631+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.632+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.632+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.633+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:06.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.634+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.635+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.635+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.636+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:06.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.637+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.637+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.638+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.639+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:06.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.640+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.640+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.641+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.642+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:06.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.643+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.644+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.645+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.646+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:06.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.647+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.647+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.647+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.648+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:06.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.650+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.650+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.650+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.651+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:06.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.653+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.653+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.653+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.655+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:06.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.656+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.656+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.657+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.658+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:06.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.659+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.660+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.660+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.661+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:06.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.663+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.663+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.664+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.664+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:06.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.666+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.667+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.667+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.668+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:06.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.669+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.670+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.670+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.671+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:06.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.672+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.673+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.673+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.674+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:06.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.675+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.675+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.676+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.677+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:06.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.678+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.679+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.679+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.681+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:06.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.682+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.682+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.682+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.684+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:06.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.685+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.685+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.686+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.687+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:06.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.688+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.689+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.689+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.690+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:06.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.691+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.691+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.691+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.692+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:06.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.694+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.694+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.694+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.695+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:06.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.697+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.697+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.697+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.698+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:06.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.699+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.700+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.700+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.701+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:06.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.702+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.703+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.703+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.704+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:06.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.705+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.705+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.706+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.706+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:06.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.708+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.708+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.708+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.709+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:06.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.711+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.712+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.712+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.713+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.714+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.715+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.715+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.716+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:06.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.717+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.718+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.718+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.719+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:06.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.721+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.721+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.722+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.723+0000 7fbe74e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:06.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.724+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.725+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:06.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.725+0000 7fbe74e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:06.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.727+0000 7fbd297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:06.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.729+0000 7fbe74e0f800 20 remove_watcher() i=0 2024-09-14T11:48:06.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.729+0000 7fbe74e0f800 2 removed watcher, disabling cache 2024-09-14T11:48:06.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.730+0000 7fbe74e0f800 20 remove_watcher() i=1 2024-09-14T11:48:06.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.731+0000 7fbe74e0f800 20 remove_watcher() i=2 2024-09-14T11:48:06.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.732+0000 7fbe74e0f800 20 remove_watcher() i=3 2024-09-14T11:48:06.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.733+0000 7fbe74e0f800 20 remove_watcher() i=4 2024-09-14T11:48:06.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.734+0000 7fbe74e0f800 20 remove_watcher() i=5 2024-09-14T11:48:06.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.735+0000 7fbe74e0f800 20 remove_watcher() i=6 2024-09-14T11:48:06.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.736+0000 7fbe74e0f800 20 remove_watcher() i=7 2024-09-14T11:48:06.745 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:06.797 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:06.797 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:06.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.835+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.836+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.836+0000 7fd07df1f800 20 realm 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.836+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.837+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.837+0000 7fd07df1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.837+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.837+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:06.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.837+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.838+0000 7fd07df1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:06.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.838+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:06.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.838+0000 7fd07df1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:06.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:06.838+0000 7fd07df1f800 20 searching for the correct realm 2024-09-14T11:48:07.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.042+0000 7fd0714a8640 0 -- 172.21.15.116:0/356850059 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fd06c038400 msgr2=0x7fd06c038880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:48:07.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.449+0000 7fd079ca9640 0 -- 172.21.15.116:0/356850059 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fd064097900 msgr2=0x7fd06408a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:07.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:07.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:07.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:07.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.657+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:07.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:07.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 zone default found 2024-09-14T11:48:07.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 4 Realm: () 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 zonegroup default 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.658+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.659+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:07.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.659+0000 7fd07df1f800 20 rados->read ofs=0 len=0 2024-09-14T11:48:07.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.659+0000 7fd07df1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:07.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.659+0000 7fd07df1f800 20 started sync module instance, tier type = 2024-09-14T11:48:07.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.659+0000 7fd07df1f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:07.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=0 2024-09-14T11:48:07.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=1 2024-09-14T11:48:07.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=2 2024-09-14T11:48:07.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=3 2024-09-14T11:48:07.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=4 2024-09-14T11:48:07.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=5 2024-09-14T11:48:07.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.669+0000 7fd07df1f800 20 add_watcher() i=6 2024-09-14T11:48:07.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.670+0000 7fd07df1f800 20 add_watcher() i=7 2024-09-14T11:48:07.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.670+0000 7fd07df1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:07.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.672+0000 7fcf2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:07.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.672+0000 7fd07df1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:07.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.672+0000 7fd07df1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.712+0000 7fcf2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:48:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.712+0000 7fd07df1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.712+0000 7fd07df1f800 20 Filter name: none 2024-09-14T11:48:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.712+0000 7fce9bfff640 20 reqs_thread_entry: start 2024-09-14T11:48:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.712+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.714+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.714+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.714+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.715+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:07.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.717+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.717+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.718+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.719+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:07.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.720+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.721+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.721+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.722+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:07.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.723+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.724+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.724+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.726+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:07.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.727+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.728+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.728+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.729+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:07.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.731+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.731+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.731+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.733+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:07.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.734+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.735+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.735+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.736+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:07.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.737+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.738+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.738+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.739+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:07.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.740+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.741+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.742+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.743+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:07.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.744+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.745+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.745+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.746+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:07.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.747+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.748+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.748+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.749+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:07.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.750+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.751+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.751+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.752+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:07.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.753+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.754+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.754+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.755+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:07.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.756+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.757+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.757+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.758+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:07.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.759+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.760+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.760+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.761+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:07.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.762+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.763+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.763+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.764+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:07.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.765+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.766+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.766+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.767+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:07.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.768+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.769+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.769+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.770+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:07.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.772+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.772+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.773+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.774+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:07.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.775+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.775+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.776+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.776+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:07.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.778+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.779+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.779+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.780+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:07.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.781+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.782+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.782+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.783+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:07.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.784+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.784+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.785+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.786+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:07.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.787+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.788+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.788+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.789+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:07.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.790+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.791+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.791+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.792+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:07.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.794+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.794+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.795+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.796+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:07.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.797+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.797+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.798+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.798+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:07.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.800+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.801+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.801+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.802+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:07.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.803+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.803+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.804+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.805+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:07.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.806+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.807+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.807+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.808+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:07.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.809+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.810+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.810+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.811+0000 7fd07df1f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:07.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.812+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.813+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:07.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.813+0000 7fd07df1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:07.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.815+0000 7fcf2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:07.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.817+0000 7fd07df1f800 20 remove_watcher() i=0 2024-09-14T11:48:07.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.817+0000 7fd07df1f800 2 removed watcher, disabling cache 2024-09-14T11:48:07.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.818+0000 7fd07df1f800 20 remove_watcher() i=1 2024-09-14T11:48:07.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.819+0000 7fd07df1f800 20 remove_watcher() i=2 2024-09-14T11:48:07.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.820+0000 7fd07df1f800 20 remove_watcher() i=3 2024-09-14T11:48:07.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.821+0000 7fd07df1f800 20 remove_watcher() i=4 2024-09-14T11:48:07.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.822+0000 7fd07df1f800 20 remove_watcher() i=5 2024-09-14T11:48:07.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.823+0000 7fd07df1f800 20 remove_watcher() i=6 2024-09-14T11:48:07.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:07.824+0000 7fd07df1f800 20 remove_watcher() i=7 2024-09-14T11:48:07.834 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:48:08.321 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :clean 2024-09-14T11:48:09.216 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileJava 2024-09-14T11:48:09.216 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processResources 2024-09-14T11:48:09.217 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :classes 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileTestJava 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :testClasses 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:48:09.618 INFO:teuthology.orchestra.run.smithi116.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :test 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14 11:48:10,855 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:48:11.618 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:48:11.619 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.619 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:48:11.816 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.816 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:48:11.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:11.916 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:48:12.216 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:12.216 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:48:12.416 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:12.416 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:48:12.516 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:12.516 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:48:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:12.716 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:48:13.116 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:13.116 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:48:13.116 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:13.116 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:48:13.216 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:13.216 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:48:13.416 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:13.416 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:48:14.016 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.016 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:48:14.116 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.116 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:48:14.516 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.516 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:48:14.516 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.516 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:48:14.616 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.616 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------- 2024-09-14T11:48:14.616 INFO:teuthology.orchestra.run.smithi116.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:48:14.617 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------- 2024-09-14T11:48:14.638 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout:BUILD SUCCESSFUL in 6s 2024-09-14T11:48:14.639 INFO:teuthology.orchestra.run.smithi116.stdout:5 actionable tasks: 5 executed 2024-09-14T11:48:14.643 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:14.694 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:14.694 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:14.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.733+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 realm 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.735+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.736+0000 7fba1353e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.736+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.736+0000 7fba1353e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:14.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.736+0000 7fba1353e800 20 searching for the correct realm 2024-09-14T11:48:14.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.739+0000 7fba07fff640 0 -- 172.21.15.116:0/4130204698 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fba00074070 msgr2=0x7fba000afba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:14.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.743+0000 7fba0f286640 0 -- 172.21.15.116:0/4130204698 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fb9f802d8d0 msgr2=0x7fb9f80523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.949+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 zone default found 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 4 Realm: () 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 zonegroup default 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.950+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.951+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.951+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.951+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.951+0000 7fba1353e800 20 rados->read ofs=0 len=0 2024-09-14T11:48:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.952+0000 7fba1353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.952+0000 7fba1353e800 20 started sync module instance, tier type = 2024-09-14T11:48:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.952+0000 7fba1353e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=0 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=1 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=2 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=3 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=4 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=5 2024-09-14T11:48:14.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.960+0000 7fba1353e800 20 add_watcher() i=6 2024-09-14T11:48:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.961+0000 7fba1353e800 20 add_watcher() i=7 2024-09-14T11:48:14.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.961+0000 7fba1353e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:14.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.963+0000 7fb8c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:14.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.963+0000 7fba1353e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:14.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.963+0000 7fba1353e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.998+0000 7fb8c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:48:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.998+0000 7fba1353e800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.998+0000 7fba1353e800 20 Filter name: none 2024-09-14T11:48:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.998+0000 7fb83e7fc640 20 reqs_thread_entry: start 2024-09-14T11:48:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:14.999+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.000+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.001+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.001+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.002+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.003+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.004+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.004+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.005+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.006+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.007+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.007+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.008+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:15.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.010+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.010+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.010+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.011+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.013+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.014+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.014+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.015+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.016+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.017+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.017+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.018+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.019+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.019+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.020+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.021+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.022+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.023+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.023+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.024+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.026+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.026+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.026+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.026+0000 7fba1353e800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3014140648568720753', time=2024-09-14T13:48:13.745188+0000, chain.objs.size()=1 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.026+0000 7fba1353e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.72__shadow_.rk5Hx6RWAM68BlAan3gJsKoko0_VRgh_0 2024-09-14T11:48:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.028+0000 7fba1353e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.030+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.032+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.032+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.032+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.033+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.035+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.035+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.036+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.037+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:15.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.038+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.039+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.039+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.040+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.041+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.041+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.042+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:48:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.042+0000 7fba1353e800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255643131196769826', time=2024-09-14T13:48:12.781854+0000, chain.objs.size()=1 2024-09-14T11:48:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.042+0000 7fba1353e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.71__shadow_.MyjCR5z5nUtZkQQw0ZcOHArS-0COu_t_0 2024-09-14T11:48:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.043+0000 7fba1353e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:48:15.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.045+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:15.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.046+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.047+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.047+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.048+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.049+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.049+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.050+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.050+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:15.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.052+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.052+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.052+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.054+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:15.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.055+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.055+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.056+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.057+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.058+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.059+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.059+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.060+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.061+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.062+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.062+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.063+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.064+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.065+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.065+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.066+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.068+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.068+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.068+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.069+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.071+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.072+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.072+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.073+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.075+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.076+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.076+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.077+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:15.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.078+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.079+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.079+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.080+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.081+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.081+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.081+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.082+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.084+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.084+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.084+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.085+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.087+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.087+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.087+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.089+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.090+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.091+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.091+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.092+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.093+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.094+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.094+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.095+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.096+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.096+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.097+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.098+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.099+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.099+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.100+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.101+0000 7fba1353e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.102+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.102+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.103+0000 7fba1353e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.104+0000 7fb8c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.107+0000 7fba1353e800 20 remove_watcher() i=0 2024-09-14T11:48:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.107+0000 7fba1353e800 2 removed watcher, disabling cache 2024-09-14T11:48:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.108+0000 7fba1353e800 20 remove_watcher() i=1 2024-09-14T11:48:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.109+0000 7fba1353e800 20 remove_watcher() i=2 2024-09-14T11:48:15.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.110+0000 7fba1353e800 20 remove_watcher() i=3 2024-09-14T11:48:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.111+0000 7fba1353e800 20 remove_watcher() i=4 2024-09-14T11:48:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.112+0000 7fba1353e800 20 remove_watcher() i=5 2024-09-14T11:48:15.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.112+0000 7fba1353e800 20 remove_watcher() i=6 2024-09-14T11:48:15.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.113+0000 7fba1353e800 20 remove_watcher() i=7 2024-09-14T11:48:15.122 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:15.212 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.214+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 20 realm 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.215+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.216+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.216+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.216+0000 7f836830c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.217+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.217+0000 7f836830c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.217+0000 7f836830c800 20 searching for the correct realm 2024-09-14T11:48:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.218+0000 7f83665fe640 0 -- 172.21.15.116:0/2895903204 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f835c03c040 msgr2=0x7f835c03c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.423+0000 7f83665fe640 0 -- 172.21.15.116:0/2895903204 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f835c016070 msgr2=0x7f835c057920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:15.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:15.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.632+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 zone default found 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 4 Realm: () 2024-09-14T11:48:15.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 zonegroup default 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.633+0000 7f836830c800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.634+0000 7f836830c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.634+0000 7f836830c800 20 started sync module instance, tier type = 2024-09-14T11:48:15.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.634+0000 7f836830c800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=0 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=1 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=2 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=3 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=4 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=5 2024-09-14T11:48:15.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.642+0000 7f836830c800 20 add_watcher() i=6 2024-09-14T11:48:15.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.643+0000 7f836830c800 20 add_watcher() i=7 2024-09-14T11:48:15.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.643+0000 7f836830c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:15.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.645+0000 7f82177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:15.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.645+0000 7f836830c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:15.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.645+0000 7f836830c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:15.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.679+0000 7f82167fc640 20 reqs_thread_entry: start 2024-09-14T11:48:15.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.679+0000 7f836830c800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:15.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.679+0000 7f836830c800 20 Filter name: none 2024-09-14T11:48:15.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.680+0000 7f8187fff640 20 reqs_thread_entry: start 2024-09-14T11:48:15.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.680+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:15.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.681+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.681+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.681+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.683+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.684+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.684+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.685+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.686+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:15.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.687+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.687+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.687+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.688+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:15.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.690+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.690+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.690+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.692+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:15.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.693+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.694+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.694+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.696+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:15.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.697+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.697+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.698+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.699+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.700+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.701+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.701+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.702+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.703+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.703+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.704+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.705+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:15.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.706+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.706+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.707+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.708+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:15.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.709+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.709+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.709+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.710+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:15.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.712+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.712+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.712+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.713+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.714+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.715+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.715+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.716+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:15.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.717+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.718+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.718+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.719+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.720+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.721+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.721+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.722+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.723+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.724+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.724+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.725+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:15.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.727+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.727+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.727+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.728+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:15.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.730+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.730+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.730+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.731+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:15.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.733+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.733+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.733+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.734+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:15.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.735+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.736+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.736+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.737+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:15.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.738+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.739+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.739+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.740+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:15.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.741+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.742+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.742+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.743+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.744+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.745+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.745+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.747+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:15.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.748+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.748+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.748+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.750+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:15.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.751+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.751+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.751+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.752+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:15.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.754+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.754+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.754+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.755+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:15.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.757+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.757+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.757+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.758+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.759+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.760+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.760+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.761+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:15.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.762+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.762+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.763+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.764+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:15.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.765+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.766+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.766+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.767+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:15.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.768+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.768+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.769+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.769+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:15.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.771+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.771+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.771+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.772+0000 7f836830c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:15.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.774+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.774+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.774+0000 7f836830c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.776+0000 7f82177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:15.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.778+0000 7f836830c800 20 remove_watcher() i=0 2024-09-14T11:48:15.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.778+0000 7f836830c800 2 removed watcher, disabling cache 2024-09-14T11:48:15.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.779+0000 7f836830c800 20 remove_watcher() i=1 2024-09-14T11:48:15.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.780+0000 7f836830c800 20 remove_watcher() i=2 2024-09-14T11:48:15.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.781+0000 7f836830c800 20 remove_watcher() i=3 2024-09-14T11:48:15.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.782+0000 7f836830c800 20 remove_watcher() i=4 2024-09-14T11:48:15.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.783+0000 7f836830c800 20 remove_watcher() i=5 2024-09-14T11:48:15.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.784+0000 7f836830c800 20 remove_watcher() i=6 2024-09-14T11:48:15.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.785+0000 7f836830c800 20 remove_watcher() i=7 2024-09-14T11:48:15.793 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:15.845 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:15.846 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:15.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.885+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 realm 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:15.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.886+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.887+0000 7fe25f811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.887+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.887+0000 7fe25f811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:15.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.887+0000 7fe25f811800 20 searching for the correct realm 2024-09-14T11:48:15.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.891+0000 7fe25a747640 0 -- 172.21.15.116:0/3867223465 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55fc43fa0910 msgr2=0x55fc43fa2d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:15.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.894+0000 7fe25af48640 0 -- 172.21.15.116:0/3867223465 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fe250066d80 msgr2=0x7fe250082170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:15.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 zone default found 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 4 Realm: () 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 zonegroup default 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.898+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 rados->read ofs=0 len=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:15.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 started sync module instance, tier type = 2024-09-14T11:48:15.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.899+0000 7fe25f811800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=0 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=1 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=2 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=3 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=4 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=5 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.908+0000 7fe25f811800 20 add_watcher() i=6 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.909+0000 7fe25f811800 20 add_watcher() i=7 2024-09-14T11:48:15.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.909+0000 7fe25f811800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:15.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.910+0000 7fe1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:15.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.910+0000 7fe25f811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:15.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.910+0000 7fe25f811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:15.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.944+0000 7fe08bfff640 20 reqs_thread_entry: start 2024-09-14T11:48:15.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.944+0000 7fe25f811800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:15.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.944+0000 7fe25f811800 20 Filter name: none 2024-09-14T11:48:15.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.944+0000 7fe089ffb640 20 reqs_thread_entry: start 2024-09-14T11:48:15.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.944+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:15.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.946+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.946+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.946+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.947+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:15.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.949+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.949+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.949+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.950+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.951+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.952+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.952+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.953+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:15.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.954+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.955+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.955+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.956+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:15.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.958+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.958+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.958+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.959+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:15.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.961+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.961+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.961+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.962+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:15.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.969+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.970+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.970+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.971+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:15.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.973+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.973+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.973+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.974+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:15.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.975+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.976+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.976+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.977+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:15.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.978+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.979+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.979+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.980+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:15.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.981+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.982+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.982+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.983+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:15.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.985+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.985+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.985+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.986+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:15.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.987+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.988+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.988+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.989+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:15.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.991+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.991+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.991+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.992+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:15.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.993+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.994+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.994+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.995+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:15.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.996+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.997+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.997+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.998+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:15.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:15.999+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.000+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:15.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.000+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:15.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.001+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:16.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.003+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.003+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.003+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.004+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:16.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.006+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.007+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.008+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.009+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:16.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.010+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.010+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.011+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.012+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:16.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.013+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.013+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.014+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.015+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:16.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.016+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.016+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.017+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.017+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:16.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.019+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.019+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.020+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.021+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:16.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.022+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.023+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.023+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.024+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:16.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.025+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.026+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.026+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.027+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:16.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.028+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.029+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.029+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.030+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:16.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.031+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.032+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.032+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.033+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:16.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.034+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.035+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.035+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.036+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:16.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.037+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.038+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.038+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.040+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:16.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.041+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.042+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.042+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.043+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:16.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.045+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.045+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.045+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.046+0000 7fe25f811800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:16.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.047+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.048+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.048+0000 7fe25f811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.050+0000 7fe1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.052+0000 7fe25f811800 20 remove_watcher() i=0 2024-09-14T11:48:16.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.052+0000 7fe25f811800 2 removed watcher, disabling cache 2024-09-14T11:48:16.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.053+0000 7fe25f811800 20 remove_watcher() i=1 2024-09-14T11:48:16.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.054+0000 7fe25f811800 20 remove_watcher() i=2 2024-09-14T11:48:16.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.055+0000 7fe25f811800 20 remove_watcher() i=3 2024-09-14T11:48:16.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.056+0000 7fe25f811800 20 remove_watcher() i=4 2024-09-14T11:48:16.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.056+0000 7fe25f811800 20 remove_watcher() i=5 2024-09-14T11:48:16.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.057+0000 7fe25f811800 20 remove_watcher() i=6 2024-09-14T11:48:16.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.058+0000 7fe25f811800 20 remove_watcher() i=7 2024-09-14T11:48:16.071 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:48:16.123 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:48:16.123 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:48:16.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.161+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.162+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.162+0000 7f40be820800 20 realm 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.162+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:16.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.163+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.164+0000 7f40be820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:48:16.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.164+0000 7f40be820800 20 searching for the correct realm 2024-09-14T11:48:16.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.167+0000 7f40bbb09640 0 -- 172.21.15.116:0/2024010797 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f40ac046030 msgr2=0x7f40ac046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:16.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.170+0000 7f40bbb09640 0 -- 172.21.15.116:0/2024010797 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f3f840870d0 msgr2=0x7f3f84089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:48:16.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:48:16.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.174+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 zone default found 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 4 Realm: () 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 zonegroup default 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados->read ofs=0 len=0 2024-09-14T11:48:16.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:48:16.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 started sync module instance, tier type = 2024-09-14T11:48:16.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.175+0000 7f40be820800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=0 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=1 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=2 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=3 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=4 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=5 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.184+0000 7f40be820800 20 add_watcher() i=6 2024-09-14T11:48:16.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.185+0000 7f40be820800 20 add_watcher() i=7 2024-09-14T11:48:16.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.185+0000 7f40be820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:48:16.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.186+0000 7f3f72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:16.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.187+0000 7f40be820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:48:16.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.187+0000 7f40be820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:48:16.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.220+0000 7f3f71fdb640 20 reqs_thread_entry: start 2024-09-14T11:48:16.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.220+0000 7f40be820800 20 init_complete bucket index max shards: 11 2024-09-14T11:48:16.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.220+0000 7f40be820800 20 Filter name: none 2024-09-14T11:48:16.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.220+0000 7f3ee37fe640 20 reqs_thread_entry: start 2024-09-14T11:48:16.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.220+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:48:16.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.222+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.222+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.223+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.224+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:48:16.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.225+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.226+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.226+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.227+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:48:16.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.229+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.229+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.230+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.231+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:48:16.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.233+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.233+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.234+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.235+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:48:16.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.236+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.236+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.237+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.238+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:48:16.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.239+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.239+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.240+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.241+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:48:16.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.242+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.243+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.243+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.244+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:48:16.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.245+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.246+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.246+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.247+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:48:16.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.248+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.248+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.249+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.249+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:48:16.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.251+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.251+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.251+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.252+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:48:16.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.253+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.254+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.254+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.255+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:48:16.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.257+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.257+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.257+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.258+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:48:16.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.260+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.260+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.260+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.261+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:48:16.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.263+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.263+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.264+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.265+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:48:16.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.266+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.267+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.267+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.268+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:48:16.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.269+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.269+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.269+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.270+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:48:16.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.272+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.272+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.272+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.273+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:48:16.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.275+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.275+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.275+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.276+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:48:16.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.278+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.279+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.279+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.280+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:48:16.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.282+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.282+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.282+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.283+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:48:16.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.285+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.285+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.286+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.287+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:48:16.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.288+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.289+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.289+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.290+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:48:16.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.291+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.292+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.292+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.294+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:48:16.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.295+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.295+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.295+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.297+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:48:16.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.298+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.298+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.298+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.300+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:48:16.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.301+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.301+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.301+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.302+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:48:16.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.303+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.304+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.304+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.305+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:48:16.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.307+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.307+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.307+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.309+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:48:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.310+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.311+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.311+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.312+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:48:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.313+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.314+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.314+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.315+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:48:16.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.316+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.317+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.317+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.318+0000 7f40be820800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:48:16.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.320+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.320+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:48:16.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.320+0000 7f40be820800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:48:16.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.322+0000 7f3f72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:48:16.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.324+0000 7f40be820800 20 remove_watcher() i=0 2024-09-14T11:48:16.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.324+0000 7f40be820800 2 removed watcher, disabling cache 2024-09-14T11:48:16.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.325+0000 7f40be820800 20 remove_watcher() i=1 2024-09-14T11:48:16.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.326+0000 7f40be820800 20 remove_watcher() i=2 2024-09-14T11:48:16.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.327+0000 7f40be820800 20 remove_watcher() i=3 2024-09-14T11:48:16.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.328+0000 7f40be820800 20 remove_watcher() i=4 2024-09-14T11:48:16.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.329+0000 7f40be820800 20 remove_watcher() i=5 2024-09-14T11:48:16.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.330+0000 7f40be820800 20 remove_watcher() i=6 2024-09-14T11:48:16.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:48:16.331+0000 7f40be820800 20 remove_watcher() i=7 2024-09-14T11:48:16.339 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:48:16.831 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :clean 2024-09-14T11:48:17.527 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileJava 2024-09-14T11:48:17.527 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processResources 2024-09-14T11:48:17.527 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :classes 2024-09-14T11:48:18.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:18.027 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :compileTestJava 2024-09-14T11:48:18.027 INFO:teuthology.orchestra.run.smithi116.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:48:18.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:48:18.028 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :testClasses 2024-09-14T11:48:18.028 INFO:teuthology.orchestra.run.smithi116.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:> Task :test 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14 11:48:19,168 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:48:20.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.029 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:48:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.127 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:48:20.127 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.127 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:48:20.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:48:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:20.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:48:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:21.027 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:48:23.427 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:23.427 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:48:23.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:23.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:48:23.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:23.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:48:24.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:24.227 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:48:24.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:24.427 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:48:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:24.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:48:24.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:24.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:48:24.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:24.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:48:25.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:25.028 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:48:25.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:25.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:48:26.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:26.927 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:48:27.327 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:27.327 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:48:27.327 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:27.327 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:48:27.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:27.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:48:27.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:27.826 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:48:28.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:28.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:48:28.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:28.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:48:28.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:28.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:48:28.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:28.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:48:29.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:29.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:48:29.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:29.227 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:48:29.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:29.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:48:29.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:29.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:48:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:30.027 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:48:30.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:30.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:48:30.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:30.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:48:32.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:32.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:48:33.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:48:33.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:49:11.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:11.927 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:49:12.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:12.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:49:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:12.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:49:12.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:12.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:49:13.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:13.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:49:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:13.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:49:15.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:15.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:49:16.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:16.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:49:16.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:16.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:49:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:16.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:49:19.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:19.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:49:20.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:20.027 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:49:24.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:24.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:49:25.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:25.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:49:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:27.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:49:27.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:27.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:49:56.827 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:56.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:49:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:49:57.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:50:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:00.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:50:01.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:01.027 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:50:03.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:03.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:50:03.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:03.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:50:05.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:05.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:50:35.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:35.427 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:50:35.427 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:35.427 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:50:35.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:35.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:50:35.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:35.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:50:36.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:36.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:50:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:36.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:50:36.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:36.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:50:36.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:36.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:50:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:36.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:50:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:37.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:50:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:37.427 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:50:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:37.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:50:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:37.827 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:50:37.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:37.927 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:50:38.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:38.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:50:38.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:38.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:50:39.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:39.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:50:39.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:39.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:50:39.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:39.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:50:39.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:39.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:50:40.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:40.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:50:40.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:40.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:50:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:41.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:50:41.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:41.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:50:41.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:41.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:50:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:41.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:50:42.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:42.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:50:42.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:42.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:50:43.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:43.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:50:43.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:43.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:50:43.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:43.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:50:44.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:44.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:50:44.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:44.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:50:44.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:44.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:50:45.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:45.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:50:45.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:45.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:50:45.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:45.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:50:46.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:46.027 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:50:46.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:46.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:50:46.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:46.627 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:50:47.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:47.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:50:47.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:47.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:50:47.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:47.727 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:50:47.927 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:47.927 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:50:48.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:48.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:50:48.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:48.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:50:49.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:49.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:50:49.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:49.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:50:49.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:49.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:50:49.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:49.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:50:50.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:50.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:50:50.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:50.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:50:51.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:51.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:50:51.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:51.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:50:51.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:51.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:50:51.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:51.826 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:50:52.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:52.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:50:52.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:52.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:50:52.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:52.826 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:50:52.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:52.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:50:53.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:50:53.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:53.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:50:53.726 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:53.726 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:50:53.826 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:53.826 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:50:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:54.226 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:50:54.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:54.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:50:54.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:54.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:50:54.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:54.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:50:55.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:55.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:50:55.327 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:55.327 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:50:55.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:55.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:50:55.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:55.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:50:55.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:55.926 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:50:56.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:56.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:50:56.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:56.526 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:50:56.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:56.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:50:57.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:57.026 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:50:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:57.126 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:50:57.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:57.426 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:50:59.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:50:59.927 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:51:00.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:00.326 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:51:02.626 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:02.626 INFO:teuthology.orchestra.run.smithi116.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:51:03.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:03.026 INFO:teuthology.orchestra.run.smithi116.stdout:---------------------------------------------------------------------- 2024-09-14T11:51:03.026 INFO:teuthology.orchestra.run.smithi116.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:51:03.026 INFO:teuthology.orchestra.run.smithi116.stdout:---------------------------------------------------------------------- 2024-09-14T11:51:03.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:03.057 INFO:teuthology.orchestra.run.smithi116.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:51:03.058 INFO:teuthology.orchestra.run.smithi116.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:51:03.058 INFO:teuthology.orchestra.run.smithi116.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:51:03.058 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:03.058 INFO:teuthology.orchestra.run.smithi116.stdout:BUILD SUCCESSFUL in 2m 46s 2024-09-14T11:51:03.058 INFO:teuthology.orchestra.run.smithi116.stdout:5 actionable tasks: 5 executed 2024-09-14T11:51:03.073 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:51:03.125 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:03.125 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:03.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.366+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 realm 2024-09-14T11:51:03.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:03.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.368+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.369+0000 7f752f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:03.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.369+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.370+0000 7f752f616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:03.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.370+0000 7f752f616800 20 searching for the correct realm 2024-09-14T11:51:03.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.374+0000 7f75225e6640 0 -- 172.21.15.116:0/1569398263 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x557cdc8a7180 msgr2=0x557cdc8a9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:03.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.377+0000 7f75225e6640 0 -- 172.21.15.116:0/1569398263 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f751c018040 msgr2=0x7f751c04c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:03.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:03.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:03.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.381+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 zone default found 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 4 Realm: () 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:03.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 zonegroup default 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.382+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.383+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.383+0000 7f752f616800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.383+0000 7f752f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.383+0000 7f752f616800 20 started sync module instance, tier type = 2024-09-14T11:51:03.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.383+0000 7f752f616800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:03.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=0 2024-09-14T11:51:03.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=1 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=2 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=3 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=4 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=5 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.393+0000 7f752f616800 20 add_watcher() i=6 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.394+0000 7f752f616800 20 add_watcher() i=7 2024-09-14T11:51:03.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.394+0000 7f752f616800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:03.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.395+0000 7f73e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:03.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.396+0000 7f752f616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:03.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.396+0000 7f752f616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:03.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.432+0000 7f735bfff640 20 reqs_thread_entry: start 2024-09-14T11:51:03.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.433+0000 7f752f616800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:03.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.433+0000 7f752f616800 20 Filter name: none 2024-09-14T11:51:03.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.433+0000 7f7359ffb640 20 reqs_thread_entry: start 2024-09-14T11:51:03.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.433+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:51:03.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.434+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13702248325023943175', time=2024-09-14T13:50:42.114467+0000, chain.objs.size()=1 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.117__shadow_.M9AJ_uofm_6ehDaCGvM7plD1sNi-X6M_0 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12497317000330925136', time=2024-09-14T13:50:44.128360+0000, chain.objs.size()=1 2024-09-14T11:51:03.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.120__shadow_.HIXU18jgJWbfNDZbzmQvpgAomYCNgA5_0 2024-09-14T11:51:03.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3595985834395484353', time=2024-09-14T13:50:46.086019+0000, chain.objs.size()=1 2024-09-14T11:51:03.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.123__shadow_.MmeZ-x5BSD9Qm3XpnodxaVwoYfnCl16_0 2024-09-14T11:51:03.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.562717732153286395', time=2024-09-14T13:50:50.077845+0000, chain.objs.size()=1 2024-09-14T11:51:03.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.435+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.129__shadow_.Yb8vIhbO-IB2LZSC0p0Xrj7Z6f_ANor_0 2024-09-14T11:51:03.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.437+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.439+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:51:03.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.440+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9082366452722143387', time=2024-09-14T13:50:44.155174+0000, chain.objs.size()=1 2024-09-14T11:51:03.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.120__shadow_.9Y5P88wm9mfGMLog-e2QnzZPgHdAr4F_0 2024-09-14T11:51:03.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8168996877207357841', time=2024-09-14T13:50:47.997623+0000, chain.objs.size()=1 2024-09-14T11:51:03.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.441+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.126__shadow_.hJVHMAiR3a8Lc_SKpQegz1jjISxqarH_0 2024-09-14T11:51:03.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.443+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.445+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:51:03.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.446+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.446+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:51:03.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5372022192634051557', time=2024-09-14T13:48:26.995305+0000, chain.objs.size()=3 2024-09-14T11:51:03.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.83__shadow_.fe5k3n308q4UdFLgCkhFbq0JWvwD49f_0 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.83__shadow_.fe5k3n308q4UdFLgCkhFbq0JWvwD49f_1 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.83__shadow_.fe5k3n308q4UdFLgCkhFbq0JWvwD49f_2 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7534110951353782505', time=2024-09-14T13:49:12.009394+0000, chain.objs.size()=7 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.1 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.1_1 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.1_2 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.2 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.2_1 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.2_2 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~u6qxr5QFRp_dj8fEdxUHVUL6D9Gqo9h.3 2024-09-14T11:51:03.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2162658793387509333', time=2024-09-14T13:49:15.751443+0000, chain.objs.size()=9 2024-09-14T11:51:03.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__multipart_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.1 2024-09-14T11:51:03.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.447+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__shadow_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.1_1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__multipart_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.2 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__shadow_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.2_1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__multipart_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.3 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__shadow_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.3_1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__multipart_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.4 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__shadow_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.4_1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.98__multipart_key1.2~gNRZiFMZ5vXKs2zn7nWr7XcFLeNygAg.5 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2664867704510674667', time=2024-09-14T13:50:00.715388+0000, chain.objs.size()=9 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__multipart_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.451+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__shadow_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.1_1 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.452+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__multipart_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.2 2024-09-14T11:51:03.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.452+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__shadow_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.2_1 2024-09-14T11:51:03.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.453+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__multipart_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.3 2024-09-14T11:51:03.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__shadow_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.3_1 2024-09-14T11:51:03.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__multipart_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.4 2024-09-14T11:51:03.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__shadow_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.4_1 2024-09-14T11:51:03.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__multipart_key1.2~xAwQ-bjslvW1QxsY1VVsecOQMKMMGO3.5 2024-09-14T11:51:03.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17940985456007634449', time=2024-09-14T13:50:39.387059+0000, chain.objs.size()=1 2024-09-14T11:51:03.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.455+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.113__shadow_.KrO_Gnwev--arGnj4tHBXrjJ2nGhbIn_0 2024-09-14T11:51:03.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.459+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.461+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:51:03.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.462+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4712327383760705643', time=2024-09-14T13:50:39.310053+0000, chain.objs.size()=1 2024-09-14T11:51:03.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.113__shadow_.8nQ2T7wdBpIHSRqk_souUgdA6qsncUa_0 2024-09-14T11:51:03.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6654354353581483517', time=2024-09-14T13:50:47.370264+0000, chain.objs.size()=1 2024-09-14T11:51:03.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.463+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.125__shadow_.j1PWKrAUrseWTEeC7Uq_dpEGcUiZYnF_0 2024-09-14T11:51:03.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.464+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.467+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:51:03.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.468+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.468+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4742488480012323788', time=2024-09-14T13:49:56.703494+0000, chain.objs.size()=7 2024-09-14T11:51:03.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.1 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.1_1 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.1_2 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.2 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.2_1 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.2_2 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~x31H4sHjfoepwcmNkaP2Q8oez6aKToU.3 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2731085994800520728', time=2024-09-14T13:50:40.718693+0000, chain.objs.size()=1 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.115__shadow_.aXOORcwk8ksC16dD1M0jkWXPApahl8F_0 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2138720262236383731', time=2024-09-14T13:50:54.855858+0000, chain.objs.size()=1 2024-09-14T11:51:03.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.469+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.138__shadow_.v2L6Vm1N7VH_ny3SONouauYVoq99khW_0 2024-09-14T11:51:03.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.472+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.474+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:51:03.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.476+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.476+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6839898182276999979', time=2024-09-14T13:49:24.838986+0000, chain.objs.size()=1 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_.VYSkgJFApHSoCDrf0ybXVniefslfD5__0 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7763080924322408469', time=2024-09-14T13:50:38.663414+0000, chain.objs.size()=1 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.112__shadow_.Trp3hWU7Kts7oAByS-U5wOWA59w9ea__0 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16185181275068145294', time=2024-09-14T13:50:39.335980+0000, chain.objs.size()=1 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.113__shadow_.2cySSH6VeMX4fdK7FmnUZl86te_UU6u_0 2024-09-14T11:51:03.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14016133800977602509', time=2024-09-14T13:50:40.744546+0000, chain.objs.size()=1 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.115__shadow_.mwppb28r-CKfaRDkPn6yoIF6RwuIBeM_0 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1381537275830114786', time=2024-09-14T13:50:41.431942+0000, chain.objs.size()=1 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.116__shadow_.qC1sW4_QRsUjLRbwYlHOOOBGSVqQg9s_0 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11593391749553941166', time=2024-09-14T13:50:42.062615+0000, chain.objs.size()=1 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.117__shadow_.VK9c_P57Ot4jZJOe_-SlzV1Rx_doxau_0 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1033336329638266276', time=2024-09-14T13:50:46.112152+0000, chain.objs.size()=1 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.123__shadow_.fpJv5r5pfRZTNSsbLBPxS9Q63j2xGrP_0 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3139998917712844552', time=2024-09-14T13:50:48.690233+0000, chain.objs.size()=1 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.127__shadow_.dYBllOTAORHQ1NB24gZbc9CGJz4ZX1z_0 2024-09-14T11:51:03.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11175873697835888618', time=2024-09-14T13:50:50.698946+0000, chain.objs.size()=1 2024-09-14T11:51:03.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.130__shadow_.3VBi7ziIoeyVDo6ZAT7poYR7Y0QTogT_0 2024-09-14T11:51:03.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10555616384006522831', time=2024-09-14T13:50:53.924826+0000, chain.objs.size()=1 2024-09-14T11:51:03.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.477+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.136__shadow_.z-gqJd1Qn31JQYrF0wNj95WuLtv3WAi_0 2024-09-14T11:51:03.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.479+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.482+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:51:03.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.483+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1319129256939270561', time=2024-09-14T13:49:56.897190+0000, chain.objs.size()=7 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.1 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.1_1 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.1_2 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.2 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.2_1 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.2_2 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~43OGeBZO41GN9Y3gjGaQBgG9bIHNwlV.3 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8536965277305220681', time=2024-09-14T13:50:41.354128+0000, chain.objs.size()=1 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.116__shadow_.tdHBwD1d_KKHajpcqIHL_2Xwae-hyms_0 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10855769329007544984', time=2024-09-14T13:50:46.723365+0000, chain.objs.size()=1 2024-09-14T11:51:03.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.124__shadow_.z11Zp3rpOgREHjecSFd4RQOk32j-aNj_0 2024-09-14T11:51:03.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8903505383441711003', time=2024-09-14T13:50:48.055151+0000, chain.objs.size()=1 2024-09-14T11:51:03.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.126__shadow_.Ec2Bm2HtYfshCmd-IWBwQc5KhwgADRY_0 2024-09-14T11:51:03.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13702734461144023756', time=2024-09-14T13:50:51.299922+0000, chain.objs.size()=1 2024-09-14T11:51:03.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.484+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.131__shadow_.ZpjOh3kz03o3LAZUBIsglzAM7-eE6lW_0 2024-09-14T11:51:03.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.487+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.489+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:51:03.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.490+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.551235236210429407', time=2024-09-14T13:49:42.530618+0000, chain.objs.size()=9 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.1 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.1_1 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.2 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.2_1 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.3 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.3_1 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.4 2024-09-14T11:51:03.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.4_1 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~R2tD7KLxTqmdcN8fbL64LcyZobflrAX.5 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17079633452518780183', time=2024-09-14T13:50:38.637575+0000, chain.objs.size()=1 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.112__shadow_.8gFGDHBzYSX6tpMtG732oe8NZ5aZd-f_0 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5967447632303796948', time=2024-09-14T13:50:40.071745+0000, chain.objs.size()=1 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.114__shadow_.I4vjBCqjsrn0j8jXlQ72rU4IOFaAoB-_0 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9054388176863610181', time=2024-09-14T13:50:50.103804+0000, chain.objs.size()=1 2024-09-14T11:51:03.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.491+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.129__shadow_.JCI49v68FiQY5MeSU_EhK7IwNuZVSry_0 2024-09-14T11:51:03.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.496+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.498+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:51:03.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.499+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.500+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.500+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:51:03.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.500+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17413711157968074052', time=2024-09-14T13:50:43.424956+0000, chain.objs.size()=1 2024-09-14T11:51:03.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.500+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.119__shadow_.GT4s09PYg2TIh0Et41kRwKTjBMuDs9R_0 2024-09-14T11:51:03.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.501+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.503+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:51:03.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.504+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8065556410390988647', time=2024-09-14T13:49:24.812734+0000, chain.objs.size()=9 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.1_1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.2 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.2_1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.3 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.3_1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.4 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.4_1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file2.mpg.2~6azQo2reglU3U7LmuY5c0hagakQ87yu.5 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8415769512967404927', time=2024-09-14T13:49:46.217594+0000, chain.objs.size()=7 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.1_1 2024-09-14T11:51:03.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.505+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.1_2 2024-09-14T11:51:03.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.2 2024-09-14T11:51:03.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.2_1 2024-09-14T11:51:03.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.2_2 2024-09-14T11:51:03.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~7UIhwnx76fPVq8Xc4OtUwUqhu27YkHa.3 2024-09-14T11:51:03.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4901289156997431759', time=2024-09-14T13:50:40.017421+0000, chain.objs.size()=1 2024-09-14T11:51:03.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.508+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.114__shadow_.2spB4KzXkVC07GcNyHpgi02ACZdb7MV_0 2024-09-14T11:51:03.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.510+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.512+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:51:03.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.514+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.514+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.514+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.514+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15435229287762658121', time=2024-09-14T13:49:03.381131+0000, chain.objs.size()=9 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.1 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.1_1 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.2 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.2_1 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.3 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.3_1 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.4 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.4_1 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~BaizLIbKv61IqW29CBI-7NeLPL3NaSt.5 2024-09-14T11:51:03.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3634968656348520802', time=2024-09-14T13:50:46.060904+0000, chain.objs.size()=1 2024-09-14T11:51:03.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.123__shadow_.0zrUrEKeCechMGj0HCxMS5GNqFTSTt6_0 2024-09-14T11:51:03.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8585329124272689272', time=2024-09-14T13:50:52.531304+0000, chain.objs.size()=1 2024-09-14T11:51:03.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.515+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.133__shadow_.6bKRyZ2bfccJuVEK9H1T298qnyyB3jC_0 2024-09-14T11:51:03.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.517+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.519+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:51:03.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.521+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.521+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:15.891281+0000, chain.objs.size()=1 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.20 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:16.421115+0000, chain.objs.size()=76 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.1 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.2 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.3 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.4 2024-09-14T11:51:03.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.5 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.6 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.7 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.8 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.9 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.10 2024-09-14T11:51:03.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.522+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.11 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.12 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.13 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.14 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.15 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.16 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.17 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.18 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.19 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.PRrXdl9Dw97WJCU2lyVUSr6_jZWLHeex.20 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.21 2024-09-14T11:51:03.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.524+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.22 2024-09-14T11:51:03.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.526+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.23 2024-09-14T11:51:03.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.526+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.24 2024-09-14T11:51:03.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.526+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.25 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.526+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.26 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.526+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.27 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.28 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.29 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.30 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.31 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.32 2024-09-14T11:51:03.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.33 2024-09-14T11:51:03.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.527+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.34 2024-09-14T11:51:03.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.528+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.35 2024-09-14T11:51:03.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.528+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.36 2024-09-14T11:51:03.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.37 2024-09-14T11:51:03.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.38 2024-09-14T11:51:03.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.39 2024-09-14T11:51:03.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.40 2024-09-14T11:51:03.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.41 2024-09-14T11:51:03.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.42 2024-09-14T11:51:03.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.43 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.529+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.44 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.530+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.45 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.530+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.46 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.530+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.47 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.530+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.48 2024-09-14T11:51:03.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.530+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.49 2024-09-14T11:51:03.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.531+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.50 2024-09-14T11:51:03.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.531+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.51 2024-09-14T11:51:03.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.52 2024-09-14T11:51:03.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.53 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.54 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.55 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.56 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.57 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.58 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.59 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.532+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.60 2024-09-14T11:51:03.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.534+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.61 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.534+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.62 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.534+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.63 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.534+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.64 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.65 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.66 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.67 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.68 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.69 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.70 2024-09-14T11:51:03.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.71 2024-09-14T11:51:03.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.535+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.72 2024-09-14T11:51:03.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.537+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.73 2024-09-14T11:51:03.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.537+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.74 2024-09-14T11:51:03.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.537+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.75 2024-09-14T11:51:03.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.76 2024-09-14T11:51:03.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:16.784756+0000, chain.objs.size()=10 2024-09-14T11:51:03.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.77 2024-09-14T11:51:03.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.78 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.79 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.80 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.81 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.82 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.83 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.538+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.84 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.539+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.85 2024-09-14T11:51:03.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.539+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.86 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.539+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:18.340443+0000, chain.objs.size()=8 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.539+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.87 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.539+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.88 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.540+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.89 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.540+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.90 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.540+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.91 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.540+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.92 2024-09-14T11:51:03.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.540+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.95 2024-09-14T11:51:03.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.96 2024-09-14T11:51:03.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:19.497310+0000, chain.objs.size()=8 2024-09-14T11:51:03.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.93 2024-09-14T11:51:03.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.94 2024-09-14T11:51:03.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.97 2024-09-14T11:51:03.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.541+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.98 2024-09-14T11:51:03.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.542+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.99 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.100 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.101 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.102 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:20.609905+0000, chain.objs.size()=4 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.103 2024-09-14T11:51:03.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.104 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.105 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.106 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:21.611231+0000, chain.objs.size()=10 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.107 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.108 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.543+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.109 2024-09-14T11:51:03.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.544+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.110 2024-09-14T11:51:03.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.111 2024-09-14T11:51:03.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.112 2024-09-14T11:51:03.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.113 2024-09-14T11:51:03.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.114 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.115 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.116 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:22.381144+0000, chain.objs.size()=5 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.117 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.545+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.118 2024-09-14T11:51:03.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.119 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.120 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.121 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:23.248248+0000, chain.objs.size()=5 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.122 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.546+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.123 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.124 2024-09-14T11:51:03.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.125 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.126 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:24.389109+0000, chain.objs.size()=8 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.127 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.547+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.128 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.548+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.129 2024-09-14T11:51:03.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.548+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.130 2024-09-14T11:51:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.131 2024-09-14T11:51:03.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.132 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.133 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.134 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:25.283114+0000, chain.objs.size()=6 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.135 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.136 2024-09-14T11:51:03.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.550+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.137 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.138 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.139 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.140 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:26.497632+0000, chain.objs.size()=9 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.141 2024-09-14T11:51:03.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.142 2024-09-14T11:51:03.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.143 2024-09-14T11:51:03.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.551+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.144 2024-09-14T11:51:03.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.552+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.145 2024-09-14T11:51:03.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.552+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.146 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.147 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.148 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.149 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:27.942653+0000, chain.objs.size()=9 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.150 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.151 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.553+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.152 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.554+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.153 2024-09-14T11:51:03.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.554+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.154 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.554+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.155 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.554+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.156 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.554+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.157 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.555+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.159 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.555+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:28.723933+0000, chain.objs.size()=7 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.555+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.158 2024-09-14T11:51:03.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.555+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.160 2024-09-14T11:51:03.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.555+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.161 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.162 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.163 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.164 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.165 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:29.851514+0000, chain.objs.size()=5 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.166 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.167 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.556+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.168 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.557+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.169 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.557+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.170 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.557+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:31.063588+0000, chain.objs.size()=7 2024-09-14T11:51:03.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.557+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.171 2024-09-14T11:51:03.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.557+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.172 2024-09-14T11:51:03.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.173 2024-09-14T11:51:03.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.174 2024-09-14T11:51:03.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.175 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.176 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.177 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:35.136970+0000, chain.objs.size()=1 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.558+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.20 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv', time=2024-09-14T13:50:35.279829+0000, chain.objs.size()=212 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.1 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.2 2024-09-14T11:51:03.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.3 2024-09-14T11:51:03.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.4 2024-09-14T11:51:03.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.5 2024-09-14T11:51:03.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.559+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.6 2024-09-14T11:51:03.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.560+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.7 2024-09-14T11:51:03.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.8 2024-09-14T11:51:03.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.9 2024-09-14T11:51:03.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.10 2024-09-14T11:51:03.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.11 2024-09-14T11:51:03.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.12 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.13 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.14 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.15 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.16 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.17 2024-09-14T11:51:03.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.561+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.18 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.19 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.PRrXdl9Dw97WJCU2lyVUSr6_jZWLHeex.20 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.21 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.22 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.23 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.24 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.25 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.26 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.27 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.28 2024-09-14T11:51:03.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.563+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.29 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.30 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.31 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.32 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.33 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.34 2024-09-14T11:51:03.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.564+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.35 2024-09-14T11:51:03.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.565+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.36 2024-09-14T11:51:03.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.565+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.37 2024-09-14T11:51:03.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.565+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.38 2024-09-14T11:51:03.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.565+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.39 2024-09-14T11:51:03.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.565+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.40 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.41 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.42 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.43 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.44 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.45 2024-09-14T11:51:03.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.46 2024-09-14T11:51:03.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.47 2024-09-14T11:51:03.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.48 2024-09-14T11:51:03.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.49 2024-09-14T11:51:03.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.566+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.50 2024-09-14T11:51:03.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.567+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.51 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.52 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.53 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.54 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.55 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.56 2024-09-14T11:51:03.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.57 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.58 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.59 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.60 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.61 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.568+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.62 2024-09-14T11:51:03.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.569+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.63 2024-09-14T11:51:03.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.64 2024-09-14T11:51:03.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.65 2024-09-14T11:51:03.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.66 2024-09-14T11:51:03.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.67 2024-09-14T11:51:03.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.68 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.69 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.70 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.71 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.72 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.570+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.73 2024-09-14T11:51:03.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.571+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.74 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.75 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.76 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.77 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.78 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.79 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.80 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.572+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.81 2024-09-14T11:51:03.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.82 2024-09-14T11:51:03.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.83 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.84 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.85 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.86 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.87 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.88 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.89 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.573+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.90 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.574+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.91 2024-09-14T11:51:03.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.574+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.92 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.93 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.94 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.95 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.96 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.97 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.98 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.99 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.100 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.101 2024-09-14T11:51:03.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.102 2024-09-14T11:51:03.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.575+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.103 2024-09-14T11:51:03.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.576+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.104 2024-09-14T11:51:03.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.577+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.105 2024-09-14T11:51:03.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.577+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.106 2024-09-14T11:51:03.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.577+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.107 2024-09-14T11:51:03.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.577+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.108 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.109 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.110 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.111 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.112 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.113 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.114 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.115 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.116 2024-09-14T11:51:03.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.117 2024-09-14T11:51:03.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.118 2024-09-14T11:51:03.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.578+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.119 2024-09-14T11:51:03.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.120 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.121 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.122 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.123 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.124 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.579+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.125 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.580+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.126 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.580+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.127 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.580+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.128 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.580+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.129 2024-09-14T11:51:03.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.580+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.130 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.581+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.131 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.132 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.133 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.134 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.135 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.136 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.137 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.138 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.139 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.140 2024-09-14T11:51:03.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.582+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.141 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.142 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.143 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.144 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.145 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.146 2024-09-14T11:51:03.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.147 2024-09-14T11:51:03.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.583+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.148 2024-09-14T11:51:03.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.584+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.149 2024-09-14T11:51:03.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.584+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.150 2024-09-14T11:51:03.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.584+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.151 2024-09-14T11:51:03.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.584+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.152 2024-09-14T11:51:03.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.585+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.153 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.154 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.155 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.156 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.157 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.158 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.159 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.160 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.161 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.162 2024-09-14T11:51:03.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.586+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.163 2024-09-14T11:51:03.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.164 2024-09-14T11:51:03.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.165 2024-09-14T11:51:03.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.166 2024-09-14T11:51:03.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.167 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.168 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.169 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.587+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.170 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.588+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.171 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.588+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.172 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.588+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.173 2024-09-14T11:51:03.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.588+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.174 2024-09-14T11:51:03.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.175 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.176 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.177 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.178 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.179 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.180 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.181 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.182 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.183 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.589+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.184 2024-09-14T11:51:03.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.590+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.185 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.186 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.187 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.188 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.189 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.190 2024-09-14T11:51:03.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.191 2024-09-14T11:51:03.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.192 2024-09-14T11:51:03.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.591+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.193 2024-09-14T11:51:03.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.592+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.194 2024-09-14T11:51:03.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.592+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.195 2024-09-14T11:51:03.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.592+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.196 2024-09-14T11:51:03.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.592+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.197 2024-09-14T11:51:03.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.593+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.198 2024-09-14T11:51:03.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.199 2024-09-14T11:51:03.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.200 2024-09-14T11:51:03.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.201 2024-09-14T11:51:03.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.202 2024-09-14T11:51:03.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.203 2024-09-14T11:51:03.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.594+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.204 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.205 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.206 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.207 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.208 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.209 2024-09-14T11:51:03.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.210 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.211 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.595+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.105__multipart_key1.2~bJVxD_-WsGCrze-0yVzWTptnZ9uZ-rv.212 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.596+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7545033273950941284', time=2024-09-14T13:50:46.697518+0000, chain.objs.size()=1 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.596+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.124__shadow_.MgdZYLC4tXbTluk5zOIO4EC_9yVsSZI_0 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.596+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3506945470522588725', time=2024-09-14T13:50:54.770531+0000, chain.objs.size()=1 2024-09-14T11:51:03.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.596+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.138__shadow_.tBjN4_aBcGIiP8F8zV9K9KLix00pppR_0 2024-09-14T11:51:03.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.598+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.599 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.600+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:51:03.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3044573264040130759', time=2024-09-14T13:48:24.531102+0000, chain.objs.size()=1 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.81__shadow_.NF0MclwO_cJwHBvd7HVs2YTvaZOtdjU_0 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15318802814838693096', time=2024-09-14T13:50:03.185809+0000, chain.objs.size()=9 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__multipart_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.1 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__shadow_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.1_1 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__multipart_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.2 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.602+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__shadow_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.2_1 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.603+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__multipart_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.3 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.603+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__shadow_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.3_1 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.603+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__multipart_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.4 2024-09-14T11:51:03.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.603+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__shadow_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.4_1 2024-09-14T11:51:03.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.603+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.104__multipart_key1.2~4MBVNcw6EXUgB6LmnKJ_c-lCu-IqqyJ.5 2024-09-14T11:51:03.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.606+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.608+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:51:03.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.609+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.609+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17224161315354765257', time=2024-09-14T13:49:11.815535+0000, chain.objs.size()=7 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.1 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.1_1 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.1_2 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.2 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.2_1 2024-09-14T11:51:03.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.2_2 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~zjEN9VGlvIi95bfSihzB84IcqNGe6AF.3 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12720024892043222904', time=2024-09-14T13:50:40.043513+0000, chain.objs.size()=1 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.114__shadow_.EvZEXzIKB39cbC1iFHdSG9N_-mWvkt4_0 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6927560613221646392', time=2024-09-14T13:50:44.075521+0000, chain.objs.size()=1 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.120__shadow_.Botup6ilNJwpyFpvjwQBc6DmCAXafaa_0 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12479741802934986227', time=2024-09-14T13:50:46.671842+0000, chain.objs.size()=1 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.124__shadow_.4gr-eh7r05bImPkg_K5i0c-kkE6N9Ld_0 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1148726502596080750', time=2024-09-14T13:50:51.968171+0000, chain.objs.size()=1 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.132__shadow_.t1StPo_p0brSLYtBgGuEeO831UFtpdf_0 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6027467437415729955', time=2024-09-14T13:50:56.189610+0000, chain.objs.size()=1 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.610+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.140__shadow_.Jqbn29Q6rHgSqMfG6LsopSv4sR_Fhmo_0 2024-09-14T11:51:03.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.611+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13198334706566081075', time=2024-09-14T13:51:02.747978+0000, chain.objs.size()=1 2024-09-14T11:51:03.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.611+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__shadow_.BuPFcjEXBaCEiJJYNlEL0CR-yzjHlkQ_0 2024-09-14T11:51:03.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.614+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.616+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:51:03.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.617+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.617+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9705126824359679539', time=2024-09-14T13:48:33.152940+0000, chain.objs.size()=9 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.1 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.1_1 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.2 2024-09-14T11:51:03.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.2_1 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.3 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.3_1 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.4 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.4_1 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.5 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1476216320905286369', time=2024-09-14T13:49:24.757228+0000, chain.objs.size()=9 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.1 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.1_1 2024-09-14T11:51:03.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.618+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.2 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.2_1 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.3 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.3_1 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.4 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.4_1 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__multipart_file.mpg.2~yuvOVUzGFLq4HHvkITvGBjr1ufAyY5i.5 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9276187751046754387', time=2024-09-14T13:50:40.666708+0000, chain.objs.size()=1 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.115__shadow_.b6pw94q2x3YsQwn-hU-aR35J34s3pKt_0 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5137583573254034078', time=2024-09-14T13:50:44.823010+0000, chain.objs.size()=1 2024-09-14T11:51:03.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.620+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.121__shadow_.7vlP4ZKVOXdQhjof5S1FH5gUnmlBIuu_0 2024-09-14T11:51:03.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.623+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.625+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:51:03.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.626+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4271928189312126503', time=2024-09-14T13:49:44.275299+0000, chain.objs.size()=9 2024-09-14T11:51:03.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.1 2024-09-14T11:51:03.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.1_1 2024-09-14T11:51:03.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.2 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.2_1 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.3 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.3_1 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.4 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.4_1 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~11bjPxvTl5IC7CKdHNDoxsMkklOnmDh.5 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6161381124642074479', time=2024-09-14T13:50:38.714030+0000, chain.objs.size()=1 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.112__shadow_.mzmeB67ghFbJuB0jbe5wxVT0-VS_k_n_0 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7892407297175805837', time=2024-09-14T13:50:42.036800+0000, chain.objs.size()=1 2024-09-14T11:51:03.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.627+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.117__shadow_._cxwv4Bw_rKgtw1uhO6YQD2UluhS0vk_0 2024-09-14T11:51:03.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.631+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.633+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:51:03.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.634+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.634+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5962921468006265773', time=2024-09-14T13:48:27.454083+0000, chain.objs.size()=1 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.84__shadow_.gVkKQ_CyYOe9Za6nmQX1PaPuyPpLL_R_0 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5059702963923398621', time=2024-09-14T13:49:06.216149+0000, chain.objs.size()=9 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.1 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.1_1 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.2 2024-09-14T11:51:03.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.2_1 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.3 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.3_1 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.4 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.4_1 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~989AYcAirBfTRsUxg3L1R49aoMzDeab.5 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9277441191226242739', time=2024-09-14T13:50:42.787858+0000, chain.objs.size()=1 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.118__shadow_.WThbOXY-DQo3JCJdCIdOVSF6GYbUHhD_0 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2613398739393018544', time=2024-09-14T13:50:48.024734+0000, chain.objs.size()=1 2024-09-14T11:51:03.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.635+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.126__shadow_.i4FzhVPIzu5pAbbw0FsUNkR14-nvxTM_0 2024-09-14T11:51:03.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.637+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5296336382454044679', time=2024-09-14T13:50:49.408968+0000, chain.objs.size()=1 2024-09-14T11:51:03.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.637+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.128__shadow_.bBLLADPbwpo4hV6GLdQaeSpDN29KwCH_0 2024-09-14T11:51:03.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.637+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2739461510710280627', time=2024-09-14T13:50:52.557559+0000, chain.objs.size()=1 2024-09-14T11:51:03.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.637+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.133__shadow_.VCiF8TOcVfgyTOMW-uO36bZJrjZ_9R4_0 2024-09-14T11:51:03.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.639+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.641+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:51:03.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.642+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.642+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5980055418484093160', time=2024-09-14T13:49:24.782329+0000, chain.objs.size()=1 2024-09-14T11:51:03.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_.S2SpzZ2jZiCqs49LtcwICUkhuSG2XrS_0 2024-09-14T11:51:03.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5213687765914829387', time=2024-09-14T13:50:48.741888+0000, chain.objs.size()=1 2024-09-14T11:51:03.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.127__shadow_.MAhyxkLgw3siuDC-diCHIZleaKdIwV2_0 2024-09-14T11:51:03.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14034318040239564901', time=2024-09-14T13:50:54.367000+0000, chain.objs.size()=1 2024-09-14T11:51:03.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.643+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.137__shadow_.Jrn7tF0pvwX-mRPzz6Vu4UBI_xHnTAG_0 2024-09-14T11:51:03.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.644+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.646+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:51:03.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.647+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1120246929264268783', time=2024-09-14T13:48:20.259267+0000, chain.objs.size()=1 2024-09-14T11:51:03.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.77__shadow_.-UpRXc42jb03D-_hcMkftBv7IEtrpGd_0 2024-09-14T11:51:03.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11937693380388021454', time=2024-09-14T13:50:44.772777+0000, chain.objs.size()=1 2024-09-14T11:51:03.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.648+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.121__shadow_.rlrhv0WEKt030FWmYOifsWWDxOOB1RC_0 2024-09-14T11:51:03.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.649+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.651+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:51:03.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8226035283817701099', time=2024-09-14T13:50:35.738728+0000, chain.objs.size()=1 2024-09-14T11:51:03.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.106__shadow_.TfE1RQ6RjMBJpiCMurhJ6iS0VWwgJNm_0 2024-09-14T11:51:03.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13862629830780133414', time=2024-09-14T13:50:51.325711+0000, chain.objs.size()=1 2024-09-14T11:51:03.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.653+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.131__shadow_.WTkYUpyFX3tvoknkh4eQ5BTHb5dljfx_0 2024-09-14T11:51:03.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.656+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.658+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:51:03.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.659+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10428109835249605294', time=2024-09-14T13:48:59.881747+0000, chain.objs.size()=9 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.1 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.1_1 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.2 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.2_1 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.3 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.3_1 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.4 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.4_1 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~Bt9Unnio2ma-AauFPSDONylY_SB-hP7.5 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8030155655701282377', time=2024-09-14T13:49:40.114180+0000, chain.objs.size()=9 2024-09-14T11:51:03.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.1 2024-09-14T11:51:03.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.1_1 2024-09-14T11:51:03.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.660+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.2 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.2_1 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.3 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.3_1 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.4 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__shadow_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.4_1 2024-09-14T11:51:03.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.664+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.102__multipart_key1.2~EDdCNLSnAQ7nV1UZa7qaAgGcYWW76kX.5 2024-09-14T11:51:03.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.665+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14637996285495685318', time=2024-09-14T13:50:49.383284+0000, chain.objs.size()=1 2024-09-14T11:51:03.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.665+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.128__shadow_.cW47Shyt7iDE93x0xL-MchDJBY--bNp_0 2024-09-14T11:51:03.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.665+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3947026708201563525', time=2024-09-14T13:50:50.052006+0000, chain.objs.size()=1 2024-09-14T11:51:03.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.665+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.129__shadow_.aAQrkFJ_iCB8Qcy6dPh54teYT7miEXY_0 2024-09-14T11:51:03.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.667+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.669+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:51:03.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15287203206818547059', time=2024-09-14T13:48:27.908537+0000, chain.objs.size()=1 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.85__shadow_.PYYdjSOLrG1FH87RG9veY_H0Iz_JEq__0 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13856448207775777316', time=2024-09-14T13:48:32.869661+0000, chain.objs.size()=9 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.1 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.1_1 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.2 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.2_1 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.3 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.3_1 2024-09-14T11:51:03.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.4 2024-09-14T11:51:03.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__shadow_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.4_1 2024-09-14T11:51:03.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.91__multipart_key1.2~xiUE34PGTMZ9GZfos_G9tcLuDucBWg6.5 2024-09-14T11:51:03.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2990083092204987626', time=2024-09-14T13:50:47.395787+0000, chain.objs.size()=1 2024-09-14T11:51:03.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.671+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.125__shadow_.O5jxuLO3DuNWGFR6OipClj1E5zoWMvb_0 2024-09-14T11:51:03.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.675+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.677+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:51:03.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.678+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:51:03.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13546520435569719627', time=2024-09-14T13:49:59.641660+0000, chain.objs.size()=1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.103__shadow_.1_EHKE6dQE7U2yHDWuGWZETJKrdD0e0_0 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9181319942829230944', time=2024-09-14T13:50:42.736513+0000, chain.objs.size()=1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.118__shadow_.yJYjkz87BsEojWlG27_EcJ8QgMjhGpQ_0 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.957204777821699747', time=2024-09-14T13:50:42.763035+0000, chain.objs.size()=1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.118__shadow_.CYBtb-87RStlDwVa2EQ2FL270oGx5y1_0 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15219517018363974254', time=2024-09-14T13:50:51.943108+0000, chain.objs.size()=1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.132__shadow_.oIOePVsMyz4oKWyPDMlUO2Y_B98-arD_0 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11621339674788572123', time=2024-09-14T13:51:00.023104+0000, chain.objs.size()=9 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__multipart_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__shadow_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.1_1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__multipart_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.2 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__shadow_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.2_1 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__multipart_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.3 2024-09-14T11:51:03.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__shadow_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.3_1 2024-09-14T11:51:03.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__multipart_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.4 2024-09-14T11:51:03.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.679+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__shadow_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.4_1 2024-09-14T11:51:03.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.681+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.143__multipart_key1.2~WxaqWFQzGge_jPWwZM7xR74gksVzrjy.5 2024-09-14T11:51:03.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.683+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.685+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:51:03.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.686+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17679856708850893502', time=2024-09-14T13:50:44.797669+0000, chain.objs.size()=1 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.121__shadow_.mBDib_cloBwOGg97kzN_6mWxGwkfiY4_0 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4167052397617901669', time=2024-09-14T13:50:45.490883+0000, chain.objs.size()=1 2024-09-14T11:51:03.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.687+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.122__shadow_.OC7ajz5A6uWW-N_Bxy_deh0n8DHnI8R_0 2024-09-14T11:51:03.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.689+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.691+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:51:03.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.692+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3508098143538320958', time=2024-09-14T13:49:12.280559+0000, chain.objs.size()=6 2024-09-14T11:51:03.692 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_0 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_1 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_2 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_3 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_4 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.93__shadow_.X1XmK4lQgpRi0o7sr5rV2RnRJ4Uqrti_5 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M', time=2024-09-14T13:49:27.379262+0000, chain.objs.size()=9 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__multipart_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.7 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__shadow_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.7_1 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__multipart_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.8 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__shadow_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.8_1 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__multipart_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.9 2024-09-14T11:51:03.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.693+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__shadow_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.9_1 2024-09-14T11:51:03.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.696+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__multipart_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.10 2024-09-14T11:51:03.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.697+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__shadow_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.10_1 2024-09-14T11:51:03.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.697+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101__multipart_key1.2~IdkRJx_jxtjQ6g7KtSwHly0nxfDkf1M.11 2024-09-14T11:51:03.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.697+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9244150896901840767', time=2024-09-14T13:50:52.583457+0000, chain.objs.size()=1 2024-09-14T11:51:03.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.697+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.133__shadow_.af26bdgrmHMvNNTTLKJZ9tOhurWYlQz_0 2024-09-14T11:51:03.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.699+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.701+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:51:03.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.702+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:51:03.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6172685401669820644', time=2024-09-14T13:49:09.027503+0000, chain.objs.size()=7 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.1_1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.1_2 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.2 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.2_1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__shadow_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.2_2 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.94__multipart_key1.2~TFJuVwUTEhx13Nee-xzMPr_UQPWW-kV.3 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17844339766524995525', time=2024-09-14T13:49:19.704815+0000, chain.objs.size()=9 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__multipart_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__shadow_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.1_1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__multipart_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.2 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__shadow_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.2_1 2024-09-14T11:51:03.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.703+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__multipart_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.3 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__shadow_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.3_1 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__multipart_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.4 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__shadow_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.4_1 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99__multipart_key1.2~Hj5H8iSxzdj38BKxFJKO59aU2iNoqVH.5 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16035027841520149830', time=2024-09-14T13:50:39.991665+0000, chain.objs.size()=1 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.114__shadow_.GcsB4PEse_avfEWPNUJE6awaHdfNigD_0 2024-09-14T11:51:03.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16706246333247540819', time=2024-09-14T13:50:41.380364+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.116__shadow_.EVAYKC63uBat8bYudS8BxVZP3jP_f3h_0 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18291225535484758121', time=2024-09-14T13:50:44.101551+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.120__shadow_._pBIWkfNCWXImwlg1cuqP_lCu2sfZI9_0 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.178557721956426610', time=2024-09-14T13:50:44.746183+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.121__shadow_.JIGLGYjBxkCChPceVWwNvnEgW7l8aLg_0 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16275577517039637827', time=2024-09-14T13:50:45.465186+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.122__shadow_.IIE4QpKdhwql1kso352Lk5_aO_pej5B_0 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7330430680313902878', time=2024-09-14T13:50:50.672831+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.130__shadow_.NdQQ5ZXAY1ElSS7ZsSp4CxcdP6KcUYk_0 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6333271890639250638', time=2024-09-14T13:50:50.724627+0000, chain.objs.size()=1 2024-09-14T11:51:03.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.708+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.130__shadow_.1Dnsga1TO_XUfhwcrB_uxjqi-yjrDOg_0 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6530516654728719148', time=2024-09-14T13:51:02.721412+0000, chain.objs.size()=9 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__multipart_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.1 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__shadow_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.1_1 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__multipart_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.2 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__shadow_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.2_1 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__multipart_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.3 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__shadow_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.3_1 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__multipart_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.4 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__shadow_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.4_1 2024-09-14T11:51:03.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.711+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144__multipart_key1/data/file.mpg.2~0tdK8WDkKG0hWGbIkAY-QdTYvn4T6b-.5 2024-09-14T11:51:03.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.714+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.716+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:51:03.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.717+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:51:03.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4801312735114496770', time=2024-09-14T13:50:47.318289+0000, chain.objs.size()=1 2024-09-14T11:51:03.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.125__shadow_.WX-qLz-WJdJpd1FpVoNmVmH_kLL6fLX_0 2024-09-14T11:51:03.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5112032992970257301', time=2024-09-14T13:50:48.715513+0000, chain.objs.size()=1 2024-09-14T11:51:03.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.127__shadow_.5r_5lrx2HerLv21RSDKskuN5P9-713r_0 2024-09-14T11:51:03.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5565004675134169885', time=2024-09-14T13:50:51.917387+0000, chain.objs.size()=1 2024-09-14T11:51:03.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.718+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.132__shadow_.uykh9W5v7_lm-j7CrFFQxz-IAe04wZA_0 2024-09-14T11:51:03.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.720+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.722+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:51:03.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.723+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.723+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.723+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:51:03.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.723+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17739405283643390201', time=2024-09-14T13:50:40.693009+0000, chain.objs.size()=1 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.723+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.115__shadow_.jTxbnLj9sisD-lBxXe7aMb8bgY13d-M_0 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9193493042705316355', time=2024-09-14T13:50:42.088090+0000, chain.objs.size()=1 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.117__shadow_.jJNKtWBYidO18BExHZcp0_TDCmivHUI_0 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5236210467197228489', time=2024-09-14T13:50:42.709923+0000, chain.objs.size()=1 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.118__shadow_.2aBLCdjkHXAuF44v8NJdVw6-CvbLrDV_0 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.938632137332790063', time=2024-09-14T13:50:47.343534+0000, chain.objs.size()=1 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.125__shadow_.3huxtt4dauZMgJ0Jd5qGBxxz4eVyD-C_0 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7798077223071764013', time=2024-09-14T13:50:55.682769+0000, chain.objs.size()=1 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.724+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.139__shadow_.XyUpR0Ci0jGXWJHHPnP5YoKBkme1Wog_0 2024-09-14T11:51:03.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.725+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.727+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:51:03.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.728+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.728+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18377257274845304060', time=2024-09-14T13:48:30.046426+0000, chain.objs.size()=1 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.90__shadow_.3-O8HOQBrm9aZecDmjiUAaG9O5-9ouV_0 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.757847809596542297', time=2024-09-14T13:50:39.361075+0000, chain.objs.size()=1 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.113__shadow_.31sytjqHU7dh32tfbiDZop5NndguvHl_0 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2726597995881023463', time=2024-09-14T13:50:45.440404+0000, chain.objs.size()=1 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.122__shadow_.5gbBzj15rPBLc_Ei-KL54fEpcPPl_YK_0 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16814707604583332455', time=2024-09-14T13:50:48.767927+0000, chain.objs.size()=1 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.127__shadow_.ogW6bfr4EIYUzt4NQoeYz4qIB84xU-A_0 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6567527416278128984', time=2024-09-14T13:50:50.025561+0000, chain.objs.size()=1 2024-09-14T11:51:03.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.729+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.129__shadow_.CtSorsBTkWvOY7vzvsoFKXTpnu3HllO_0 2024-09-14T11:51:03.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.730+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.732+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:51:03.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.733+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q', time=2024-09-14T13:48:23.389487+0000, chain.objs.size()=9 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__multipart_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__shadow_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.1_1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__multipart_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.2 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__shadow_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.2_1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__multipart_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.3 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__shadow_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.3_1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__multipart_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.4 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__shadow_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.4_1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.734+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.79__multipart_key1.2~R7yjPI0fFZW9TzYnYIjjHLa1DuHbO_Q.5 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17469537734367706286', time=2024-09-14T13:49:24.864830+0000, chain.objs.size()=1 2024-09-14T11:51:03.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.100__shadow_.zEuTmi8Ova69sJyTMLWp-0lBJ0X4rx__0 2024-09-14T11:51:03.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4259160410053080885', time=2024-09-14T13:50:41.405922+0000, chain.objs.size()=1 2024-09-14T11:51:03.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.116__shadow_.Yi3pW5GN8saibYqLq-NVrwjx4Uq69oX_0 2024-09-14T11:51:03.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13542496462105638855', time=2024-09-14T13:50:45.414353+0000, chain.objs.size()=1 2024-09-14T11:51:03.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.735+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.122__shadow_.nUI14KUy-CyW2ko-1S9CZ02Vpu9046k_0 2024-09-14T11:51:03.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.738+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.740+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:51:03.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.742+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.742+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.743+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:51:03.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.743+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15181178188846817057', time=2024-09-14T13:50:43.399066+0000, chain.objs.size()=1 2024-09-14T11:51:03.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.743+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.119__shadow_.gJTrnpfporXG563bzlueyu9ex6Vd7dI_0 2024-09-14T11:51:03.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.743+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7842629806495038288', time=2024-09-14T13:50:48.081274+0000, chain.objs.size()=1 2024-09-14T11:51:03.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.743+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.126__shadow_.Kfs6Bzh1BRdS0gWTxYC8e-5LEielUX-_0 2024-09-14T11:51:03.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.744+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.746+0000 7f752f616800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:51:03.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.747+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11362127561048732247', time=2024-09-14T13:50:38.688916+0000, chain.objs.size()=1 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.112__shadow_.TnmZ_Z2lKMyWLfHAR9VgVl_WkkyN2Ai_0 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6690999917646340726', time=2024-09-14T13:50:43.450719+0000, chain.objs.size()=1 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.119__shadow_.s1U-WrebiygwzXzqHfcgkluuEr7Ar6w_0 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6033484368610328677', time=2024-09-14T13:50:43.479657+0000, chain.objs.size()=1 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.119__shadow_.auvq-puTkItcIVXj5Vfr1A9viQDtDqn_0 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2131815361079423621', time=2024-09-14T13:50:49.356592+0000, chain.objs.size()=1 2024-09-14T11:51:03.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.128__shadow_.UewV9C4YOFwz2-YqmXSbhFGt7D7uS23_0 2024-09-14T11:51:03.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12444269566545201399', time=2024-09-14T13:50:49.434962+0000, chain.objs.size()=1 2024-09-14T11:51:03.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.128__shadow_.RAl6t7Jn-FjqwX11LNyWZ2Rq1QvFk5k_0 2024-09-14T11:51:03.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1055646035383218673', time=2024-09-14T13:50:51.351656+0000, chain.objs.size()=1 2024-09-14T11:51:03.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.748+0000 7f752f616800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.131__shadow_.LSZ_rBKwe5r7gaYVVijOd6lq2cBGmZU_0 2024-09-14T11:51:03.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.750+0000 7f752f616800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:51:03.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.753+0000 7f73e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:03.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.755+0000 7f752f616800 20 remove_watcher() i=0 2024-09-14T11:51:03.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.755+0000 7f752f616800 2 removed watcher, disabling cache 2024-09-14T11:51:03.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.756+0000 7f752f616800 20 remove_watcher() i=1 2024-09-14T11:51:03.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.757+0000 7f752f616800 20 remove_watcher() i=2 2024-09-14T11:51:03.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.758+0000 7f752f616800 20 remove_watcher() i=3 2024-09-14T11:51:03.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.759+0000 7f752f616800 20 remove_watcher() i=4 2024-09-14T11:51:03.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.760+0000 7f752f616800 20 remove_watcher() i=5 2024-09-14T11:51:03.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.761+0000 7f752f616800 20 remove_watcher() i=6 2024-09-14T11:51:03.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.761+0000 7f752f616800 20 remove_watcher() i=7 2024-09-14T11:51:03.771 DEBUG:teuthology.orchestra.run.smithi116:> radosgw-admin gc process --include-all 2024-09-14T11:51:03.863 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:03.863 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:03.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.901+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.902+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.902+0000 7f79df9a7800 20 realm 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.902+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.903+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.903+0000 7f79df9a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.903+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.903+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.903+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.904+0000 7f79df9a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:03.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.904+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.904+0000 7f79df9a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:03.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.904+0000 7f79df9a7800 20 searching for the correct realm 2024-09-14T11:51:03.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.908+0000 7f79d4c90640 0 -- 172.21.15.116:0/614308189 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f79d000a430 msgr2=0x7f79d00a1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:03.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.911+0000 7f79d4c90640 0 -- 172.21.15.116:0/614308189 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f78a8087050 msgr2=0x7f78a8089480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:03.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:03.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:03.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:03.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 zone default found 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 4 Realm: () 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 zonegroup default 2024-09-14T11:51:03.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.915+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.916+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.916+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.916+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.916+0000 7f79df9a7800 20 rados->read ofs=0 len=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.917+0000 7f79df9a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.917+0000 7f79df9a7800 20 started sync module instance, tier type = 2024-09-14T11:51:03.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.917+0000 7f79df9a7800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:03.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=0 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=1 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=2 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=3 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=4 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=5 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.925+0000 7f79df9a7800 20 add_watcher() i=6 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.926+0000 7f79df9a7800 20 add_watcher() i=7 2024-09-14T11:51:03.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.926+0000 7f79df9a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:03.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.927+0000 7f7893fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:03.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.927+0000 7f79df9a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:03.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.927+0000 7f79df9a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:03.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.961+0000 7f7892fe5640 20 reqs_thread_entry: start 2024-09-14T11:51:03.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.961+0000 7f79df9a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:03.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.961+0000 7f79df9a7800 20 Filter name: none 2024-09-14T11:51:03.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.961+0000 7f7890fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:03.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.961+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:51:03.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.962+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.963+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.963+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.964+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:51:03.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.965+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.966+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.966+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.967+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:51:03.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.968+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.969+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.969+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.970+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:51:03.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.971+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.971+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.972+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.973+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:51:03.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.974+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.974+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.975+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.975+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:51:03.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.977+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.977+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.978+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.978+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:51:03.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.981+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.981+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.981+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.982+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:51:03.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.983+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.984+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.984+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.985+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:51:03.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.986+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.987+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.985 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.987+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.988+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:51:03.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.989+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.990+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.990+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.990 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.991+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:51:03.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.992+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.993+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.993+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.994+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:51:03.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.995+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.996+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.996+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.997+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:51:03.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.998+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.999+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:03.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:03.999+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:03.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.000+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:51:04.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.001+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.002+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.002+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.005+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:51:04.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.006+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.007+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.007+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.007 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.008+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:51:04.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.009+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.010+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.010+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.011+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:51:04.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.012+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.012+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.013+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.014+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:51:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.015+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.015+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.016+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.017+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:51:04.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.018+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.019+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.019+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.020+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:51:04.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.021+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.021+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.022+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.023+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:51:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.024+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.024+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.024+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.025+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:51:04.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.028+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.028+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.028+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.029+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:51:04.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.031+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.031+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.031+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.032+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:51:04.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.033+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.034+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.034+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.035+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:51:04.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.036+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.037+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.037+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.038+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:51:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.039+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.039+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.040+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.041+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:51:04.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.042+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.042+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.043+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.044+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:51:04.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.045+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.045+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.046+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.047+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:51:04.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.048+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.049+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.049+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.050+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:51:04.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.051+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.051+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.052+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.053+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:51:04.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.054+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.055+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.055+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.056+0000 7f79df9a7800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:51:04.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.057+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.057+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:51:04.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.058+0000 7f79df9a7800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:51:04.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.059+0000 7f7893fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:04.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.061+0000 7f79df9a7800 20 remove_watcher() i=0 2024-09-14T11:51:04.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.061+0000 7f79df9a7800 2 removed watcher, disabling cache 2024-09-14T11:51:04.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.062+0000 7f79df9a7800 20 remove_watcher() i=1 2024-09-14T11:51:04.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.063+0000 7f79df9a7800 20 remove_watcher() i=2 2024-09-14T11:51:04.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.064+0000 7f79df9a7800 20 remove_watcher() i=3 2024-09-14T11:51:04.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.065+0000 7f79df9a7800 20 remove_watcher() i=4 2024-09-14T11:51:04.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.066+0000 7f79df9a7800 20 remove_watcher() i=5 2024-09-14T11:51:04.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.067+0000 7f79df9a7800 20 remove_watcher() i=6 2024-09-14T11:51:04.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:04.068+0000 7f79df9a7800 20 remove_watcher() i=7 2024-09-14T11:51:04.077 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:51:04.095 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:51:04.095 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:51:04.095 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:51:04.096 DEBUG:teuthology.orchestra.run.smithi116:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:51:04.124 INFO:teuthology.orchestra.run.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:51:04.919 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:51:04.920 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:51:05.020 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:05.020 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:05.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.054+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.055+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.055+0000 7efe4c973800 20 realm 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.055+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.056+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.056+0000 7efe4c973800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.056+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.056+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.056+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.057+0000 7efe4c973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.057+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.057+0000 7efe4c973800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:05.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.057+0000 7efe4c973800 20 searching for the correct realm 2024-09-14T11:51:05.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.060+0000 7efe4ac5e640 0 -- 172.21.15.116:0/1525801053 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7efe34073030 msgr2=0x7efe3400eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:05.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.064+0000 7efe4a45d640 0 -- 172.21.15.116:0/1525801053 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7efe3407c0d0 msgr2=0x7efe34009b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.271+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:05.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 zone default found 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 4 Realm: () 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 zonegroup default 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.272+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.273+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.273+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.273+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.273+0000 7efe4c973800 20 started sync module instance, tier type = 2024-09-14T11:51:05.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.273+0000 7efe4c973800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=0 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=1 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=2 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=3 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=4 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=5 2024-09-14T11:51:05.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.283+0000 7efe4c973800 20 add_watcher() i=6 2024-09-14T11:51:05.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.284+0000 7efe4c973800 20 add_watcher() i=7 2024-09-14T11:51:05.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.284+0000 7efe4c973800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efd00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 5 note: GC not initialized 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efc7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:51:05.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:05.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 20 Filter name: none 2024-09-14T11:51:05.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efc797fa640 20 reqs_thread_entry: start 2024-09-14T11:51:05.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:51:05.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.286+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:51:05.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.287+0000 7efe4c973800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.288+0000 7efe4c973800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.288+0000 7efe4c973800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.288+0000 7efe4c973800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.289+0000 7efd2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 94407756004944 notifier 9183 bl.length()=384 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.289+0000 7efd2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:51:05.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.289+0000 7efd2dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efe4c973800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:51:05.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efe4c973800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efe4c973800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:51:05.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efd2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497150 cookie 94407756012464 notifier 9183 bl.length()=225 2024-09-14T11:51:05.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efd2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:51:05.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.292+0000 7efd2dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.294+0000 7efe4c973800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:51:05.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.294+0000 7efe4c973800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:51:05.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.294+0000 7efe4c973800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:51:05.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.295+0000 7efd2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 94407755998032 notifier 9183 bl.length()=234 2024-09-14T11:51:05.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.295+0000 7efd2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:51:05.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.295+0000 7efd2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:51:05.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.297+0000 7efd00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:05.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.299+0000 7efe4c973800 20 remove_watcher() i=0 2024-09-14T11:51:05.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.299+0000 7efe4c973800 2 removed watcher, disabling cache 2024-09-14T11:51:05.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.300+0000 7efe4c973800 20 remove_watcher() i=1 2024-09-14T11:51:05.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.301+0000 7efe4c973800 20 remove_watcher() i=2 2024-09-14T11:51:05.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.302+0000 7efe4c973800 20 remove_watcher() i=3 2024-09-14T11:51:05.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.303+0000 7efe4c973800 20 remove_watcher() i=4 2024-09-14T11:51:05.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.304+0000 7efe4c973800 20 remove_watcher() i=5 2024-09-14T11:51:05.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.305+0000 7efe4c973800 20 remove_watcher() i=6 2024-09-14T11:51:05.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.306+0000 7efe4c973800 20 remove_watcher() i=7 2024-09-14T11:51:05.313 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "id": "RGW11111111111111111", 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "tenant": "", 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "quota": { 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:05.314 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_users": 1000, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_roles": 1000, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_groups": 1000, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout: "max_access_keys": 4 2024-09-14T11:51:05.315 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:05.316 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:51:05.317 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key DZMPEFAIJRQOKJNGTILE --secret g/r6FhGTgRpkUlKi0WBW0RMErjQQO3MZ6oobCbzc9Y8oFH5Ao+4XLA== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:51:05.384 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:05.384 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:05.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.605+0000 7f5ebaf92640 0 --2- 172.21.15.116:0/3346410389 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b1b799c440 0x55b1b7a8ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:51:05.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.620+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 realm 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.622+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.623+0000 7f5ebf815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.623+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.624+0000 7f5ebf815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:05.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.624+0000 7f5ebf815800 20 searching for the correct realm 2024-09-14T11:51:05.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.626+0000 7f5ebaf92640 0 -- 172.21.15.116:0/3327658195 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f5eb4079060 msgr2=0x7f5eb40a7770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:05.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.629+0000 7f5ebb793640 0 -- 172.21.15.116:0/3327658195 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f5eb001d040 msgr2=0x7f5eb0069260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:05.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.635+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 zone default found 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 4 Realm: () 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 zonegroup default 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 started sync module instance, tier type = 2024-09-14T11:51:05.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.636+0000 7f5ebf815800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=0 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=1 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=2 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=3 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=4 2024-09-14T11:51:05.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=5 2024-09-14T11:51:05.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.645+0000 7f5ebf815800 20 add_watcher() i=6 2024-09-14T11:51:05.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.646+0000 7f5ebf815800 20 add_watcher() i=7 2024-09-14T11:51:05.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.646+0000 7f5ebf815800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5ebf815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5ebf815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5ebf815800 5 note: GC not initialized 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5d70fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:05.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5ebf815800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5ebf815800 20 Filter name: none 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.648+0000 7f5d69ffb640 20 reqs_thread_entry: start 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE : miss 2024-09-14T11:51:05.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE info.flags=0x0 2024-09-14T11:51:05.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 adding default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE to cache LRU end 2024-09-14T11:51:05.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:51:05.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.649+0000 7f5ebf815800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE : hit (negative entry) 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.650+0000 7f5ebf815800 10 cache get: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE : hit (negative entry) 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.651+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:51:05.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.651+0000 7f5ebf815800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:05.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.651+0000 7f5ebf815800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:51:05.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.652+0000 7f5d9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497151 cookie 94221779281328 notifier 8453 bl.length()=673 2024-09-14T11:51:05.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.652+0000 7f5d9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:51:05.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.652+0000 7f5d9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:05.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.654+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:51:05.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.654+0000 7f5ebf815800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:51:05.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.654+0000 7f5ebf815800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:51:05.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.655+0000 7f5d9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497152 cookie 94221779293104 notifier 8453 bl.length()=185 2024-09-14T11:51:05.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.655+0000 7f5d9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:51:05.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.655+0000 7f5d9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:51:05.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5ebf815800 10 cache put: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE info.flags=0x7 2024-09-14T11:51:05.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5ebf815800 10 moving default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE to cache LRU end 2024-09-14T11:51:05.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5ebf815800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:DZMPEFAIJRQOKJNGTILE, ofs0, ns] 2024-09-14T11:51:05.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5d9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497153 cookie 94221779281328 notifier 8453 bl.length()=186 2024-09-14T11:51:05.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5d9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE info.flags=0x7 2024-09-14T11:51:05.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.657+0000 7f5d9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DZMPEFAIJRQOKJNGTILE to cache LRU end 2024-09-14T11:51:05.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.660+0000 7f5ebf815800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:51:05.658 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:05.658 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "foo.client.0", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "foo+test@test.test", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "foo.client.0", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "DZMPEFAIJRQOKJNGTILE", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "g/r6FhGTgRpkUlKi0WBW0RMErjQQO3MZ6oobCbzc9Y8oFH5Ao+4XLA==", 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:05.652160Z" 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:05.659 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:05.660 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "root", 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:05.652145Z", 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:05.661 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:05.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.660+0000 7f5d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:05.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.663+0000 7f5ebf815800 20 remove_watcher() i=0 2024-09-14T11:51:05.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.663+0000 7f5ebf815800 2 removed watcher, disabling cache 2024-09-14T11:51:05.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.664+0000 7f5ebf815800 20 remove_watcher() i=1 2024-09-14T11:51:05.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.665+0000 7f5ebf815800 20 remove_watcher() i=2 2024-09-14T11:51:05.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.666+0000 7f5ebf815800 20 remove_watcher() i=3 2024-09-14T11:51:05.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.669+0000 7f5ebf815800 20 remove_watcher() i=4 2024-09-14T11:51:05.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.670+0000 7f5ebf815800 20 remove_watcher() i=5 2024-09-14T11:51:05.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.671+0000 7f5ebf815800 20 remove_watcher() i=6 2024-09-14T11:51:05.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.671+0000 7f5ebf815800 20 remove_watcher() i=7 2024-09-14T11:51:05.681 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8367791095 --totp-seed 6SU6JJ6H33ECSE2DRXCWHV7PQ4SI4QWG4HVFXI6OEYOG5EP66NRYDQRHD4SLB2TE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:05.746 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:05.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.780+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 realm 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.782+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.783+0000 7f2f0eb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.783+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.784+0000 7f2f0eb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:05.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.784+0000 7f2f0eb25800 20 searching for the correct realm 2024-09-14T11:51:05.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.787+0000 7f2f01f32640 0 -- 172.21.15.116:0/1066154832 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x558044709160 msgr2=0x55804470b5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:05.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.791+0000 7f2f0a733640 0 -- 172.21.15.116:0/1066154832 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f2ef40a3040 msgr2=0x7f2ef406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:05.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:05.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.795+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:05.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:05.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 zone default found 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 4 Realm: () 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 zonegroup default 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.796+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 started sync module instance, tier type = 2024-09-14T11:51:05.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.797+0000 7f2f0eb25800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:05.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=0 2024-09-14T11:51:05.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=1 2024-09-14T11:51:05.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=2 2024-09-14T11:51:05.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=3 2024-09-14T11:51:05.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=4 2024-09-14T11:51:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=5 2024-09-14T11:51:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.806+0000 7f2f0eb25800 20 add_watcher() i=6 2024-09-14T11:51:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.807+0000 7f2f0eb25800 20 add_watcher() i=7 2024-09-14T11:51:05.806 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.807+0000 7f2f0eb25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2dc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2f0eb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2f0eb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2f0eb25800 5 note: GC not initialized 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2d3b7fe640 20 reqs_thread_entry: start 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2f0eb25800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.809+0000 7f2f0eb25800 20 Filter name: none 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2d397fa640 20 reqs_thread_entry: start 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 20 rados->read ofs=0 len=0 2024-09-14T11:51:05.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:51:05.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:51:05.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:05.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:05.810+0000 7f2f0eb25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:07.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2f0eb25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:51:07.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2f0eb25800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:07.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2f0eb25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:51:07.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2ded7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431746 cookie 94009392409952 notifier 9222 bl.length()=687 2024-09-14T11:51:07.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2ded7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:51:07.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.039+0000 7f2ded7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:51:07.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.042+0000 7f2dc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.045+0000 7f2f0eb25800 20 remove_watcher() i=0 2024-09-14T11:51:07.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.045+0000 7f2f0eb25800 2 removed watcher, disabling cache 2024-09-14T11:51:07.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.046+0000 7f2f0eb25800 20 remove_watcher() i=1 2024-09-14T11:51:07.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.047+0000 7f2f0eb25800 20 remove_watcher() i=2 2024-09-14T11:51:07.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.049+0000 7f2f0eb25800 20 remove_watcher() i=3 2024-09-14T11:51:07.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.050+0000 7f2f0eb25800 20 remove_watcher() i=4 2024-09-14T11:51:07.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.051+0000 7f2f0eb25800 20 remove_watcher() i=5 2024-09-14T11:51:07.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.052+0000 7f2f0eb25800 20 remove_watcher() i=6 2024-09-14T11:51:07.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.053+0000 7f2f0eb25800 20 remove_watcher() i=7 2024-09-14T11:51:07.064 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:51:07.064 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key CZHEKHXNYSXFRAFOKODA --secret rJjRJm5+5jGMKrBmXaa8oSQcK6Vgc4LM0arcjjfJ+EuqAg8aDOvCYw== --cluster ceph 2024-09-14T11:51:07.130 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:07.130 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:07.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.164+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 realm 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.166+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.167+0000 7f4976a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.167+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.167+0000 7f4976a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:07.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.167+0000 7f4976a40800 20 searching for the correct realm 2024-09-14T11:51:07.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.171+0000 7f4974d2b640 0 -- 172.21.15.116:0/896020203 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55973b9ab7b0 msgr2=0x55973b9adc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.174+0000 7f4973d29640 0 -- 172.21.15.116:0/896020203 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f49640d8070 msgr2=0x7f49640d9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:07.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.178+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 zone default found 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 4 Realm: () 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 zonegroup default 2024-09-14T11:51:07.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.179+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.180+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.180+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.180+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.180+0000 7f4976a40800 20 started sync module instance, tier type = 2024-09-14T11:51:07.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.180+0000 7f4976a40800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:07.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=0 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=1 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=2 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=3 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=4 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=5 2024-09-14T11:51:07.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=6 2024-09-14T11:51:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 20 add_watcher() i=7 2024-09-14T11:51:07.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.189+0000 7f4976a40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f482afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4976a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4976a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:07.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4976a40800 5 note: GC not initialized 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4829fdb640 20 reqs_thread_entry: start 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4976a40800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.191+0000 7f4976a40800 20 Filter name: none 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f479b7fe640 20 reqs_thread_entry: start 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:51:07.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:51:07.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:51:07.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 10 cache get: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA : miss 2024-09-14T11:51:07.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.192+0000 7f4976a40800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.193+0000 7f4976a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.193+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA info.flags=0x0 2024-09-14T11:51:07.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.193+0000 7f4976a40800 10 adding default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA to cache LRU end 2024-09-14T11:51:07.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.193+0000 7f4976a40800 10 cache get: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA : hit (negative entry) 2024-09-14T11:51:07.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.193+0000 7f4976a40800 10 cache get: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA : hit (negative entry) 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.194+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.194+0000 7f4976a40800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.194+0000 7f4976a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.195+0000 7f484b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94108028474352 notifier 8489 bl.length()=645 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.195+0000 7f484b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:51:07.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.195+0000 7f484b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.197+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.197+0000 7f4976a40800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.197+0000 7f4976a40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.198+0000 7f484b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431761 cookie 94108028484976 notifier 8489 bl.length()=185 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.198+0000 7f484b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:51:07.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.198+0000 7f484b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:51:07.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.200+0000 7f4976a40800 10 cache put: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA info.flags=0x7 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.200+0000 7f4976a40800 10 moving default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA to cache LRU end 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.200+0000 7f4976a40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:CZHEKHXNYSXFRAFOKODA, ofs0, ns] 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.201+0000 7f484b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94108028491520 notifier 8489 bl.length()=186 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.201+0000 7f484b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA info.flags=0x7 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.201+0000 7f484b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CZHEKHXNYSXFRAFOKODA to cache LRU end 2024-09-14T11:51:07.200 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "bar.client.0", 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "bar+test@test.test", 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:07.201 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "bar.client.0", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "CZHEKHXNYSXFRAFOKODA", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "rJjRJm5+5jGMKrBmXaa8oSQcK6Vgc4LM0arcjjfJ+EuqAg8aDOvCYw==", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:07.194997Z" 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:07.202 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:07.194987Z", 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:07.204 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:07.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.203+0000 7f482afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.205+0000 7f4976a40800 20 remove_watcher() i=0 2024-09-14T11:51:07.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.205+0000 7f4976a40800 2 removed watcher, disabling cache 2024-09-14T11:51:07.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.206+0000 7f4976a40800 20 remove_watcher() i=1 2024-09-14T11:51:07.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.207+0000 7f4976a40800 20 remove_watcher() i=2 2024-09-14T11:51:07.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.208+0000 7f4976a40800 20 remove_watcher() i=3 2024-09-14T11:51:07.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.209+0000 7f4976a40800 20 remove_watcher() i=4 2024-09-14T11:51:07.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.210+0000 7f4976a40800 20 remove_watcher() i=5 2024-09-14T11:51:07.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.211+0000 7f4976a40800 20 remove_watcher() i=6 2024-09-14T11:51:07.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.212+0000 7f4976a40800 20 remove_watcher() i=7 2024-09-14T11:51:07.222 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 5463605918 --totp-seed BSYIN7PIF4DONVMT5BEG743HYGMUS4M4BO5NBFFFVQXYWMVE3XMQXD22KBUU5JMN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:07.288 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:07.288 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:07.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.323+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 20 realm 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.324+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.325+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.325+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.326+0000 7fdc85216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.326+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.326+0000 7fdc85216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:07.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.326+0000 7fdc85216800 20 searching for the correct realm 2024-09-14T11:51:07.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.330+0000 7fdc801e6640 0 -- 172.21.15.116:0/227929761 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x55c3c2966fb0 msgr2=0x55c3c2969470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.333+0000 7fdc801e6640 0 -- 172.21.15.116:0/227929761 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fdc70082150 msgr2=0x7fdc700c23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:07.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:07.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:07.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.337+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 zone default found 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 4 Realm: () 2024-09-14T11:51:07.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 zonegroup default 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 started sync module instance, tier type = 2024-09-14T11:51:07.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.338+0000 7fdc85216800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:07.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=0 2024-09-14T11:51:07.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=1 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=2 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=3 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=4 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=5 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.347+0000 7fdc85216800 20 add_watcher() i=6 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.348+0000 7fdc85216800 20 add_watcher() i=7 2024-09-14T11:51:07.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.348+0000 7fdc85216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdb36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 5 note: GC not initialized 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdb35fe3640 20 reqs_thread_entry: start 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:07.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 20 Filter name: none 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdaa77fe640 20 reqs_thread_entry: start 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.350+0000 7fdc85216800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.351+0000 7fdc85216800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.351+0000 7fdc85216800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.351+0000 7fdc85216800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.351+0000 7fdc85216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:07.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.353+0000 7fdc85216800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:51:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.353+0000 7fdc85216800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.353+0000 7fdc85216800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:51:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.354+0000 7fdb57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431691 cookie 94299271673936 notifier 9261 bl.length()=659 2024-09-14T11:51:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.354+0000 7fdb57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:51:07.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.354+0000 7fdb57fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:51:07.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.356+0000 7fdb36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.358+0000 7fdc85216800 20 remove_watcher() i=0 2024-09-14T11:51:07.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.358+0000 7fdc85216800 2 removed watcher, disabling cache 2024-09-14T11:51:07.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.359+0000 7fdc85216800 20 remove_watcher() i=1 2024-09-14T11:51:07.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.360+0000 7fdc85216800 20 remove_watcher() i=2 2024-09-14T11:51:07.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.361+0000 7fdc85216800 20 remove_watcher() i=3 2024-09-14T11:51:07.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.362+0000 7fdc85216800 20 remove_watcher() i=4 2024-09-14T11:51:07.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.363+0000 7fdc85216800 20 remove_watcher() i=5 2024-09-14T11:51:07.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.364+0000 7fdc85216800 20 remove_watcher() i=6 2024-09-14T11:51:07.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.365+0000 7fdc85216800 20 remove_watcher() i=7 2024-09-14T11:51:07.374 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:51:07.437 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:07.437 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:07.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.471+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.472+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.472+0000 7fcd5ab39800 20 realm 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.472+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.473+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.473+0000 7fcd5ab39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:07.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.473+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.473+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.473+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.474+0000 7fcd5ab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.474+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.474+0000 7fcd5ab39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:07.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.474+0000 7fcd5ab39800 20 searching for the correct realm 2024-09-14T11:51:07.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.478+0000 7fcd56fc8640 0 -- 172.21.15.116:0/1949646141 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fcd40003ac0 msgr2=0x7fcd4004fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:07.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.685+0000 7fcd567c7640 0 -- 172.21.15.116:0/1949646141 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x555f659e8ff0 msgr2=0x555f659eb3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 zone default found 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 4 Realm: () 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 zonegroup default 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.688+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 started sync module instance, tier type = 2024-09-14T11:51:07.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.689+0000 7fcd5ab39800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:07.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=0 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=1 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=2 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=3 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=4 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=5 2024-09-14T11:51:07.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.699+0000 7fcd5ab39800 20 add_watcher() i=6 2024-09-14T11:51:07.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.700+0000 7fcd5ab39800 20 add_watcher() i=7 2024-09-14T11:51:07.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.700+0000 7fcd5ab39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.701+0000 7fcc0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.701+0000 7fcd5ab39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.701+0000 7fcd5ab39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.701+0000 7fcd5ab39800 5 note: GC not initialized 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcb877fe640 20 reqs_thread_entry: start 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:07.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 20 Filter name: none 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcb857fa640 20 reqs_thread_entry: start 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.702+0000 7fcd5ab39800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:51:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:51:07.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.703+0000 7fcd5ab39800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.704+0000 7fcd5ab39800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.704+0000 7fcd5ab39800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.704+0000 7fcd5ab39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.705+0000 7fcc39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431692 cookie 93868215150096 notifier 9279 bl.length()=389 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.705+0000 7fcc39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:51:07.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.705+0000 7fcc39ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.707+0000 7fcd5ab39800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.707+0000 7fcd5ab39800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.707+0000 7fcd5ab39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.708+0000 7fcc39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431747 cookie 93868215181392 notifier 9279 bl.length()=230 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.708+0000 7fcc39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:51:07.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.708+0000 7fcc39ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcd5ab39800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:51:07.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcd5ab39800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:51:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcd5ab39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:51:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcc397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431679 cookie 93868215186832 notifier 9279 bl.length()=234 2024-09-14T11:51:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcc397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:51:07.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.711+0000 7fcc397fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:51:07.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.713+0000 7fcc0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.715+0000 7fcd5ab39800 20 remove_watcher() i=0 2024-09-14T11:51:07.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.715+0000 7fcd5ab39800 2 removed watcher, disabling cache 2024-09-14T11:51:07.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.716+0000 7fcd5ab39800 20 remove_watcher() i=1 2024-09-14T11:51:07.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.717+0000 7fcd5ab39800 20 remove_watcher() i=2 2024-09-14T11:51:07.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.718+0000 7fcd5ab39800 20 remove_watcher() i=3 2024-09-14T11:51:07.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.719+0000 7fcd5ab39800 20 remove_watcher() i=4 2024-09-14T11:51:07.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.720+0000 7fcd5ab39800 20 remove_watcher() i=5 2024-09-14T11:51:07.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.721+0000 7fcd5ab39800 20 remove_watcher() i=6 2024-09-14T11:51:07.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.722+0000 7fcd5ab39800 20 remove_watcher() i=7 2024-09-14T11:51:07.729 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:07.729 INFO:teuthology.orchestra.run.smithi116.stdout: "id": "RGW33333333333333333", 2024-09-14T11:51:07.729 INFO:teuthology.orchestra.run.smithi116.stdout: "tenant": "testx", 2024-09-14T11:51:07.729 INFO:teuthology.orchestra.run.smithi116.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "quota": { 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.730 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_users": 1000, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_roles": 1000, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_groups": 1000, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout: "max_access_keys": 4 2024-09-14T11:51:07.731 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:07.733 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:51:07.733 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key JSIXBJNPRFITEVHUSJJQ --secret G0RqZCzCYlsIWTLyAkDS+K36q34odt0nw0JY2oXKnGoT3bXHSwzcLw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:51:07.800 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:07.800 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:07.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.834+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 realm 2024-09-14T11:51:07.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:07.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.836+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.837+0000 7fcdfda20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.837+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.837+0000 7fcdfda20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:07.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.837+0000 7fcdfda20800 20 searching for the correct realm 2024-09-14T11:51:07.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.841+0000 7fcdfad09640 0 -- 172.21.15.116:0/3802420284 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fcdec095060 msgr2=0x7fcdec0b9f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.844 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.845+0000 7fcdfad09640 0 -- 172.21.15.116:0/3802420284 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7fccc4087e60 msgr2=0x7fccc408a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:07.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.848+0000 7fcdfda20800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:07.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:07.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:07.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:07.849 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 zone default found 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 4 Realm: () 2024-09-14T11:51:07.850 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 zonegroup default 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.849+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 started sync module instance, tier type = 2024-09-14T11:51:07.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.850+0000 7fcdfda20800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=0 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=1 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=2 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=3 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=4 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=5 2024-09-14T11:51:07.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.859+0000 7fcdfda20800 20 add_watcher() i=6 2024-09-14T11:51:07.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.860+0000 7fcdfda20800 20 add_watcher() i=7 2024-09-14T11:51:07.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.860+0000 7fcdfda20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:07.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.861+0000 7fccb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.861+0000 7fcdfda20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.861+0000 7fcdfda20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.861+0000 7fcdfda20800 5 note: GC not initialized 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fccb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 20 Filter name: none 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcc2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.862+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ : miss 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ info.flags=0x0 2024-09-14T11:51:07.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 adding default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ to cache LRU end 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.863+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ : hit (negative entry) 2024-09-14T11:51:07.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.864+0000 7fcdfda20800 10 cache get: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ : hit (negative entry) 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fcdfda20800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fcdfda20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431762 cookie 94015777264944 notifier 8540 bl.length()=732 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:51:07.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.865+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:07.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:51:07.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fcdfda20800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:51:07.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fcdfda20800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:51:07.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94015777272096 notifier 8540 bl.length()=215 2024-09-14T11:51:07.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:51:07.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.868+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:51:07.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.871+0000 7fcdfda20800 10 cache put: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ info.flags=0x7 2024-09-14T11:51:07.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.871+0000 7fcdfda20800 10 moving default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ to cache LRU end 2024-09-14T11:51:07.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.871+0000 7fcdfda20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:JSIXBJNPRFITEVHUSJJQ, ofs0, ns] 2024-09-14T11:51:07.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.871+0000 7fccdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431748 cookie 94015777262304 notifier 8540 bl.length()=201 2024-09-14T11:51:07.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.871+0000 7fccdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ info.flags=0x7 2024-09-14T11:51:07.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.872+0000 7fccdeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JSIXBJNPRFITEVHUSJJQ to cache LRU end 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.874+0000 7fcdfda20800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:07.873 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "JSIXBJNPRFITEVHUSJJQ", 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "G0RqZCzCYlsIWTLyAkDS+K36q34odt0nw0JY2oXKnGoT3bXHSwzcLw==", 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:07.865792Z" 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:07.874 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:07.875 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "root", 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:07.865779Z", 2024-09-14T11:51:07.876 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:07.877 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:07.877 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:07.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:07.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.874+0000 7fccb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:07.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.877+0000 7fcdfda20800 20 remove_watcher() i=0 2024-09-14T11:51:07.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.877+0000 7fcdfda20800 2 removed watcher, disabling cache 2024-09-14T11:51:07.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.878+0000 7fcdfda20800 20 remove_watcher() i=1 2024-09-14T11:51:07.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.879+0000 7fcdfda20800 20 remove_watcher() i=2 2024-09-14T11:51:07.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.880+0000 7fcdfda20800 20 remove_watcher() i=3 2024-09-14T11:51:07.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.881+0000 7fcdfda20800 20 remove_watcher() i=4 2024-09-14T11:51:07.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.882+0000 7fcdfda20800 20 remove_watcher() i=5 2024-09-14T11:51:07.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.883+0000 7fcdfda20800 20 remove_watcher() i=6 2024-09-14T11:51:07.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.884+0000 7fcdfda20800 20 remove_watcher() i=7 2024-09-14T11:51:07.893 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 4601652415 --totp-seed Y2UWC7YXGC3QYZ436ZP2B5MHZA7PKFATVEPXNAJZQDXIHXDP53TKJ4LSQOUWRJKT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:07.960 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:07.960 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:07.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.994+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 20 realm 2024-09-14T11:51:07.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:07.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.995+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.996+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:07.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.996+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.996+0000 7f8073928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:07.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.996+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:07.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.997+0000 7f8073928800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:07.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:07.997+0000 7f8073928800 20 searching for the correct realm 2024-09-14T11:51:07.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.000+0000 7f8066e6e640 0 -- 172.21.15.116:0/3355194279 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f80600b0020 msgr2=0x7f80600eca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:08.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.004+0000 7f8066e6e640 0 -- 172.21.15.116:0/3355194279 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f7f38087db0 msgr2=0x7f7f3808a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.008+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 zone default found 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 4 Realm: () 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 zonegroup default 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.009+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.010+0000 7f8073928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.010+0000 7f8073928800 20 started sync module instance, tier type = 2024-09-14T11:51:08.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.010+0000 7f8073928800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=0 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=1 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=2 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=3 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=4 2024-09-14T11:51:08.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=5 2024-09-14T11:51:08.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.039+0000 7f8073928800 20 add_watcher() i=6 2024-09-14T11:51:08.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.040+0000 7f8073928800 20 add_watcher() i=7 2024-09-14T11:51:08.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.040+0000 7f8073928800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:08.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.041+0000 7f7f25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.041+0000 7f8073928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.041+0000 7f8073928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.041+0000 7f8073928800 5 note: GC not initialized 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f7f24fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f8073928800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f8073928800 20 Filter name: none 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f7e9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f8073928800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:51:08.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.042+0000 7f8073928800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.043+0000 7f8073928800 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:51:08.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.043+0000 7f8073928800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:51:08.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.043+0000 7f8073928800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:08.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.043+0000 7f8073928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:08.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f8073928800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:51:08.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f8073928800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:08.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f8073928800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:51:08.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f7f52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399059 cookie 93919272862064 notifier 9321 bl.length()=746 2024-09-14T11:51:08.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f7f52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:51:08.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.045+0000 7f7f52ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:51:08.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.048+0000 7f7f25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.050+0000 7f8073928800 20 remove_watcher() i=0 2024-09-14T11:51:08.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.050+0000 7f8073928800 2 removed watcher, disabling cache 2024-09-14T11:51:08.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.052+0000 7f8073928800 20 remove_watcher() i=1 2024-09-14T11:51:08.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.053+0000 7f8073928800 20 remove_watcher() i=2 2024-09-14T11:51:08.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.054+0000 7f8073928800 20 remove_watcher() i=3 2024-09-14T11:51:08.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.055+0000 7f8073928800 20 remove_watcher() i=4 2024-09-14T11:51:08.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.056+0000 7f8073928800 20 remove_watcher() i=5 2024-09-14T11:51:08.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.057+0000 7f8073928800 20 remove_watcher() i=6 2024-09-14T11:51:08.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.057+0000 7f8073928800 20 remove_watcher() i=7 2024-09-14T11:51:08.067 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:51:08.067 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key FYUJBERMVVPZPBHPYQOF --secret o4K9NmlZsu/RvyMzTg596M2YTWg9hSnhjll7jsMOsoBePWt+uOUV4g== --cluster ceph 2024-09-14T11:51:08.131 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:08.131 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:08.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.165+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 realm 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.167+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.168+0000 7f85df740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.169+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.169+0000 7f85df740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:08.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.169+0000 7f85df740800 20 searching for the correct realm 2024-09-14T11:51:08.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.172+0000 7f85d3fff640 0 -- 172.21.15.116:0/2274085781 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7f85cc03f070 msgr2=0x7f85cc06cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:08.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.175+0000 7f85db4c0640 0 -- 172.21.15.116:0/2274085781 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f85c404a9e0 msgr2=0x7f85c4095040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 zone default found 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 4 Realm: () 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 zonegroup default 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.381+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.382+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.382+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.382+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.382+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.383+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.383+0000 7f85df740800 20 started sync module instance, tier type = 2024-09-14T11:51:08.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.383+0000 7f85df740800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=0 2024-09-14T11:51:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=1 2024-09-14T11:51:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=2 2024-09-14T11:51:08.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=3 2024-09-14T11:51:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=4 2024-09-14T11:51:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.391+0000 7f85df740800 20 add_watcher() i=5 2024-09-14T11:51:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.392+0000 7f85df740800 20 add_watcher() i=6 2024-09-14T11:51:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.393+0000 7f85df740800 20 add_watcher() i=7 2024-09-14T11:51:08.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.393+0000 7f85df740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.394+0000 7f8491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.394+0000 7f85df740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.394+0000 7f85df740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.394+0000 7f85df740800 5 note: GC not initialized 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f8490fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 20 Filter name: none 2024-09-14T11:51:08.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f840a7fc640 20 reqs_thread_entry: start 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.395+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:51:08.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 cache get: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF : miss 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF info.flags=0x0 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 adding default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF to cache LRU end 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 cache get: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF : hit (negative entry) 2024-09-14T11:51:08.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.396+0000 7f85df740800 10 cache get: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF : hit (negative entry) 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f85df740800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f85df740800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f84beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398932 cookie 94868939450768 notifier 8573 bl.length()=660 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f84beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:08.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.397+0000 7f84beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.400+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.400+0000 7f85df740800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.400+0000 7f85df740800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.401+0000 7f84beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398989 cookie 94868939432672 notifier 8573 bl.length()=191 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.401+0000 7f84beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:51:08.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.401+0000 7f84beffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f85df740800 10 cache put: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF info.flags=0x7 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f85df740800 10 moving default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF to cache LRU end 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f85df740800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:FYUJBERMVVPZPBHPYQOF, ofs0, ns] 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f84beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398958 cookie 94868939435408 notifier 8573 bl.length()=189 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f84beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF info.flags=0x7 2024-09-14T11:51:08.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.404+0000 7f84beffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FYUJBERMVVPZPBHPYQOF to cache LRU end 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "foobar.client.0", 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "foobar+test@test.test", 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "foobar.client.0", 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "FYUJBERMVVPZPBHPYQOF", 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "o4K9NmlZsu/RvyMzTg596M2YTWg9hSnhjll7jsMOsoBePWt+uOUV4g==", 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:08.398241Z" 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:08.398230Z", 2024-09-14T11:51:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:08.408 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:08.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.406+0000 7f8491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.408+0000 7f85df740800 20 remove_watcher() i=0 2024-09-14T11:51:08.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.408+0000 7f85df740800 2 removed watcher, disabling cache 2024-09-14T11:51:08.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.409+0000 7f85df740800 20 remove_watcher() i=1 2024-09-14T11:51:08.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.410+0000 7f85df740800 20 remove_watcher() i=2 2024-09-14T11:51:08.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.411+0000 7f85df740800 20 remove_watcher() i=3 2024-09-14T11:51:08.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.412+0000 7f85df740800 20 remove_watcher() i=4 2024-09-14T11:51:08.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.413+0000 7f85df740800 20 remove_watcher() i=5 2024-09-14T11:51:08.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.414+0000 7f85df740800 20 remove_watcher() i=6 2024-09-14T11:51:08.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.415+0000 7f85df740800 20 remove_watcher() i=7 2024-09-14T11:51:08.424 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 8583788772 --totp-seed MFDEMRZJFUSGJM4ZRIRJMTEMALNRW2Z2CS4YRJM46MZAI7U7LZSXP75Y27FFGAXL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:08.490 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:08.490 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:08.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.524+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.525+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.525+0000 7ff674539800 20 realm 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.525+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.526+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.526+0000 7ff674539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.526+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.526+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.526+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.527+0000 7ff674539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:08.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.527+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.527+0000 7ff674539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:08.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.527+0000 7ff674539800 20 searching for the correct realm 2024-09-14T11:51:08.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.530+0000 7ff667fff640 0 -- 172.21.15.116:0/1012560124 >> [v2:172.21.15.164:6808/1086332038,v1:172.21.15.164:6809/1086332038] conn(0x7ff66007e040 msgr2=0x7ff6600676a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:08.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.533+0000 7ff670225640 0 -- 172.21.15.116:0/1012560124 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7ff658096c60 msgr2=0x7ff658068040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.740+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 zone default found 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 4 Realm: () 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:08.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 zonegroup default 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.741+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.742+0000 7ff674539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.742+0000 7ff674539800 20 started sync module instance, tier type = 2024-09-14T11:51:08.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.742+0000 7ff674539800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=0 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=1 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=2 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=3 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=4 2024-09-14T11:51:08.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=5 2024-09-14T11:51:08.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.751+0000 7ff674539800 20 add_watcher() i=6 2024-09-14T11:51:08.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.752+0000 7ff674539800 20 add_watcher() i=7 2024-09-14T11:51:08.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.752+0000 7ff674539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:08.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff674539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff674539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff674539800 5 note: GC not initialized 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff525fdb640 20 reqs_thread_entry: start 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.753+0000 7ff674539800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 20 Filter name: none 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff4977fe640 20 reqs_thread_entry: start 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:51:08.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.754+0000 7ff674539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:08.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff674539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:08.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff674539800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff674539800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:51:08.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff5477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398933 cookie 94346781993136 notifier 9357 bl.length()=674 2024-09-14T11:51:08.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff5477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:08.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.757+0000 7ff5477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:08.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.759+0000 7ff526fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:08.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.762+0000 7ff674539800 20 remove_watcher() i=0 2024-09-14T11:51:08.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.762+0000 7ff674539800 2 removed watcher, disabling cache 2024-09-14T11:51:08.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.762+0000 7ff674539800 20 remove_watcher() i=1 2024-09-14T11:51:08.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.763+0000 7ff674539800 20 remove_watcher() i=2 2024-09-14T11:51:08.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.764+0000 7ff674539800 20 remove_watcher() i=3 2024-09-14T11:51:08.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.765+0000 7ff674539800 20 remove_watcher() i=4 2024-09-14T11:51:08.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.767+0000 7ff674539800 20 remove_watcher() i=5 2024-09-14T11:51:08.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.767+0000 7ff674539800 20 remove_watcher() i=6 2024-09-14T11:51:08.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.768+0000 7ff674539800 20 remove_watcher() i=7 2024-09-14T11:51:08.778 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:51:08.836 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:08.836 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:08.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:08.870+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.072+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.072+0000 7faa04539800 20 realm 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.072+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.073+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.073+0000 7faa04539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:09.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.073+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.073+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.073+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.074+0000 7faa04539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.074+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.074+0000 7faa04539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:09.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.074+0000 7faa04539800 20 searching for the correct realm 2024-09-14T11:51:09.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.078+0000 7fa9ff9c6640 0 -- 172.21.15.116:0/227504633 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x559a79f11250 msgr2=0x559a79f136c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.081+0000 7faa001c7640 0 -- 172.21.15.116:0/227504633 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fa9e80ad200 msgr2=0x7fa9e80c0150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.086+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 zone default found 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 4 Realm: () 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 zonegroup default 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 started sync module instance, tier type = 2024-09-14T11:51:09.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.087+0000 7faa04539800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:09.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=0 2024-09-14T11:51:09.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=1 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=2 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=3 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=4 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=5 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.096+0000 7faa04539800 20 add_watcher() i=6 2024-09-14T11:51:09.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.097+0000 7faa04539800 20 add_watcher() i=7 2024-09-14T11:51:09.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.097+0000 7faa04539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7fa8b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 5 note: GC not initialized 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7fa8b57e2640 20 reqs_thread_entry: start 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 20 Filter name: none 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7fa826ffd640 20 reqs_thread_entry: start 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.099+0000 7faa04539800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.100+0000 7faa04539800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.100+0000 7faa04539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.100+0000 7faa04539800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:09.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.100+0000 7faa04539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:09.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7faa04539800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:09.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7faa04539800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:09.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7faa04539800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7fa8df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94121959197760 notifier 9372 bl.length()=727 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7fa8df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.101+0000 7fa8df7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "foobar.client.0", 2024-09-14T11:51:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "foobar+test@test.test", 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "foobar.client.0", 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "FYUJBERMVVPZPBHPYQOF", 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "o4K9NmlZsu/RvyMzTg596M2YTWg9hSnhjll7jsMOsoBePWt+uOUV4g==", 2024-09-14T11:51:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:08.398241Z" 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [ 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "oidc-provider", 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "perm": "*" 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "roles", 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "perm": "*" 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "user-policy", 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "perm": "*" 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "rgw", 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [ 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "8583788772" 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "", 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:08.398230Z", 2024-09-14T11:51:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.104+0000 7fa8b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.106+0000 7faa04539800 20 remove_watcher() i=0 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.106+0000 7faa04539800 2 removed watcher, disabling cache 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.107+0000 7faa04539800 20 remove_watcher() i=1 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.108+0000 7faa04539800 20 remove_watcher() i=2 2024-09-14T11:51:09.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.109+0000 7faa04539800 20 remove_watcher() i=3 2024-09-14T11:51:09.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.110+0000 7faa04539800 20 remove_watcher() i=4 2024-09-14T11:51:09.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.111+0000 7faa04539800 20 remove_watcher() i=5 2024-09-14T11:51:09.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.112+0000 7faa04539800 20 remove_watcher() i=6 2024-09-14T11:51:09.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.113+0000 7faa04539800 20 remove_watcher() i=7 2024-09-14T11:51:09.123 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:51:09.182 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:09.182 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:09.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.216+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 realm 2024-09-14T11:51:09.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.218+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.219+0000 7fd147620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.219+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.219+0000 7fd147620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:09.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.219+0000 7fd147620800 20 searching for the correct realm 2024-09-14T11:51:09.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.223+0000 7fd145912640 0 -- 172.21.15.116:0/1864503088 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7fd130066f70 msgr2=0x7fd13006fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.429+0000 7fd145111640 0 -- 172.21.15.116:0/1864503088 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x5619f1991db0 msgr2=0x5619f1994200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:09.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.432+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 zone default found 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 4 Realm: () 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:09.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 zonegroup default 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.433+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.434+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.434+0000 7fd147620800 20 started sync module instance, tier type = 2024-09-14T11:51:09.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.434+0000 7fd147620800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:09.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=0 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=1 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=2 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=3 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=4 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=5 2024-09-14T11:51:09.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.443+0000 7fd147620800 20 add_watcher() i=6 2024-09-14T11:51:09.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.444+0000 7fd147620800 20 add_watcher() i=7 2024-09-14T11:51:09.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.444+0000 7fd147620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:09.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.446+0000 7fcffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.446+0000 7fd147620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:09.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.446+0000 7fd147620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:09.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.446+0000 7fd147620800 5 note: GC not initialized 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fcffa7e4640 20 reqs_thread_entry: start 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 Filter name: none 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fcf6bfff640 20 reqs_thread_entry: start 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:51:09.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.447+0000 7fd147620800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:51:09.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd147620800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:51:09.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd147620800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd147620800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:51:09.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd028ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398990 cookie 94669427548368 notifier 8627 bl.length()=384 2024-09-14T11:51:09.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd028ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:51:09.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.449+0000 7fd028ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd147620800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd147620800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd147620800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd028ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399045 cookie 94669427559248 notifier 8627 bl.length()=225 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd028ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:51:09.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.453+0000 7fd028ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd147620800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:51:09.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd147620800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:51:09.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd147620800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:51:09.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd017fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398976 cookie 94669427555648 notifier 8627 bl.length()=234 2024-09-14T11:51:09.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd017fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:51:09.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.456+0000 7fd017fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:51:09.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.458+0000 7fcffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.460+0000 7fd147620800 20 remove_watcher() i=0 2024-09-14T11:51:09.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.460+0000 7fd147620800 2 removed watcher, disabling cache 2024-09-14T11:51:09.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.462+0000 7fd147620800 20 remove_watcher() i=1 2024-09-14T11:51:09.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.463+0000 7fd147620800 20 remove_watcher() i=2 2024-09-14T11:51:09.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.464+0000 7fd147620800 20 remove_watcher() i=3 2024-09-14T11:51:09.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.465+0000 7fd147620800 20 remove_watcher() i=4 2024-09-14T11:51:09.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.466+0000 7fd147620800 20 remove_watcher() i=5 2024-09-14T11:51:09.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.467+0000 7fd147620800 20 remove_watcher() i=6 2024-09-14T11:51:09.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.467+0000 7fd147620800 20 remove_watcher() i=7 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "id": "RGW88888888888888888", 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tenant": "", 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "quota": { 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.475 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.476 INFO:teuthology.orchestra.run.smithi116.stdout: "max_users": 1000, 2024-09-14T11:51:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "max_roles": 1000, 2024-09-14T11:51:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "max_groups": 1000, 2024-09-14T11:51:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:09.477 INFO:teuthology.orchestra.run.smithi116.stdout: "max_access_keys": 4 2024-09-14T11:51:09.477 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:09.478 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:51:09.479 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key PDXXJVMECHVCNCMHRLRR --secret stdP6kApEHCxY0TNwVI0h70SPQ2+bGw8s7FxVHKOxqAxkk8VLGEqfg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:51:09.546 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:09.546 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:09.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.580+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 realm 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.582+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.583+0000 7f6a07d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.583+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.584+0000 7f6a07d3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:09.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.584+0000 7f6a07d3a800 20 searching for the correct realm 2024-09-14T11:51:09.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.587+0000 7f6a032ba640 0 -- 172.21.15.116:0/3038654665 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x55fa6566d2a0 msgr2=0x55fa6566f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.590+0000 7f6a03abb640 0 -- 172.21.15.116:0/3038654665 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f69f80731f0 msgr2=0x7f69f8043b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 zone default found 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 4 Realm: () 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 zonegroup default 2024-09-14T11:51:09.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.595+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 started sync module instance, tier type = 2024-09-14T11:51:09.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.596+0000 7f6a07d3a800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:09.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=0 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=1 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=2 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=3 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=4 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=5 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.605+0000 7f6a07d3a800 20 add_watcher() i=6 2024-09-14T11:51:09.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.606+0000 7f6a07d3a800 20 add_watcher() i=7 2024-09-14T11:51:09.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.606+0000 7f6a07d3a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:09.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f68b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:09.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:09.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 5 note: GC not initialized 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f68b8fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 20 Filter name: none 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f68327fc640 20 reqs_thread_entry: start 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.608+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:51:09.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR : miss 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR info.flags=0x0 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 adding default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR to cache LRU end 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:51:09.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.609+0000 7f6a07d3a800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR : hit (negative entry) 2024-09-14T11:51:09.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.610+0000 7f6a07d3a800 10 cache get: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR : hit (negative entry) 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.611+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.611+0000 7f6a07d3a800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.611+0000 7f6a07d3a800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.612+0000 7f68e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398991 cookie 94533931435712 notifier 9408 bl.length()=681 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.612+0000 7f68e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:51:09.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.612+0000 7f68e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f6a07d3a800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f6a07d3a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f68e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399060 cookie 94533931446416 notifier 9408 bl.length()=189 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f68e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:51:09.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.615+0000 7f68e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:51:09.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f6a07d3a800 10 cache put: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR info.flags=0x7 2024-09-14T11:51:09.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f6a07d3a800 10 moving default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR to cache LRU end 2024-09-14T11:51:09.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f6a07d3a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:PDXXJVMECHVCNCMHRLRR, ofs0, ns] 2024-09-14T11:51:09.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f68e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94533931439616 notifier 9408 bl.length()=188 2024-09-14T11:51:09.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f68e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR info.flags=0x7 2024-09-14T11:51:09.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.618+0000 7f68e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PDXXJVMECHVCNCMHRLRR to cache LRU end 2024-09-14T11:51:09.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.620+0000 7f6a07d3a800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "root1.client.0", 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "root1+test@test.test", 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:09.620 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "root1.client.0", 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "PDXXJVMECHVCNCMHRLRR", 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "stdP6kApEHCxY0TNwVI0h70SPQ2+bGw8s7FxVHKOxqAxkk8VLGEqfg==", 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:09.612068Z" 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:09.621 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:09.622 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "root", 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:09.612057Z", 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:09.623 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:09.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.621+0000 7f68b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.624+0000 7f6a07d3a800 20 remove_watcher() i=0 2024-09-14T11:51:09.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.624+0000 7f6a07d3a800 2 removed watcher, disabling cache 2024-09-14T11:51:09.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.625+0000 7f6a07d3a800 20 remove_watcher() i=1 2024-09-14T11:51:09.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.626+0000 7f6a07d3a800 20 remove_watcher() i=2 2024-09-14T11:51:09.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.627+0000 7f6a07d3a800 20 remove_watcher() i=3 2024-09-14T11:51:09.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.628+0000 7f6a07d3a800 20 remove_watcher() i=4 2024-09-14T11:51:09.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.629+0000 7f6a07d3a800 20 remove_watcher() i=5 2024-09-14T11:51:09.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.630+0000 7f6a07d3a800 20 remove_watcher() i=6 2024-09-14T11:51:09.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.631+0000 7f6a07d3a800 20 remove_watcher() i=7 2024-09-14T11:51:09.641 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2737628868 --totp-seed OJBZ3TR3ICUM7RO6BSZZMWODOJ2FV44VVQNDLCP4ILSCA247FABRT6BFBR3AYYWS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:09.707 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:09.707 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:09.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.741+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 realm 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:09.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.743+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.744+0000 7f9a5073d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.744+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.744+0000 7f9a5073d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:09.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.744+0000 7f9a5073d800 20 searching for the correct realm 2024-09-14T11:51:09.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.748+0000 7f9a43fff640 0 -- 172.21.15.116:0/3500832916 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x564ba5ba8b60 msgr2=0x564ba5baafd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.751+0000 7f9a4c42a640 0 -- 172.21.15.116:0/3500832916 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9a340a4920 msgr2=0x7f9a340a1450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.755+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 zone default found 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 4 Realm: () 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 zonegroup default 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.756+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.757+0000 7f9a5073d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.757+0000 7f9a5073d800 20 started sync module instance, tier type = 2024-09-14T11:51:09.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.757+0000 7f9a5073d800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:09.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=0 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=1 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=2 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=3 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=4 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=5 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=6 2024-09-14T11:51:09.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 20 add_watcher() i=7 2024-09-14T11:51:09.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.766+0000 7f9a5073d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.768+0000 7f9902fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.768+0000 7f9a5073d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.768+0000 7f9a5073d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.768+0000 7f9a5073d800 5 note: GC not initialized 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f9901fdb640 20 reqs_thread_entry: start 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f9a5073d800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f9a5073d800 20 Filter name: none 2024-09-14T11:51:09.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f98737fe640 20 reqs_thread_entry: start 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f9a5073d800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.769+0000 7f9a5073d800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.770+0000 7f9a5073d800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.770+0000 7f9a5073d800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.770+0000 7f9a5073d800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.770+0000 7f9a5073d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:09.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.772+0000 7f9a5073d800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:51:09.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.772+0000 7f9a5073d800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.772+0000 7f9a5073d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:51:09.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.773+0000 7f99237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398992 cookie 94882903015328 notifier 8660 bl.length()=695 2024-09-14T11:51:09.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.773+0000 7f99237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:51:09.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.773+0000 7f99237fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:51:09.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.775+0000 7f9902fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:09.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.777+0000 7f9a5073d800 20 remove_watcher() i=0 2024-09-14T11:51:09.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.777+0000 7f9a5073d800 2 removed watcher, disabling cache 2024-09-14T11:51:09.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.779+0000 7f9a5073d800 20 remove_watcher() i=1 2024-09-14T11:51:09.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.780+0000 7f9a5073d800 20 remove_watcher() i=2 2024-09-14T11:51:09.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.781+0000 7f9a5073d800 20 remove_watcher() i=3 2024-09-14T11:51:09.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.782+0000 7f9a5073d800 20 remove_watcher() i=4 2024-09-14T11:51:09.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.783+0000 7f9a5073d800 20 remove_watcher() i=5 2024-09-14T11:51:09.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.784+0000 7f9a5073d800 20 remove_watcher() i=6 2024-09-14T11:51:09.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.785+0000 7f9a5073d800 20 remove_watcher() i=7 2024-09-14T11:51:09.794 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:51:09.854 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:09.855 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:09.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.889+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 realm 2024-09-14T11:51:09.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:09.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:09.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.891+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.892+0000 7f58f120e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:09.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.892+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:09.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.893+0000 7f58f120e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:09.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.893+0000 7f58f120e800 20 searching for the correct realm 2024-09-14T11:51:09.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.896+0000 7f58ed0cc640 0 -- 172.21.15.116:0/4261791156 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f58d802e070 msgr2=0x7f58d802e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:09.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:09.899+0000 7f58ec8cb640 0 -- 172.21.15.116:0/4261791156 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f58d8001c20 msgr2=0x7f58d803d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:10.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.105+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 zone default found 2024-09-14T11:51:10.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 4 Realm: () 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 zonegroup default 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.106+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.107+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.107+0000 7f58f120e800 20 started sync module instance, tier type = 2024-09-14T11:51:10.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.107+0000 7f58f120e800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:10.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=0 2024-09-14T11:51:10.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=1 2024-09-14T11:51:10.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=2 2024-09-14T11:51:10.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=3 2024-09-14T11:51:10.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=4 2024-09-14T11:51:10.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=5 2024-09-14T11:51:10.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.116+0000 7f58f120e800 20 add_watcher() i=6 2024-09-14T11:51:10.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.117+0000 7f58f120e800 20 add_watcher() i=7 2024-09-14T11:51:10.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.117+0000 7f58f120e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:10.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f57a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f58f120e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f58f120e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f58f120e800 5 note: GC not initialized 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f57a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f58f120e800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f58f120e800 20 Filter name: none 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.119+0000 7f571a7fc640 20 reqs_thread_entry: start 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:51:10.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:51:10.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:51:10.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.120+0000 7f58f120e800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f58f120e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f58f120e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f58f120e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:51:10.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f57caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398993 cookie 94475300997248 notifier 9447 bl.length()=384 2024-09-14T11:51:10.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f57caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:51:10.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.122+0000 7f57caffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f58f120e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:51:10.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f58f120e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f58f120e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:51:10.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f57caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399046 cookie 94475301005264 notifier 9447 bl.length()=225 2024-09-14T11:51:10.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f57caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:51:10.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.125+0000 7f57caffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.128+0000 7f58f120e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:51:10.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.128+0000 7f58f120e800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:51:10.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.128+0000 7f58f120e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:51:10.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.129+0000 7f57caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398978 cookie 94475301001264 notifier 9447 bl.length()=234 2024-09-14T11:51:10.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.129+0000 7f57caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:51:10.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.129+0000 7f57caffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:51:10.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.131+0000 7f57a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.133+0000 7f58f120e800 20 remove_watcher() i=0 2024-09-14T11:51:10.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.133+0000 7f58f120e800 2 removed watcher, disabling cache 2024-09-14T11:51:10.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.134+0000 7f58f120e800 20 remove_watcher() i=1 2024-09-14T11:51:10.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.135+0000 7f58f120e800 20 remove_watcher() i=2 2024-09-14T11:51:10.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.136+0000 7f58f120e800 20 remove_watcher() i=3 2024-09-14T11:51:10.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.137+0000 7f58f120e800 20 remove_watcher() i=4 2024-09-14T11:51:10.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.138+0000 7f58f120e800 20 remove_watcher() i=5 2024-09-14T11:51:10.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.139+0000 7f58f120e800 20 remove_watcher() i=6 2024-09-14T11:51:10.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.140+0000 7f58f120e800 20 remove_watcher() i=7 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "id": "RGW99999999999999999", 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "tenant": "", 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "quota": { 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:10.148 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_users": 1000, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_roles": 1000, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_groups": 1000, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout: "max_access_keys": 4 2024-09-14T11:51:10.149 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:10.150 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:51:10.151 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key TNALHKXCEYPFPFZRBOEQ --secret VdOib/c50DKVFUtHuXzqZsYWuMKpRzrVztqnH8n0lBCou4UV+Y0ShQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:51:10.217 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:10.217 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:10.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.251+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 realm 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:10.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.253+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.254+0000 7fcb6a010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:10.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.254+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.255+0000 7fcb6a010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:10.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.255+0000 7fcb6a010800 20 searching for the correct realm 2024-09-14T11:51:10.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.258+0000 7fcb5ffff640 0 -- 172.21.15.116:0/321003638 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x561c37965530 msgr2=0x561c379679b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:51:10.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.262+0000 7fcb657e0640 0 -- 172.21.15.116:0/321003638 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fcb5006d930 msgr2=0x7fcb50082410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:10.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:10.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 zone default found 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 4 Realm: () 2024-09-14T11:51:10.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 zonegroup default 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.266+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 started sync module instance, tier type = 2024-09-14T11:51:10.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.267+0000 7fcb6a010800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:10.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=0 2024-09-14T11:51:10.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=1 2024-09-14T11:51:10.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=2 2024-09-14T11:51:10.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=3 2024-09-14T11:51:10.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=4 2024-09-14T11:51:10.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=5 2024-09-14T11:51:10.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=6 2024-09-14T11:51:10.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 20 add_watcher() i=7 2024-09-14T11:51:10.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.277+0000 7fcb6a010800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fca1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fcb6a010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fcb6a010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fcb6a010800 5 note: GC not initialized 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fca1afe5640 20 reqs_thread_entry: start 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.279+0000 7fcb6a010800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 Filter name: none 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fca18fe1640 20 reqs_thread_entry: start 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:51:10.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:51:10.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ : miss 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.280+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ info.flags=0x0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 adding default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ to cache LRU end 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:51:10.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ : hit (negative entry) 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.281+0000 7fcb6a010800 10 cache get: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ : hit (negative entry) 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.282+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.282+0000 7fcb6a010800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.282+0000 7fcb6a010800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:51:10.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.283+0000 7fca48ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398994 cookie 94679191724320 notifier 9468 bl.length()=681 2024-09-14T11:51:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.283+0000 7fca48ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:51:10.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.283+0000 7fca48ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.285+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:51:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.286+0000 7fcb6a010800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:51:10.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.286+0000 7fcb6a010800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:51:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.286+0000 7fca48ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399061 cookie 94679191739152 notifier 9468 bl.length()=189 2024-09-14T11:51:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.286+0000 7fca48ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:51:10.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.286+0000 7fca48ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:51:10.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fcb6a010800 10 cache put: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ info.flags=0x7 2024-09-14T11:51:10.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fcb6a010800 10 moving default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ to cache LRU end 2024-09-14T11:51:10.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fcb6a010800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:TNALHKXCEYPFPFZRBOEQ, ofs0, ns] 2024-09-14T11:51:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fca37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 94679191722192 notifier 9468 bl.length()=188 2024-09-14T11:51:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fca37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ info.flags=0x7 2024-09-14T11:51:10.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.289+0000 7fca37fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TNALHKXCEYPFPFZRBOEQ to cache LRU end 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.291+0000 7fcb6a010800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "user_id": "root2.client.0", 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "email": "root2+test@test.test", 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "suspended": 0, 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "max_buckets": 1000, 2024-09-14T11:51:10.290 INFO:teuthology.orchestra.run.smithi116.stdout: "subusers": [], 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "keys": [ 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "user": "root2.client.0", 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "access_key": "TNALHKXCEYPFPFZRBOEQ", 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "secret_key": "VdOib/c50DKVFUtHuXzqZsYWuMKpRzrVztqnH8n0lBCou4UV+Y0ShQ==", 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "active": true, 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:10.283477Z" 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "swift_keys": [], 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": [], 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "op_mask": "read, write, delete", 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "default_placement": "", 2024-09-14T11:51:10.291 INFO:teuthology.orchestra.run.smithi116.stdout: "default_storage_class": "", 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "placement_tags": [], 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "bucket_quota": { 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "user_quota": { 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "enabled": false, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "check_on_raw": false, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size": -1, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_size_kb": 0, 2024-09-14T11:51:10.292 INFO:teuthology.orchestra.run.smithi116.stdout: "max_objects": -1 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "temp_url_keys": [], 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "type": "root", 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "mfa_ids": [], 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "path": "/", 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "create_date": "2024-09-14T11:51:10.283463Z", 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "tags": [], 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: "group_ids": [] 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T11:51:10.293 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:51:10.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.292+0000 7fca1bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.294+0000 7fcb6a010800 20 remove_watcher() i=0 2024-09-14T11:51:10.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.294+0000 7fcb6a010800 2 removed watcher, disabling cache 2024-09-14T11:51:10.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.296+0000 7fcb6a010800 20 remove_watcher() i=1 2024-09-14T11:51:10.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.297+0000 7fcb6a010800 20 remove_watcher() i=2 2024-09-14T11:51:10.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.298+0000 7fcb6a010800 20 remove_watcher() i=3 2024-09-14T11:51:10.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.299+0000 7fcb6a010800 20 remove_watcher() i=4 2024-09-14T11:51:10.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.301+0000 7fcb6a010800 20 remove_watcher() i=5 2024-09-14T11:51:10.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.302+0000 7fcb6a010800 20 remove_watcher() i=6 2024-09-14T11:51:10.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.303+0000 7fcb6a010800 20 remove_watcher() i=7 2024-09-14T11:51:10.313 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 5953605895 --totp-seed 5ATGNPII3OHKGJYGQOYPR5H4NPKFTXK6BY4VLDWT67JK6T5RIX5KAWLBGY3HRH5B --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:51:10.378 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:51:10.379 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:51:10.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.413+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 realm 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.415+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.416+0000 7fc112640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:10.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.416+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.416+0000 7fc112640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:51:10.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.416+0000 7fc112640800 20 searching for the correct realm 2024-09-14T11:51:10.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.420+0000 7fc10f929640 0 -- 172.21.15.116:0/1551560556 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x562b3037f720 msgr2=0x562b30381b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:10.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.423+0000 7fc11012a640 0 -- 172.21.15.116:0/1551560556 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc104086900 msgr2=0x7fc1040897f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.427+0000 7fc112640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 zone default found 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 4 Realm: () 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 zonegroup default 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.428+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.429+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.429+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.429+0000 7fc112640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.429+0000 7fc112640800 20 started sync module instance, tier type = 2024-09-14T11:51:10.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.429+0000 7fc112640800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=0 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=1 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=2 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=3 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=4 2024-09-14T11:51:10.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=5 2024-09-14T11:51:10.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.438+0000 7fc112640800 20 add_watcher() i=6 2024-09-14T11:51:10.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.439+0000 7fc112640800 20 add_watcher() i=7 2024-09-14T11:51:10.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.439+0000 7fc112640800 2 all 8 watchers are set, enabling cache 2024-09-14T11:51:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fbfc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fc112640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:51:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fc112640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:51:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fc112640800 5 note: GC not initialized 2024-09-14T11:51:10.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fbfc5fdb640 20 reqs_thread_entry: start 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fc112640800 20 init_complete bucket index max shards: 11 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fc112640800 20 Filter name: none 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.441+0000 7fbf377fe640 20 reqs_thread_entry: start 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 20 rados->read ofs=0 len=0 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.442+0000 7fc112640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:51:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.444+0000 7fc112640800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:51:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.444+0000 7fc112640800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.444+0000 7fc112640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:51:10.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.445+0000 7fbfe77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398995 cookie 94743492560224 notifier 9489 bl.length()=695 2024-09-14T11:51:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.445+0000 7fbfe77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:51:10.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.445+0000 7fbfe77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:51:10.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.447+0000 7fbfc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:51:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.449+0000 7fc112640800 20 remove_watcher() i=0 2024-09-14T11:51:10.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.449+0000 7fc112640800 2 removed watcher, disabling cache 2024-09-14T11:51:10.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.450+0000 7fc112640800 20 remove_watcher() i=1 2024-09-14T11:51:10.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.451+0000 7fc112640800 20 remove_watcher() i=2 2024-09-14T11:51:10.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.452+0000 7fc112640800 20 remove_watcher() i=3 2024-09-14T11:51:10.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.453+0000 7fc112640800 20 remove_watcher() i=4 2024-09-14T11:51:10.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.454+0000 7fc112640800 20 remove_watcher() i=5 2024-09-14T11:51:10.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.455+0000 7fc112640800 20 remove_watcher() i=6 2024-09-14T11:51:10.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:51:10.456+0000 7fc112640800 20 remove_watcher() i=7 2024-09-14T11:51:10.465 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:51:10.466 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:51:10.466 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:51:10.494 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:51:10.494 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T11:51:10.494 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:51:10.563 DEBUG:teuthology.orchestra.run.smithi116:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:51:10.744 INFO:teuthology.orchestra.run.smithi116.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:51:10.919 INFO:teuthology.orchestra.run.smithi116.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:51:11.179 INFO:teuthology.orchestra.run.smithi116.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:52:54.889 INFO:teuthology.orchestra.run.smithi116.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:52:56.283 INFO:teuthology.orchestra.run.smithi116.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=6f0241003e3de8868e66a92fc9ccf7284fbd27f7424e362dcc266059fe0e24c6,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:52:56.283 INFO:teuthology.orchestra.run.smithi116.stdout:py run-test-pre: PYTHONHASHSEED='2242326558' 2024-09-14T11:52:56.283 INFO:teuthology.orchestra.run.smithi116.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:52:56.417 INFO:teuthology.orchestra.run.smithi116.stdout:============================= test session starts ============================== 2024-09-14T11:52:56.417 INFO:teuthology.orchestra.run.smithi116.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:52:56.417 INFO:teuthology.orchestra.run.smithi116.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:52:56.417 INFO:teuthology.orchestra.run.smithi116.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:52:56.417 INFO:teuthology.orchestra.run.smithi116.stdout:configfile: pytest.ini 2024-09-14T11:52:58.149 INFO:teuthology.orchestra.run.smithi116.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:52:58.150 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:52:58.550 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:52:58.867 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:52:59.235 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:52:59.608 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:52:59.911 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:53:00.251 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:53:00.669 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:53:00.965 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:53:01.085 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:53:01.205 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:53:01.515 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:53:01.825 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:53:02.130 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:53:02.442 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:53:02.564 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:53:02.686 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:53:02.762 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:53:02.837 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:53:02.913 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:53:02.988 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:53:03.064 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:53:03.140 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:53:03.216 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.292 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.370 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.445 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.521 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.596 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.672 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:53:03.748 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:53:03.824 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:53:03.901 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:53:03.977 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:53:04.051 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:53:04.127 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:53:04.204 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:53:04.278 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:53:04.354 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.430 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.504 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.580 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.656 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.732 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.808 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:53:04.884 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:53:04.961 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.036 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.112 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.189 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.263 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.338 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.414 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:53:05.489 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:53:06.061 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:53:09.048 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:53:12.924 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:53:17.633 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:53:24.246 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:53:26.052 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:53:27.915 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:53:28.712 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:53:28.979 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:53:29.372 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:53:29.765 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:53:30.461 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:53:30.859 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:53:31.111 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:53:31.112 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:53:31.113 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:53:31.114 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:53:31.115 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:53:31.116 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:53:31.117 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:53:31.118 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:53:31.118 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.119 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.120 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.121 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.121 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:53:31.122 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.123 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.124 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:53:31.125 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:53:31.126 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:53:31.126 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:53:31.127 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:53:31.128 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:53:31.129 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:53:31.130 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:53:31.131 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:53:31.131 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:53:31.132 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:53:31.133 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:53:31.134 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:53:31.217 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:53:31.227 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:53:31.929 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:53:42.531 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:53:43.045 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:53:43.643 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:53:44.252 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:53:44.842 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:53:45.430 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:53:45.884 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:53:46.498 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:53:47.057 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:53:47.604 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:53:48.071 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:53:48.515 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:53:48.979 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:53:49.191 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:53:49.696 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:53:50.271 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:53:50.876 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:53:51.343 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:53:51.805 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:53:52.272 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:53:52.727 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:53:53.186 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:53:53.629 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:53:54.080 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:53:54.301 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:53:54.552 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:53:54.772 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:53:54.991 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:53:55.212 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:53:55.661 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:53:55.891 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:53:56.149 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:53:56.558 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:53:56.951 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:53:57.181 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:53:57.604 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:53:57.996 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:53:58.552 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:53:58.901 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:53:59.289 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:53:59.680 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:54:00.391 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:54:01.003 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:54:01.548 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:54:02.223 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:03.013 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:04.273 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:05.937 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:06.764 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:07.551 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:54:08.152 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:54:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:54:09.413 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:54:10.706 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:54:11.507 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:54:12.512 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:54:14.683 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:54:17.581 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:54:19.132 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:54:20.562 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:54:21.651 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:54:22.287 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:54:23.555 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:54:24.412 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:54:25.606 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:54:26.397 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:54:27.972 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:54:29.185 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:54:30.982 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:54:32.717 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:54:33.878 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:54:34.928 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:54:35.746 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:54:37.893 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:54:39.409 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:54:41.193 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:54:42.890 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:54:44.444 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:54:45.988 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:54:47.264 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:54:48.129 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:54:49.136 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:54:51.081 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:54:53.654 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:54:54.706 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:54:56.322 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:54:57.935 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:54:59.419 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:55:00.943 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:55:02.529 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:55:04.064 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:55:05.521 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:55:06.517 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:55:07.313 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:55:08.087 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:55:08.874 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:55:10.303 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:55:11.790 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:55:13.270 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:55:14.689 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:55:16.187 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:55:17.585 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:55:19.041 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:55:20.507 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:55:21.896 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:55:23.362 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:55:24.776 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:55:26.250 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:55:27.178 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:55:28.073 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:55:28.917 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:55:29.778 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:55:30.376 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:55:31.245 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:55:31.969 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:55:32.686 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:55:33.422 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:55:34.125 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:55:34.812 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:55:35.501 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:55:36.235 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:55:37.205 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:55:38.185 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:55:38.758 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:55:39.334 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:55:40.065 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:55:40.747 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:55:41.730 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:55:42.708 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:55:43.393 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:55:44.095 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:55:44.823 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:55:45.511 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:55:46.201 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:55:46.888 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:55:47.573 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:55:48.263 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:55:48.988 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:55:49.693 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:55:50.376 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:55:51.058 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:55:51.704 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:55:52.359 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:55:53.016 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:55:53.740 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:55:54.437 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:56:40.670 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:56:41.354 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:56:41.997 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:56:42.650 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:56:43.299 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:56:43.948 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:56:44.617 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:56:45.267 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:56:45.950 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:56:46.591 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:56:47.234 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:56:47.876 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:56:48.520 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:56:49.209 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:56:49.906 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:56:50.631 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:56:51.314 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:56:51.999 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:56:52.679 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:56:53.368 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:56:54.062 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:56:54.756 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:56:55.476 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:56:56.240 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:56:57.001 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:56:57.686 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:56:58.364 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:56:59.062 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:56:59.785 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:57:00.040 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:57:00.625 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:57:02.572 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:57:04.529 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:57:05.198 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:57:05.915 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:57:06.705 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:57:07.390 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:57:08.149 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:57:08.911 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:57:09.617 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:57:10.307 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:57:11.029 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:57:11.721 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:57:12.401 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:57:13.080 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:57:14.011 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:57:15.215 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:57:15.758 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:57:16.262 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:57:16.723 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:57:17.186 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:57:17.412 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:57:17.641 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:57:17.866 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:57:18.463 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:57:20.162 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:57:20.427 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:57:20.990 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:57:21.438 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:57:21.918 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:57:22.390 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:57:24.369 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:57:25.230 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:57:26.115 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:58:12.946 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:59:00.128 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:59:00.702 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:59:01.255 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:59:01.834 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:59:02.408 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:59:03.310 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:59:03.890 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:59:04.516 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:59:05.167 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:59:05.783 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:59:06.409 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:59:07.039 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:59:07.715 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:59:08.323 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:59:08.794 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:59:09.341 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:59:09.923 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:59:10.745 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:59:11.323 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:59:11.871 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:59:12.419 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:59:13.002 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:59:13.639 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:59:14.107 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:59:14.580 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:59:15.110 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:59:15.579 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:59:16.042 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:59:16.514 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:59:17.089 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:59:17.564 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:59:18.038 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:59:18.513 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:59:18.982 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:59:19.739 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:59:20.242 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:59:20.714 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:59:21.190 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:59:21.665 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:59:22.141 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:59:22.615 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:59:23.095 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:59:24.264 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:59:24.775 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:59:25.405 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:59:26.020 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:59:26.603 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:59:27.219 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:59:27.842 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:59:29.457 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:59:30.091 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:59:30.748 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:59:31.472 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:59:32.219 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:59:32.939 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:59:33.529 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:59:34.251 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:59:35.019 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:59:35.644 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:59:36.424 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:59:36.984 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:59:37.447 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:59:37.904 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:59:38.440 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:59:38.939 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:59:39.169 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:59:39.916 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:59:40.497 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:59:41.096 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:59:44.119 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:59:44.696 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:59:45.289 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:59:45.855 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:59:46.426 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:59:46.936 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:59:47.511 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:59:48.143 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:59:48.736 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:59:49.292 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:59:49.849 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:59:50.422 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:59:50.981 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:59:51.559 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:59:52.106 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:59:52.714 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:59:53.287 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:59:53.842 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:59:54.069 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:59:54.299 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:59:54.530 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:59:54.981 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:59:55.452 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:59:55.904 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:59:56.352 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:59:56.871 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:59:57.304 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:59:57.529 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:59:58.019 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:59:58.248 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:59:58.476 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:59:58.704 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:59:58.933 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:59:59.444 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:59:59.965 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T12:00:00.460 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T12:00:00.971 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T12:00:01.490 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T12:00:02.003 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T12:00:02.505 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T12:00:03.104 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T12:00:03.616 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:00:04.125 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:00:04.743 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T12:00:05.374 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T12:00:06.075 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T12:00:06.792 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:00:07.418 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:00:08.134 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T12:00:08.844 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T12:00:09.548 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T12:00:10.225 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T12:00:10.710 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T12:00:11.420 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T12:00:12.116 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T12:00:12.824 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T12:00:13.530 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T12:00:14.272 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T12:00:15.038 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T12:00:15.722 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T12:00:16.385 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T12:00:17.113 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T12:00:17.773 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T12:00:18.316 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T12:00:18.931 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T12:00:19.575 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T12:00:20.141 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T12:00:20.647 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T12:00:21.370 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T12:00:22.267 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T12:00:23.191 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T12:00:24.089 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T12:00:24.995 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T12:00:25.908 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:00:26.802 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T12:00:27.710 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T12:00:28.669 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T12:00:29.600 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:00:30.550 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T12:00:31.480 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T12:00:32.408 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T12:00:33.922 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T12:00:35.460 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T12:00:35.678 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T12:00:35.902 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T12:00:36.126 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T12:00:36.612 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T12:00:37.102 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T12:00:37.551 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T12:00:37.997 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T12:00:38.702 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T12:00:40.910 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T12:00:41.689 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T12:00:42.402 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T12:00:45.300 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T12:00:46.023 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T12:00:46.736 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T12:00:47.374 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T12:00:48.073 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T12:00:49.092 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T12:00:49.913 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T12:00:50.734 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T12:00:51.514 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T12:00:52.789 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T12:00:54.069 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T12:00:54.545 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T12:00:55.036 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T12:00:57.154 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T12:00:57.958 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T12:01:04.527 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T12:01:05.053 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T12:01:05.812 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T12:01:07.954 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T12:01:08.637 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T12:01:09.845 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T12:01:15.743 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T12:01:23.355 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T12:01:36.639 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T12:02:28.206 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T12:02:36.889 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T12:02:49.296 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T12:02:50.297 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T12:02:54.934 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T12:02:58.873 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T12:03:00.735 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T12:03:01.344 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T12:03:04.517 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T12:03:05.254 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T12:03:05.883 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T12:03:06.503 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T12:03:24.322 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T12:03:27.149 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T12:03:27.828 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T12:03:28.346 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T12:03:29.021 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T12:03:33.053 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T12:03:36.613 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T12:03:40.143 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T12:03:40.746 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T12:03:41.384 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T12:03:41.990 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T12:03:42.600 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T12:03:43.202 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T12:03:43.833 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T12:03:44.473 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T12:03:45.498 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T12:03:47.219 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T12:03:50.649 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T12:03:51.796 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T12:03:54.052 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T12:03:57.394 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T12:03:58.656 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T12:04:01.451 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T12:04:07.359 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T12:04:08.528 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T12:04:09.309 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T12:04:10.379 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T12:04:10.993 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T12:04:16.517 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T12:04:17.177 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T12:04:17.788 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T12:04:18.400 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T12:04:19.012 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T12:04:19.835 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T12:04:31.254 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T12:04:32.375 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T12:04:33.152 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T12:04:34.205 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T12:04:35.245 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T12:04:39.959 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T12:04:41.017 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T12:04:46.745 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T12:05:08.005 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T12:05:20.081 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T12:05:22.336 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T12:05:24.573 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T12:05:25.499 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T12:05:26.512 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T12:05:27.224 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T12:05:28.374 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T12:05:29.390 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T12:05:31.123 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T12:05:31.676 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T12:05:32.239 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T12:05:32.793 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T12:05:33.271 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T12:05:33.748 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T12:05:34.347 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T12:05:34.881 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T12:05:35.368 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T12:05:36.022 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T12:05:36.515 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T12:05:37.015 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T12:05:37.513 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T12:05:38.010 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T12:05:38.487 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T12:05:39.130 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T12:05:39.791 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T12:05:40.647 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T12:05:41.292 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T12:05:41.924 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T12:05:42.541 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T12:05:43.164 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T12:05:43.687 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T12:05:44.201 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T12:05:44.758 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T12:05:45.274 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T12:06:11.986 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T12:06:38.615 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T12:06:45.966 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T12:06:46.554 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T12:07:47.689 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T12:08:49.176 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T12:08:49.868 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T12:08:50.490 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T12:08:51.004 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T12:08:51.477 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T12:09:10.242 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T12:09:16.692 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T12:09:23.162 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T12:09:23.751 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T12:09:24.419 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T12:09:25.070 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T12:09:25.932 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T12:09:26.554 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T12:09:27.168 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T12:09:27.798 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T12:09:28.420 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T12:09:29.110 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T12:09:29.867 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T12:09:30.490 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T12:09:31.120 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T12:09:32.213 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T12:09:33.288 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T12:09:35.305 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T12:09:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T12:09:38.239 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T12:09:39.747 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T12:09:41.219 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T12:09:42.764 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T12:09:44.226 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T12:09:45.889 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T12:09:47.446 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T12:09:48.161 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T12:09:48.743 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T12:09:49.419 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T12:09:50.950 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T12:09:52.488 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T12:09:54.037 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T12:09:55.553 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T12:10:08.583 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T12:10:09.479 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T12:10:10.476 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:10:11.461 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:10:12.796 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T12:10:13.987 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T12:10:14.637 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T12:10:15.747 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T12:10:16.218 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T12:10:16.687 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T12:10:17.158 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T12:10:17.635 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T12:10:18.270 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T12:10:18.848 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T12:10:19.833 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T12:10:20.408 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T12:10:20.914 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T12:10:21.428 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T12:10:21.935 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T12:10:22.451 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T12:10:23.016 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T12:10:23.533 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T12:10:24.079 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T12:10:24.615 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T12:10:25.120 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T12:10:25.824 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T12:10:26.444 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T12:10:27.138 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T12:10:27.801 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T12:10:28.426 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T12:10:29.032 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T12:10:29.786 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T12:10:30.514 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T12:10:31.238 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T12:10:31.894 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T12:10:32.591 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T12:10:33.240 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:10:34.036 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T12:10:34.811 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T12:10:35.514 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:10:36.183 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T12:10:36.835 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T12:10:37.469 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T12:10:38.225 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T12:10:38.847 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T12:10:39.540 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:10:40.353 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:10:40.972 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T12:10:41.652 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T12:10:42.266 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T12:10:52.720 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T12:10:53.389 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T12:11:03.410 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T12:11:04.108 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T12:11:04.795 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T12:11:05.278 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T12:11:05.830 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:11:06.400 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:11:06.959 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:11:07.528 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T12:11:08.110 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T12:11:08.600 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T12:11:09.145 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T12:11:09.794 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T12:11:10.327 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T12:11:11.062 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T12:11:11.708 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T12:11:12.251 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T12:11:12.805 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T12:11:13.628 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T12:11:24.425 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T12:11:24.915 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:11:25.480 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:11:26.071 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:11:26.682 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T12:11:28.084 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T12:11:28.755 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T12:11:29.931 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T12:11:33.307 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T12:11:34.514 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T12:11:39.320 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T12:11:43.426 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T12:11:44.113 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T12:11:44.942 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T12:11:58.255 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T12:12:18.668 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T12:12:21.331 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T12:12:23.164 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T12:12:24.965 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T12:12:26.494 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T12:12:27.144 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T12:12:30.687 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T12:12:36.750 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T12:13:17.025 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T12:13:19.698 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T12:13:21.451 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T12:13:23.178 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T12:13:24.172 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T12:13:29.116 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T12:13:32.068 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T12:13:32.914 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T12:13:34.105 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T12:13:39.071 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T12:13:43.007 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T12:13:47.115 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T12:13:48.722 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T12:13:48.929 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T12:13:52.273 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T12:13:55.765 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T12:13:57.811 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T12:14:01.779 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T12:14:02.942 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T12:14:31.398 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T12:14:31.606 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T12:14:32.625 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T12:14:33.341 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T12:14:34.097 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T12:14:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T12:14:35.021 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout:=============================== warnings summary =============================== 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout: import imp 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py:120 2024-09-14T12:14:35.022 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: if boto_type is 'S3Connection': 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_headers.py:124 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3.py:359 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T12:14:35.023 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: if k is 'BucketName': 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: @pytest.mark.timeout(10) 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.024 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.025 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T12:14:35.026 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.027 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.028 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.029 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T12:14:35.030 INFO:teuthology.orchestra.run.smithi116.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1298.60s (0:21:38) = 2024-09-14T12:14:35.146 INFO:teuthology.orchestra.run.smithi116.stdout:___________________________________ summary ____________________________________ 2024-09-14T12:14:35.146 INFO:teuthology.orchestra.run.smithi116.stdout: py: commands succeeded 2024-09-14T12:14:35.146 INFO:teuthology.orchestra.run.smithi116.stdout: congratulations :) 2024-09-14T12:14:35.163 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T12:14:35.164 DEBUG:teuthology.orchestra.run.smithi116:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:14:35.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:14:35.279 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T12:14:35.279 DEBUG:teuthology.orchestra.run.smithi116:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T12:14:35.308 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T12:14:35.308 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:14:35.500 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T12:14:35.512 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:14:35.512 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T12:14:35.513 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:14:35.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:14:35.542 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T12:14:35.542 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:14:35.611 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T12:14:35.611 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T12:14:35.681 INFO:tasks.workunit:timeout=3h 2024-09-14T12:14:35.681 INFO:tasks.workunit:cleanup=True 2024-09-14T12:14:35.682 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:14:35.751 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T12:15:31.157 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T12:15:31.157 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.157 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.158 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-09-14T12:15:31.159 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.159 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T12:15:31.159 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:31.159 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T12:15:31.160 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T12:15:31.229 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T12:15:31.231 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:15:31.232 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T12:15:31.280 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T12:15:31.330 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T12:15:31.370 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:15:31.372 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:15:31.372 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T12:15:31.409 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:15:31.413 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T12:15:31.413 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T12:15:31.488 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T12:15:31.489 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T12:15:31.490 DEBUG:teuthology.orchestra.run.smithi116:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:15:31.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:15:31.562 INFO:tasks.workunit.client.0.smithi116.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:15:31.562 INFO:tasks.workunit.client.0.smithi116.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:15:33.846 INFO:tasks.workunit.client.0.smithi116.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ deactivate nondestructive 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset VIRTUAL_ENV 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:15:33.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ export VIRTUAL_ENV 2024-09-14T12:15:33.848 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:15:33.848 INFO:tasks.workunit.client.0.smithi116.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:15:33.848 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PATH 2024-09-14T12:15:33.848 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n '' ']' 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ PS1='(rgw) ' 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ export PS1 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ hash -r 2024-09-14T12:15:33.849 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install pip --upgrade 2024-09-14T12:15:34.070 INFO:tasks.workunit.client.0.smithi116.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T12:15:34.247 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting pip 2024-09-14T12:15:34.252 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T12:15:34.297 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: pip 2024-09-14T12:15:34.297 INFO:tasks.workunit.client.0.smithi116.stdout: Attempting uninstall: pip 2024-09-14T12:15:34.297 INFO:tasks.workunit.client.0.smithi116.stdout: Found existing installation: pip 21.3.1 2024-09-14T12:15:34.448 INFO:tasks.workunit.client.0.smithi116.stdout: Uninstalling pip-21.3.1: 2024-09-14T12:15:34.453 INFO:tasks.workunit.client.0.smithi116.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T12:15:35.192 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed pip-24.2 2024-09-14T12:15:35.240 INFO:tasks.workunit.client.0.smithi116.stderr:+ pip install boto3 2024-09-14T12:15:36.014 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting boto3 2024-09-14T12:15:36.016 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T12:15:36.598 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T12:15:36.599 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T12:15:36.649 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T12:15:36.650 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T12:15:36.703 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T12:15:36.704 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T12:15:36.754 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:15:36.755 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T12:15:36.823 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:15:36.824 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T12:15:36.977 INFO:tasks.workunit.client.0.smithi116.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:15:36.978 INFO:tasks.workunit.client.0.smithi116.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T12:15:36.982 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T12:15:36.983 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T12:15:36.993 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T12:15:36.994 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T12:15:36.995 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T12:15:36.997 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T12:15:36.998 INFO:tasks.workunit.client.0.smithi116.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T12:15:37.071 INFO:tasks.workunit.client.0.smithi116.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T12:15:38.117 INFO:tasks.workunit.client.0.smithi116.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T12:15:38.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T12:15:38.369 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T12:15:38.405 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:38.405 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:38.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.445+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 realm 2024-09-14T12:15:38.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.444 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:15:38.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.445 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.446+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.447+0000 7f908f82b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:38.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.447+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.447+0000 7f908f82b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:15:38.446 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.447+0000 7f908f82b800 20 searching for the correct realm 2024-09-14T12:15:38.449 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.451+0000 7f908cb14640 0 -- 172.21.15.116:0/1768065034 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5570a2c9e660 msgr2=0x5570a2ca0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:38.453 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.455+0000 7f908d315640 0 -- 172.21.15.116:0/1768065034 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f9084055410 msgr2=0x7f9084055890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.459+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.459 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 zone default found 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 4 Realm: () 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 zonegroup default 2024-09-14T12:15:38.460 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.460+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.461+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.461+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.461+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.461+0000 7f908f82b800 20 started sync module instance, tier type = 2024-09-14T12:15:38.461 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.461+0000 7f908f82b800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=0 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=1 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=2 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=3 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=4 2024-09-14T12:15:38.468 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=5 2024-09-14T12:15:38.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.470+0000 7f908f82b800 20 add_watcher() i=6 2024-09-14T12:15:38.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.471+0000 7f908f82b800 20 add_watcher() i=7 2024-09-14T12:15:38.469 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.471+0000 7f908f82b800 2 all 8 watchers are set, enabling cache 2024-09-14T12:15:38.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f8f437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:38.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f908f82b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:15:38.471 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f908f82b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f908f82b800 5 note: GC not initialized 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f8f427e4640 20 reqs_thread_entry: start 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.473+0000 7f908f82b800 20 init_complete bucket index max shards: 11 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 20 Filter name: none 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f8eb3fff640 20 reqs_thread_entry: start 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T12:15:38.472 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T12:15:38.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:15:38.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T12:15:38.473 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 20 rados->read ofs=0 len=0 2024-09-14T12:15:38.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:38.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T12:15:38.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:15:38.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:15:38.474 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.474+0000 7f908f82b800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f908f82b800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f908f82b800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f908f82b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f8f70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399115 cookie 93942255869136 notifier 9507 bl.length()=613 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f8f70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:15:38.475 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.476+0000 7f8f70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f908f82b800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f908f82b800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f908f82b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f8f70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399559 cookie 93942255860736 notifier 9507 bl.length()=191 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f8f70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:15:38.477 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.479+0000 7f8f70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:15:38.479 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.481+0000 7f8f437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:38.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.483+0000 7f908f82b800 20 remove_watcher() i=0 2024-09-14T12:15:38.481 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.483+0000 7f908f82b800 2 removed watcher, disabling cache 2024-09-14T12:15:38.482 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.484+0000 7f908f82b800 20 remove_watcher() i=1 2024-09-14T12:15:38.483 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.485+0000 7f908f82b800 20 remove_watcher() i=2 2024-09-14T12:15:38.484 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.486+0000 7f908f82b800 20 remove_watcher() i=3 2024-09-14T12:15:38.485 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.487+0000 7f908f82b800 20 remove_watcher() i=4 2024-09-14T12:15:38.486 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.488+0000 7f908f82b800 20 remove_watcher() i=5 2024-09-14T12:15:38.487 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.489+0000 7f908f82b800 20 remove_watcher() i=6 2024-09-14T12:15:38.488 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:38.490+0000 7f908f82b800 20 remove_watcher() i=7 2024-09-14T12:15:38.749 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T12:15:38.749 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:38.870 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:15:38.897 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:38.897 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:39.135 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.138+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.137 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 realm 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.138 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.140+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.141+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.141+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.141+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:15:39.139 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.141+0000 7f607b532800 20 searching for the correct realm 2024-09-14T12:15:39.142 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.145+0000 7f606e9bb640 0 -- 172.21.15.116:0/4091631987 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5633d401e030 msgr2=0x5633d4020440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:39.146 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.148+0000 7f60771bc640 0 -- 172.21.15.116:0/4091631987 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f6060094290 msgr2=0x7f60600089a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:15:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:15:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:15:39.151 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.153+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:39.152 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 zone default found 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 4 Realm: () 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 zonegroup default 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.154+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.153 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.155+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.155+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.155+0000 7f607b532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.155+0000 7f607b532800 20 started sync module instance, tier type = 2024-09-14T12:15:39.154 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.155+0000 7f607b532800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=0 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=1 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=2 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=3 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=4 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=5 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.164+0000 7f607b532800 20 add_watcher() i=6 2024-09-14T12:15:39.162 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.165+0000 7f607b532800 20 add_watcher() i=7 2024-09-14T12:15:39.163 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.165+0000 7f607b532800 2 all 8 watchers are set, enabling cache 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f5f2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f607b532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f607b532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f607b532800 5 note: GC not initialized 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f5f2cfe1640 20 reqs_thread_entry: start 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f607b532800 20 init_complete bucket index max shards: 11 2024-09-14T12:15:39.165 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f607b532800 20 Filter name: none 2024-09-14T12:15:39.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.167+0000 7f5ea67fc640 20 reqs_thread_entry: start 2024-09-14T12:15:39.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.168+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.168+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:15:39.166 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.168+0000 7f607b532800 20 rados->read ofs=0 len=0 2024-09-14T12:15:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.169+0000 7f607b532800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:15:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.169+0000 7f607b532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:15:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.169+0000 7f607b532800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:15:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.169+0000 7f607b532800 20 INFO: main: starting shard=0 2024-09-14T12:15:39.167 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.169+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.0 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 INFO: main: starting shard=1 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.1 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 INFO: main: starting shard=2 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.170+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.2 2024-09-14T12:15:39.168 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: starting shard=3 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.3 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: starting shard=4 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.4 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.169 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 INFO: main: starting shard=5 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.171+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.5 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 INFO: main: starting shard=6 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.6 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 INFO: main: starting shard=7 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.172+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.7 2024-09-14T12:15:39.170 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 INFO: main: starting shard=8 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.8 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 INFO: main: starting shard=9 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.173+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.9 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.174+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.171 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.174+0000 7f607b532800 20 INFO: main: starting shard=10 2024-09-14T12:15:39.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.174+0000 7f607b532800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.10 2024-09-14T12:15:39.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.174+0000 7f607b532800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:39.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.174+0000 7f607b532800 20 INFO: main: done 2024-09-14T12:15:39.172 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.175+0000 7f5f2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:39.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.177+0000 7f607b532800 20 remove_watcher() i=0 2024-09-14T12:15:39.175 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.177+0000 7f607b532800 2 removed watcher, disabling cache 2024-09-14T12:15:39.176 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.178+0000 7f607b532800 20 remove_watcher() i=1 2024-09-14T12:15:39.177 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.180+0000 7f607b532800 20 remove_watcher() i=2 2024-09-14T12:15:39.178 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.181+0000 7f607b532800 20 remove_watcher() i=3 2024-09-14T12:15:39.179 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.182+0000 7f607b532800 20 remove_watcher() i=4 2024-09-14T12:15:39.180 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.183+0000 7f607b532800 20 remove_watcher() i=5 2024-09-14T12:15:39.181 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.183+0000 7f607b532800 20 remove_watcher() i=6 2024-09-14T12:15:39.182 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.184+0000 7f607b532800 20 remove_watcher() i=7 2024-09-14T12:15:39.193 INFO:tasks.workunit.client.0.smithi116.stderr:rados -p default.rgw.buckets.data ls | grep f8566603-49ea-46bc-9a91-d9775223cb05 2024-09-14T12:15:39.216 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:39.216 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:39.293 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:39.295+0000 7f25656d0640 0 -- 172.21.15.116:0/3177836759 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x7f2550017300 msgr2=0x7f2550017700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:15:39.304 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T12:15:39.304 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:39.305 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:15:40.735 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:15:41.131 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:15:41.158 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:41.158 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:41.195 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.197+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 realm 2024-09-14T12:15:41.197 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:15:41.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.198 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.199+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.199 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.200+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:41.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.200+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.200+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:15:41.200 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.200+0000 7f229612f800 20 searching for the correct realm 2024-09-14T12:15:41.203 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.205+0000 7f2292677640 0 -- 172.21.15.116:0/2184564617 >> [v2:172.21.15.164:6824/3391939760,v1:172.21.15.164:6825/3391939760] conn(0x7f227c06ac30 msgr2=0x7f227c0738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:41.409 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.411+0000 7f2291e76640 0 -- 172.21.15.116:0/2184564617 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x5591dd65fcb0 msgr2=0x5591dd662140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:41.412 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.413 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.414+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:41.414 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:15:41.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 zone default found 2024-09-14T12:15:41.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 4 Realm: () 2024-09-14T12:15:41.415 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 zonegroup default 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.415+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.416+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.416+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.416+0000 7f229612f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:41.416 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.416+0000 7f229612f800 20 started sync module instance, tier type = 2024-09-14T12:15:41.417 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.416+0000 7f229612f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:15:41.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=0 2024-09-14T12:15:41.423 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=1 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=2 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=3 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=4 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=5 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.425+0000 7f229612f800 20 add_watcher() i=6 2024-09-14T12:15:41.424 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.426+0000 7f229612f800 20 add_watcher() i=7 2024-09-14T12:15:41.425 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.426+0000 7f229612f800 2 all 8 watchers are set, enabling cache 2024-09-14T12:15:41.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.428+0000 7f2143fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:41.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:15:41.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:15:41.427 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 5 note: GC not initialized 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f2142ffd640 20 reqs_thread_entry: start 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 init_complete bucket index max shards: 11 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 Filter name: none 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f2140ff9640 20 reqs_thread_entry: start 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:15:41.428 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.429+0000 7f229612f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.430+0000 7f229612f800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.430+0000 7f229612f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.430+0000 7f229612f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.430+0000 7f229612f800 20 INFO: main: starting shard=0 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.430+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.0 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 INFO: main: starting shard=1 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.1 2024-09-14T12:15:41.431 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 INFO: main: starting shard=2 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.431+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.2 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: starting shard=3 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.3 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: starting shard=4 2024-09-14T12:15:41.432 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.4 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 INFO: main: starting shard=5 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.432+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.5 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 INFO: main: starting shard=6 2024-09-14T12:15:41.433 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.6 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 INFO: main: starting shard=7 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.433+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.7 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 INFO: main: starting shard=8 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.8 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 INFO: main: starting shard=9 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.434+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.9 2024-09-14T12:15:41.435 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.435+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.435+0000 7f229612f800 20 INFO: main: starting shard=10 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.435+0000 7f229612f800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.10 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.435+0000 7f229612f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.435+0000 7f229612f800 20 INFO: main: done 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.436+0000 7f2143fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:41.436 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.438+0000 7f229612f800 20 remove_watcher() i=0 2024-09-14T12:15:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.438+0000 7f229612f800 2 removed watcher, disabling cache 2024-09-14T12:15:41.437 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.439+0000 7f229612f800 20 remove_watcher() i=1 2024-09-14T12:15:41.438 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.440+0000 7f229612f800 20 remove_watcher() i=2 2024-09-14T12:15:41.439 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.441+0000 7f229612f800 20 remove_watcher() i=3 2024-09-14T12:15:41.440 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.442+0000 7f229612f800 20 remove_watcher() i=4 2024-09-14T12:15:41.441 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.443+0000 7f229612f800 20 remove_watcher() i=5 2024-09-14T12:15:41.442 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.444+0000 7f229612f800 20 remove_watcher() i=6 2024-09-14T12:15:41.443 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.445+0000 7f229612f800 20 remove_watcher() i=7 2024-09-14T12:15:41.454 INFO:tasks.workunit.client.0.smithi116.stderr:rados -p default.rgw.buckets.data ls | grep 53b2da7c-6d3a-40b5-a7a2-2e70f588897d 2024-09-14T12:15:41.477 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:41.477 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:41.545 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:41.548+0000 7f68e8afa640 0 -- 172.21.15.116:0/2381351506 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f68d0014a80 msgr2=0x7f68d006a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:41.562 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T12:15:41.562 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:41.671 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:15:43.164 INFO:tasks.workunit.client.0.smithi116.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T12:15:43.166 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:15:43.618 INFO:tasks.workunit.client.0.smithi116.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T12:15:43.618 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-09-14T12:15:43.784 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T12:15:47.260 INFO:tasks.workunit.client.0.smithi116.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T12:15:47.662 INFO:tasks.workunit.client.0.smithi116.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T12:15:47.693 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:47.694 INFO:tasks.workunit.client.0.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:47.730 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.732+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.732 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 realm 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.733 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.734+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.735+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:47.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.735+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.736+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:15:47.734 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.736+0000 7fc8dc73a800 20 searching for the correct realm 2024-09-14T12:15:47.737 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.739+0000 7fc8d8cbc640 0 -- 172.21.15.116:0/862955786 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7fc8c0038070 msgr2=0x7fc8c002a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:47.740 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.742+0000 7fc8d84bb640 0 -- 172.21.15.116:0/862955786 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7fc8c0053900 msgr2=0x7fc8c00453f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:15:47.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:15:47.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:15:47.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:15:47.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:15:47.948 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.948+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 zone default found 2024-09-14T12:15:47.949 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 4 Realm: () 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 zonegroup default 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.949+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.950 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.950+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.950+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.950+0000 7fc8dc73a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:47.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.950+0000 7fc8dc73a800 20 started sync module instance, tier type = 2024-09-14T12:15:47.951 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.950+0000 7fc8dc73a800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:15:47.957 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=0 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=1 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=2 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=3 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=4 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=5 2024-09-14T12:15:47.958 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=6 2024-09-14T12:15:47.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 20 add_watcher() i=7 2024-09-14T12:15:47.959 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.960+0000 7fc8dc73a800 2 all 8 watchers are set, enabling cache 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.962+0000 7fc78efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 5 note: GC not initialized 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc78dfdb640 20 reqs_thread_entry: start 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 20 init_complete bucket index max shards: 11 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 20 Filter name: none 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc6ff7fe640 20 reqs_thread_entry: start 2024-09-14T12:15:47.962 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.963+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.964+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.964+0000 7fc8dc73a800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.964+0000 7fc8dc73a800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.964+0000 7fc8dc73a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782 : miss 2024-09-14T12:15:47.963 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.964+0000 7fc8dc73a800 20 rados->read ofs=0 len=0 2024-09-14T12:15:47.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:15:47.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782 info.flags=0x17 2024-09-14T12:15:47.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782 to cache LRU end 2024-09-14T12:15:47.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:15:47.965 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.965+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.0 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.966+0000 7fc8dc73a800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.966+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.1 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.966+0000 7fc8dc73a800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.966+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.2 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.967+0000 7fc8dc73a800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.967+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.3 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.967+0000 7fc8dc73a800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T12:15:47.966 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.967+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.4 2024-09-14T12:15:47.967 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.968+0000 7fc8dc73a800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.968+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.5 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.968+0000 7fc8dc73a800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.968+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.6 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.969+0000 7fc8dc73a800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.969+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.7 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.969+0000 7fc8dc73a800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.969+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.8 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T12:15:47.968 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.9 2024-09-14T12:15:47.969 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T12:15:47.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 20 bucket index object: :.dir.38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782.10 2024-09-14T12:15:47.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T12:15:47.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.970+0000 7fc8dc73a800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T12:15:47.970 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.971+0000 7fc78efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:47.971 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.974+0000 7fc8dc73a800 20 remove_watcher() i=0 2024-09-14T12:15:47.972 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.974+0000 7fc8dc73a800 2 removed watcher, disabling cache 2024-09-14T12:15:47.973 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.975+0000 7fc8dc73a800 20 remove_watcher() i=1 2024-09-14T12:15:47.974 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.976+0000 7fc8dc73a800 20 remove_watcher() i=2 2024-09-14T12:15:47.975 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.977+0000 7fc8dc73a800 20 remove_watcher() i=3 2024-09-14T12:15:47.976 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.978+0000 7fc8dc73a800 20 remove_watcher() i=4 2024-09-14T12:15:47.977 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.979+0000 7fc8dc73a800 20 remove_watcher() i=5 2024-09-14T12:15:47.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.980+0000 7fc8dc73a800 20 remove_watcher() i=6 2024-09-14T12:15:47.978 INFO:tasks.workunit.client.0.smithi116.stderr:2024-09-14T12:15:47.981+0000 7fc8dc73a800 20 remove_watcher() i=7 2024-09-14T12:15:47.989 INFO:tasks.workunit.client.0.smithi116.stderr:Deleting bucket versioning-bucket 2024-09-14T12:15:48.149 INFO:tasks.workunit.client.0.smithi116.stderr:Completed bucket versioning tests 2024-09-14T12:15:48.150 INFO:tasks.workunit.client.0.smithi116.stdout:connected to http://localhost:80 2024-09-14T12:15:48.209 INFO:tasks.workunit.client.0.smithi116.stderr:+ deactivate 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:15:48.210 INFO:tasks.workunit.client.0.smithi116.stderr:+ hash -r 2024-09-14T12:15:48.211 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -n '' ']' 2024-09-14T12:15:48.211 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset VIRTUAL_ENV 2024-09-14T12:15:48.211 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T12:15:48.211 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset -f deactivate 2024-09-14T12:15:48.211 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo OK. 2024-09-14T12:15:48.212 INFO:tasks.workunit.client.0.smithi116.stdout:OK. 2024-09-14T12:15:48.213 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T12:15:48.213 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T12:15:48.294 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T12:15:48.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T12:15:48.666 DEBUG:teuthology.parallel:result is None 2024-09-14T12:15:48.666 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:15:48.705 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:15:48.705 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:15:48.775 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:15:48.775 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T12:15:48.786 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T12:15:48.805 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T12:15:48.805 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T12:15:48.805 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T12:15:48.878 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T12:15:48.878 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T12:15:48.935 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:15:48.935 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:15:48.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.970+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:48.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.971+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.971+0000 7f36b6c2f800 20 realm 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.971+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.972+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.972+0000 7f36b6c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.972+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.972+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:48.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.972+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:48.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.973+0000 7f36b6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:48.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.973+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:48.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.973+0000 7f36b6c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:15:48.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.973+0000 7f36b6c2f800 20 searching for the correct realm 2024-09-14T12:15:48.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.976+0000 7f36b4f1a640 0 -- 172.21.15.116:0/866709780 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f369c07c070 msgr2=0x7f369c0aaa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:15:48.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:48.980+0000 7f36b4719640 0 -- 172.21.15.116:0/866709780 >> [v2:172.21.15.116:6818/834372472,v1:172.21.15.116:6819/834372472] conn(0x7f369c07d050 msgr2=0x7f369c028a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:15:49.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.186+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 zone default found 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 4 Realm: () 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 zonegroup default 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.187+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:49.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:49.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:15:49.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 started sync module instance, tier type = 2024-09-14T12:15:49.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.188+0000 7f36b6c2f800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:15:49.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=0 2024-09-14T12:15:49.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=1 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=2 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=3 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=4 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=5 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=6 2024-09-14T12:15:49.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 20 add_watcher() i=7 2024-09-14T12:15:49.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.198+0000 7f36b6c2f800 2 all 8 watchers are set, enabling cache 2024-09-14T12:15:49.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.200+0000 7f356afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:49.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.200+0000 7f36b6c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:15:49.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.200+0000 7f36b6c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:15:49.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.238+0000 7f3569fdb640 20 reqs_thread_entry: start 2024-09-14T12:15:49.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.239+0000 7f36b6c2f800 20 init_complete bucket index max shards: 11 2024-09-14T12:15:49.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.239+0000 7f36b6c2f800 20 Filter name: none 2024-09-14T12:15:49.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.239+0000 7f34db7fe640 20 reqs_thread_entry: start 2024-09-14T12:15:49.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.239+0000 7f36b6c2f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T12:15:49.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.239+0000 7f36b6c2f800 20 rados->read ofs=0 len=0 2024-09-14T12:15:49.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.240+0000 7f36b6c2f800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T12:15:49.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.240+0000 7f36b6c2f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T12:15:49.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.240+0000 7f36b6c2f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T12:15:49.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.240+0000 7f36b6c2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:15:49.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.241+0000 7f36b6c2f800 10 removing key index: PCBVVABRKQXWVTMZPCWN 2024-09-14T12:15:49.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.242+0000 7f36b6c2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:PCBVVABRKQXWVTMZPCWN, ofs0, ns] 2024-09-14T12:15:49.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.242+0000 7f358b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399567 cookie 94393679514944 notifier 9633 bl.length()=170 2024-09-14T12:15:49.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.244+0000 7f36b6c2f800 10 removing email index: tester.client.0_test@test.test 2024-09-14T12:15:49.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.245+0000 7f36b6c2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T12:15:49.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.245+0000 7f358b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399068 cookie 94393679508224 notifier 9633 bl.length()=181 2024-09-14T12:15:49.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.246+0000 7f36b6c2f800 10 removing user buckets index 2024-09-14T12:15:49.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.248+0000 7f36b6c2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T12:15:49.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.248+0000 7f358affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399116 cookie 94393679521808 notifier 9633 bl.length()=172 2024-09-14T12:15:49.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.249+0000 7f36b6c2f800 10 removing user index: tester.client.0 2024-09-14T12:15:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.250+0000 7f36b6c2f800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T12:15:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.250+0000 7f36b6c2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T12:15:49.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.250+0000 7f358affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399568 cookie 94393679513200 notifier 9633 bl.length()=164 2024-09-14T12:15:49.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.252+0000 7f356afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:15:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.255+0000 7f36b6c2f800 20 remove_watcher() i=0 2024-09-14T12:15:49.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.255+0000 7f36b6c2f800 2 removed watcher, disabling cache 2024-09-14T12:15:49.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.256+0000 7f36b6c2f800 20 remove_watcher() i=1 2024-09-14T12:15:49.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.257+0000 7f36b6c2f800 20 remove_watcher() i=2 2024-09-14T12:15:49.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.258+0000 7f36b6c2f800 20 remove_watcher() i=3 2024-09-14T12:15:49.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.259+0000 7f36b6c2f800 20 remove_watcher() i=4 2024-09-14T12:15:49.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.260+0000 7f36b6c2f800 20 remove_watcher() i=5 2024-09-14T12:15:49.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.261+0000 7f36b6c2f800 20 remove_watcher() i=6 2024-09-14T12:15:49.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:15:49.262+0000 7f36b6c2f800 20 remove_watcher() i=7 2024-09-14T12:15:49.271 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T12:15:49.281 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T12:15:49.291 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T12:15:49.347 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T12:15:49.358 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T12:15:49.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:15:49.368 INFO:tasks.rgw.client.0.smithi116.stdout:2024-09-14T12:15:49.365+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46041) UID: 0 2024-09-14T12:15:49.368 INFO:tasks.rgw.client.0.smithi116.stdout:2024-09-14T12:15:49.368+0000 a1c2240 -1 shutting down 2024-09-14T12:16:08.033 INFO:tasks.rgw.client.0.smithi116.stderr:==00:00:58:33.921 46043== could not unlink /tmp/vgdb-pipe-from-vgdb-to-46043-by-root-on-??? 2024-09-14T12:16:08.034 INFO:tasks.rgw.client.0.smithi116.stderr:==00:00:58:33.921 46043== could not unlink /tmp/vgdb-pipe-to-vgdb-from-46043-by-root-on-??? 2024-09-14T12:16:08.034 INFO:tasks.rgw.client.0.smithi116.stderr:==00:00:58:33.921 46043== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-46043-by-root-on-??? 2024-09-14T12:16:12.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-14T12:16:13.764 INFO:tasks.rgw.client.0:Stopped 2024-09-14T12:16:13.765 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T12:16:13.800 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T12:16:13.883 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T12:16:13.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T12:16:13.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T12:16:13.963 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T12:16:14.060 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:16:14.060 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:16:14.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.096+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 20 realm 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:16:14.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.098+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.099+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.099+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.099+0000 7f15f1926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:16:14.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.099+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.100+0000 7f15f1926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:16:14.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.100+0000 7f15f1926800 20 searching for the correct realm 2024-09-14T12:16:14.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.102+0000 7f15ed66f640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.116:6826/1774573854,v1:172.21.15.116:6827/1774573854] conn(0x7f15e8023030 msgr2=0x7f15e8064190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:16:14.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.106+0000 7f15ede70640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.164:6816/4224008643,v1:172.21.15.164:6817/4224008643] conn(0x7f15d801a040 msgr2=0x7f15d8019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:16:14.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got zone_info.38a4cafb-e998-4940-b6f4-48d3d00371d5 2024-09-14T12:16:14.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:16:14.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:16:14.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got zonegroup_info.e33bd1b3-c135-437d-a978-9a1a344597e8 2024-09-14T12:16:14.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:16:14.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:16:14.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.111+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 zone default found 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 4 Realm: () 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 4 ZoneGroup: default (e33bd1b3-c135-437d-a978-9a1a344597e8) 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 4 Zone: default (38a4cafb-e998-4940-b6f4-48d3d00371d5) 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 zonegroup default 2024-09-14T12:16:14.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.112+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.113+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.113+0000 7f15f1926800 20 rados->read ofs=0 len=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.113+0000 7f15f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.113+0000 7f15f1926800 20 started sync module instance, tier type = 2024-09-14T12:16:14.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.113+0000 7f15f1926800 20 started zone id=38a4cafb-e998-4940-b6f4-48d3d00371d5 (name=default) with tier type = 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=0 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=1 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=2 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=3 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=4 2024-09-14T12:16:14.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=5 2024-09-14T12:16:14.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.122+0000 7f15f1926800 20 add_watcher() i=6 2024-09-14T12:16:14.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.123+0000 7f15f1926800 20 add_watcher() i=7 2024-09-14T12:16:14.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.123+0000 7f15f1926800 2 all 8 watchers are set, enabling cache 2024-09-14T12:16:14.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.125+0000 7f14a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:16:14.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.125+0000 7f15f1926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:16:14.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.125+0000 7f15f1926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:16:14.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.164+0000 7f14a2fe5640 20 reqs_thread_entry: start 2024-09-14T12:16:14.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.164+0000 7f15f1926800 20 init_complete bucket index max shards: 11 2024-09-14T12:16:14.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.164+0000 7f15f1926800 20 Filter name: none 2024-09-14T12:16:14.162 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.164+0000 7f14a0fe1640 20 reqs_thread_entry: start 2024-09-14T12:16:14.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.164+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:16:14.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.166+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.167+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45582' 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17832919064907673612', time=2024-09-14T13:53:30.317067+0000, chain.objs.size()=1 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.170__shadow_.AfRB073fov8jzE_okk_4FlSyi4LVqBk_0 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16262398162876239788', time=2024-09-14T13:55:40.447456+0000, chain.objs.size()=1 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.242__shadow_.czJGq2dv4AMZmbVPfQdJMxRCzFzsts4_0 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12477469560623038368', time=2024-09-14T13:55:41.416530+0000, chain.objs.size()=1 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.243__shadow_.Z0KnFUeJXNQSfo519uNmq4MdHGsp_pJ_0 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4635166764759497461', time=2024-09-14T13:55:43.775146+0000, chain.objs.size()=1 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.246__shadow_.q0p7oC_HcOZ52Jd72ItZcXgl8_hSD91_0 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9407109304416744615', time=2024-09-14T13:55:45.208532+0000, chain.objs.size()=1 2024-09-14T12:16:14.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.248__shadow_.BTnk-hvCWzAa4JssCJ84h0UZdlWSHFP_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15387750816577003694', time=2024-09-14T13:56:29.601486+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.84Htf589DGtyQ5WIN3t7V5PLkb9ciCF_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10156823958562151234', time=2024-09-14T13:56:29.625377+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-DumnH_GLxeDA2bZnyC6Ve4bfeWPnRf_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10715784490495164394', time=2024-09-14T13:56:29.858193+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WGrndzh_UxiJFrrhqiBsk05Fb6QakDN_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4861293189428112199', time=2024-09-14T13:56:29.858906+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qcnbaAssuhIQjM4JtHa2QAwnmijqD39_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9351326569238860376', time=2024-09-14T13:56:30.088306+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9ucgLub8MpoObp87kxbVWyDZH2ypV4T_0 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16329367932294638657', time=2024-09-14T13:56:30.164530+0000, chain.objs.size()=1 2024-09-14T12:16:14.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xmFJB6KiAlXcHA18EjOcvq4r4U4fK88_0 2024-09-14T12:16:14.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16220297015645213051', time=2024-09-14T13:56:30.181954+0000, chain.objs.size()=1 2024-09-14T12:16:14.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SnYn5aYUBIR2dSsvtvm118wjE_3zz_a_0 2024-09-14T12:16:14.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6429685714497962346', time=2024-09-14T13:56:31.650430+0000, chain.objs.size()=1 2024-09-14T12:16:14.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.APb91sNvrax6yZxwujMXfph0S7Z7qv8_0 2024-09-14T12:16:14.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18429484204542914663', time=2024-09-14T13:56:31.695188+0000, chain.objs.size()=1 2024-09-14T12:16:14.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.q59TIR45CM--M2xH_WpW5AIJKP_eOrT_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.418741283008668549', time=2024-09-14T13:56:32.205244+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Nfnc0pWlZg24Rz_C3mURnzOmr29hb4y_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1620849325363467129', time=2024-09-14T13:56:32.620971+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.X5JfFWE7XbZRYKyz-dW6gfYPLy00fDz_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7674242466294620254', time=2024-09-14T13:56:32.722716+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Gt69zKSFwK1R2EDCWX3BhYZr9klQkIj_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10876580094468705716', time=2024-09-14T13:56:32.887799+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8FcR0Z0aysfNLUB1fx3Sx_M_oK0RFPg_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1622559723574364345', time=2024-09-14T13:56:32.888408+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xWErYvJF_ic5dUg-rRA1z64EqOQX7vk_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6709466647707909356', time=2024-09-14T13:56:32.889242+0000, chain.objs.size()=1 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cfCRd6OIdTQ-aaAt53zpwCT2drpTgZO_0 2024-09-14T12:16:14.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11082996109285839163', time=2024-09-14T13:56:32.999530+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iGDJyIlo3voRckWUmzCN38VciwIgofk_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10755605780377620128', time=2024-09-14T13:56:33.000505+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7eDH3yt_pKxpb9ibD_PpuLjmZZC99LO_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5990490657913471585', time=2024-09-14T13:56:33.025231+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hP8mEn_IwGAajhXntnOQjLjdMQhQsZB_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5441638769245943704', time=2024-09-14T13:56:33.119225+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6jTkKuKAdaNNqNoaYTzSFjW87ylneGk_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3866613433474028999', time=2024-09-14T13:56:33.309959+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rcaJHJjz2uU9FnPvQ_FeCT05irRcfR5_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9805154554323454410', time=2024-09-14T13:56:33.335023+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JllfE-JEy8GjzZjLJkeEchz_dzmtNEP_0 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.171+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18261652469954714501', time=2024-09-14T13:56:35.020847+0000, chain.objs.size()=1 2024-09-14T12:16:14.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pvzjTObAdAchd84COjJaPNGNM-yZE--_0 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3059928787787710796', time=2024-09-14T13:56:35.021436+0000, chain.objs.size()=1 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qHX8U5fFjq-emshChq9NRw6w4ExvNp2_0 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5746379733000061597', time=2024-09-14T13:56:35.576911+0000, chain.objs.size()=1 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.S0Xb9KDZgsDBUwqiCuzpCQkjuQpdNvK_0 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10888918652812176612', time=2024-09-14T13:56:36.203497+0000, chain.objs.size()=1 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.B1SwYyo0-2JcQauL_aalIkRvI8HF0ys_0 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12106432214872618328', time=2024-09-14T13:56:36.772920+0000, chain.objs.size()=1 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iVboMUQ0pSQjA9CiB5MQVbxn35BFSI5_0 2024-09-14T12:16:14.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18241452969031218', time=2024-09-14T13:56:36.966363+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HTU16ddUtrOpeglRS28Swd9Dg15Y_v7_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17558297660451428744', time=2024-09-14T13:56:37.083849+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.173+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-3CwlGkDH3m9Msz6KErS9ztRgRp_npU_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2777093814725850859', time=2024-09-14T13:56:37.215928+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.epZngOTDKJoNmvkbegRu6uIjDkHCVLM_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17046992272418854674', time=2024-09-14T13:56:37.734126+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Aw5DxRq-aKDmLoC3Bknbni9mZ8DeCXe_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2056508329176817336', time=2024-09-14T13:56:38.120420+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.npHgVR9NU8Q_kPtQ9mdI0i64A_36tjz_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14743594910809937199', time=2024-09-14T13:56:38.829871+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mWdwUIIY0_gxLidF38nwsT9vecdP-E0_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13241894618642407947', time=2024-09-14T13:56:38.877094+0000, chain.objs.size()=1 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pG2lfWFLhuLN5rwS_8pltzLODqlgn-l_0 2024-09-14T12:16:14.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18332620543764279433', time=2024-09-14T13:56:39.220390+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KWXp9g-J991C1lkqCqaTN8tMtI7rBBT_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.175+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7446785190497687873', time=2024-09-14T13:56:39.520853+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.175+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fu1aQHCAHUWolnB3E7Ab-P-ED5IUnQ4_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.175+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15072153312459620124', time=2024-09-14T13:56:39.682056+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.175+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RdyDVRAtdFrI1FYINvNk9qxE03TXeq3_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18005459950159521432', time=2024-09-14T13:56:39.875294+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.J5amttbIvFdCh167HZKqltHpKH_noxn_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4206403752123694254', time=2024-09-14T13:56:39.965100+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fJju2VXAzccPZ0vhpBQHbuzgHOPzg8q_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10032721511558523313', time=2024-09-14T13:56:40.130952+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1Uk21Uon3HfPcYJTh8690Mp7iL0ibd__0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8254169420964112139', time=2024-09-14T13:56:40.291627+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OVKAspFt6KfAgCtcOTi99LYeCKCEt4v_0 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10752287808425015789', time=2024-09-14T13:56:40.292501+0000, chain.objs.size()=1 2024-09-14T12:16:14.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SEDVtxLAK-dYzcjj6Qk80RzISaviqYh_0 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12249127426591900996', time=2024-09-14T13:56:41.691146+0000, chain.objs.size()=1 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.264__shadow_.XEYMw77sbpgyJHIgW2RqjspzPSN012O_0 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16997232657531874703', time=2024-09-14T13:56:51.007918+0000, chain.objs.size()=1 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.278__shadow_.WDFIlMdtEN9oEcLCryEDZ8oacmJUPsB_0 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18140997424755993229', time=2024-09-14T13:56:57.375385+0000, chain.objs.size()=1 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.287__shadow_.tik7VazJwIEMewIxvcjl7exLL6Rq4vi_0 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6444712737248730620', time=2024-09-14T13:57:02.127615+0000, chain.objs.size()=1 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.V1iUtJDkoPsyF08If2Hq-VFJ3-v86MY_0 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15562411243973588355', time=2024-09-14T13:57:02.221067+0000, chain.objs.size()=1 2024-09-14T12:16:14.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.46VIyl4K2Ugx1fa7QB05-1G_WuR9Atc_0 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.177+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13495562861177454559', time=2024-09-14T13:57:02.237082+0000, chain.objs.size()=1 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.HGXjAJa9Wp5Dju6yflKiJGirBYVgSKG_0 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.178+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1118009607457187157', time=2024-09-14T13:57:07.087848+0000, chain.objs.size()=1 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.178+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.297__shadow_.K13yi8JdTtGSuqPFxE0yxhK7Lh4npG-_0 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.178+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17957346868967466910', time=2024-09-14T13:57:10.723008+0000, chain.objs.size()=1 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.178+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.302__shadow_.99aboHWbBZsvrnwtAGU_NothEY1YnMq_0 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10677488866539621104', time=2024-09-14T13:57:12.094989+0000, chain.objs.size()=1 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.304__shadow_.7oxT28lMyo7DYICn_0pUc3371GvwaHi_0 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8288965040091135739', time=2024-09-14T13:58:02.213786+0000, chain.objs.size()=1 2024-09-14T12:16:14.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.29cQKrKynl9uXaNkbHAB6aRpMu3RrPL_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2721456091663572704', time=2024-09-14T13:58:02.250417+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VwgPN0mR0_IjI9ihJe2KB9Mg1A9LnKr_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5169046160007776450', time=2024-09-14T13:58:02.434972+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UEo6H1dE98n8CKPhXLaVYblPRFFNCGH_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13084037789581448424', time=2024-09-14T13:58:02.695220+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5RjLi8zkC86062wMp2WDogwHsup3JAD_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12447661805505971837', time=2024-09-14T13:58:02.770482+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wFIv3n8-vaZG4Ctcc1ec-7FLN49Dqwq_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17010385101367096199', time=2024-09-14T13:58:04.710088+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8qKTjVbYs2TRMc4NS7y4FtpBvjf_q9B_0 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14034472885759728466', time=2024-09-14T13:58:05.881371+0000, chain.objs.size()=1 2024-09-14T12:16:14.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8ha9Ds7gF68q2Vvm9s9QE-xYlosp7By_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10328835577294820421', time=2024-09-14T13:58:05.952091+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.B9TNY9JVLlTuKNXbNwWAySkdFCxL0Ol_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.180+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9265361069529787222', time=2024-09-14T13:58:06.871327+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.180+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mxZfDodwnTiykAiLC9VwBJTKkA4KrnJ_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.180+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14850306053028933860', time=2024-09-14T13:58:06.991974+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.180+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YM2-axmNEVkc8oyUMk0W5N01oF8TN8y_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11721294415506933624', time=2024-09-14T13:58:07.082754+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CLoqs6HNmpQ2Bc46aIwjVo_Csvh-eo9_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6537735007199316397', time=2024-09-14T13:58:07.910319+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9jPB3xtjgyt-Jtwg6gWyQ11Ey5qNpIQ_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13961888491439128148', time=2024-09-14T13:58:07.921007+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.181+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2w4AmO5Aic1Br4DnXwfwzqgOAfcKrYG_0 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5003415922624100968', time=2024-09-14T13:58:08.165399+0000, chain.objs.size()=1 2024-09-14T12:16:14.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.t-dm924cKBHqDrIOdGxLdt4IaSmctgZ_0 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15414919781119767996', time=2024-09-14T13:58:08.356799+0000, chain.objs.size()=1 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mg5ir4sQuNIVAi3SDpuCOVIrH1rRg4u_0 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14984190794096655591', time=2024-09-14T13:58:08.489818+0000, chain.objs.size()=1 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uECPT52Iku6Sy9kelgP6XcPO53kAevm_0 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7487535598598684928', time=2024-09-14T13:58:09.952480+0000, chain.objs.size()=1 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GrLSRQLnqLWMsu_vDBujneROVIw-lrk_0 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.49564748548374298', time=2024-09-14T13:58:10.206608+0000, chain.objs.size()=1 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oaYvlt2ZWqDfh-6pMeWQcBuy8broiAh_0 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.851088942055812375', time=2024-09-14T13:58:10.252547+0000, chain.objs.size()=1 2024-09-14T12:16:14.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.09f77RoasZBNo3A7YcRjzUQRmui5mEk_0 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9566835236267078960', time=2024-09-14T13:58:10.575407+0000, chain.objs.size()=1 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YzPWOey-yUHJCnZ9pH_1TpRTC8Qoxar_0 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5842591831403703944', time=2024-09-14T13:58:10.789470+0000, chain.objs.size()=1 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.182+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cFiQ7iYxxHFLlGBjMJeTS6KF1GqPiT8_0 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7776782447515971170', time=2024-09-14T13:58:10.901754+0000, chain.objs.size()=1 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0O_7N6uLVeRuHFdb0Z5tob5852YJ-nc_0 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7493656947707826675', time=2024-09-14T13:58:10.961394+0000, chain.objs.size()=1 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Uo3NKSDGAdsknNI4M8OfTXT3Wa4ysaZ_0 2024-09-14T12:16:14.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10716412711687716814', time=2024-09-14T13:58:11.285185+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kvbKbBrSdbADzaPzymrGi6Pt2_TQ7kr_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12930722367776269082', time=2024-09-14T13:58:11.517112+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7IJPI_R7LKDWvD78bJT71jZD-CmdePw_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18237661949965122222', time=2024-09-14T13:58:11.528234+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.R4etjqKvZYJH-4MQnOK9NUWphAMz0Hw_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14209267169007049070', time=2024-09-14T13:58:49.165829+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QOQflYeJzNMkmJncq347z7j1LfAZsta_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.842237950218220587', time=2024-09-14T13:58:49.876794+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wI9gSN8emJ70V-9XZoF9tmmvMlKc--h_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9178749825024431555', time=2024-09-14T13:58:51.362469+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.O_BXwRJNH5FDBbBD_9VA8GI2EgvXQNc_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5712021795940397539', time=2024-09-14T13:58:51.936281+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9_iyS3CAwVv7MVHaLpXQ8_Eg-BhAj78_0 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10523056147493671798', time=2024-09-14T13:58:52.310744+0000, chain.objs.size()=1 2024-09-14T12:16:14.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sMvDJxLKxRwyjXp4y1H-RKuDt9FQqQq_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9579971777861445991', time=2024-09-14T13:58:52.315381+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.184+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nL9EmRXYOGYNdyCg-BxjONFAmxXYWc__0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2020898302715466669', time=2024-09-14T13:58:52.777946+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IlQfUXSVIeEfzVp5wB0wn_GowAHai5e_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6733515459449797867', time=2024-09-14T13:58:52.942264+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aaF9xmQj_R_UZC-R04EDlfpTuoWs-yn_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15643888250838076860', time=2024-09-14T13:58:53.364508+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9POHnJsg2mr7EgKT0o6Nx1SWW8WW1Vv_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11976335645276702998', time=2024-09-14T13:58:54.252240+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2_jclDpw2cnUI77gnMIs2cEct1Gok7W_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16614918413236983795', time=2024-09-14T13:58:54.777432+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.186+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WBktQmOCgvGve7FN6GpWt4mL1XtVFnv_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10787288677055335317', time=2024-09-14T13:58:55.350732+0000, chain.objs.size()=1 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3CnQAIc9zPK5IDIVB2vmiOoLRxHR6dH_0 2024-09-14T12:16:14.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10372808049978207641', time=2024-09-14T13:58:55.533862+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gNjBUuUIvmeO29iiRM_Orj9KTgbL5tP_0 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3732528783736604339', time=2024-09-14T13:58:56.438822+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._QADO6QdFcKiTpt1Npa_2IeR4cGR6JU_0 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9160296894800790709', time=2024-09-14T13:58:56.654596+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bbM0ygoq5kB_AyTWhJrHtRdCt7ppRh0_0 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5453133707806425374', time=2024-09-14T13:58:57.173512+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2neAsjTdYIfnqwc9UwFDUI1hDFb7iX2_0 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4737176697771521658', time=2024-09-14T13:58:57.340646+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UO2dNPbE0GVDr9AdungBQWJVyVP4lmy_0 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.188+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.493771033947750768', time=2024-09-14T13:58:58.095700+0000, chain.objs.size()=1 2024-09-14T12:16:14.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.188+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yFdxhQ-In1rBYll8xdT8wf5hHG2hY1h_0 2024-09-14T12:16:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4287163745094400148', time=2024-09-14T13:58:58.215761+0000, chain.objs.size()=1 2024-09-14T12:16:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.V9UVV2UAXr4EywqvVhCC92tBgHv5ald_0 2024-09-14T12:16:14.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/45582 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6041735952268945946', time=2024-09-14T13:58:58.630662+0000, chain.objs.size()=1 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MbpOjlHeRBi9T5wHR8Og-dClzrFw7eM_0 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14301136252689311153', time=2024-09-14T13:58:59.018959+0000, chain.objs.size()=1 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.EDK817W3Lcq13rsM1ynZbDAWYyWPKao_0 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3641214324258886719', time=2024-09-14T13:58:59.122037+0000, chain.objs.size()=1 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.S-4qD3lFbwAH7BrURE-McfS815w2aTQ_0 2024-09-14T12:16:14.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7976187483243768119', time=2024-09-14T13:58:59.556432+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FNjvUYtv98yzuxllV0S4gCpxYW_Ob8K_0 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4214775033162577643', time=2024-09-14T13:59:12.090842+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.344__shadow_.47Vfn7eXwwEJZt2nsTOLZrR-zWwLi9p_0 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14582479204713838991', time=2024-09-14T13:59:43.805702+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.394__shadow:3fBjwekSs4VaJouVR1ctu8C.jbLyn12_.1GY8lkHvzYbUljHwjPMVgLv8kk0nAjU_0 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18022832745637765091', time=2024-09-14T14:00:07.086262+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.433__shadow_.xu03-t5iVI7SbNfe7yuzVhWHi-utPe9_0 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18157673274732170756', time=2024-09-14T14:00:47.549653+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.490__shadow_.5BRB4jeZBvUzBr51PKtGphN6xIMU79f_0 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18157673274732170756', time=2024-09-14T14:00:47.745256+0000, chain.objs.size()=1 2024-09-14T12:16:14.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.490__shadow_.5BRB4jeZBvUzBr51PKtGphN6xIMU79f_0 2024-09-14T12:16:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14440632118233512749', time=2024-09-14T14:02:32.830751+0000, chain.objs.size()=2 2024-09-14T12:16:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~K4UeRQUyjy1KeNmWRmOTTOwVIRA_b44.1 2024-09-14T12:16:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~K4UeRQUyjy1KeNmWRmOTTOwVIRA_b44.2 2024-09-14T12:16:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~HnwTUCaUtu3WITgxmx7NISFx0ydcSZ6', time=2024-09-14T14:03:04.035567+0000, chain.objs.size()=1 2024-09-14T12:16:14.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.531__multipart_mymultipart.2~HnwTUCaUtu3WITgxmx7NISFx0ydcSZ6.1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12744944259666316232', time=2024-09-14T14:03:45.174720+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.550__shadow_.dYLlGPBA_Po6QllW7gvqYt2q3ETBBMM_0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13592344904053873071', time=2024-09-14T14:03:53.467695+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.554__shadow_.hZOXIDJ9viA0tVUvZIqGPBG6ROKC4kO_0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11887912823076607021', time=2024-09-14T14:04:27.567072+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:gFmfci7xRETKm1u2cT7zf8lUN-DYmOb_.9VbQYc-Pyumo2aYpeXhH9XyaAMXSkOP_0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14576695350333422977', time=2024-09-14T14:05:01.495932+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:abLxa2EXtA59-lwge2Kxm9wdhILX6rT_.b1DOjKQlTrCCOF4iyM3t0t-zMcGauxP_0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.267158559059073569', time=2024-09-14T14:05:30.110117+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:ML3h-rT1QcBPNw7PCflQR9wQ.fGMlXV_.nNVetzyCxzxwGs9wDsuncP8Dihn4QD8_0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7892447410336767424', time=2024-09-14T14:05:30.434777+0000, chain.objs.size()=1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:IiN-Bp2I2QNCEYjZMBcou7-q05nVQuE_.dZ94Qxeb71AqthnA70yq_18v904NYy__0 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2917418216009893421', time=2024-09-14T14:09:09.914124+0000, chain.objs.size()=12 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.1 2024-09-14T12:16:14.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.1_1 2024-09-14T12:16:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.2 2024-09-14T12:16:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.2_1 2024-09-14T12:16:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.3 2024-09-14T12:16:14.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.3_1 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.4 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.4_1 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.5 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.5_1 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__multipart_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.6 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.197+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623__shadow_multipart_enc.2~mSYrMrba0IaG9CCgGqiHzJwOz8YVmUT.6_1 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14348823886124103680', time=2024-09-14T14:10:13.660223+0000, chain.objs.size()=1 2024-09-14T12:16:14.196 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.668__shadow_.8iIIlgCUW0lgSiGbohQFoTKOI7LbcsZ_0 2024-09-14T12:16:14.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6803012909916561198', time=2024-09-14T14:10:26.108308+0000, chain.objs.size()=1 2024-09-14T12:16:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.691__shadow_.cj2JCuznXT130uL6MmbrYwk6hYhdPdJ_0 2024-09-14T12:16:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10712706982758284277', time=2024-09-14T14:10:40.533968+0000, chain.objs.size()=1 2024-09-14T12:16:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.712__shadow:HMSJFFdpITH6mDBfNxlJ8XL6L6Jc-AR_.kDSjlXIGOkjGwOxDrvjrnuaOD2YaRd9_0 2024-09-14T12:16:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10411414011371714414', time=2024-09-14T14:10:52.405337+0000, chain.objs.size()=1 2024-09-14T12:16:14.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.715__shadow:JuyieJkINDmuyGk8E13MsQMJ1qBVNVq_.BMKN_UObfHSbArouzYmdIc09r8XpaRo_0 2024-09-14T12:16:14.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15262678577696237826', time=2024-09-14T14:13:16.691333+0000, chain.objs.size()=1 2024-09-14T12:16:14.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.761__shadow_.HmgJvuVTWDv7FOsBcMlHH1NHuZOq8HD_0 2024-09-14T12:16:14.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.204+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:16:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.206+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.206+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47095' 2024-09-14T12:16:14.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4266270270800792574', time=2024-09-14T13:53:12.720684+0000, chain.objs.size()=5 2024-09-14T12:16:14.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-FROZEN.2~QBtA8jKI8NaUvlSY-K-sP0E2tn7dAo4.1 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__shadow_mymultipart-FROZEN.2~QBtA8jKI8NaUvlSY-K-sP0E2tn7dAo4.1_1 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-FROZEN.2~QBtA8jKI8NaUvlSY-K-sP0E2tn7dAo4.2 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__shadow_mymultipart-FROZEN.2~QBtA8jKI8NaUvlSY-K-sP0E2tn7dAo4.2_1 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-FROZEN.2~QBtA8jKI8NaUvlSY-K-sP0E2tn7dAo4.3 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11531842726549346453', time=2024-09-14T13:53:12.774482+0000, chain.objs.size()=3 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-STANDARD.2~T8NP7DZnwr0qaoHoiQxyXDtISYJ9kBa.1 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-STANDARD.2~T8NP7DZnwr0qaoHoiQxyXDtISYJ9kBa.2 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-STANDARD.2~T8NP7DZnwr0qaoHoiQxyXDtISYJ9kBa.3 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_vW0MihNG7y39MGEMNJHZLSYLN3jlr2V', time=2024-09-14T13:53:17.429745+0000, chain.objs.size()=3 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.9Djg0N1LRdOPS87LykTWgcBaaGU2Wz3_0 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.9Djg0N1LRdOPS87LykTWgcBaaGU2Wz3_1 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.9Djg0N1LRdOPS87LykTWgcBaaGU2Wz3_2 2024-09-14T12:16:14.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15322555838170602052', time=2024-09-14T13:55:31.655012+0000, chain.objs.size()=1 2024-09-14T12:16:14.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.207+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.230__shadow_.toev_4yab9GmGeouZi-9dkNrtgB6geW_0 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.209+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17090591150890901231', time=2024-09-14T13:55:46.577513+0000, chain.objs.size()=1 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.209+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.250__shadow_.zQQsnGTRcZwCwNyRhgvUk-CdxjFnc7F_0 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.209+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1143248662735233136', time=2024-09-14T13:55:46.587359+0000, chain.objs.size()=1 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.209+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.250__shadow_.bZkmFUDlzi6-oUMfkObiZYW7emQZviH_0 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3159533296952176627', time=2024-09-14T13:55:50.073009+0000, chain.objs.size()=1 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255__shadow_.SFJ8QlxNpaiAWJ1KklXBvxl7DulxyeU_0 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6590436966144647859', time=2024-09-14T13:56:29.628049+0000, chain.objs.size()=1 2024-09-14T12:16:14.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dg12cOIYWuJefXU4q6bO87HDfNanw_i_0 2024-09-14T12:16:14.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4297747782682666490', time=2024-09-14T13:56:30.639844+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Vzw8zQqmTcdnDanfGfNuLqNUzhNcKFq_0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1311806329786597218', time=2024-09-14T13:56:31.267437+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LgjBzAi2Qt69MCc5EOHzCp2ZhGiIJgY_0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13942890250720407500', time=2024-09-14T13:56:31.768987+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DW632dt1zL4TPQVyFwfSmiZt6jCXgG-_0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9715951066316148902', time=2024-09-14T13:56:31.950680+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jLn_ZQKCCtw4dJXLjMrRkI_ya6G1Rty_0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6272760363758558797', time=2024-09-14T13:56:32.622464+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Lpz_p2Is9_o2v14wlrRBbJdJ5X1O_Nu_0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9146300223439934982', time=2024-09-14T13:56:32.638961+0000, chain.objs.size()=1 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ybHJKNkF-NMxOXOUNKYQmyoO6rlzB8__0 2024-09-14T12:16:14.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2180596686429989930', time=2024-09-14T13:56:32.796616+0000, chain.objs.size()=1 2024-09-14T12:16:14.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.i9IXYBC3L32mG1kQXgv0-b4AaKEnYF9_0 2024-09-14T12:16:14.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8164692401529090309', time=2024-09-14T13:56:32.956871+0000, chain.objs.size()=1 2024-09-14T12:16:14.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HbF5jyPB9aJTF7oWfhzB0CZJle7mMAM_0 2024-09-14T12:16:14.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.211+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10890175146737309130', time=2024-09-14T13:56:33.278257+0000, chain.objs.size()=1 2024-09-14T12:16:14.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.212+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FFOqUrX2Q5VkaYz0r5xSEdCZ9qPxWtr_0 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.212+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15158592643111178169', time=2024-09-14T13:56:33.337499+0000, chain.objs.size()=1 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.212+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NC-CZYUZrdh3CZfKW2qqtC7hdHx8cfD_0 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1262653690870188138', time=2024-09-14T13:56:33.430604+0000, chain.objs.size()=1 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uAncjvOjfq9zSoplO8QWBgqg1naDglM_0 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9291748161370070601', time=2024-09-14T13:56:33.468386+0000, chain.objs.size()=1 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Z-DYyVuMDszhpIPzlP2vA2iG_84ilTz_0 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13706070366872911098', time=2024-09-14T13:56:34.568732+0000, chain.objs.size()=1 2024-09-14T12:16:14.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6Qi9QY8vAth-2pfgAh_oO70d8v-30hh_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12027837007586193079', time=2024-09-14T13:56:36.224723+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._Xu0uCsRqM_Q6qmz22Imbxud7p-knD3_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14583949138709011985', time=2024-09-14T13:56:36.966413+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NZpbYFPVzxS02QuglhYcRTG4dRWvd4X_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10507581873413542220', time=2024-09-14T13:56:37.108507+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.213+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.50C3zA8ZbQ_86APEnppBAcRsarroTly_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18253818953094302266', time=2024-09-14T13:56:37.143665+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.I-Yx0XiIBgkiJrsscTx4cbbTT5SEhBY_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1852681637261034457', time=2024-09-14T13:56:37.382682+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1Fs5Y5q6Q84p7LrP1mplahtY8uJT7g-_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7854718571880833936', time=2024-09-14T13:56:37.528959+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2xTZ2zOpkkFZWoKXsdpPgd-3PRrPBnT_0 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15197739776766391813', time=2024-09-14T13:56:37.779468+0000, chain.objs.size()=1 2024-09-14T12:16:14.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jB3WQuncbmhl0L6iMIswR62ppmhaGe1_0 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14166416524790387644', time=2024-09-14T13:56:38.413577+0000, chain.objs.size()=1 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y73a98YKIb-oePlxK97GDoyhsdcx7hQ_0 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18056504191227568221', time=2024-09-14T13:56:38.511292+0000, chain.objs.size()=1 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eS_M1qzZn4E9Y01Y6n5mESMx05Db848_0 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8656432617313319931', time=2024-09-14T13:56:38.630014+0000, chain.objs.size()=1 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.m5EfJqunTwl3PDphYmwB1TOh_wY5Hs9_0 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.215+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9755090228449664204', time=2024-09-14T13:56:39.229482+0000, chain.objs.size()=1 2024-09-14T12:16:14.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.215+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7CSIR1MnmwSm34Nk_jleBCYPzJObv3b_0 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4428813912225670843', time=2024-09-14T13:56:39.519045+0000, chain.objs.size()=1 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EqXrrC_N0q5Ij8d0DgizgUJN9C35FEc_0 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14370203595322812673', time=2024-09-14T13:56:39.773562+0000, chain.objs.size()=1 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ILyZ2Kne3s_h8iUhnzG9tNFEPL_rPa5_0 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11656404599062420541', time=2024-09-14T13:56:39.847831+0000, chain.objs.size()=1 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.C0fNRRtnGXqJ-VGkjjEhfK_KHCM7G3r_0 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1706902258405983725', time=2024-09-14T13:56:39.912802+0000, chain.objs.size()=1 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6WGnr1uA7vHNCiC2-x2gTbtX8DwtDcH_0 2024-09-14T12:16:14.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6630099504203599215', time=2024-09-14T13:56:39.959319+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xF-BudV_MPCrpyr-fHQar0t0z1jkm4m_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18077477436573019739', time=2024-09-14T13:56:44.289811+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.268__shadow_.dP-z1_EzMmtsOCblZJ3HFncUZLFnDfk_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17002165378025199638', time=2024-09-14T13:56:47.569717+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.273__shadow_.jdQ0yrGstYH2BJBARmT_gx4LnVoqC68_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1031565041199524698', time=2024-09-14T13:56:48.214131+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.274__shadow_.UpiL1YEWzsNYgJNLAgDTVQ9KbhE27vY_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10518644945337891072', time=2024-09-14T13:56:50.328971+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.277__shadow_.ScF4_VhQfCeaioghe5H6_EMKHXrM8_M_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9835786066991820370', time=2024-09-14T13:56:53.054450+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.217+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.281__shadow_.dC0EO0qi7wYb0hcd_8JuBYQ_1N8Y5hJ_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8471827673668421840', time=2024-09-14T13:56:58.058298+0000, chain.objs.size()=1 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.288__shadow_.0KmWbAzJ2Y5IixvA5plW4oDUwvlcIxD_0 2024-09-14T12:16:14.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8586555048528873335', time=2024-09-14T13:57:05.573088+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.295__shadow_.24dtm1hn1yj4WgKlu7uDMg4YCWUaMlh_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6781718134360768355', time=2024-09-14T13:58:02.397573+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FlnrpWao_23hv1xFJagyFEXvSAjUps4_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11239034553075588753', time=2024-09-14T13:58:02.551037+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0PS_22gZ4Drpe5_oI29Yr93YdcJKrrw_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4445887850803339145', time=2024-09-14T13:58:02.694069+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4bQdeDekRcp43aO1Pw0_ZJ4c0TAcDPW_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7869880073257469523', time=2024-09-14T13:58:02.900679+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CTIbZbHB7vhMPJyy5_S8ZoIiSKpW7sh_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3409501514319010676', time=2024-09-14T13:58:02.967489+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-ht94U1p0sK8DV9HYcG9QQIdJtYv-jc_0 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1893524843151623354', time=2024-09-14T13:58:03.021149+0000, chain.objs.size()=1 2024-09-14T12:16:14.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zhNBP50lMAGvsxwYwpS9k4BqJMK31kM_0 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2708720486256297126', time=2024-09-14T13:58:04.066490+0000, chain.objs.size()=1 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Gaz5XPPIeJQ_ICrjw0XlEasKlOQHUeX_0 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12082508428459586218', time=2024-09-14T13:58:04.450391+0000, chain.objs.size()=1 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Py7XK-bs9j-vFs-NfVOZ7xQta6-A3mI_0 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15846108453499881381', time=2024-09-14T13:58:04.669434+0000, chain.objs.size()=1 2024-09-14T12:16:14.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6taovLzz-czzzpktWn-Ro8-vMdjT0Ee_0 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7375902872823729396', time=2024-09-14T13:58:05.186514+0000, chain.objs.size()=1 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wfCzKfWAHWZ5E3Rn8I2M7Pka3BA43FG_0 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16535174720560726469', time=2024-09-14T13:58:05.320802+0000, chain.objs.size()=1 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.s37mM4OiLNCzkXTy39HOPYJnyEd3l5h_0 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.335591723333766047', time=2024-09-14T13:58:05.480610+0000, chain.objs.size()=1 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.220+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HLVB6TuPQKRg-k-BK45ErrhM_EbPN1K_0 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9524642790201793381', time=2024-09-14T13:58:05.540567+0000, chain.objs.size()=1 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9K3y3rZGdxxJXjgiQyIeO7WJbsXX27R_0 2024-09-14T12:16:14.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14629367948652561023', time=2024-09-14T13:58:05.704811+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.je8uknSWpr9Zlt9g8KRNXJt4DjIfnIG_0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8837477286529501693', time=2024-09-14T13:58:06.090470+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AAQNiCGAJoJMaJZCTybm4qYfXDXnCzS_0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13029430967669181978', time=2024-09-14T13:58:06.992933+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Apeh83UgzinDK54BYL3mFW-yK8i0C7__0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5108477357142502646', time=2024-09-14T13:58:07.222473+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QUiZt_TjskahVzxfsJ1sbz94Y49bZtn_0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14573262055458992085', time=2024-09-14T13:58:07.560462+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7HiXKCryo-UPvYed_QPDY3kD9eOeFUJ_0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14867810419417414664', time=2024-09-14T13:58:07.909145+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zb-pTTppsxReMVC1gvGon_DE5rP1NUQ_0 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16053304146274032785', time=2024-09-14T13:58:08.079287+0000, chain.objs.size()=1 2024-09-14T12:16:14.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8LQH6SUkpdavq4HQlHQWMaO9vAUCk4V_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5962805752091856321', time=2024-09-14T13:58:08.414435+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0NYNcWFlGnVgTu3LULl2sT0kDj33KSI_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4899263162119944857', time=2024-09-14T13:58:08.530091+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KJ_YKNXUWZ0d8kfmXGaKjUGUzpznmpI_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12755952252499046540', time=2024-09-14T13:58:08.577091+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.222+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.z3QGjFd6UoZ44bAvkBB0F-mW9qThDVr_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11458363838159991727', time=2024-09-14T13:58:09.322857+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BbU4vZgBb_41P-8xm_0LNtLZZQTg-3v_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.437707117945536621', time=2024-09-14T13:58:09.362056+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RlSEGVIClvBDdF-xmRgJUBdxS7d9VvW_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5756642650550573137', time=2024-09-14T13:58:09.588701+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.s0YuHBZnUIIMMBatuKN1kOekOwiYxxv_0 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5004142681874956099', time=2024-09-14T13:58:10.676030+0000, chain.objs.size()=1 2024-09-14T12:16:14.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qxBMqq948NhtDsbs6EtA9lTjo0SNLiO_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12679591959671695104', time=2024-09-14T13:58:11.172367+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xq7E2rQTPG04yXX2LZYdaLmLjPAtm4q_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13855780410297376559', time=2024-09-14T13:58:11.173174+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vaOSxG9OM3puLiWv-scHjEZkLfjE3nx_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16241471793170693160', time=2024-09-14T13:58:11.285139+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.A-gJGWvKVV7HonWne_qZipcERGcoht8_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13863861952722608029', time=2024-09-14T13:58:11.528221+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uZDE5X8LgDcS1vDta_EhxoUBvcmZLAO_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625993157757966214', time=2024-09-14T13:58:11.995016+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SnhIfT23N66Jje6YFLO3UY8gdJZ5KHM_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17396770209798459134', time=2024-09-14T13:58:11.995709+0000, chain.objs.size()=1 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.y0o3TGof-nZiII4z0dQg0T7tgtiYgMd_0 2024-09-14T12:16:14.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10118566950959770596', time=2024-09-14T13:58:12.416928+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.okF58TK6maHlgYE_1h0NoSFvruBywoR_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14144078130586900426', time=2024-09-14T13:58:49.533350+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dtGFIY4s602v0njIntljAvm30YjUFeS_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11894134765401968194', time=2024-09-14T13:58:49.594183+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.keQvDInVRhXfWOlBwYbbDDaxpSYk7iJ_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10931592003686439264', time=2024-09-14T13:58:49.877832+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.O7nMJ0qgV90piQBvSWMnPsx56Mu8k7i_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8393855262988404733', time=2024-09-14T13:58:49.878601+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vi5kFUjSJKk4KEfpIexwAOH6RMH-X53_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9102022601679661921', time=2024-09-14T13:58:50.006800+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hD7W92_4z7mUCtCsBHeFITWHQbm9xo__0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16211631224246704789', time=2024-09-14T13:58:51.244285+0000, chain.objs.size()=1 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QVsgh7ytooQ1powj6Hjb33tU0_EAZ5-_0 2024-09-14T12:16:14.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9326883525806277872', time=2024-09-14T13:58:51.306942+0000, chain.objs.size()=1 2024-09-14T12:16:14.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FDgoFVCXXvOB8Uv0l51Q85w1sWR9q0z_0 2024-09-14T12:16:14.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3906352332354104935', time=2024-09-14T13:58:51.308092+0000, chain.objs.size()=1 2024-09-14T12:16:14.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j9QhFf3J67kzmDK0SeDIRTUxRUUCrKy_0 2024-09-14T12:16:14.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16258953207074332300', time=2024-09-14T13:58:51.478472+0000, chain.objs.size()=1 2024-09-14T12:16:14.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sTIceP33x5MU6ZLpl1prUOTqoZTzXz5_0 2024-09-14T12:16:14.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2232619367359482091', time=2024-09-14T13:58:51.527432+0000, chain.objs.size()=1 2024-09-14T12:16:14.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eX2ukTYLXiW0hJsJ8Ag_NwsKJV7-Tz__0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17488707607617631600', time=2024-09-14T13:58:52.247761+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.APeJPAoASBJRskoFqgczF25kDhb8qw0_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12594251831422073239', time=2024-09-14T13:58:52.365929+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TqUc0PkXeBqKdf3VogjycvUk47tr24k_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10784530809728414691', time=2024-09-14T13:58:52.849537+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iL-0GZ8g7MyvGyXXYTMqxX18YVuf5Oz_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17965342026039476002', time=2024-09-14T13:58:53.765309+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.edriQHW4l-ZlR5Kv2NLuVqn7Ulr4TwL_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4827101496821033036', time=2024-09-14T13:58:53.935749+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BWkTFTAV1N_g8pXeA-_Bjk9ZV8w3_6P_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13182731670506273264', time=2024-09-14T13:58:54.376961+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.t9PORsDOXss-V-DTDnOzmkhkmWWKmbt_0 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8032098306086188349', time=2024-09-14T13:58:55.633181+0000, chain.objs.size()=1 2024-09-14T12:16:14.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iyvPVRec8VfsUuJB9AaTbqnXTw8gDmj_0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3245255347419895889', time=2024-09-14T13:58:55.767429+0000, chain.objs.size()=1 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BhvE-OmlRkjB0ZN8D-lhKTY0Z96QgR3_0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.228+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13102639073431400222', time=2024-09-14T13:58:56.736848+0000, chain.objs.size()=1 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.228+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8nvw9LyqGASa5PNBMGpXjoSJeeTRvnN_0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.228+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12423473917339729334', time=2024-09-14T13:58:56.873235+0000, chain.objs.size()=1 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.228+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7wT-IajnDxhCXN04IAAcqysTL9ysaX__0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10529552931222025623', time=2024-09-14T13:58:56.912718+0000, chain.objs.size()=1 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Mkq4dfFzx7gpkD4wRoAEUZ3Wx8q_aq2_0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15303657907198057840', time=2024-09-14T13:58:57.116663+0000, chain.objs.size()=1 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HU4JzxhmbgBcSwfVociZHvpR9w48af9_0 2024-09-14T12:16:14.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/47095 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.233+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.233+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13342005673771259671', time=2024-09-14T13:58:57.221017+0000, chain.objs.size()=1 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.233+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ue943pOLhKu37jM7vGtJWwYn39YJocA_0 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.233+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2967280859378623326', time=2024-09-14T13:58:57.893155+0000, chain.objs.size()=1 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5sJpM11e-9ciDmmoGDEX0zXnO539emG_0 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16218703759289042885', time=2024-09-14T13:58:57.919652+0000, chain.objs.size()=1 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yOzAc4yske9VcEXkaEym-39ytSHQ_3E_0 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1984791482089270376', time=2024-09-14T13:58:59.260875+0000, chain.objs.size()=1 2024-09-14T12:16:14.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.knw-2OGAf-X615kRt4QG6RmLqiKGssV_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2360064433178430238', time=2024-09-14T13:58:59.299902+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.a1WNjrgf66Uqro9w3BBqsCC2Y2HmUBk_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15128319988506027580', time=2024-09-14T13:58:59.674733+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dAA7u8aPdXi__FGaxFUcADRR9lZXRrh_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10483566051573595889', time=2024-09-14T13:59:09.010473+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.339__shadow_.ZoWHHAk-dMowfnQ4vEuWubPSFFeYvdc_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16487276153188922117', time=2024-09-14T14:00:11.796172+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.440__shadow_.EErvNcZk5-GEwOg_l2Khq72EaXeQoeF_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6100901007103025022', time=2024-09-14T14:00:21.945088+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.455__shadow_.mKGxhwxdMd_Rd4IKz3x_2qzdDDEXQ9G_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2016039744002785636', time=2024-09-14T14:00:41.379481+0000, chain.objs.size()=1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.484__shadow_.FpkkynFcCHbJr2rgr-TJGAl2Cl9riPw_0 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16003114393488784661', time=2024-09-14T14:02:34.291669+0000, chain.objs.size()=3 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~DBdMfv7GA4v7OsBFvu9npOq55DlL0oG.1 2024-09-14T12:16:14.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.234+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~DBdMfv7GA4v7OsBFvu9npOq55DlL0oG.2 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~DBdMfv7GA4v7OsBFvu9npOq55DlL0oG.3 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7281636620285650279', time=2024-09-14T14:04:20.739545+0000, chain.objs.size()=1 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:Yve5YRJ9et-9LABcVhnoUjXV84iuyE8_.3rUWDvukgXL2VBG2-Elo_wlr1dk7uib_0 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4263631991331598159', time=2024-09-14T14:04:22.098329+0000, chain.objs.size()=1 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:TS0F8RZ3iCwpv3mej7alno4EyFw2vzB_.zI_SCNUs9as7851EZ7jj0B3SF5awjGr_0 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4459441720455772184', time=2024-09-14T14:04:26.574167+0000, chain.objs.size()=1 2024-09-14T12:16:14.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.235+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:LDBgdOJem38rcqqsTgAa1ZuS6iMeFJw_.m_MPvxruFQKdXl-Uf0_xJyFB259gO8P_0 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6875195345839854435', time=2024-09-14T14:04:42.529090+0000, chain.objs.size()=1 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:bHf88lLMigMmLrTcAlnZOw7Bij9wP6K_.z52jj-TE714k0kmAdV2UhoxOU7_hhsK_0 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11760394546819732457', time=2024-09-14T14:04:51.126706+0000, chain.objs.size()=1 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:WofqepNcOkarUz5BM15hUL3j4xWGzsY_.-gpH3JbIVPYINwPUL4v-lBwSPxNDnG2_0 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16486464945630253214', time=2024-09-14T14:05:19.001310+0000, chain.objs.size()=7 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.1 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.1_1 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.2 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.2_1 2024-09-14T12:16:14.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.236+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.3 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.3_1 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~p41pJqp0OTYU_KeqyRpJx9Hda4ogA3i.4 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14497981459286962230', time=2024-09-14T14:09:24.082727+0000, chain.objs.size()=1 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.627__shadow_._CqOyL48Jgw8GTVTVbeNFiUpaI16EA8_0 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2810368586916978547', time=2024-09-14T14:09:48.412623+0000, chain.objs.size()=1 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.652__shadow_.-sZKSJpSyObrx9Pm1w6CyAY5ldssp0C_0 2024-09-14T12:16:14.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13865522312025466698', time=2024-09-14T14:09:50.623040+0000, chain.objs.size()=2 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.654__shadow_.WymjKv_CeeN3NubTS7cI28r56XOaqBs_0 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.654__shadow_.WymjKv_CeeN3NubTS7cI28r56XOaqBs_1 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14704317726674773522', time=2024-09-14T14:11:29.565026+0000, chain.objs.size()=1 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.742__multipart_mymultipart3.2~-kTMexpY6sQSizCu9pP76tvUp6rlPzA.1 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5269099554749448318', time=2024-09-14T14:13:28.786528+0000, chain.objs.size()=1 2024-09-14T12:16:14.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.766__shadow_.rQHq__nrzszbA-eQ5bnKNh3FFkT9lO3_0 2024-09-14T12:16:14.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.242+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.245+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:16:14.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.246+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.246+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51654' 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2124115124539642731', time=2024-09-14T13:53:00.528131+0000, chain.objs.size()=1 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.151__shadow_.ZVnuJOK0odOTwLlFUYX0lR-S1wd9O_Z_0 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3637841472932189159', time=2024-09-14T13:53:08.905216+0000, chain.objs.size()=3 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.AX6QMDOKzqpK8qwIEgK-_IxWR9CT-HI_0 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.AX6QMDOKzqpK8qwIEgK-_IxWR9CT-HI_1 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.AX6QMDOKzqpK8qwIEgK-_IxWR9CT-HI_2 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3469929885687144645', time=2024-09-14T13:53:28.559887+0000, chain.objs.size()=1 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.166__shadow_.d682mwvbr2A6PFnGLR-JnTm44shbEWr_0 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10876168358501819320', time=2024-09-14T13:55:46.578880+0000, chain.objs.size()=1 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.250__shadow_.KxIGPb6RXviL8stjmYz951j4PBRDd7b_0 2024-09-14T12:16:14.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6091382269327026543', time=2024-09-14T13:55:47.265499+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.251__shadow_.RjaWULs7RhhvQIjJvyNMjmWznF8oiBI_0 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9010066962991641673', time=2024-09-14T13:55:48.675850+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.253__shadow_.sasheRtQPLxpYR7pVH5XKSuAEBALQ0v_0 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1167309895619758605', time=2024-09-14T13:55:49.385673+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.254__shadow_.YnugJ3CrVzhwQvQRgkKiYJhtC-gDnFj_0 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17603134497772181170', time=2024-09-14T13:55:50.073360+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255__shadow_.6CJU3QqyLIJhiHIiiFjjaZ6nZLDXNub_0 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6969452082803409503', time=2024-09-14T13:55:53.428691+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.260__shadow_.0ePZlXow_fz2PbQnQ6IiqrCkxwuW7pn_0 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14160523087756855946', time=2024-09-14T13:56:30.269042+0000, chain.objs.size()=1 2024-09-14T12:16:14.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.248+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Z0oYsxuO6nQx8Oxmgjv8CZXlNf7mw2o_0 2024-09-14T12:16:14.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3348131120402113309', time=2024-09-14T13:56:30.672687+0000, chain.objs.size()=1 2024-09-14T12:16:14.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dssTZE6HmPOdclq0DFTUmPxl1KOfZtk_0 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12156179649137028883', time=2024-09-14T13:56:30.673348+0000, chain.objs.size()=1 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nplyx4zM0tkGI338MQpclDoDO8MvVe4_0 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15224342134052100718', time=2024-09-14T13:56:31.542210+0000, chain.objs.size()=1 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8UO7K0R3FtfqWt8Mc0DxR8Xg4cJ7FD7_0 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8696857883108230521', time=2024-09-14T13:56:31.960056+0000, chain.objs.size()=1 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.250+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.--rrfi4tp_KpbTjNxydSOhrEnOPGW12_0 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4788076581711600528', time=2024-09-14T13:56:32.123926+0000, chain.objs.size()=1 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ktw5SviAq6AYa09EG5OzXGV0A0Q3DMa_0 2024-09-14T12:16:14.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9364730216939588353', time=2024-09-14T13:56:32.828587+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NMqVjpdGtgGs15tcws5-nF4GJ3KAoxw_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3067795848605198891', time=2024-09-14T13:56:33.068895+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JBBTUuOQ2Aa46o3YURROZYm1sXtKvkV_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6844762887135977498', time=2024-09-14T13:56:33.311523+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.n3VUmS4tDTHJ4tEo-SHQLNDwKp4XSYJ_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9213497999423947026', time=2024-09-14T13:56:33.459701+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cIIF6NvCZTgwmiI8lMNdWPicfv1MJxU_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3374677625496023784', time=2024-09-14T13:56:33.561620+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FbC-tgAZj2S7boVJ_G1HTJBWs-Aq_7y_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16408941291677448576', time=2024-09-14T13:56:34.502235+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DqvApZMJHSQXb0BXfcoUDNjnxP4FA_-_0 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13596448824664818127', time=2024-09-14T13:56:34.773455+0000, chain.objs.size()=1 2024-09-14T12:16:14.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.251+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._1Da5vH_hHe2WZrw3bIK-6Txln-_lXj_0 2024-09-14T12:16:14.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3510280160766219669', time=2024-09-14T13:56:35.589403+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.s8Sra5JzoZ4A7j9Q61Pf6lNjItBjwVK_0 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7791031787337642324', time=2024-09-14T13:56:36.125452+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Hlp1WHysNEb0UBOHowvheApmFlJEi_d_0 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5393343206350379154', time=2024-09-14T13:56:36.934229+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XX2cyKzlPvq-tDHYGyvSiFKWh3_Yq4g_0 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2706882453503476308', time=2024-09-14T13:56:37.040402+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lCh5HGtB01vDnfyhLyNiAX6OLmqJlwA_0 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5163494089646270438', time=2024-09-14T13:56:37.185306+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.253+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.07O5-anEUgaaGEezwGXGpL5208lUZax_0 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1374715107128123307', time=2024-09-14T13:56:37.258017+0000, chain.objs.size()=1 2024-09-14T12:16:14.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._4q4dKwvZZ6P9BN0vZN52CrixAScER4_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7909642772885066058', time=2024-09-14T13:56:37.294635+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EV6mXErsZS6flCIi0U0WARfz81Jl1Lm_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16847768908786896972', time=2024-09-14T13:56:37.529158+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8KNIVE_Xo9HWkBjqo_hUqUdvqBdqxWR_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5392951328320198455', time=2024-09-14T13:56:37.544549+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hGPMVsKPkJ2_koX7RSJgLyBQveAKpOp_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13135499708750135060', time=2024-09-14T13:56:37.774651+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.phFBXWrVoDD91dUzFApsuuw7MZM3Lh6_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1824240517072350714', time=2024-09-14T13:56:38.448770+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NYiD9FE0gK4-p4jb1uwTGIGtxCcT0aL_0 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11149038826381115691', time=2024-09-14T13:56:38.553496+0000, chain.objs.size()=1 2024-09-14T12:16:14.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qR9BYdBX38QlX0Y_0NZ-oG_nlRPKMv5_0 2024-09-14T12:16:14.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8562026231780680752', time=2024-09-14T13:56:38.818662+0000, chain.objs.size()=1 2024-09-14T12:16:14.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ld50HlJIizva0hsmGlDx7vDGfcoj8zh_0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8161167442745306759', time=2024-09-14T13:56:38.963849+0000, chain.objs.size()=1 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.i91cy6ebi6hFTMOaLq7pMma277-7j46_0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5924257610000529314', time=2024-09-14T13:56:39.217983+0000, chain.objs.size()=1 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TKuzWFfTuTfd8POeP3IFaMQQpsvcCaV_0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6206941156362930056', time=2024-09-14T13:56:39.231217+0000, chain.objs.size()=1 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qHt3bPsMl4-O2pZMLkZNmkdo63DoKuC_0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4130006298948520912', time=2024-09-14T13:56:39.645671+0000, chain.objs.size()=1 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ttfn9W60R1d55vb3UnmvFDGa0I1rEv1_0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2749048719390722558', time=2024-09-14T13:56:40.030540+0000, chain.objs.size()=1 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IGMSHt6kV6cvH0THRa1lvYKRIvWTq___0 2024-09-14T12:16:14.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2810145160969831621', time=2024-09-14T13:56:40.232175+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SmC-1Ca30lsMP2LE40HFkAJOCTkWKRI_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18208020840883208491', time=2024-09-14T13:56:40.318933+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NSgGbKM-eAqKN8eFLOJrSVQ822T2Jhl_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3600287479668154831', time=2024-09-14T13:56:48.901031+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.275__shadow_.hXulpfUxQmPpAbFzr4rsYKFrRVuiSZa_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13380459010160071281', time=2024-09-14T13:56:56.684247+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.286__shadow_._MTT_uCQmslNmYsM6NpS74HE8ZhtmLl_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12863084590424408256', time=2024-09-14T13:57:02.185262+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.GWR6MAWoJX7jRP_YnoL6L-gEf7K6MnP_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9943976731795512670', time=2024-09-14T13:57:02.226909+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.BuWKz964loqkM-hScWvcc09UqaPh_VN_0 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5616447421418795331', time=2024-09-14T13:57:04.075080+0000, chain.objs.size()=1 2024-09-14T12:16:14.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.256+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.bW2Wz_Z0WtY0xgV2MbBllvmgK3JMGAG_0 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4789900505386461942', time=2024-09-14T13:57:04.885773+0000, chain.objs.size()=1 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.294__shadow_.Ls6xMWKni3ROavhAKxQsGXHRoLCA_h2_0 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12762495033539603172', time=2024-09-14T13:57:11.404577+0000, chain.objs.size()=1 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.303__shadow_.VzGf-dr0UmBr2Z5cyQd4dKoxjcgA5ci_0 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4641669095481521385', time=2024-09-14T13:58:02.845883+0000, chain.objs.size()=1 2024-09-14T12:16:14.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.t2MdTKxgcMFBgCuccvYHR-J4gtCTvPU_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16345454282658915001', time=2024-09-14T13:58:03.734746+0000, chain.objs.size()=1 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.T7TBMvEMEhMV57kBugCCHBZ-mlhWeTd_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3394824577092124074', time=2024-09-14T13:58:03.767672+0000, chain.objs.size()=1 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hWwFcKRvYpL5ddMBhDAT60p6T7gYLLL_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14550494637909971821', time=2024-09-14T13:58:04.345213+0000, chain.objs.size()=1 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.41pKpERgO0IAkfC4y9rcDiprqEQaiM-_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10035548210569963495', time=2024-09-14T13:58:04.495460+0000, chain.objs.size()=1 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zY8QSUW89ZQSqJ3APgtZIIHBDNYoYii_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3054739621380273607', time=2024-09-14T13:58:04.744780+0000, chain.objs.size()=1 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7ceOKO6Pq0vaiw8VlM8EkZmTZj5G7rJ_0 2024-09-14T12:16:14.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2175188801396398791', time=2024-09-14T13:58:05.188524+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.258+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kaabzIzBqO2luuL5ndxam0X139lHBUa_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4869953343637948142', time=2024-09-14T13:58:05.320942+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6dFil7HCF9IOLKuVQHWhud3G2TncSI6_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4758211325122421275', time=2024-09-14T13:58:05.340920+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KU8Nudk33KgsluhqtUJdOJucYmMmZlB_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.260+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7117908134140753384', time=2024-09-14T13:58:05.576444+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.260+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KI18IVo2joF9P5nsG5zfVRSbtAZkAkU_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.260+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14484192354582408024', time=2024-09-14T13:58:05.738430+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.260+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.I3SkRhYVGal9cHjk42CLLCHNbVdIWW4_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13354663342092078167', time=2024-09-14T13:58:05.778878+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WHI1RIN2rYd6_M0BSdINyvrSIHO6jaJ_0 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7209826133588333901', time=2024-09-14T13:58:05.831315+0000, chain.objs.size()=1 2024-09-14T12:16:14.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XV4f3UXiA34-fDDQBiuKqab-x-TD9AL_0 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8756983143377408546', time=2024-09-14T13:58:06.009547+0000, chain.objs.size()=1 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7o-Wyg89mDelNETZ45v7yiYU4WJD5tx_0 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17491781153216159126', time=2024-09-14T13:58:06.164277+0000, chain.objs.size()=1 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GodvkNv3L9JTMIgkzq-IIpEiYywRrwJ_0 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7813042183059440587', time=2024-09-14T13:58:06.557659+0000, chain.objs.size()=1 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FqV0FNkuBq0va6hvYFzaui7BKsjThjr_0 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2742616459460996377', time=2024-09-14T13:58:06.586329+0000, chain.objs.size()=1 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1i3_YkeIoe7ii2qSNyHEgWano0VDt_U_0 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3685411569372188090', time=2024-09-14T13:58:06.800880+0000, chain.objs.size()=1 2024-09-14T12:16:14.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2H-_zfCiT8eaBEHMH_GbvlpuEw68TRg_0 2024-09-14T12:16:14.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13691299188736145044', time=2024-09-14T13:58:06.974989+0000, chain.objs.size()=1 2024-09-14T12:16:14.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IwTgg1vQKKkf5b_Upnmn10f9fyIDRj-_0 2024-09-14T12:16:14.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3573829120877821388', time=2024-09-14T13:58:07.040630+0000, chain.objs.size()=1 2024-09-14T12:16:14.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LIAfnyzlTzl9iHE8V2BP2BkXM9BY5yL_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3867166520068232308', time=2024-09-14T13:58:08.021535+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vqQmKReRDTJLaQ0xR06g9sDo06ocl6s_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.901810306430733808', time=2024-09-14T13:58:08.040224+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Cl1_YO3NaLCxYgGj60LNusQALgHJjC7_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7917424958042133428', time=2024-09-14T13:58:08.413384+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ECxbzHL-QHuRvUTHvf-IDNpsNIqaBNl_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.623396396846734773', time=2024-09-14T13:58:08.912090+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.pBBSBFZGNdEr6_ROI22pS2vUTNkEWHu_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1806754531140230331', time=2024-09-14T13:58:09.540059+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dKE5QTOcimck2LHG7MrOJO3dHeuOtHa_0 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18203584497939624494', time=2024-09-14T13:58:09.649239+0000, chain.objs.size()=1 2024-09-14T12:16:14.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.b2X8Cgffvwz7kNU-TDSfD7NKjpOyLMc_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15534581403346366509', time=2024-09-14T13:58:09.656965+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SzMXwb69TIGFKlB0gmmLZRAupEpap24_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15805274797543806975', time=2024-09-14T13:58:09.916213+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.v14DXMTBS5NtueMYgvOF5fMvGn5Y_M7_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5950853477539869253', time=2024-09-14T13:58:10.209255+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Yrqukst_tC9blfyjXcuWMbbjj2pS9oy_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14217528034162624205', time=2024-09-14T13:58:10.590924+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KPR9tZgXOF7O9XpmpvWU-aAp_UG0ysK_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5656803350866563104', time=2024-09-14T13:58:10.935525+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HRc5v_kK48gT8agdaXyBluG_nJn1g7k_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17737631982996707356', time=2024-09-14T13:58:10.936079+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uiVlRzAVEI0IyYDqrwwy6sjJ4DZBY_y_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8068890739854543487', time=2024-09-14T13:58:12.192852+0000, chain.objs.size()=1 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K4Au2rtShX6_BC5zRY_CHnb54euAW9V_0 2024-09-14T12:16:14.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4949222913311658969', time=2024-09-14T13:58:12.274524+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O8by2C-W1M5bconCO5-8BITUo6CDTad_0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11066880531440380683', time=2024-09-14T13:58:12.538928+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.U5525bjBwk4LAxKS9J5dns6xczQNW1N_0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4366335242717406565', time=2024-09-14T13:58:48.997696+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RNu930uwngh_vK5NOvSnUxo7Cl0AVpE_0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13947794295640183526', time=2024-09-14T13:58:49.487293+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ggnSnNkb1PK4Ffx60nyHR25AJpSVbh7_0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7337485511362506442', time=2024-09-14T13:58:49.722591+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.345OknHkUwnzRdbYMmwkcRjafLtCTqI_0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8901581489325761533', time=2024-09-14T13:58:50.001040+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZtInOiwAh_F_wNsPvURkHspC5vhnxP__0 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1431944239696198854', time=2024-09-14T13:58:50.658204+0000, chain.objs.size()=1 2024-09-14T12:16:14.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dESkzFupIIcCryVT6ESm_BJzGkacsVt_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8855768814914095965', time=2024-09-14T13:58:50.765171+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eWv2H6Hn1aCj1HDksVdQWxJYTbtTPAY_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14915616030084610458', time=2024-09-14T13:58:51.526662+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XQNuc3Qw7J4KYvJoTesm9J75tDYd_2a_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6053241007704061699', time=2024-09-14T13:58:51.534862+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yltjREun6tHQQgTQAMAlhMC9AGLky5N_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18154373324603367993', time=2024-09-14T13:58:52.115817+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fHlDGBZk1bYQcFyOycApaemvnN7PqPl_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.266+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3837255760091937632', time=2024-09-14T13:58:52.530172+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.266+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.62VY1pBwJOu7zhzTUQMTSvbiT7MNl6j_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13802747023312099088', time=2024-09-14T13:58:52.843987+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aYqHRNnVOKgVz1nFQ_KZLpYCQjRIWX0_0 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11616619595495119148', time=2024-09-14T13:58:52.971416+0000, chain.objs.size()=1 2024-09-14T12:16:14.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BFuByW0C2D1E9ADeNb7d8Pc-FnT7LU3_0 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16475020273612891721', time=2024-09-14T13:58:53.460335+0000, chain.objs.size()=1 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6FwEaVZPDJ6F5udAV_T8kbLXGl33ZIz_0 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18052482079646397006', time=2024-09-14T13:58:53.673007+0000, chain.objs.size()=1 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0g3wfRHk6npk6wRNvbfcuQzT4LJzeQM_0 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13535830453194088177', time=2024-09-14T13:58:53.938364+0000, chain.objs.size()=1 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yi5yq05nPM7tGjSwKIgydC9seqKuHNT_0 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17815825197525801470', time=2024-09-14T13:58:54.003455+0000, chain.objs.size()=1 2024-09-14T12:16:14.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GsTvi-n2JksSk1Lyzq0xK8PTUrUiRv4_0 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/51654 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9259956968391994269', time=2024-09-14T13:58:54.086386+0000, chain.objs.size()=1 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bw4wKZPPzgbYzWhdIIUiPoOqowXZTcR_0 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7757548542245038755', time=2024-09-14T13:58:54.338444+0000, chain.objs.size()=1 2024-09-14T12:16:14.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tpVCCZhLe-G4Pf-gVBEvBzA3SyVoRID_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6174452012852592394', time=2024-09-14T13:58:54.746623+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OY-butrTA_0dbgTlKzOhpOFasPSP3_M_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13559802521859788280', time=2024-09-14T13:58:55.246145+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BsvxJrpeMpHxbidc-TWrYWSiMzw7-aA_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16894471404306314414', time=2024-09-14T13:58:55.383339+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WUV0AZcPn6CfblFQSCEqHkJfZWyGc9q_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4958093136015807372', time=2024-09-14T13:58:55.592766+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aQOgOblKNwW3T11PRF2EvxJYF0pNKlF_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14723944991751216012', time=2024-09-14T13:58:56.560806+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8yu-271U-sWH2eRWGMj7oKMjJyFJQkY_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5204287434871324775', time=2024-09-14T13:58:56.874539+0000, chain.objs.size()=1 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MSxi9PZaQbnzxerDnJMoDlOOh8j_4zY_0 2024-09-14T12:16:14.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.23226293298350463', time=2024-09-14T13:58:56.875282+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AYzZw3Fiff3mPDma7Dq9I4PxYBOztD8_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7130102292406280913', time=2024-09-14T13:58:57.156467+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VQHd1BvbTCoNiOYZgcFpNaaHao3204h_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1998715095484715043', time=2024-09-14T13:58:57.390991+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JoMsabBRg1b5TzrWjug1JTUhGBlB-zd_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7390280545124971377', time=2024-09-14T13:58:57.399630+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.37M0zX7wuAe2DwwZZdblYduK-Dob38Z_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.272+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6120919435091997362', time=2024-09-14T13:58:57.842062+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.272+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Xk5OGRYyWPKPRO9ysynsCvuFdUgVYzb_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16390743602620165851', time=2024-09-14T13:58:58.203474+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bJKAzPEbgH7xZfYoqMfr-8rgcGQOluE_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7151044089755081893', time=2024-09-14T13:58:58.707007+0000, chain.objs.size()=1 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.a9zEXpl76A7lXieC1LmSv86n9Ho7-wp_0 2024-09-14T12:16:14.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12442906157162515823', time=2024-09-14T13:58:59.219029+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ler_ClolQnIIGxnn0tCNXTNtmD-0eYE_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6633514270444138429', time=2024-09-14T13:58:59.495636+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.B0vDXR7xzg5Qt-B6R88ztY8JOF_gnHo_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5195403341461750445', time=2024-09-14T13:58:59.521873+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cpUCS93M270IIzDNOtcb9Qq0ZYJ3qEJ_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13483872265998200512', time=2024-09-14T13:58:59.678612+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yjIz8ebnZl41cgAdmm24JGwNcNr2etE_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11830151868463813771', time=2024-09-14T13:59:02.079151+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.328__shadow_.SLo7laEeCnjumVOfcmTFVhDldQB-7lI_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11106076312423356136', time=2024-09-14T13:59:02.698202+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.329__shadow_.rOEO06LSFzWZ0kfhEVOWXr2vqEdowBS_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16283741748969828868', time=2024-09-14T13:59:06.714249+0000, chain.objs.size()=1 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.335__shadow_.j1TyYIf8eBhElb0wsIaarOa2f5ncysz_0 2024-09-14T12:16:14.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7025556777691742473', time=2024-09-14T13:59:07.388809+0000, chain.objs.size()=1 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.273+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.336__shadow_.wQBQTo_kAzdM0xomR98w0c9ZYufuJTv_0 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.274+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10313493232757520445', time=2024-09-14T13:59:39.599676+0000, chain.objs.size()=1 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.274+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.390__shadow_.ilSm2vwoAtgX1Irz5eFV2KQ-_0Sa5Cn_0 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5591948012541822936', time=2024-09-14T14:00:13.202333+0000, chain.objs.size()=1 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.442__shadow_.46Uomt4K5HyfkCQ3YaIsxeRHeHDZqzz_0 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6298683752268510439', time=2024-09-14T14:00:40.555787+0000, chain.objs.size()=1 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.7_wsk0etswmFJk1EjZ9VBragW4hnSCH_0 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18296269601729070653', time=2024-09-14T14:02:12.036307+0000, chain.objs.size()=6 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.1 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.2 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.brHaZ5QaMytozxXgpfPLcNh4sqfFVtys.3 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.4 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.5 2024-09-14T12:16:14.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.6 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4065963046510134924', time=2024-09-14T14:04:25.760024+0000, chain.objs.size()=1 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:NEzzqY8V45WAl8IRky7VySI..JkiFPm_.uqYmQLs_iX4AjAMYZ3pagrUjoPOs0zM_0 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3400551131865453142', time=2024-09-14T14:04:39.244149+0000, chain.objs.size()=1 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:IcTTXGcmsCvL5A7aH2J1Jk18ldA0TMV_.LaVX53brlxDToFTc0M_M4xXda2e6uXd_0 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17689281033916959483', time=2024-09-14T14:04:43.226857+0000, chain.objs.size()=1 2024-09-14T12:16:14.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:U99coWxj2qbJ5JCMLLiDwv50bpY-zxK_.r1CajqTSKaPMa1Ib4KVxtvgR3Txc5C9_0 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8149551252014247803', time=2024-09-14T14:04:49.589772+0000, chain.objs.size()=1 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:zpSjjiXvYeSg6rvs3Zo8tucS6O2H8yZ_.5fvzAAIzJcuZ3oDfQlRoZP-mWgxgAcw_0 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12403663094662066669', time=2024-09-14T14:05:00.554971+0000, chain.objs.size()=1 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:04Sd.TH5w4m.QGEhfRVw7Gd0r9A9WAI_.CZ60-uS0Gb8oLcGdCP5oE0JpflJEmbN_0 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6402322149906631737', time=2024-09-14T14:05:06.655466+0000, chain.objs.size()=1 2024-09-14T12:16:14.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:TscaIH0AqgsqEh5WSREQE.6ejNK7TL5_.-fqyUiquV9VNMCcCdewq-WAr_AMK0lT_0 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4798709782027754205', time=2024-09-14T14:10:11.138292+0000, chain.objs.size()=1 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.665__shadow_.9SkeHEvo32-obsBHtBb0Q72MSn6SCC9_0 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5035776770162375504', time=2024-09-14T14:10:12.477308+0000, chain.objs.size()=1 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.666__shadow_.k9mAqwW6yMLLxFxl8cIN7Xt6EH0Wy7o_0 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.278+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9947605432031179744', time=2024-09-14T14:10:41.247936+0000, chain.objs.size()=1 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.713__shadow:cjnoNkSTGEtd.tAXzwnlRQ1K-ZrDqoK_.ebf8vN-peghX7pXjdA0ctnV5rEJWS3s_0 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.279+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.281+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:16:14.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.283+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.283+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51925' 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14537400135784472718', time=2024-09-14T13:55:37.862943+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.238__shadow_.6RnwqhckzxyQ4bDsZOS7zsnYmq_pehO_0 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5401882136307126894', time=2024-09-14T13:55:45.881448+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.249__shadow_.dRKdTjUkoPoRFzxl35F8rMtPM2M-d0Y_0 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4730756843951895652', time=2024-09-14T13:55:47.257108+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.251__shadow_.L3zsqwq8lm4Gv3OBgSkKf0I0d5JD4PN_0 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2344612521020500943', time=2024-09-14T13:55:49.384506+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.254__shadow_.Tv3mjxulBasyg1M1CzZfZmYbS4s3-23_0 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4638371507603216922', time=2024-09-14T13:55:50.753881+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.256__shadow_.MjJutYRKTmdN5CqDZmS0mbSvtF-s8So_0 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7720273996772468764', time=2024-09-14T13:55:50.754456+0000, chain.objs.size()=1 2024-09-14T12:16:14.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.256__shadow_.A-HoI1DYlV6F5VqW800BPzEvBVvK8eH_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2722787690122047991', time=2024-09-14T13:55:53.438941+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.260__shadow_.K-zzCwXI8pN06RGwtaJSiQVj13Lvk_P_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8760005945687732135', time=2024-09-14T13:55:54.125221+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.261__shadow_.lRC6HIlwucLaSuTD7z8Wvx_WwOO6dq-_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5061418752360449673', time=2024-09-14T13:56:29.735942+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.khA_Fb5gUgcR5-PbjFQkiZghfEU74f3_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4935792518492788877', time=2024-09-14T13:56:30.401986+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GDp8l5SBhEcr3_a2kfTdl1KvYpmURRw_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14770419847927597742', time=2024-09-14T13:56:31.230972+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sEzvjl9ylWx0AmPe1j231jDx4FxhIby_0 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15112169545990714645', time=2024-09-14T13:56:31.268572+0000, chain.objs.size()=1 2024-09-14T12:16:14.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.285+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-NYwO0XMTIzg_9BSdtOTHMdlYj2EaTk_0 2024-09-14T12:16:14.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11052046876072918694', time=2024-09-14T13:56:31.269276+0000, chain.objs.size()=1 2024-09-14T12:16:14.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QmMyyFZw5LKIfzpKikSXa9HOND-SWcc_0 2024-09-14T12:16:14.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3810447805407842607', time=2024-09-14T13:56:31.617027+0000, chain.objs.size()=1 2024-09-14T12:16:14.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3pgrq3-ZYXi7_ECAmNVCMW5qpsfU02M_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1983877493011420440', time=2024-09-14T13:56:31.758757+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tqRaC3McRRb8ehehbQRCjNhzjrD-4Lf_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12151562944072881969', time=2024-09-14T13:56:31.801304+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Fq2Q8nZOkNbdTw_HJWMUZdWAFK-Bmc0_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3992983795576208790', time=2024-09-14T13:56:31.885415+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bZ_RpVYYMOc1soK0jvbuwoNJzKehPZf_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10185201461197432111', time=2024-09-14T13:56:32.956949+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.66ejop8ODe1s-l3-c1CLxZ7aGmTMBdq_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6884187406982203793', time=2024-09-14T13:56:33.078242+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.p_zSOYrShJIHkVIw5nBghZX1oQz9MP4_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8006527092618059148', time=2024-09-14T13:56:33.499905+0000, chain.objs.size()=1 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cZHtc8SIaUlMBkDLRXFV8syfWS_Cixb_0 2024-09-14T12:16:14.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7170333132100145083', time=2024-09-14T13:56:34.053085+0000, chain.objs.size()=1 2024-09-14T12:16:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9pp9r2fyatgVRZk_H3BjsFUdNL_zADj_0 2024-09-14T12:16:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4321659961855750135', time=2024-09-14T13:56:34.139329+0000, chain.objs.size()=1 2024-09-14T12:16:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3pTQUn89rfevQfXULDmkei4rSz98j2E_0 2024-09-14T12:16:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2411264990804450897', time=2024-09-14T13:56:34.386704+0000, chain.objs.size()=1 2024-09-14T12:16:14.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qWeBnvg0MFZw1myUVr_zSu8Z0BIX0ur_0 2024-09-14T12:16:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12831209312066094709', time=2024-09-14T13:56:34.627580+0000, chain.objs.size()=1 2024-09-14T12:16:14.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.diPxNEzwgQIKLoGr2UVTpBxQXyW6D4q_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4114176246320808759', time=2024-09-14T13:56:34.672545+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yLGgN5MiUNh08w6iye14zjlRqPTK1WI_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5789263403626189710', time=2024-09-14T13:56:34.708750+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Kae2T0JLWj0jvP-Ie3eAX6VZoRFQcmU_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9816796027577346535', time=2024-09-14T13:56:35.067148+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3tUOhwKDw3p2J-OedXKU1sI1QDaSKBS_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12837236989352960243', time=2024-09-14T13:56:35.609080+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sdEXc0HAsYLxjaccMdl79e1aIk5D3Dz_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10359473004179450749', time=2024-09-14T13:56:35.713092+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IPJrQIceNh3n5XYFVYcV6qc-JAjdPHl_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.875181930029536355', time=2024-09-14T13:56:36.151192+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oPMiwVKkXDelNY33xtDosgCtrqH7KHJ_0 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15597180764527589840', time=2024-09-14T13:56:36.225460+0000, chain.objs.size()=1 2024-09-14T12:16:14.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cEnJ3TXf_WzzT5t-h-hsRusTzfuQRqM_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2034503995848814698', time=2024-09-14T13:56:36.369596+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dFlPBA4GMIxHGtOoQ9ZUfUBsYbjwrgM_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8655344330656186350', time=2024-09-14T13:56:37.241309+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._1PclO26RM1uXs8y1ObXL63lh8BdXoA_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11144966937886944389', time=2024-09-14T13:56:37.415581+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8QzqwwUitc2zv4fX_yFXmMkBbFu0_Cl_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2093136766925578676', time=2024-09-14T13:56:37.528797+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8UATIc0olWiPPoSjNCUdJM1Czo_6Dxw_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7045903000149877539', time=2024-09-14T13:56:37.756383+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.K8zTqAtejfCJwKCFLee8i-OpRBtZDaQ_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7725884071121210306', time=2024-09-14T13:56:38.252956+0000, chain.objs.size()=1 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eFNukuhF-pqZFNcL1_Ax_6488Ajf8kV_0 2024-09-14T12:16:14.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2048791129530958199', time=2024-09-14T13:56:38.356691+0000, chain.objs.size()=1 2024-09-14T12:16:14.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EThYQpP1oGAsAN13zoTlki9XcmudHsc_0 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17968500503133436031', time=2024-09-14T13:56:38.388530+0000, chain.objs.size()=1 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JsYvgb-v9iCH1MRRAhDUkTUpojR5BZb_0 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9430157411012491050', time=2024-09-14T13:56:38.924875+0000, chain.objs.size()=1 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vv44r4I1A3T3_9IL_qx43jfUWcqNPPn_0 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11465267036349092608', time=2024-09-14T13:56:39.563479+0000, chain.objs.size()=1 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.aN3hs39VTNUlpW1kXA9f_342urK2pMK_0 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2381383597896850996', time=2024-09-14T13:56:43.638040+0000, chain.objs.size()=1 2024-09-14T12:16:14.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.267__shadow_.cT_sPYtyH48xOI1iKCyPA3gn2bmAt_U_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18278659657775802204', time=2024-09-14T13:56:58.743736+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.289__shadow_.OYZG6U0wbeqeVF2GdZr8j40VpmOw2Ac_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18011373444847300956', time=2024-09-14T13:57:02.124685+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.lwu8rBecTTO2FoazwjliBLW8Ney_0F9_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3698214078008559624', time=2024-09-14T13:58:02.365326+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GmBUeuJMWiwQ8YJ6twHFhF9fRL-ZKEf_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12054061063339585151', time=2024-09-14T13:58:02.900700+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5IpVKtWiZxDUjvVuJLM1NzML5tZKGoS_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237301976224207177', time=2024-09-14T13:58:03.733961+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GGY17PjawmqiTmMJZ6NXLhnSQg2TRZt_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18337237830801032304', time=2024-09-14T13:58:03.734751+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PRHbx359rtNJw8Irp-waCVCbIGQIG_T_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3150313435404257582', time=2024-09-14T13:58:03.768458+0000, chain.objs.size()=1 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0RohKcEgcaqHciEdPtMQmLJHDoyw9FM_0 2024-09-14T12:16:14.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9541131101110910871', time=2024-09-14T13:58:04.122314+0000, chain.objs.size()=1 2024-09-14T12:16:14.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Bg7XcLYxZuMxLQ27ve8TH40b1dclEpj_0 2024-09-14T12:16:14.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8518166157123519905', time=2024-09-14T13:58:04.240138+0000, chain.objs.size()=1 2024-09-14T12:16:14.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aRv0KZqiA2oVvLi1JVZU_mYI1vgDvIb_0 2024-09-14T12:16:14.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12927051086901603118', time=2024-09-14T13:58:04.486494+0000, chain.objs.size()=1 2024-09-14T12:16:14.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lepYZQK7rFuc6mtkt2NeSy_9BvuWtRu_0 2024-09-14T12:16:14.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3555557364529914693', time=2024-09-14T13:58:04.667639+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oxruOOzra3dhIgdoCb8tX3EoKEvbRPF_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4901341863101049738', time=2024-09-14T13:58:05.163465+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vSpcBWaz7S2-AF72ss5IEpk4lpwB0fM_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10822414311166990045', time=2024-09-14T13:58:05.164213+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BzkWu6QQX6wMqE1SW6yA9-S72JJ1kZf_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.936319257869770085', time=2024-09-14T13:58:05.187772+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.y6E83-7_9rFa4WLGwwP7GlY1dXykPVR_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3913846879152980226', time=2024-09-14T13:58:05.203656+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.II4v4APgjgGbdvPK8qM5UDPfMgX7Vvs_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2922372667060302263', time=2024-09-14T13:58:05.704846+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FYrqo6-N5-Jpm6ysMq7m0fFBCE65RaX_0 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7560895006505336093', time=2024-09-14T13:58:06.711716+0000, chain.objs.size()=1 2024-09-14T12:16:14.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jQG8QNKUbgrUD6DleEaXvX3Sy3S6_P7_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13576948569207684222', time=2024-09-14T13:58:06.832229+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MiLbPPkC-X-tTTJoVP8xpcPNjrwwVKw_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13027709286490904700', time=2024-09-14T13:58:07.316489+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.w5SHr-8gmL1dgr6gKjDUuRIsJ5DGt4x_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18442628631758945110', time=2024-09-14T13:58:07.369570+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.77WaGE2G2HlIcJy_E-IFDQhOZdvd9Ag_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2705019462500373918', time=2024-09-14T13:58:07.502237+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.o14BNleKKBoYYGE09xV37RqDhlzG-XF_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8188709724471853287', time=2024-09-14T13:58:08.477866+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.B_Elh1VHP-akrh9v-EMNUJEkxNbcxML_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11328778045104354700', time=2024-09-14T13:58:08.624830+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ibDhreCe1jzxt9eLkhv52xpwsRvSOb0_0 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13967194494756211255', time=2024-09-14T13:58:08.685962+0000, chain.objs.size()=1 2024-09-14T12:16:14.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.epCkZvQ5sxanginmZ3Lm_97Mj16wdSn_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9383736070547398080', time=2024-09-14T13:58:09.239370+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3l-QGhDgVEc9HGKwtioxJwlCMOHvU0g_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16958628929538822244', time=2024-09-14T13:58:09.375210+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CCH_mHyLsNSC0vgS7CaCnpX0tIHJc_1_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7528259180124039913', time=2024-09-14T13:58:09.437615+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.288rAka9c3Lm3JW56Oj_k3Yxpq6W_BA_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15317783709908652910', time=2024-09-14T13:58:09.756163+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.85n4lgR5JjQltdsRzQ_jlypHaG9xi5s_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14409567418216235376', time=2024-09-14T13:58:10.120429+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DTsfx5_qu5FoHaPLgvxxq8QMUGfosy6_0 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16845874581457184406', time=2024-09-14T13:58:10.222857+0000, chain.objs.size()=1 2024-09-14T12:16:14.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.odJxAqJn_390HiPnTjWzVHhj12QIGKh_0 2024-09-14T12:16:14.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1103047241650057807', time=2024-09-14T13:58:11.144370+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yJtZ2U6pVQLxg5qFCZUlwP0hTutL4mh_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14037256372767053382', time=2024-09-14T13:58:11.534286+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mQlTNqCIR_o0t0pcGfvqk6HQ032d-FE_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6478193089658223998', time=2024-09-14T13:58:12.503846+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gfOY3hLjR_N1k9FqO7QzO-2qIl0x5Nb_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10855137414114196598', time=2024-09-14T13:58:12.543713+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._b-3Yd4-QIoxc86xNQu2F6DqYOM0Xmq_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15889647466101782851', time=2024-09-14T13:58:48.989719+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VFgGIsLCYwPSyVoWICAZ5TPtZRofPkl_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5297311929632379860', time=2024-09-14T13:58:49.462911+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GHut231l2RqqPNz_CxWDwLD_gRJ2l-m_0 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3648916562269089805', time=2024-09-14T13:58:49.633710+0000, chain.objs.size()=1 2024-09-14T12:16:14.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9dGcLJz-H2TAA0jj1xUNzXKHj5iQtuY_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12690167791660747339', time=2024-09-14T13:58:50.033259+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Vm-UgYNvaGeUie9-59T3OUMnb9O4rk7_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16511257782526655782', time=2024-09-14T13:58:50.887958+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Km0XkRlBNJZ3Mq6u30u3RcG5_9mU01H_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5724706967299517606', time=2024-09-14T13:58:51.478469+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wyWUl--XfJbFtlZLT_r0f7aZL4LaO0i_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13378472892218496136', time=2024-09-14T13:58:51.999055+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.x6Ro8ZnGleM0_aCibmImIVgNu0Oodw0_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11119496734250122496', time=2024-09-14T13:58:52.157552+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.e5p2ek1ocZ0VpkUNTgXCUIB9ed4jdO7_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16036077803884199173', time=2024-09-14T13:58:52.247753+0000, chain.objs.size()=1 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yqCqYoH-mt-4gFBsaWmVzbSMmh7Aqnt_0 2024-09-14T12:16:14.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16627710959618753862', time=2024-09-14T13:58:52.487436+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3vjaVJgVd3gTUqZqBjpvWnponGvV7Wt_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5831683083156925384', time=2024-09-14T13:58:52.488237+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZZWITYiIJpIAvEpcJa-8hbjMWIXSuwD_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4381432158017918177', time=2024-09-14T13:58:52.745456+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cx3lLb-va8eTli09TFFWuXX14-qIRDK_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12087995805369945605', time=2024-09-14T13:58:54.077416+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.84j4dMZrlkHdFjatGhGiFDGtJWwVX-4_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6097212902709810256', time=2024-09-14T13:58:54.122565+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MGnTpMmy2n7kVCGrDXNcXR4o4rNqlXk_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8137940161596764722', time=2024-09-14T13:58:54.263325+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-AS8qW1qAxYsR4jYdyQtwJSuRa0jdTZ_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7385599395719730386', time=2024-09-14T13:58:54.348558+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gl8WTauqqW4fGLh87d3BaQrqNpVkGHG_0 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10492259114080373604', time=2024-09-14T13:58:54.969906+0000, chain.objs.size()=1 2024-09-14T12:16:14.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7NJX06OoE-VmXZ4NWkYa8yqH6RK3BNv_0 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17887175717543557525', time=2024-09-14T13:58:55.055577+0000, chain.objs.size()=1 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9I5kNt95UIk2-AnaXGCYyqsZOtACM-b_0 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14780401900336362771', time=2024-09-14T13:58:55.453971+0000, chain.objs.size()=1 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8mp0dtb7LsEX1CckhhzfMFijco1H1bH_0 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9834137911934052906', time=2024-09-14T13:58:55.610994+0000, chain.objs.size()=1 2024-09-14T12:16:14.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UwEY_WQ4ut75oYFuUuopbJb-o1b6yEO_0 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17587003908898556220', time=2024-09-14T13:58:55.728427+0000, chain.objs.size()=1 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.T0XE8jNXGv51kSnxFfyrYQYumAEpf2-_0 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1699096036276345926', time=2024-09-14T13:58:56.873253+0000, chain.objs.size()=1 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mpgsbaIrMItsCvZNKTRf-Z5GHhnLO1T_0 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14871833651993839151', time=2024-09-14T13:58:56.983318+0000, chain.objs.size()=1 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2dbV_8dMUWhGl0IWvnieSwACD1Qsnrh_0 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12580494561264234305', time=2024-09-14T13:58:57.219735+0000, chain.objs.size()=1 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.304+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.msiL0_m9BW0MGtzoSOJgPtZCCY5DbO9_0 2024-09-14T12:16:14.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/51925 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8903003813235874711', time=2024-09-14T13:58:57.701699+0000, chain.objs.size()=1 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VEybguz9fRgonaCOougFsS2LeptEP_j_0 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11299399714915389120', time=2024-09-14T13:58:58.166910+0000, chain.objs.size()=1 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MakFKdjquvzY2qVY2TqglIIuI9mknhm_0 2024-09-14T12:16:14.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1849722527666663201', time=2024-09-14T13:58:58.415364+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jpI0VJKziKNeDIT2Net6H8rsHkeeLtl_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13162572611302635766', time=2024-09-14T13:58:58.666323+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jXKjE_KWxmUvuuTEdAxZWNlDJnbhD9u_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7482743002509935049', time=2024-09-14T13:58:58.982229+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rFyrYdCbaqLW_aIqZ92bkEOQYiXY_t2_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.633020263359926220', time=2024-09-14T13:58:59.635055+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.NPAjtlOBAzyl2tcL4upIGpJ6wHO3oe5_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12654977002385348591', time=2024-09-14T13:59:04.178308+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.331__shadow_.1WHEtJPERmIWF4LoVbDk65KaJAVXUti_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1911697264718592887', time=2024-09-14T13:59:13.310478+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.346__shadow_.mt4I4iWyHmw4r7PooXM55i8UWUU6T-H_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.513191342258020389', time=2024-09-14T13:59:34.677034+0000, chain.objs.size()=1 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.382__shadow_.JLGccA_j0iDW9sC0l9YSgpLMIZVLJKz_0 2024-09-14T12:16:14.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3134794068109599104', time=2024-09-14T14:00:21.942038+0000, chain.objs.size()=1 2024-09-14T12:16:14.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.455__shadow_.opyGgkio6VPs8uC_-u0xJdb6nWd2zK0_0 2024-09-14T12:16:14.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13075087020577809350', time=2024-09-14T14:00:28.341560+0000, chain.objs.size()=1 2024-09-14T12:16:14.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.462__shadow_.nHhx_c5uSIr3vp-alxf78MbtSiBD15b_0 2024-09-14T12:16:14.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4859699598061854559', time=2024-09-14T14:00:45.697597+0000, chain.objs.size()=1 2024-09-14T12:16:14.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.308+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.487__shadow_.bqPvHV59h0n-Ue9x-aRpK5y8rpNwwWE_0 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9456100571559113463', time=2024-09-14T14:01:07.624527+0000, chain.objs.size()=1 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.513__multipart_mymultipart.2~dXWIGliRNvZv1Xw83S7Jt9fxt0t9r6Q.1 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6302424882742893875', time=2024-09-14T14:02:58.548229+0000, chain.objs.size()=2 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.528__multipart_mymultipart.2~HXQI7w7Xulh1CVSwy-CYP9iNMWAr4Cs.1 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.528__multipart_mymultipart.2~HXQI7w7Xulh1CVSwy-CYP9iNMWAr4Cs.2 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14162074890911781853', time=2024-09-14T14:04:18.073136+0000, chain.objs.size()=1 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.566__shadow_.S6cNtf97IOp1sBHYoySc2mwGhq2mhvF_0 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5638205193777287680', time=2024-09-14T14:04:29.820605+0000, chain.objs.size()=1 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:nxz.0fW7G3ZHv1gX0LtgQkpzmO-GYeO_.4SegFxvlKqSyiOWNMqBn5sInrONOrHE_0 2024-09-14T12:16:14.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1426411088813683772', time=2024-09-14T14:04:48.957972+0000, chain.objs.size()=1 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:s4AYSqE4n3gRPiPOZcpAiGMaQhxeLOx_.39voqZ69EiL00D9aHuGAPuQfai8wvvv_0 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7299053327853140076', time=2024-09-14T14:04:57.889360+0000, chain.objs.size()=1 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:0G-qucIlOFDqH4RojnDEsDDBvyi6Gk6_.ZmMiYfayZk3Ayht0duxjQtyr82lMUiS_0 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236077439253332558', time=2024-09-14T14:05:21.751914+0000, chain.objs.size()=1 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:oYz7sgn0ufVI6W900sWra7zT0r0z01k_.VN_6YLPnCm4rU5gR-HAwnFDZ9ozIfPu_0 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3961652043140064990', time=2024-09-14T14:06:45.638312+0000, chain.objs.size()=12 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.1 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.1_1 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.2 2024-09-14T12:16:14.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.311+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.2_1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.3 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.3_1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.4 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.4_1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.5 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.313+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.5_1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.313+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__multipart_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.6 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.313+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.615__shadow_multipart_enc.2~IH5tdcWQR5KNCdHQ8TXYYAKlKRgzVdm.6_1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.313+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14488976364964363615', time=2024-09-14T14:06:46.223580+0000, chain.objs.size()=1 2024-09-14T12:16:14.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.313+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.616__shadow_.UsDosMSA6K_h7_Q75GaSn2PQ4zFjo3q_0 2024-09-14T12:16:14.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12773730603437856055', time=2024-09-14T14:10:29.475271+0000, chain.objs.size()=1 2024-09-14T12:16:14.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.696__shadow:X2pfapjf6AsZTffgrWJ2NdftV-JFQXk_.2dU0iK_Rm21yz4VHdL0T-CKOkhWlFj7_0 2024-09-14T12:16:14.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.315+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12202657509666544360', time=2024-09-14T14:10:30.070861+0000, chain.objs.size()=1 2024-09-14T12:16:14.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.315+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.697__shadow:6ZvQQyj1-4qLaBq4QodCiAr0IQrqKK3_.oixKgetpOUaZQ1SL9EbAaAieD2gHQDh_0 2024-09-14T12:16:14.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.315+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12118316383595222148', time=2024-09-14T14:13:46.791736+0000, chain.objs.size()=1 2024-09-14T12:16:14.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.315+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.772__shadow_.jVYxGh8qMTow-GbScYEeP-6n6izuzOd_0 2024-09-14T12:16:14.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.316+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4532499821163831119', time=2024-09-14T14:14:02.613964+0000, chain.objs.size()=1 2024-09-14T12:16:14.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.316+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.778__shadow_.qILSXdWuta7OtnttqqAwC8YdwpT5GVV_0 2024-09-14T12:16:14.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.317+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.320+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:16:14.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.321+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.322+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44624' 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15012033955669187396', time=2024-09-14T13:55:43.083106+0000, chain.objs.size()=1 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.245__shadow_.hcj9U7dSvqQ-ZcdnTRzCaec00b9rzlb_0 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17789973812558555271', time=2024-09-14T13:55:52.049097+0000, chain.objs.size()=1 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.258__shadow_.brPBhK6Y4pBIDI0hop_BQ8qu54B8qPL_0 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11341899603588044344', time=2024-09-14T13:56:29.862229+0000, chain.objs.size()=1 2024-09-14T12:16:14.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UjvhtLx5UZK3G4aXtpkFNIiFJIZJb00_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3430588691005995203', time=2024-09-14T13:56:30.621243+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TdflDEDnJtVyiQIkkqxKnBdY0m2O9BX_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11612992935384865618', time=2024-09-14T13:56:31.228749+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RFSoqgoexfuBKS-eMe5gO4DksmUOjCs_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1842503266803357527', time=2024-09-14T13:56:31.441384+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EBoaYO-P8p22LlH8vtWYX9ItDEKYU33_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4310534423438207613', time=2024-09-14T13:56:31.459272+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9_6SLI7zAs1pH0ZgqLNbtS9O9Hegdfc_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8119121466948434851', time=2024-09-14T13:56:31.545131+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iXM5Cwdt_lu3vEo60E2QIJBeeTspsB9_0 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11709489341373514247', time=2024-09-14T13:56:31.545809+0000, chain.objs.size()=1 2024-09-14T12:16:14.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Oh9sQAuB4AQwyKOSYF2EzNj61uuGV7i_0 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4264928368635143793', time=2024-09-14T13:56:32.621097+0000, chain.objs.size()=1 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mkk9kkiMDcc7_7WI89bY3LEZVp-qciu_0 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12349058572722785386', time=2024-09-14T13:56:32.889269+0000, chain.objs.size()=1 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NM-v6RpbXHgLn9xMiU0DMkVgalZRcYp_0 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13787936638259545807', time=2024-09-14T13:56:32.952065+0000, chain.objs.size()=1 2024-09-14T12:16:14.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.323+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YosisMjCEqg28l0MgbM0sUoQYv6w6N6_0 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17984174902780797485', time=2024-09-14T13:56:34.047452+0000, chain.objs.size()=1 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dpjexzcv8GEX3saFxb44mZJVHUDFvKG_0 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17415731517804372282', time=2024-09-14T13:56:34.261536+0000, chain.objs.size()=1 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5swktQ-Zg6KkwPzJ_nQJUa8ILbBogTP_0 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8070663834341182844', time=2024-09-14T13:56:34.642079+0000, chain.objs.size()=1 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Q0j8WRuvgeAUjPvKFoBGous55zgRlls_0 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5147682776107511163', time=2024-09-14T13:56:34.713934+0000, chain.objs.size()=1 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JcpdxozAvWSevwr81kyrGANuBBxyCra_0 2024-09-14T12:16:14.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9773029287584890780', time=2024-09-14T13:56:34.953916+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9B1lcGMxHrxs6MVRkz5g-LGG6WZXnXM_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2626262516217330974', time=2024-09-14T13:56:35.534260+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4nF7NCuGac5PrAZUBjnYulOOI397jTF_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11706100074553370761', time=2024-09-14T13:56:35.765004+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nSuiWd51awAGKGgDKVO8fCOX-rNX0Jt_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14915137966418732704', time=2024-09-14T13:56:35.909520+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GlslNvWbYtKBlUg4hu4lGY0yk_k-0-W_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18076164813428547160', time=2024-09-14T13:56:36.070420+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tfddhJTu8dD1igXikGrr-FgjCGAoNTh_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12568729314674216266', time=2024-09-14T13:56:36.371227+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jdorXWC9a6le2nTOHsd5ZnCiGufjO-h_0 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5787709656983337032', time=2024-09-14T13:56:36.371939+0000, chain.objs.size()=1 2024-09-14T12:16:14.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.325+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Fv6rsh-ZZxs_iqrr4lsPrhPXQ83Q_a-_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15415598865860566527', time=2024-09-14T13:56:36.412135+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PHJtc78XD7DSqoag6vtxS7SJXU-pRjX_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7610627816291661718', time=2024-09-14T13:56:36.425871+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lYQgF-kPgQuuod3u4WzDMgKZaXEp_zM_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9573535901540956958', time=2024-09-14T13:56:36.896438+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rPJnFsjEjpja25v2dDaxcPh4XFDDJDw_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13147770148379253602', time=2024-09-14T13:56:37.118866+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.W56Mx3QQ1OPBXpmfamon89Ur5nhLT3d_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16317615967994922423', time=2024-09-14T13:56:37.381494+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cVYIpUCsQWvhtVZgDa2C8isArs_1C7K_0 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4998927309519490951', time=2024-09-14T13:56:38.989160+0000, chain.objs.size()=1 2024-09-14T12:16:14.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2DXP_rUV835SPtC43P-5gqhRZuIzV0y_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8042553087769689074', time=2024-09-14T13:56:39.128162+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.X0qXb_RGCeXRACnTUd8Gi50xh66KGQg_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12628053220116820558', time=2024-09-14T13:56:39.501151+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y42wXeC983olMDq8AmrTB6ve23gtUEV_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8657124868379395805', time=2024-09-14T13:56:39.562310+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.44E8CHy5TF9O3GJIE2yo2cjEWmGeMbv_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11207829743686256301', time=2024-09-14T13:56:40.054211+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QlfoRiUxr8nUYpFUA-kfeGwD1x1-RWE_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6184128164559296226', time=2024-09-14T13:56:40.251313+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YoSStRbW4OFFpOtyxkULUjzYRQNK_2V_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2228126049081379551', time=2024-09-14T13:56:40.333309+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tnSjniCbCkzOfCvRnE725lSpT5EMCBS_0 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4732254880137996604', time=2024-09-14T13:56:55.177742+0000, chain.objs.size()=1 2024-09-14T12:16:14.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.284__shadow_.CUMD4xsVJcFN1NHbiDCCyApyY9CJZvZ_0 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8748996015809593221', time=2024-09-14T13:56:55.926989+0000, chain.objs.size()=1 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.285__shadow_.pFkw0JNSPdtiMhC5Hszcl1ZGsRJONpD_0 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11093482527946013484', time=2024-09-14T13:57:02.124999+0000, chain.objs.size()=1 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.TO1FuMMyAqwgCpRs_UyHfGz_T6fUXcH_0 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7821110007251778293', time=2024-09-14T13:57:02.125730+0000, chain.objs.size()=1 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.5k78ZJPuKoMzGgwbqz7fQ_wdyWX6bVU_0 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15258634031177834120', time=2024-09-14T13:57:02.244040+0000, chain.objs.size()=1 2024-09-14T12:16:14.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.2us-qY__cSBE0HO4MDZHutTCwpyrxwy_0 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.468650082604617977', time=2024-09-14T13:57:02.244939+0000, chain.objs.size()=1 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.p0vvODKAjt2bCWa8gHjqOQ4bIx4jp2Q_0 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11582311589968487793', time=2024-09-14T13:57:04.193964+0000, chain.objs.size()=1 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.AdDc_DTttrrTe6KfhwTCTVvkLxXHdC9_0 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11707201402980755411', time=2024-09-14T13:57:07.832493+0000, chain.objs.size()=1 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.298__shadow_.S3gpDQjmQyjCzjxpsls3e3gvl_tqYqQ_0 2024-09-14T12:16:14.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9024170053737462621', time=2024-09-14T13:57:09.992930+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301__shadow_.m6nk_nGAhNAhHozwAYJqKwyLtjMq7tb_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14114819472008195530', time=2024-09-14T13:57:13.702262+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.306__shadow_.Dw3J6h9-wQPgdNYO0wt43f0whwPoG6r_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15951436551739550687', time=2024-09-14T13:58:02.871384+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Si3Vvp6d6TEfcZWf2AV3cVVnhn3d8JY_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12150514502139153350', time=2024-09-14T13:58:03.066152+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HPcyZcXSfQrfy2FMdUx5eDxX9cMRRKK_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2215203750722222418', time=2024-09-14T13:58:03.886267+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bCP4xLm3DZJPotY1jxKfog8M_TcGowY_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3931538282093448677', time=2024-09-14T13:58:03.975321+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GY-cN1AOZTY8F8-6KfwWKx5S23jWdfz_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5694231077546479197', time=2024-09-14T13:58:04.646835+0000, chain.objs.size()=1 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yoaqjtjWsaw6KEwkAc6ZHpiZ7DYOf63_0 2024-09-14T12:16:14.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5805668621300262465', time=2024-09-14T13:58:04.715202+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vVCTe8fpXYRk_BooLu7c58Eiu8Xd_Fv_0 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2851939664463640423', time=2024-09-14T13:58:04.733305+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wZ_rySJjT6J0f_491pJ2igb9voEQkB7_0 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17487294249521909697', time=2024-09-14T13:58:05.437011+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hyzln3Z99s3BO_AftgNrraKwdHEssLc_0 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11060747424766275567', time=2024-09-14T13:58:05.437755+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gv6GK0DE3HtDYwBnd_gjiYxqGEfYWzF_0 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10567726383876780937', time=2024-09-14T13:58:05.674384+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FwVjGjTk9g43cmTEbv97kU5jdUcbvAf_0 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14242302400407630520', time=2024-09-14T13:58:06.177302+0000, chain.objs.size()=1 2024-09-14T12:16:14.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O2_4ml3CovNvMRwEsdDhnxphdjOewkO_0 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11272062959719730569', time=2024-09-14T13:58:06.595901+0000, chain.objs.size()=1 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.G1_JVPPanOuw-l_7ys1S_6nf8XcqbIb_0 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11754450476020503119', time=2024-09-14T13:58:07.101179+0000, chain.objs.size()=1 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RDsWQP21ZHfYMpe7nC7iQU2FNM1FbTH_0 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14396143841711303559', time=2024-09-14T13:58:07.304774+0000, chain.objs.size()=1 2024-09-14T12:16:14.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5EiOapOEe2CpUhI0DrAddu9xsk-JLkR_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3539545296206290813', time=2024-09-14T13:58:07.345095+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bndAtyFefgTkHMiPx-DuJFRax48MeIJ_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10627802522220597040', time=2024-09-14T13:58:07.893754+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EdfIiX5CEaUcw-I94OiwawP6enm6gBM_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7803179759310927182', time=2024-09-14T13:58:08.042143+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.C0Uj-sPLqn_BHLIQ22ugASQU0IKOsBo_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13012071005653662253', time=2024-09-14T13:58:08.230888+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8qdTu0ANZGCaZWzRcm7u1mkPI67xzCT_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17582388511662185183', time=2024-09-14T13:58:08.670800+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oMpNj4FdbGrscjRbBMlaGwCYGbNByaA_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16611309165060403189', time=2024-09-14T13:58:10.034673+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.m2LEdWOYrled1UVlUrwrQBhN5framIq_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15651631699381973016', time=2024-09-14T13:58:10.112431+0000, chain.objs.size()=1 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7U9xMu2zAqVd4A2S0BjIyh6Bqb4cNGH_0 2024-09-14T12:16:14.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14453699359988261470', time=2024-09-14T13:58:10.818057+0000, chain.objs.size()=1 2024-09-14T12:16:14.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XMm-K_TBRoHQkr1_ktFOVLf1f6ikpbd_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4045030781915828005', time=2024-09-14T13:58:11.345036+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.x5gz7Zjsyv0ZbeTfrsIOXFuFF2kqNKl_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.326291448631367611', time=2024-09-14T13:58:12.103259+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xfLeU0I09XcmMCEvFXFQhKXOS_w0bFz_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12566760046021195359', time=2024-09-14T13:58:12.166801+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SMDp3f_y4rnU5EdbjNGwW2LOvwFMWld_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2717711166555872011', time=2024-09-14T13:58:12.218329+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NGSbKOT3Zpkd-0m5E9Z8NXFQ1RLQkUd_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3383369551975061862', time=2024-09-14T13:58:12.505726+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NP7aE410Wnq4Pf5UtXMU8HDfdbcdiXT_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17121713816240422786', time=2024-09-14T13:58:12.600920+0000, chain.objs.size()=1 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yjdaW496LrkTa2ZStIyfMbN583se6VG_0 2024-09-14T12:16:14.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1783133510078598038', time=2024-09-14T13:58:49.415521+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ILeLhinODguzxjvz5H4THs8lTAxNt5q_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14804356913553465148', time=2024-09-14T13:58:49.485142+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0VKcxt5L5YFos8YQkVAcX5MgZDOebPV_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1835582613730574662', time=2024-09-14T13:58:49.525830+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PwXCD28ePs8GX2Wk_eioQ44fXrMDcyj_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15782333200528027981', time=2024-09-14T13:58:49.899384+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WR9Bm82ipPXt2VxoeoWemqcZcfeUWLN_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.175759266870944284', time=2024-09-14T13:58:50.527156+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BjCZfR7SB3dd__JiujxTsLhYenfw6YZ_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3352122619364327009', time=2024-09-14T13:58:50.801537+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0X9SBdbxwr5DV2AcjpI9jNrXdU4qpPX_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5278738943395914049', time=2024-09-14T13:58:50.842720+0000, chain.objs.size()=1 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qs4diUpa4dMOKRQ5Qm8_E6Rx4DOwMcm_0 2024-09-14T12:16:14.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8302111616955119639', time=2024-09-14T13:58:51.008056+0000, chain.objs.size()=1 2024-09-14T12:16:14.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PimW0Aqy5InAt9ar4WsWenTD5WbmUG3_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3532418124457427491', time=2024-09-14T13:58:51.234043+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XikhlbJ33b6PShKUMawy9TFmNhI0OyX_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11220651015034085696', time=2024-09-14T13:58:51.965805+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WGjyyouHNXcRQv9LZpAj2wd7E6MeIfo_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12846735654442224531', time=2024-09-14T13:58:52.233812+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.p_DDDCer3nd4Y-PEFgEGgLh2hEFhk4g_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12161132373597073513', time=2024-09-14T13:58:53.495368+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TO-ZvUtWBwVQcn-ANs_9otvR-UTUTpk_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10656300746593843312', time=2024-09-14T13:58:54.337789+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qKxiXicYwyROzvpiedhKPFtu6jC9UgG_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5318611668061719586', time=2024-09-14T13:58:54.942866+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BLv9VbuNdTwC41mV9lZsotYv7-SeAvP_0 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3871783493569935847', time=2024-09-14T13:58:55.213003+0000, chain.objs.size()=1 2024-09-14T12:16:14.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3-Lqr3Ciay_yuwZqKl49yPNpVdYi85n_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15623798860844118782', time=2024-09-14T13:58:55.229045+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lVAyln9g7cSTJqP_AuQizK1yVhZT6bZ_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10491704494170846853', time=2024-09-14T13:58:55.300969+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vnLvzqvWsQDeMQuztX6_oqoy2ZQZKWi_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9178523600884194370', time=2024-09-14T13:58:55.491579+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aCaoFIuUUiN9wz2L1rS2VC-hB_JNoyH_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.738242129047169716', time=2024-09-14T13:58:57.049686+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.SNFS2NxNNIfrBV_grIzpD-gtGtG_88p_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.340+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5096284562539779578', time=2024-09-14T13:58:57.091478+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.340+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XMajQTMa247HgqfjL8f3zRkNd4fC-4N_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.340+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18059984112631851455', time=2024-09-14T13:58:57.281928+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.340+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._sfE6K6XpBbiCsIL1qpgc4e0PcpoUHa_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.340+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13025932543401012502', time=2024-09-14T13:58:57.702998+0000, chain.objs.size()=1 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.341+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j3Gyzmq0VgvckOj2sxrmVzDn_1vSGH8_0 2024-09-14T12:16:14.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.341+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14958980966299791748', time=2024-09-14T13:58:57.958818+0000, chain.objs.size()=1 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.341+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IiDd3s8pYORPoFss9Be4gq-09e8iaVv_0 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8860691942522897349', time=2024-09-14T13:58:58.030610+0000, chain.objs.size()=1 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bU2nQ4KaS5D_5B_Irma1eQxms3YhY3o_0 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6593481593502075287', time=2024-09-14T13:58:58.060862+0000, chain.objs.size()=1 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4YQwA4vcl0cjMCOUZBBfZLOQ93z0ksX_0 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13730118197207109394', time=2024-09-14T13:58:58.322026+0000, chain.objs.size()=1 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gI3xzxAceQlyB2vbt0V9-pJUV8cfXZf_0 2024-09-14T12:16:14.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8874074506064177772', time=2024-09-14T13:58:58.429558+0000, chain.objs.size()=1 2024-09-14T12:16:14.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.342+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.U2IiwbOcHpMuWqAfHcyNOd7En7J1fmg_0 2024-09-14T12:16:14.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/44624 2024-09-14T12:16:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:16:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12481252685468797025', time=2024-09-14T13:58:58.961957+0000, chain.objs.size()=1 2024-09-14T12:16:14.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cEmXYbZEx2atC66NTX51vZ7tqkU9NVS_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.299681592274076830', time=2024-09-14T13:58:59.255040+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Nh8EpqgHG463INJ0nTuX9Ja8EwwN0xE_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8300446412891255808', time=2024-09-14T13:58:59.759775+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xfDF37Z-HgIZgyJcFBkoRQIIWvBIs4V_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1432329458327491606', time=2024-09-14T13:59:25.081521+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.369__shadow_.4h1P2OOJZF09ODyoGX0xGMrxIycuTtd_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16599881529164135345', time=2024-09-14T13:59:36.100277+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.384__shadow_.BLvfipbnZtXBIK3TYqyz4FGqjGcVdMD_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6639653568362049544', time=2024-09-14T14:00:18.605210+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.450__shadow_.pGZuviWQB7Zeu6IxFT7SK-CsQ-G442N_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14268695251844128845', time=2024-09-14T14:00:30.913237+0000, chain.objs.size()=1 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.465__shadow_.H4Xo9gaFhq4b1aniA0MLxtZPjDjGhMD_0 2024-09-14T12:16:14.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7359421244936021642', time=2024-09-14T14:03:58.321614+0000, chain.objs.size()=1 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.556__shadow_.djuFw-CRUXgxeHTONNNwoUWbpOUnW2-_0 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11123244298635863120', time=2024-09-14T14:04:28.380810+0000, chain.objs.size()=1 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:Ci0y9Y1fKO3wMDqiz8.XeoVaCpyxlqG_.Nqab5zYGGy_F_IqISUDC1tqR8ANFG-m_0 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16798437408852741622', time=2024-09-14T14:04:38.113812+0000, chain.objs.size()=1 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:-GgjDu1XMKlukkFYJvzfVMWiiPoi89K_.nudKp6R-BJw_bY96FkNVw9V2ZIndyQL_0 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10204318138713619356', time=2024-09-14T14:05:23.923296+0000, chain.objs.size()=1 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:d3W1wlGCZCeqOfut7Pfj62FdVVeSijf_.Kobz0Fe-gbotKlgun7E_R55ROizJlRh_0 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15723700738691346041', time=2024-09-14T14:10:10.160791+0000, chain.objs.size()=1 2024-09-14T12:16:14.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.664__shadow_.nNgWs74pnP-WOYV2sQG-xcPhqDQ-O5g_0 2024-09-14T12:16:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.348+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15151199531348699880', time=2024-09-14T14:10:12.474129+0000, chain.objs.size()=1 2024-09-14T12:16:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.348+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.666__shadow_.0IXBwrXnwZV1Lx_XY79mekEnOw9PnoP_0 2024-09-14T12:16:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.348+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9664601719121225332', time=2024-09-14T14:13:31.718132+0000, chain.objs.size()=1 2024-09-14T12:16:14.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.348+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.767__shadow_.KcTGUmUnsSvsFkxJTulGXN0qkVc80_f_0 2024-09-14T12:16:14.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.349+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.351+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:16:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.353+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.353+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45180' 2024-09-14T12:16:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_acDOTQzN6ST8GGPPqZdWnoPjsoTrj_h', time=2024-09-14T13:53:17.145978+0000, chain.objs.size()=3 2024-09-14T12:16:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5D2HLoRivRpTBsyhZqkrinXyO9WIlmB_0 2024-09-14T12:16:14.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5D2HLoRivRpTBsyhZqkrinXyO9WIlmB_1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5D2HLoRivRpTBsyhZqkrinXyO9WIlmB_2 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_cIa6887E-_pr8C1R61QRrJ-PZ8kpo-t', time=2024-09-14T13:53:24.103038+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_._zV1L9JRYtFsf3Se784-7IanlZVg7Jf_0 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13297827414709463273', time=2024-09-14T13:53:47.274637+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.183__shadow_.Wl0A2ap8mv6wa4rRgr7e9d3mx1JfjrG_0 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14193259855249444938', time=2024-09-14T13:54:02.709309+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.200__shadow_.xXh8s7hIiw5AntqI21wAIsagXnRPuC__0 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1619554986037851392', time=2024-09-14T13:55:35.193966+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.235__shadow_.UFQbP-T-CYkq_Sq5ysgijolGdd6kKvN_0 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8852029275737531396', time=2024-09-14T13:55:40.444417+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.242__shadow_.T94MXxsTOL6_UyeHIa0np-Tilgwnxv6_0 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8064860856469216059', time=2024-09-14T13:55:44.521632+0000, chain.objs.size()=1 2024-09-14T12:16:14.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.247__shadow_.35t8BvfRY2U8jTohgYZBoe_8HbCxIQb_0 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11504994826209325175', time=2024-09-14T13:55:54.124079+0000, chain.objs.size()=1 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.261__shadow_.gMHvkURuudDeNrspjX_H_fQtEGduYvI_0 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14365668606945903315', time=2024-09-14T13:56:29.968081+0000, chain.objs.size()=1 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RVG5Yw7VB6SkvfXwDSEsIvZd4625lS0_0 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17236082180565109941', time=2024-09-14T13:56:30.572809+0000, chain.objs.size()=1 2024-09-14T12:16:14.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CPHsA9xib_DQ-hl-ZQMplYxfruNlMmU_0 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4429229457858360861', time=2024-09-14T13:56:30.687132+0000, chain.objs.size()=1 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.auoDR_R-5CEKd3ChaZPBRsMrUjopHmG_0 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10732475336466988414', time=2024-09-14T13:56:31.361674+0000, chain.objs.size()=1 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6g2l6C5z7EH4DW_M4dpVN37VZnNC7eE_0 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8696726758878053988', time=2024-09-14T13:56:31.557216+0000, chain.objs.size()=1 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rvr6ACU_HRLqMn2BSaWrPcdiewsgFOz_0 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5072848881504743450', time=2024-09-14T13:56:31.883544+0000, chain.objs.size()=1 2024-09-14T12:16:14.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.R-F1eknQH_5J8X8MMSZ5yTTE6yqDfDV_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1293634436504755929', time=2024-09-14T13:56:32.030835+0000, chain.objs.size()=1 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-HQFcdoqWJ1fUSgD0d-WAZCPPg4UJtc_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12934781021225148545', time=2024-09-14T13:56:32.819276+0000, chain.objs.size()=1 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qd8_tCBaKoYmhlEg37L_M0znbjl-p7t_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4126183962891990928', time=2024-09-14T13:56:33.309391+0000, chain.objs.size()=1 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LzQ3edSaW5aSEKIHlGplNnaYjrtXO7k_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16127162957558546359', time=2024-09-14T13:56:33.574553+0000, chain.objs.size()=1 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fcXpneGqh8fQ4psK_PzIhqzAFupL1FK_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17239106335800718920', time=2024-09-14T13:56:33.619416+0000, chain.objs.size()=1 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.F0UcDVOiIabCpWtuct1-AETVfKVB904_0 2024-09-14T12:16:14.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.357+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.933867207492376183', time=2024-09-14T13:56:34.092984+0000, chain.objs.size()=1 2024-09-14T12:16:14.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.357+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4zgbakF6u6NHsZ8mowMY9iruGIjqyuQ_0 2024-09-14T12:16:14.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.357+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14093208238638131348', time=2024-09-14T13:56:34.832035+0000, chain.objs.size()=1 2024-09-14T12:16:14.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.357+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BX2G1H4wsCtdDILgWnZWTPPLguqpBqE_0 2024-09-14T12:16:14.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3156452752649672774', time=2024-09-14T13:56:34.869444+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.d51iz-_I0fbbjDpKgk5ZVqT3xKtASXz_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11200768474431294643', time=2024-09-14T13:56:34.939515+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Fb9bJEbsC8dKFYUBLUIXKi3ilSgvne8_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4990081791660553860', time=2024-09-14T13:56:34.958968+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tedz-CPbAuQ0TBtbPR6O4PAIZPLlcIP_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15025714637370870538', time=2024-09-14T13:56:36.255179+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.S_lbORroj8T7Hhnxo1Zk3pHsDaeSgbv_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10933434997165323318', time=2024-09-14T13:56:37.216957+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D9KNTlBXRxqAigA6IduaesTCND5YOHj_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4285540052214292807', time=2024-09-14T13:56:38.360733+0000, chain.objs.size()=1 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ujq8c2IfuxNrlHH1EeBIFNxq35LR8az_0 2024-09-14T12:16:14.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4068833082080716646', time=2024-09-14T13:56:38.402024+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.z0ptj0iopzoa47PuefkAwCAnhsuggr__0 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8610241473864302196', time=2024-09-14T13:56:38.939450+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lH-3aFAPf8x7YkQZQBfw0qxwc2qviSN_0 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15588229248193793122', time=2024-09-14T13:56:40.151039+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JpaJ5toDvf1024JB_ppdWunanEQxWsN_0 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16976748460317118034', time=2024-09-14T13:56:42.980224+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.266__shadow_.JaeffSsNX3ZcaJPO1LncAXJUOw_TXH5_0 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15400989821860484714', time=2024-09-14T13:56:43.633391+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.267__shadow_.bzR9Ho36d6qNjLHGnm2B2t0EvQ_Th4i_0 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8613645221280000261', time=2024-09-14T13:56:43.634219+0000, chain.objs.size()=1 2024-09-14T12:16:14.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.267__shadow_.Oaj2dxKnTVDtObnLWSsKa-MxuxKPWLf_0 2024-09-14T12:16:14.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6246537429000419997', time=2024-09-14T13:56:45.598668+0000, chain.objs.size()=1 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.270__shadow_.kgI6OijtE8sibkAXTWM4aVgQzt3FQbC_0 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2102835052919451579', time=2024-09-14T13:56:55.931133+0000, chain.objs.size()=1 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.285__shadow_.KsXp6T9K5O45z4iGzGc5_hAmi-peLti_0 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7231575122669973480', time=2024-09-14T13:56:59.438413+0000, chain.objs.size()=1 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.290__shadow_.wtPYHq1AojnGOFzFJ7KgD5DtUouX45O_0 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13863479575234431402', time=2024-09-14T13:57:04.104021+0000, chain.objs.size()=1 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.SBvpztAvzPtYJZAX5VUJ3Gj_5Naby-s_0 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5141283110939660616', time=2024-09-14T13:57:07.081113+0000, chain.objs.size()=1 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.297__shadow_.lFLZeRNJvuFYUytY3oBazwvClU2c1nb_0 2024-09-14T12:16:14.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14105847243032512821', time=2024-09-14T13:57:12.095303+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.304__shadow_.LJ-UzYVkC31xQFb04n1iaaZ20pdnGpQ_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3309612375444487419', time=2024-09-14T13:57:23.337040+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319__shadow:UmKUE7Tb4QgY8QnUOt7JWzp9sB7X6-3_.HhdxVZG1ekS5TgV2DFzSWZHAVPoIMi0_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10814145229674681732', time=2024-09-14T13:58:02.392018+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.P4kDSQox9me9YLwxvw-cpz_9r9sV_NZ_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7891474571156486670', time=2024-09-14T13:58:02.643510+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MmJq1y-DCzD8b_146so4GZTb6mA5Wk6_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1983320798616456091', time=2024-09-14T13:58:02.772400+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.I64uEjqv9WqPPVjGAjzABq1bwK2boZT_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6556086914706647217', time=2024-09-14T13:58:05.153939+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yfpqGykmxX0XXmEAByoZ9EHM8_PVdeb_0 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503933469952066438', time=2024-09-14T13:58:05.362110+0000, chain.objs.size()=1 2024-09-14T12:16:14.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eJLw4j_KJtRk7Mbo_QZFjFwLr__SYLy_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2500504634129383113', time=2024-09-14T13:58:05.821487+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ABE1yuN_DwjdsUomL1FoVZkAZygJ793_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4586834606308696531', time=2024-09-14T13:58:05.844645+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.E5Bs57SUnOxHIx55bOVfL-eNApH2rjo_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7625193961822677597', time=2024-09-14T13:58:05.878458+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FoOOYsc8gneXPd_lDKI0mA3FxcVa8ql_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17670786798669605635', time=2024-09-14T13:58:06.132780+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jiR5F5dkmCQCEv1EcOdWDoZ6AbPKXNc_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17536675232161503073', time=2024-09-14T13:58:06.898854+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lemNZv0fkTc-4f5uq1H2jKshsM_JBk5_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.655162255761967064', time=2024-09-14T13:58:07.063568+0000, chain.objs.size()=1 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LvpOcQn_Bq0dEFt_t9dmtr9hyhTA3rm_0 2024-09-14T12:16:14.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3395631096657304078', time=2024-09-14T13:58:07.254403+0000, chain.objs.size()=1 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.f-uWSWApmb1FLGTMbtAB_ekwLMZFmdl_0 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10951245906358500766', time=2024-09-14T13:58:07.491755+0000, chain.objs.size()=1 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.700TNTX8sdWDr1VFOtziMyVeEPVNYXR_0 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17554958589306856874', time=2024-09-14T13:58:07.909918+0000, chain.objs.size()=1 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Rd82DjQZGMKtT46gvcsvXA7T52tD06-_0 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14084880304895908570', time=2024-09-14T13:58:08.046135+0000, chain.objs.size()=1 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FjS7zNx77PbPf8c-fv5uCyHwI5fUaVw_0 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14586599770600795250', time=2024-09-14T13:58:08.082149+0000, chain.objs.size()=1 2024-09-14T12:16:14.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QbC05PguxXm6rC-ow71yE-UbkNzCEeQ_0 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14464422113220805700', time=2024-09-14T13:58:08.187233+0000, chain.objs.size()=1 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.y6AStghRalU6snEWULyH_ICfGZl_s-i_0 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17288262427897856424', time=2024-09-14T13:58:08.299748+0000, chain.objs.size()=1 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M5LrNdXiRwPGXbv-W5dxiazpEYE9wZV_0 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8748006750398347470', time=2024-09-14T13:58:08.685230+0000, chain.objs.size()=1 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2TqaO-Iux7ELSnUuGeGUPBusADNCLna_0 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14237223097975868358', time=2024-09-14T13:58:08.822204+0000, chain.objs.size()=1 2024-09-14T12:16:14.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Wr4hp5BGDRouQShXSe6TPbSVmS3RMPs_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6005845376348381747', time=2024-09-14T13:58:09.447240+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1XnBVp4FY0ZeG_nHK9A1_e5AxxTMqK8_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6624055158018217495', time=2024-09-14T13:58:09.561193+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yDvFciaTih0Jw6puYsgPjwNV4xfhbZb_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3190462932075963018', time=2024-09-14T13:58:09.980820+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bE3YukvlbRsrBBbpG-YuEhOu_X0ot6e_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8410925327475272629', time=2024-09-14T13:58:12.625629+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DYvqx8Y4HSuG3XBcEjJKLmCs-HvM2Ta_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9618889244933196291', time=2024-09-14T13:58:49.056488+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qcflldP0BQvuZg8cvSiz1x8MExDZeAY_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8618985133629253044', time=2024-09-14T13:58:49.154895+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6obPZMHPNOpRHHDH9183aLLiKiFVAN3_0 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4128148880709094057', time=2024-09-14T13:58:49.155751+0000, chain.objs.size()=1 2024-09-14T12:16:14.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4VVKiMl4rTqwIe36FJOVZlGWbLYNHSC_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.518473995802678027', time=2024-09-14T13:58:50.006189+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.97rtcZjoWi7uqhmpV9wIFLOpDgNuBsW_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11497909500654289011', time=2024-09-14T13:58:50.995230+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ew4XBvRDi2lHWdpyUYNHZON4Db8HhD__0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4393366653413654858', time=2024-09-14T13:58:52.275819+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6dX1YHfhD6bgDUm-3U1D1g_A-0dw0gS_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10443129539318829744', time=2024-09-14T13:58:53.516415+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HBY1dzzAuUOiDFTm_-U_rW1VfM1_cyd_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4957689659335663214', time=2024-09-14T13:58:53.629322+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0PNKNqQEJCDA4siTu004SIZ1VI-sABL_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14285087715513011233', time=2024-09-14T13:58:53.700159+0000, chain.objs.size()=1 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0v8JpC_fZfBtkEAHyRMNTLgG99TuNcw_0 2024-09-14T12:16:14.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3405747385024385231', time=2024-09-14T13:58:53.958138+0000, chain.objs.size()=1 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Q9OQSxgY4sG5ujEVfr328am485s2Heg_0 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4353239847231735820', time=2024-09-14T13:58:54.246283+0000, chain.objs.size()=1 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6HrsyBVi2x2gjLfOk1ZYFEa6y1eiTNE_0 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11032975732008819602', time=2024-09-14T13:58:54.369227+0000, chain.objs.size()=1 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TtOjiCeC2m0DqMANoL3UzV1i9C4pIUe_0 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2351969408745338028', time=2024-09-14T13:58:54.781493+0000, chain.objs.size()=1 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nIqbaHGR4xD_ACl2Du9xAWJztvDibE9_0 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6929571068785855386', time=2024-09-14T13:58:55.356396+0000, chain.objs.size()=1 2024-09-14T12:16:14.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3wJVOWb5-l-noVylkU7IouIJWL0r7AV_0 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12208243570665237262', time=2024-09-14T13:58:55.497812+0000, chain.objs.size()=1 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.I47dZ2LQYA7HsHyJpsboToOVdSTgefE_0 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8927284153444119317', time=2024-09-14T13:58:55.705484+0000, chain.objs.size()=1 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vyB8o9swwb7DY4kJrAnNhasvPi3UprC_0 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12994650396077849355', time=2024-09-14T13:58:56.509495+0000, chain.objs.size()=1 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.I2w9TRjC9Obg69czhlsQJ725TKpI7uw_0 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3771839256276289969', time=2024-09-14T13:58:56.719238+0000, chain.objs.size()=1 2024-09-14T12:16:14.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0RDUplwJwgucQSY4mi53sZ9SzRpea_5_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11202781440423533194', time=2024-09-14T13:58:56.788924+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.J7dAWS-srDfKoJiKFIWRJukxf3bT-Hq_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16037704471052433919', time=2024-09-14T13:58:56.880316+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.kqi-hBGTbeBKsiGBndqA-81lN3S2vFF_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3695313240838980523', time=2024-09-14T13:58:56.990743+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wdk254ostMcntaQ2Q1E8TlS9Oh-JKj3_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15674253138440183346', time=2024-09-14T13:58:57.028112+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FyV_D9rBMsPeeX4PPBMcnw4mcmTQZwP_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10383090097462754505', time=2024-09-14T13:58:57.091188+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JW1PRWUowg-evigdWwoVrydlBH8FYmT_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.371+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4392836963836886984', time=2024-09-14T13:58:57.357654+0000, chain.objs.size()=1 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.371+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.k-X_1ACMbg0i2YKe9lNF8vrYjs6r3Ag_0 2024-09-14T12:16:14.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12774703680990670286', time=2024-09-14T13:58:57.756137+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wWcRcNbC0eDwWX5KnbhG6GnGvBKAWLq_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6170137072404617393', time=2024-09-14T13:58:57.794594+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pP5fva7f_fI1OxrsGIxIar_zyD2ZZcS_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2475896166589405566', time=2024-09-14T13:58:58.160572+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uIUSzlmROM4DGm8rk6f9_egTekeVU5-_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6183593836381549872', time=2024-09-14T13:58:58.409818+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.13jUTAV6LTjooLXdeeK2oSs-g6KuOFl_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6302540117617218661', time=2024-09-14T13:58:59.108391+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BARukNCeAnXPLDGCXVFAIDgBJAA7yi2_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14740370206949507103', time=2024-09-14T13:58:59.756518+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-Sh_Iyp2VTxCDgo0CInXGW0BCYr2s-4_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1573551843368491089', time=2024-09-14T13:58:59.789963+0000, chain.objs.size()=1 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qLk3vaJVnlhJefzJHsuRHxjBiP__LCS_0 2024-09-14T12:16:14.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2390214255052653327', time=2024-09-14T13:59:10.994022+0000, chain.objs.size()=1 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.342__shadow_.S9FeepHc8yZ284V3z-vLV9xzgx1goIW_0 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8905702235602755844', time=2024-09-14T14:00:12.496645+0000, chain.objs.size()=1 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.441__shadow_.dbv_8-jpuxTOqLPakI1PRmRsu5-Tbq1_0 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17107764864487133172', time=2024-09-14T14:00:13.940993+0000, chain.objs.size()=1 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.443__shadow_.Wgu62vQg1tN1nkgpk1pdRPMHszJh-NH_0 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3377571347996618902', time=2024-09-14T14:00:22.837035+0000, chain.objs.size()=1 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.456__shadow_.TbXXgeFxCCXtRZouQHUbDu7YUDz7G63_0 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13314119673859691422', time=2024-09-14T14:00:23.772480+0000, chain.objs.size()=1 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.373+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.457__shadow_.NA2_VH7eyqM2nYGdSlgtnggZ3WhCDdY_0 2024-09-14T12:16:14.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/45180 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13121752581236935645', time=2024-09-14T14:00:30.227082+0000, chain.objs.size()=1 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.464__shadow_.IbIw6oHAsCA781-OtsWgY5eMkqtbdmH_0 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6020413340812298123', time=2024-09-14T14:00:47.047449+0000, chain.objs.size()=1 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.489__shadow_.gvpqCmvlb_XlIVwqSPS2y2-VVUGxGNR_0 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14768968438271349132', time=2024-09-14T14:00:52.218949+0000, chain.objs.size()=1 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.497__shadow_.qL14laoKJtCHWTaFJOMDhtvloMTT2yx_0 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6812494616194731339', time=2024-09-14T14:01:03.696261+0000, chain.objs.size()=6 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:14.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11590479264341888187', time=2024-09-14T14:03:23.954194+0000, chain.objs.size()=7 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__multipart_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.1 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__shadow_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.1_1 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__multipart_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.2 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.378+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__shadow_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.2_1 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.378+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__multipart_mymultipart.F2NUmrtasgheePUy-9PaCns_-6Sa8YhN.3 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.378+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__shadow_mymultipart.F2NUmrtasgheePUy-9PaCns_-6Sa8YhN.3_1 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__multipart_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.4 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7645742060060913734', time=2024-09-14T14:04:41.769679+0000, chain.objs.size()=1 2024-09-14T12:16:14.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:x1srXJfvXB8E7HfR3gq9oKC0vGb9HDx_.mlJqdXUl28sVcBvxmeHLVtmn__qruOi_0 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5866411947232350673', time=2024-09-14T14:04:46.331048+0000, chain.objs.size()=1 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:gAvoF2A0oJYDVFeKNxaFS1Mz9bIgDSa_.M1dTdOQiv0EM1UDrt2G_s5_CzZwPhyF_0 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3724329068656445185', time=2024-09-14T14:04:50.156881+0000, chain.objs.size()=1 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:2icWbdO2ILev89TvGaNKpTvBvKgD-N4_._SyyO0GxmFprVKRZqTS4b89_PSARcf6_0 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11208850049069032908', time=2024-09-14T14:10:07.985032+0000, chain.objs.size()=6 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.1 2024-09-14T12:16:14.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.2 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.3 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.4 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.5 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.661__multipart_baz.2~d-ZZxScqPtlL1NbImFGBJ2dvILZUFfX.6 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.381+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6423838680654219072', time=2024-09-14T14:10:11.139253+0000, chain.objs.size()=1 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.381+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.665__shadow_.Y30bNreEQ6L41viZ_gj5O7Udcni9vLd_0 2024-09-14T12:16:14.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.383+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.385+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:16:14.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.386+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.386+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43369' 2024-09-14T12:16:14.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10482118569695675816', time=2024-09-14T13:53:13.891526+0000, chain.objs.size()=1 2024-09-14T12:16:14.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.o3u4tCn4vkng5yooYYBbCLxQyjFIDva_0 2024-09-14T12:16:14.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17244344903308576921', time=2024-09-14T13:53:49.949265+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.188__shadow_.dWM7Ylz0T0xCgiCVLPNfcvNYWKT3Su3_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9386607166983203584', time=2024-09-14T13:55:34.507804+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.234__shadow_.Ql7rYL2EIjqe32JHVAQUtZYLkJhFFAB_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.862065759624466482', time=2024-09-14T13:55:51.398393+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.257__shadow_.tSkaq2U8UTuafEVarxNk_lrYuWFujSZ_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2584740779641060420', time=2024-09-14T13:56:30.265828+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xBjpCbuu5PqgmfgSCt9445gvcji-zZA_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8451588164802797250', time=2024-09-14T13:56:30.314397+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.V0DdsMgUz_loDAVP693ApbORQ3_MsiH_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16850450337982693516', time=2024-09-14T13:56:31.185965+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JcECN3EdYw-OisVCDFqQoIAgpDLKCN3_0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6634698163821439570', time=2024-09-14T13:56:31.205213+0000, chain.objs.size()=1 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3PR1jVv_OVpi7xBOtPfFBhhq7nvaI3__0 2024-09-14T12:16:14.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1010772727062256142', time=2024-09-14T13:56:31.205728+0000, chain.objs.size()=1 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hHSpTmhn2I0rZ72C-8cqQkAS8Sh90ov_0 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8111533591927355827', time=2024-09-14T13:56:31.357633+0000, chain.objs.size()=1 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jY8uajPNoSP5TWZHHafvgRB4FodAiAq_0 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8825104228591236546', time=2024-09-14T13:56:31.731426+0000, chain.objs.size()=1 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2G-MdFG9f0EvTv-ZzvR6vEXdAHl-e3l_0 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13339211964661761669', time=2024-09-14T13:56:32.178077+0000, chain.objs.size()=1 2024-09-14T12:16:14.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UYxF3zTxpk96ssvo9l-uJoe-BoOohqF_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15955853663816578069', time=2024-09-14T13:56:32.203983+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8lezsUa2BiO04sRPwv3UbgG5hdyGq2Z_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13700062547522751261', time=2024-09-14T13:56:32.204469+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RNvDbdchgxlCqzfspr4gVbmRZDJuCJL_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4193429415533560025', time=2024-09-14T13:56:33.159182+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jMaVDf6aiHx9h3EIkRkR3GxMYXXkFCz_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10035871441600680402', time=2024-09-14T13:56:33.350873+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PGLVuXimKWGf63XqrUuzOZJmKqJXVat_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1294027701820246072', time=2024-09-14T13:56:34.046019+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.baJXsYPugxvmo-Tnbid5t2FNZOohXVd_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1466730744831299922', time=2024-09-14T13:56:34.207626+0000, chain.objs.size()=1 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vyrmjMSKrIhMh--J3uxbUnlwVe9U903_0 2024-09-14T12:16:14.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16414156477200374313', time=2024-09-14T13:56:34.570228+0000, chain.objs.size()=1 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SQKqzMJXv8Ny2boReFTPQLYBCMHlos2_0 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10900627291290253571', time=2024-09-14T13:56:34.773875+0000, chain.objs.size()=1 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.o0p0V90naGuggLODFfLp5z-6VW6dLwG_0 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7350549495359051156', time=2024-09-14T13:56:34.979485+0000, chain.objs.size()=1 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LHM0AjgaDeM_f0HGPcsQrIgmmQ1i29G_0 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9243525033664785741', time=2024-09-14T13:56:35.466639+0000, chain.objs.size()=1 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.s2vaT1srWNQCe8uv4rxIwbFdbqvgaCP_0 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14880014638722564498', time=2024-09-14T13:56:35.848050+0000, chain.objs.size()=1 2024-09-14T12:16:14.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.390+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LcPTN9g43HNaRWqeZOn7bMq4UJdTAJK_0 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5298075174915931461', time=2024-09-14T13:56:36.015026+0000, chain.objs.size()=1 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fbB_kTYy1-rIRPO-cJPkO74YGOrFnSM_0 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7692530936638552648', time=2024-09-14T13:56:36.158883+0000, chain.objs.size()=1 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._PnwlnU-afJmvVJs_mq_YSR3bE8QrY7_0 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4943257953775523300', time=2024-09-14T13:56:36.202278+0000, chain.objs.size()=1 2024-09-14T12:16:14.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.71gBERgHjeuLloCdYI0mQoubDSmZ6d1_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16677030173702817599', time=2024-09-14T13:56:36.931130+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hI5hTzT-Y-ilW1ep30ogHKpdeS7pWsK_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17372182695420384702', time=2024-09-14T13:56:37.184553+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oUFnLtNwEFCgPNQf9CcGHw5Twf3ziVt_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15652356259592364275', time=2024-09-14T13:56:37.217819+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-rSTBo4quC9oDw6t8YjJDXY-h2WRg7o_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4234580188586544841', time=2024-09-14T13:56:37.297559+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XXmOfUXbNEVZZBuPPhbDUdHWgCdRWvG_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16544387819629719017', time=2024-09-14T13:56:37.346539+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.X2Ygn_lV_nJKaI25wimuGNCSabU2gmy_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2253903446215518541', time=2024-09-14T13:56:37.383356+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7HW7-ViklDC3UGIMqvZqo1k6qS-0STj_0 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2329464127986630468', time=2024-09-14T13:56:37.612100+0000, chain.objs.size()=1 2024-09-14T12:16:14.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.m92DiYJp9vHM9ccvMNJ89cTOGvELZn8_0 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.266072398427388458', time=2024-09-14T13:56:38.386333+0000, chain.objs.size()=1 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tj7MZgtZPfMU30tRmluJaLJ4KeshPBL_0 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17977780713739085282', time=2024-09-14T13:56:39.130818+0000, chain.objs.size()=1 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1Gzqi_uWd4W7Fu-NYTw63q2wUqe8lji_0 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14798777733146240464', time=2024-09-14T13:56:39.165523+0000, chain.objs.size()=1 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jg8wzoe3-u-BU_X4OLWAC-Gv5Xco5HC_0 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16933721716768292896', time=2024-09-14T13:56:45.599569+0000, chain.objs.size()=1 2024-09-14T12:16:14.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.270__shadow_.Y4LenYv6FkTiUqJ25N2QY0FvOO-NNVF_0 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11685841210266163282', time=2024-09-14T13:56:57.374289+0000, chain.objs.size()=1 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.287__shadow_.LdVrdjSHzWJpkwEWdeQSxTLOndcMmwV_0 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2741013829265332060', time=2024-09-14T13:58:02.239040+0000, chain.objs.size()=1 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kFk3RDYm_STaEzh_2NkA8uwxVKm8u-__0 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9525817449327163428', time=2024-09-14T13:58:02.251637+0000, chain.objs.size()=1 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9sZRgu_RMwxlbnRRFrAl-R65SRA-ooG_0 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9300939360229443455', time=2024-09-14T13:58:02.867871+0000, chain.objs.size()=1 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qKO_orX5QxJc4MudBZbgLS_bm73iNt1_0 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12046991296425330972', time=2024-09-14T13:58:04.019619+0000, chain.objs.size()=1 2024-09-14T12:16:14.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Vi9zeH7ycp5oekqKaPTnrJPuxKLzFO9_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14360219174221047985', time=2024-09-14T13:58:04.191344+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PqeR4NZsVyYduRGYSoiLPMcRPurnv5K_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18386551315353887437', time=2024-09-14T13:58:04.230441+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.j1hdkWfQLfcYRM_Gdwo59ppUuZeb_E8_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17274401716938197386', time=2024-09-14T13:58:04.512719+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gxe860FoYXvvs-580EJLkqQsdD3o9Xp_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12577169925617724307', time=2024-09-14T13:58:04.629772+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.A187XDXfzscsdFsAMdUVXp3DQLqRnFE_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1964945401749170357', time=2024-09-14T13:58:04.756740+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9G43ZE-EkhdiZt_PPE9vqHn5HQ_hgaa_0 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3268681192902840471', time=2024-09-14T13:58:05.538992+0000, chain.objs.size()=1 2024-09-14T12:16:14.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kcBFNHidphTIgD7hdB71etdmYSjXyJc_0 2024-09-14T12:16:14.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3875244308662688740', time=2024-09-14T13:58:05.695081+0000, chain.objs.size()=1 2024-09-14T12:16:14.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.elQKlosIo2gRp3WdGU7_0laBVonPlVm_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7765574515948565203', time=2024-09-14T13:58:06.058507+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fnUBFf7m9XLUvQ3FW2OHKXoLB_8Tq2f_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3290227097161623940', time=2024-09-14T13:58:06.581591+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JrvvfDLw6MA9ck_8ETQFVrby1i44Yxl_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17838446765434055786', time=2024-09-14T13:58:06.687348+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O07A3ayZ3U8J9WNGlvV9l_wh1N9n74c_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3658807262156067861', time=2024-09-14T13:58:06.748784+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7p1_Tu2HO7LulWL5Nf-QVBzKnBgb57w_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1032299512124506552', time=2024-09-14T13:58:07.140779+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5kEgPcH9jPTnfrEPwJSciqLDqzB6bli_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9694167081567127235', time=2024-09-14T13:58:07.356313+0000, chain.objs.size()=1 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mXhsOFr5doWMTXbDIK_43je7kE_R76I_0 2024-09-14T12:16:14.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12058947030600547823', time=2024-09-14T13:58:07.924265+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hTvNAps9ndErFHTiKdog-cN6CJHWQuL_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10470257074282854770', time=2024-09-14T13:58:08.172617+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ewSzgdcQV3ovCAPkgd5bE14DNX5oAhy_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5796474830407826034', time=2024-09-14T13:58:08.193912+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Znhtdmsmta2vJP-q29WbPL-E-5Jvold_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12374136333536790635', time=2024-09-14T13:58:08.338848+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mTkweLurAlQNUkjSGGEOAFrXzk0I92-_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6526701830628773758', time=2024-09-14T13:58:08.627587+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.y2KTb9VI09hoNnAH1jFleZeiKqGBkKR_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13986322203982242367', time=2024-09-14T13:58:08.652848+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EFSyihWkPRhzZujH1P5tcciODTqvOPo_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9235607105004067435', time=2024-09-14T13:58:08.698834+0000, chain.objs.size()=1 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ni1EqFqZb56vjryXxrPrxKKhQVqhTF0_0 2024-09-14T12:16:14.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7440680452304566887', time=2024-09-14T13:58:08.912914+0000, chain.objs.size()=1 2024-09-14T12:16:14.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uJgaWHmaScV3YtjoROyzqHwqdFzfPx7_0 2024-09-14T12:16:14.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11135272087893779480', time=2024-09-14T13:58:09.282831+0000, chain.objs.size()=1 2024-09-14T12:16:14.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i6i_zVdf74PM0FMNfaythc6KhFJaKtR_0 2024-09-14T12:16:14.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.55450055145207744', time=2024-09-14T13:58:09.556804+0000, chain.objs.size()=1 2024-09-14T12:16:14.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4RszXD9zy9hargVfVnQ_NKmASq7kzps_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15528756119387211219', time=2024-09-14T13:58:09.855875+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wKyyKf3KZwSN_GzxEzQ5NdCFivFkwIH_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12352667917536869571', time=2024-09-14T13:58:10.227421+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.J_Qhfc9POQTeLe7ShVIr7vJhnNotvjJ_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3962937530468813461', time=2024-09-14T13:58:11.428829+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NIgPML3hRxIv0KTGvZc5ZeEHmvJptQ8_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6955209400233142649', time=2024-09-14T13:58:11.475293+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IlcI3QE9voan07NbZkmSJslQWiH00P8_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.763743052677971774', time=2024-09-14T13:58:11.543694+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hsuCoDs2j-pDjSu-M6VfJrHiwvV_D0B_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4346712332771899565', time=2024-09-14T13:58:11.552857+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VEJFPXGxgk6vx5v3ucRpV8oSpwssFCz_0 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8716365837354488431', time=2024-09-14T13:58:11.960552+0000, chain.objs.size()=1 2024-09-14T12:16:14.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O2IRL2q0SZ88yKpns6Po7s6V1wiP35z_0 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1537186562472774434', time=2024-09-14T13:58:12.222890+0000, chain.objs.size()=1 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.weqp9VQooNixqZSwrAGXbJAwCzDPPmD_0 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12306355225562195230', time=2024-09-14T13:58:12.359681+0000, chain.objs.size()=1 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.h0G8dk2PajoCjQLDzhA2z3T0_pVMucJ_0 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11305326618595997176', time=2024-09-14T13:58:12.626515+0000, chain.objs.size()=1 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RxzHWFPx3E36L-_EfYGdyFRfiybvk8n_0 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15485707265173721993', time=2024-09-14T13:58:49.371067+0000, chain.objs.size()=1 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4HetfvzaREMNHKA3X7yezyXHUg8l7sP_0 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18143763489092142956', time=2024-09-14T13:58:49.484838+0000, chain.objs.size()=1 2024-09-14T12:16:14.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zjUoIFHJrHxGrdtlcxyXkCzHsl7vo2z_0 2024-09-14T12:16:14.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16996351576750966539', time=2024-09-14T13:58:49.531451+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.i7e8eo6inXwjnD9_-_3LRonfyeYgMRK_0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14473155220168530506', time=2024-09-14T13:58:49.714810+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rdOHkuNLTZHEWvlDEyxYDkglV0a0qIu_0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8017778195387088580', time=2024-09-14T13:58:49.807324+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XAcoNmhWewFTepGMakQOp1HJzGxLVO1_0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5679114308604279600', time=2024-09-14T13:58:50.661348+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GieOU0jLADTzkijlQcw6vafAFYZcbb__0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4150236930047272800', time=2024-09-14T13:58:50.919098+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UBaqK8PFF79JluQiRe4PYMVaj2InVmZ_0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9577387379178634152', time=2024-09-14T13:58:50.996977+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yexF0P9w_RdFk6XtFWdVzQgpZKOUBEZ_0 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7736036976518515562', time=2024-09-14T13:58:51.023967+0000, chain.objs.size()=1 2024-09-14T12:16:14.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MqrHWG1Fj_x0SABSeyqeygMNY6PM7uJ_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1271809118814532177', time=2024-09-14T13:58:52.014326+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.00Y1lKFbTvj-xqcvJU98dE7HrxHD94Q_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13056002667238423855', time=2024-09-14T13:58:52.404723+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XsuHRis949w1-VDishd4MJa7TNYBx6m_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9126964423567491817', time=2024-09-14T13:58:52.574650+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.402+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uhRR2Pj-5nDLyHjuq-wgqdFeDNT9-Aj_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15769737015145178875', time=2024-09-14T13:58:52.964048+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ITShTQ0gvVJo-AKxMZPXfoOFvJ2T2u8_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4351471814403664184', time=2024-09-14T13:58:53.408652+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9DGkO5byMNe1KxtZeiVZLC1E7T79F4o_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13127303124725619574', time=2024-09-14T13:58:53.518072+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PsdtrOY0xn_XjDDvg1JjLCt3V0efUnh_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7759030650420279806', time=2024-09-14T13:58:53.519083+0000, chain.objs.size()=1 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eaHECY2-vQsUgb4NyTCv-KQ_YfCMteE_0 2024-09-14T12:16:14.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17241202899690608661', time=2024-09-14T13:58:53.650347+0000, chain.objs.size()=1 2024-09-14T12:16:14.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zJbQd-EBKffG90UdkWvfy1U8HQ4IGGX_0 2024-09-14T12:16:14.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9223165230413769096', time=2024-09-14T13:58:54.126194+0000, chain.objs.size()=1 2024-09-14T12:16:14.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7jcgRYBR_FNDcHFo7AOEBBog5d44S1i_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7072353039523439254', time=2024-09-14T13:58:54.383395+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Xd6sThILWuTkwHLvHp6fLqvZ5MyONVf_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9824275949898136896', time=2024-09-14T13:58:54.779332+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mIg7WMAkGpBuaS663QotNNKlrbRQ0BN_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6792363489529486012', time=2024-09-14T13:58:54.893207+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.B75Xar9fJqLDboNqp8hidpzm8BLk7yn_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17459966902525718933', time=2024-09-14T13:58:55.060950+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tZDfjeE86qmlJyFE6UzSj6wvNg4R4NI_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.502507512471186784', time=2024-09-14T13:58:55.495955+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gX5RfwesISe_hzZcmXP-oMkOTxeUOgi_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7899074046975012800', time=2024-09-14T13:58:55.496520+0000, chain.objs.size()=1 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xdGQiUTVpS2CwssiLZ6z6fUiDjU_MIZ_0 2024-09-14T12:16:14.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6095989499619174821', time=2024-09-14T13:58:55.642140+0000, chain.objs.size()=1 2024-09-14T12:16:14.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Y0uY1ZqvFo9-zOxA7BX5oP7ovdI8P50_0 2024-09-14T12:16:14.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.407+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/43369 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.672173502358910937', time=2024-09-14T13:58:55.728748+0000, chain.objs.size()=1 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZMjp2inP82qFWwkekXVYAHny2CAHEkF_0 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2689352181817014159', time=2024-09-14T13:58:56.405916+0000, chain.objs.size()=1 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1OJ1P2yD7bXiKYGkG3FQ9QYg3M3T76G_0 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17964426827918871027', time=2024-09-14T13:58:56.641003+0000, chain.objs.size()=1 2024-09-14T12:16:14.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.kZfrhJyMTEwHlS4MYIVDVMQb5dpIScY_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8027764862774310300', time=2024-09-14T13:58:56.882141+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZshiCjJBOSPVRQqo8k5-x4bAZTu5CWf_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13781592715760953781', time=2024-09-14T13:58:57.894381+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0PIY4cydQcsr7l5G9-XXtvS9ZqApMfk_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5671658075360986282', time=2024-09-14T13:58:58.432946+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CVub-XVMpyILQiteUKpZIZSfF8G8zRw_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17194121868561308203', time=2024-09-14T13:58:58.465585+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Oyyc4ckJIhS3Ah2unw_YbLGHkdgH9Me_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7893446749672638198', time=2024-09-14T13:58:58.689213+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PTt6-f9UuGFIVN-brVjryJkENoDs8Uo_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7711898115787615049', time=2024-09-14T13:58:59.381039+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BdsCzk8Yagu3rOecXOplBiw4fSGY8Ep_0 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8415960829487778597', time=2024-09-14T13:58:59.451174+0000, chain.objs.size()=1 2024-09-14T12:16:14.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MA8pbN2wpj5nUHx_xHHgJwU9BsdPlWL_0 2024-09-14T12:16:14.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2310036687827356434', time=2024-09-14T13:58:59.597126+0000, chain.objs.size()=1 2024-09-14T12:16:14.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.coCw60qdNhPZJSbrXjGfEVcopBxwOHK_0 2024-09-14T12:16:14.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3775325313089350618', time=2024-09-14T13:58:59.627806+0000, chain.objs.size()=1 2024-09-14T12:16:14.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.409+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xeypXB6PuiZl9YRdTj_TOmUOjaNkerl_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16890494965764777603', time=2024-09-14T13:58:59.733741+0000, chain.objs.size()=1 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RrF2tAu1EGx63VcB098sFrRWfA6O6CE_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9694350336370800343', time=2024-09-14T13:58:59.764468+0000, chain.objs.size()=1 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3T9h-HGKlW4ZwlfQyxfOd8Zx5zss45x_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10905866326953210326', time=2024-09-14T13:59:29.744573+0000, chain.objs.size()=1 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.375__shadow_.2pO9J2mIGFq2D9-sExLVxdM5hKDHPQ0_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4179715999482471804', time=2024-09-14T13:59:35.311169+0000, chain.objs.size()=1 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.383__shadow_.vsQzFzFnKp5-UogM_acFWjghvbuCLO9_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10759009078965723516', time=2024-09-14T14:00:31.736750+0000, chain.objs.size()=1 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.466__shadow_.9roeXc5VxVpum5kSaVPAvwQRwOPe3p8_0 2024-09-14T12:16:14.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2223852349232103962', time=2024-09-14T14:00:32.090944+0000, chain.objs.size()=1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.466__shadow_.xWfCAZ6OZx6szNrdaqDXGU8zpUnHD9p_0 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17394597637277535911', time=2024-09-14T14:00:41.371452+0000, chain.objs.size()=1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.484__shadow_.1BoOVeDPsSUNaz4QHqmiI3ajnmTc-xY_0 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14797359150181916412', time=2024-09-14T14:01:07.374144+0000, chain.objs.size()=2 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.512__shadow_.XPWfE2MxD9WVnVP4O1qH_woI4N3Ra7k_0 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.512__shadow_.XPWfE2MxD9WVnVP4O1qH_woI4N3Ra7k_1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~gUOUHzPmdQklZrewFGC0kvPWrx7JakX', time=2024-09-14T14:03:04.070810+0000, chain.objs.size()=3 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.531__multipart_mymultipart.2~gUOUHzPmdQklZrewFGC0kvPWrx7JakX.1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.411+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.531__shadow_mymultipart.2~gUOUHzPmdQklZrewFGC0kvPWrx7JakX.1_1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.412+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.531__multipart_mymultipart.2~gUOUHzPmdQklZrewFGC0kvPWrx7JakX.2 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.412+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12042634028743427341', time=2024-09-14T14:04:25.047491+0000, chain.objs.size()=1 2024-09-14T12:16:14.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.412+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:76Jd7RDckr5REo386A.M9tgAXSiDIaa_.AfNXetosZjxdJmKSJJRITJufzdQl5Iw_0 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8144717204871737312', time=2024-09-14T14:05:21.858476+0000, chain.objs.size()=1 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:zflqAadr1o3bjiVMyPP.YpxE0cQQca1_.sredRv0_9qPBLMYTybPLmuXJ4244smD_0 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15350162615778236723', time=2024-09-14T14:05:35.670399+0000, chain.objs.size()=1 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.596__shadow_.CJ5MyHlhWBzYx23MOn09E7lqfRbXxeG_0 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18266999778295510610', time=2024-09-14T14:08:50.162991+0000, chain.objs.size()=1 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.620__shadow_.q9DVpRilerNntR6kZayslrepxKJQjjz_0 2024-09-14T12:16:14.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17162657372679679920', time=2024-09-14T14:10:09.162683+0000, chain.objs.size()=1 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.663__shadow_.QYEx-9acVM2Uzcu-tcqn5l4lHeaxc5l_0 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17219124673019518746', time=2024-09-14T14:10:31.486436+0000, chain.objs.size()=1 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.699__shadow:lw.FAx.ZQNxjU8trxWnfNT8cAINmgd9_.NANrCXIHfsOUHXlDC9WOMoQ3B05bIOE_0 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12478630800018060812', time=2024-09-14T14:10:32.836655+0000, chain.objs.size()=1 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.701__shadow:iZEZQxgFHzgPlqauv-QzymmNQXxe.Wb_.ZZu8KWFFEiRFEtBxaEmZjOCYcPSpHUd_0 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.414+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9002306845549229331', time=2024-09-14T14:14:01.444970+0000, chain.objs.size()=1 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.414+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.777__shadow_.pQvQF3KLbLEqwbXuSxK5gGtQqrkYkWK_0 2024-09-14T12:16:14.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.416+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.418+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:16:14.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.419+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.420+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56750' 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9427883055560097439', time=2024-09-14T13:53:16.809729+0000, chain.objs.size()=3 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5yxVnNkhOQ_oXbxFV1-hwabl5Y1wUzl_0 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5yxVnNkhOQ_oXbxFV1-hwabl5Y1wUzl_1 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5yxVnNkhOQ_oXbxFV1-hwabl5Y1wUzl_2 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_HnRzjOV7FgDc_BWHQ6LXjP5rWaQriT3', time=2024-09-14T13:53:25.899695+0000, chain.objs.size()=1 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.163__shadow_.i8nKVywWgda6QS5C4YPWjnR_zXlhs1L_0 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8344187700708342607', time=2024-09-14T13:55:32.377021+0000, chain.objs.size()=1 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.231__shadow_.QHa6GTR-HaocVKPmBXUFxJWoui8x5-p_0 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16370380906686039016', time=2024-09-14T13:55:37.877538+0000, chain.objs.size()=1 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.238__shadow_.DjxGCCG51Voyb9zrwQgDquP_j1O8zcD_0 2024-09-14T12:16:14.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1598786060328016459', time=2024-09-14T13:55:40.436920+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.242__shadow_.rd7sLiHlb3Z5WCafsIUFJEnBjOAqnEo_0 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13350704085701649003', time=2024-09-14T13:55:43.767433+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.246__shadow_.vGlxJ5POxHv5erdkzLiu7rR8dpLoWDq_0 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16014750555974056517', time=2024-09-14T13:55:50.066738+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255__shadow_.5C6Brj39daTwztwVUdHQz6gx6zVr6zD_0 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1040856975010163682', time=2024-09-14T13:56:30.688876+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Nrjm-Nci3cvAfsnxyC90UyeO0JAWgB8_0 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14470575853079280046', time=2024-09-14T13:56:31.393746+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bKylCuO_fLQG5D5tFmQujwLhH8bY3ai_0 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13204582474731890026', time=2024-09-14T13:56:31.524634+0000, chain.objs.size()=1 2024-09-14T12:16:14.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.d8i35O2IDmd_AWfoD9dQt8CvyKEmH4F_0 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12142572873663435736', time=2024-09-14T13:56:31.853607+0000, chain.objs.size()=1 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OaU8B3kmJ6gLI75919lFH1vkjWGhWbg_0 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14904859230379867560', time=2024-09-14T13:56:32.186353+0000, chain.objs.size()=1 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.zTRCShnEeMZU772_TBNmDqFqqqYK-YF_0 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13411345547097249609', time=2024-09-14T13:56:32.659722+0000, chain.objs.size()=1 2024-09-14T12:16:14.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cJXy8hQ5cnua-Xcv1p04_V3I0GobwHK_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18279246966937224521', time=2024-09-14T13:56:33.207664+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rf5R8D6r2jVMZW84jDQ-YzwC1bLSHfq_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6201417611249941243', time=2024-09-14T13:56:34.311138+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.o0Beh5_6W6i3Dvb07fKI-S8pqlnVmTK_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8899540629450122159', time=2024-09-14T13:56:34.477651+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0j-P72Ji3nhrlhuEHtpKGCUotXxe1ep_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8374200348843646674', time=2024-09-14T13:56:37.414159+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.S0GrqedheOwvNRXxzEV1fWN8As74CUi_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15156735175479240895', time=2024-09-14T13:56:38.086823+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.zepYGo7Qr-pzwHvP0w3Fn5i7CR44QCC_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5016902856834897644', time=2024-09-14T13:56:38.535711+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.x5l7ITXQHq-jaqWxuBFXoAgnC7Zaigd_0 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16710609261740638558', time=2024-09-14T13:56:39.099910+0000, chain.objs.size()=1 2024-09-14T12:16:14.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hE4wBGfObwUGwBGgSyimJ9E9f6TgdxW_0 2024-09-14T12:16:14.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3742636413381858996', time=2024-09-14T13:56:39.912041+0000, chain.objs.size()=1 2024-09-14T12:16:14.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.h-z-dmVEFL4RlWzu-kCs1u90KxxHxcw_0 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16834503386167822308', time=2024-09-14T13:56:40.029305+0000, chain.objs.size()=1 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.H-_KMaSzNbBslg9Y9oNjuASb8sD-vAw_0 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17112896495062416779', time=2024-09-14T13:56:40.092157+0000, chain.objs.size()=1 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kUegZdhmeaMyuwyJIRAt3BLCBJcFA5m_0 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7119134313949491354', time=2024-09-14T13:56:46.923044+0000, chain.objs.size()=1 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.272__shadow_.84zfLR_PrASK_L5oORUzWkOmm4_KFWt_0 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2451485095143567326', time=2024-09-14T13:56:57.375380+0000, chain.objs.size()=1 2024-09-14T12:16:14.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.287__shadow_.NFbxA80DjmEcl-KMyH45N9bxhBNiHyj_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6894030580536656506', time=2024-09-14T13:56:58.057616+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.288__shadow_.GmfYYARqJ-EkNjDzo6iTf6M6NigdxhL_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18351434041461496238', time=2024-09-14T13:56:59.440384+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.290__shadow_.wLwKU_QwiZrQzUeZ4Se2PYONfuDckyN_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2063537813277574141', time=2024-09-14T13:57:02.126284+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_._pCytd60IYnFoFQpBIaBGEaTolI5ZZY_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16396498583856991280', time=2024-09-14T13:57:02.150874+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.G3G5bqDkqD5qXTL5g6og2VPLxdRitWy_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3874402063279972628', time=2024-09-14T13:57:25.467131+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.322__shadow_.l0oBFK3SvHfokhboiCTyGuZrv9csguh_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4459460210434672514', time=2024-09-14T13:58:03.020383+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9oMFEbGG6_GBOxXgBkKsKhUMvKJiwuw_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2483928557024268772', time=2024-09-14T13:58:03.172055+0000, chain.objs.size()=1 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2ORbQ4uRlJIF_sxoIfl1dpQJEaxb1mS_0 2024-09-14T12:16:14.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4542518630190332890', time=2024-09-14T13:58:03.219460+0000, chain.objs.size()=1 2024-09-14T12:16:14.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.426+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K5KcoAKfoyLG1c7jcuGOxPaoq_q0Bgd_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16232668123653066874', time=2024-09-14T13:58:03.884681+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6x32hd7TOqAj4ZCWPZM_6oDlcGyYXOK_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10873016867226849706', time=2024-09-14T13:58:03.886010+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.R27UvQywLyyD0cQQ_ArDKsKTi-c3BMa_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8988589072219721973', time=2024-09-14T13:58:04.006930+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.x97m9Yr3-3Jb75lV41CecqNrvspIvGT_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10379908457428908418', time=2024-09-14T13:58:04.015492+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X9Tk8W9Vbubq06K-aO8JYXNJnfatalX_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2551629350629422430', time=2024-09-14T13:58:05.303100+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lLs201kB_jfXzh9jLL_z1D4WmdpXLWg_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5391062816421712613', time=2024-09-14T13:58:05.595580+0000, chain.objs.size()=1 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.m46U38dOT714cP2PMSsLehZV_84VgIE_0 2024-09-14T12:16:14.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1633728903496112733', time=2024-09-14T13:58:05.985806+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QOmBd_BZxIVJAp31nYoLqSnR0Eog3hc_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11589682936813858121', time=2024-09-14T13:58:06.940626+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GiA93lR7wjgECnBij6vIl6StpnaP1KX_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4896033609203491887', time=2024-09-14T13:58:07.173849+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.428+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SfnAXbqu3ytZoXsxHDAZnFPru4BDH5l_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15942550055276952644', time=2024-09-14T13:58:07.316578+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SGhouXedGhJQZ1M08o-rgSKOlLVaxKM_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3497009389656037873', time=2024-09-14T13:58:07.502287+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ocf47o8T0w3qBQ36-GZCyVhKgxLr4oK_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.914377423247451106', time=2024-09-14T13:58:07.532666+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kcW2XgzcB2TBKQObkmBT1EuMqmC_EeT_0 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2363099160558769336', time=2024-09-14T13:58:08.379210+0000, chain.objs.size()=1 2024-09-14T12:16:14.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LRTDOKSRMkHx3uq-sGcuGZfT5h0qGWP_0 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11570021296697681266', time=2024-09-14T13:58:08.614846+0000, chain.objs.size()=1 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.u_vbNFUkmTRYA1xdgd3UX3tg_0iW61P_0 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7396554905788889827', time=2024-09-14T13:58:08.815067+0000, chain.objs.size()=1 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WC0RnXWuoJDV2qNFj7QykxS9Lhb6hl0_0 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16887254759098577300', time=2024-09-14T13:58:09.333608+0000, chain.objs.size()=1 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X6MWUwMKAqBtTJD0lthdRNJw2fLsBK1_0 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9017649608849117642', time=2024-09-14T13:58:09.633505+0000, chain.objs.size()=1 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MpLX7Cs-ls91M6kdHVEBw2-9ESSNhYy_0 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.430+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6258780747846300796', time=2024-09-14T13:58:09.651937+0000, chain.objs.size()=1 2024-09-14T12:16:14.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.430+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TDXmyypPS5zMExclfNaPpWdmt-NsL-c_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.430+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8661752950900942713', time=2024-09-14T13:58:09.724118+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.430+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xs2BLvS6uwR-FfSLlTKWGmwqSFEriC5_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14090700346806458087', time=2024-09-14T13:58:09.759153+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.S23-yDt6YIWyVv_KfLsOJUT_55YzBtR_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13975692381684301259', time=2024-09-14T13:58:09.824997+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XVjywIK0DRp9pnT8iUJBkB5-MprvSwK_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16182048490669621763', time=2024-09-14T13:58:09.986791+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AUgH0W3_AKP0Pz8mgb3EExCaP85gZmQ_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5921386601612242383', time=2024-09-14T13:58:10.961429+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K6BdqIUzLmOe35HK7cdLUodM3bcG6DY_0 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12981037891073047604', time=2024-09-14T13:58:11.348337+0000, chain.objs.size()=1 2024-09-14T12:16:14.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qgG0m761PLrwSJrgJAdRDz4fk4Xxp-3_0 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15978388429756505319', time=2024-09-14T13:58:11.400200+0000, chain.objs.size()=1 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.S8dG_E_BuDujI-XP026JUu50xjUgWRH_0 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10760047539317346591', time=2024-09-14T13:58:11.473259+0000, chain.objs.size()=1 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.85JJS3jkq42YUSXdcyqS-xxfU2HjOhR_0 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.493984117532716046', time=2024-09-14T13:58:11.928814+0000, chain.objs.size()=1 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dkj-EnhDziZ5wA3S8ixmLLgu7ueu6wl_0 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319260169220232098', time=2024-09-14T13:58:12.042011+0000, chain.objs.size()=1 2024-09-14T12:16:14.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.432+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TfXS7dLejW-yxUonqlkhjqsSsT1XnxW_0 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1729178946331454441', time=2024-09-14T13:58:12.131439+0000, chain.objs.size()=1 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TeSdB090uWJH7QZ9bhmyju-UEdp2uAT_0 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13340152425977712542', time=2024-09-14T13:58:12.135174+0000, chain.objs.size()=1 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._Cv-28WWa2K-koxcHlyrLLC-hI-dxhW_0 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5854834636996993282', time=2024-09-14T13:58:48.989614+0000, chain.objs.size()=1 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2ElGRxah9p31eHoGU3G86LgItJoY7Oo_0 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13445048253851163866', time=2024-09-14T13:58:49.502552+0000, chain.objs.size()=1 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OPsMEEc7cYOW65qEcTwklw0i4ahI5Ln_0 2024-09-14T12:16:14.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1807863126709147933', time=2024-09-14T13:58:50.533349+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qqZsvOzaooAdHjmjxcwiRoldJHF4g82_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11372353507231444939', time=2024-09-14T13:58:50.536856+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TroDD5j81v4KPvRc9t3cpBhQiXAraZU_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14308027856523466287', time=2024-09-14T13:58:50.677875+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aqTlPhVOl1sNnzFDvUCmELGaHBduP5c_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2249553166500088972', time=2024-09-14T13:58:50.694684+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HkRbCRylRz3ozeWKr4c_SOEPa33djK9_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9498895810264087489', time=2024-09-14T13:58:50.695177+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MxSnEAG6aejwb9Ii-w--9d2F9nYK7g1_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17276450913410578500', time=2024-09-14T13:58:50.887924+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3dGejy3Z3a2VHLcV0cM5OIzRG2WT1nF_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13057604992489023846', time=2024-09-14T13:58:51.362360+0000, chain.objs.size()=1 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.w8jjLcF2ELcHjut0vG0TU8l-PJTup9o_0 2024-09-14T12:16:14.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5219799820642010550', time=2024-09-14T13:58:51.439147+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1vXuqusorAvmlVO7yQ2bFPSIIQVUmC4_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3189987249988087641', time=2024-09-14T13:58:52.461361+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8ZBX95hvJzAND5oEgO2mb9jiri_JgKQ_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14047420747964278111', time=2024-09-14T13:58:52.462066+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Y_r2ZGCgXRtVhFUFKBsuNMFimOauOKt_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3419672072170039592', time=2024-09-14T13:58:52.487476+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7MFI56dGaLuKQaq8wEnARXNIhDwWgYi_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12640556962047652567', time=2024-09-14T13:58:52.873754+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.byvqANYxHSSh2sWLGBV2CirDWqDcYAN_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4388276035802005839', time=2024-09-14T13:58:53.366599+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vjrliiZwKb9aTac874O4OWWP_WXeZnT_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13228660773815725', time=2024-09-14T13:58:54.003183+0000, chain.objs.size()=1 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9fgRVPRExpqId75NGoo_i-8524xC42D_0 2024-09-14T12:16:14.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1016851570694914854', time=2024-09-14T13:58:54.004327+0000, chain.objs.size()=1 2024-09-14T12:16:14.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.y4x-q8Z1HJYclXqw-PHn4iKqW_K7s0g_0 2024-09-14T12:16:14.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15391077384973921392', time=2024-09-14T13:58:54.077367+0000, chain.objs.size()=1 2024-09-14T12:16:14.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bRnaNGXC7wULytLVEJ7WHQ56QXG41iH_0 2024-09-14T12:16:14.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4423728231717563271', time=2024-09-14T13:58:55.234247+0000, chain.objs.size()=1 2024-09-14T12:16:14.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.436+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nUeXAoRAAWYuS8w84T7Csnj75zR29lv_0 2024-09-14T12:16:14.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16206217697729423619', time=2024-09-14T13:58:56.873904+0000, chain.objs.size()=1 2024-09-14T12:16:14.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zSEHCwnEuYsn74xSI1nCSSf8sdfEWda_0 2024-09-14T12:16:14.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11696025327435052440', time=2024-09-14T13:58:57.732886+0000, chain.objs.size()=1 2024-09-14T12:16:14.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DEI_6-pEr52VkMbkQiRTTeGbsgASohp_0 2024-09-14T12:16:14.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17388451108725599545', time=2024-09-14T13:58:58.149322+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FvaE1w7zHxbTtFHUL8J1JC1wqaHA_vs_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8300926901085144999', time=2024-09-14T13:58:58.459298+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ur5xpUuRQVTPhFW6oHIh9xhdtkspTCQ_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12052531566271847749', time=2024-09-14T13:58:59.467922+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rBH-gIuQC7duySKZUTLOrXXRNJH0f_m_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.487653384981906346', time=2024-09-14T13:58:59.674201+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JzNjsvqymhhBGyJzGnvDjo9SQRA79Ts_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1516793320492204127', time=2024-09-14T13:59:04.853809+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.332__shadow_.e54RSqQahnK96aGOAqcAfClyUu1-olw_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.655267659379218016', time=2024-09-14T14:00:40.595613+0000, chain.objs.size()=1 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.SGrFdrw5Y6eAsqW9DwSY4tP1mc7AEpV_0 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.97156614200465290', time=2024-09-14T14:01:04.218179+0000, chain.objs.size()=6 2024-09-14T12:16:14.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.438+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.439+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.439+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.439+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.439+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14351304792465084543', time=2024-09-14T14:02:48.093506+0000, chain.objs.size()=3 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.439+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~7aPpKaBQOC4JDSD-FHu-f_0PFVSt7um.1 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~7aPpKaBQOC4JDSD-FHu-f_0PFVSt7um.2 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~7aPpKaBQOC4JDSD-FHu-f_0PFVSt7um.3 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10445961250596327228', time=2024-09-14T14:03:26.820447+0000, chain.objs.size()=1 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.536__multipart_mymultipart.2~azNbiRZEna8KULusuOn6hATRGsqjlJF.1 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18051304010290307595', time=2024-09-14T14:04:06.700146+0000, chain.objs.size()=2 2024-09-14T12:16:14.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.440+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.1-QBwNjUR0Kt04WF2kL2yVgGCVq7ble_0 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.441+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.1-QBwNjUR0Kt04WF2kL2yVgGCVq7ble_1 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.441+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14472469125986270189', time=2024-09-14T14:04:22.917477+0000, chain.objs.size()=1 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.441+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:GIJSXUex6QFhH5JOnZOknPwSAMxIggX_.TBBHOY5P1LgeliPRhqzECbmk9Nue4UL_0 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.441+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15881254609125864977', time=2024-09-14T14:04:39.493314+0000, chain.objs.size()=1 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.441+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:m6yeKZGx821DOiskTRlpBl..Og-iwVt_.r9A-4Lp8ddf21CVV5h9bttqkc0Q1ckw_0 2024-09-14T12:16:14.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.742703724448580540', time=2024-09-14T14:04:44.422195+0000, chain.objs.size()=1 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:-yeL8QVj2AG9hBzQJWK6oYY39gvp4io_.zJn7fpYEpQB3loj3DU5e1icNqZKCWoj_0 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14401281697890417219', time=2024-09-14T14:05:23.928990+0000, chain.objs.size()=1 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:j0nCjM207WjAZhz8TjJiV6.PcJgLrCe_.Br6YReF9eSxKmy1PZKWvLwEQRJ3LpoX_0 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9202994186010086599', time=2024-09-14T14:05:24.251454+0000, chain.objs.size()=1 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:iGIKlkv6AYoaA8da8Zwg3EqLgkYivgR_.PBjCwhyD1FakUnozwxFHD5YEiNZumDB_0 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7228888088497994606', time=2024-09-14T14:09:37.912671+0000, chain.objs.size()=1 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.644__shadow_.D27_qf5EEAnSvhSC6gs6-nxTWfRXqew_0 2024-09-14T12:16:14.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.443+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/56750 2024-09-14T12:16:14.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.445+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T12:16:14.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.317456223742084943', time=2024-09-14T14:10:28.707027+0000, chain.objs.size()=1 2024-09-14T12:16:14.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.695__shadow_.uTQO9ki6iPhG6jJatFZ7sN9SKvnp9Qt_0 2024-09-14T12:16:14.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.32897842911583516', time=2024-09-14T14:12:36.418908+0000, chain.objs.size()=1 2024-09-14T12:16:14.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.760__shadow_.F4PM35CoGpPktsJKZdDTmLWyz3voukt_0 2024-09-14T12:16:14.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.447+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.449+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:16:14.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.450+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.450+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57841' 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1450090700130175264', time=2024-09-14T13:53:08.853865+0000, chain.objs.size()=3 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.OG8LCKGyG3v9d4hkH-7O_sz1kXCaRUQ_0 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.OG8LCKGyG3v9d4hkH-7O_sz1kXCaRUQ_1 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.OG8LCKGyG3v9d4hkH-7O_sz1kXCaRUQ_2 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_3wO_FYvksqLZ1S0LhBgnJCV3M1-H9KJ', time=2024-09-14T13:53:17.455780+0000, chain.objs.size()=3 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.k3j-PmBTszWrJ1Ia0Dc6WnxwpfHMkU2_0 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.k3j-PmBTszWrJ1Ia0Dc6WnxwpfHMkU2_1 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.k3j-PmBTszWrJ1Ia0Dc6WnxwpfHMkU2_2 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14187465795946876268', time=2024-09-14T13:55:33.797343+0000, chain.objs.size()=1 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.233__shadow_.GQHrGVF5v3tuPymVvILWJX25fM0nlp8_0 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7772734602436871656', time=2024-09-14T13:55:47.952233+0000, chain.objs.size()=1 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.252__shadow_.LwkhWFXQwn2vj2dIyDrwyBc_WxJZwKq_0 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7723288696563583184', time=2024-09-14T13:55:52.040808+0000, chain.objs.size()=1 2024-09-14T12:16:14.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.258__shadow_.rp5_PvLsmXsXIqsjlZt2CTI-wozlx2r_0 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10869080900478833327', time=2024-09-14T13:56:29.743310+0000, chain.objs.size()=1 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JsnW-SM0J8ffgI57hFqywPgV2pR0isL_0 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.581422521230071887', time=2024-09-14T13:56:29.862227+0000, chain.objs.size()=1 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.p_Z0qxmcuwYVxyYYkuZiL_MpDW5Aya-_0 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17956460707200486948', time=2024-09-14T13:56:29.953418+0000, chain.objs.size()=1 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.451+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6aUWTaH9QCvNy4CjI-ENh7vM4Rvzhtj_0 2024-09-14T12:16:14.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.453+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9814366523807208680', time=2024-09-14T13:56:30.073979+0000, chain.objs.size()=1 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.453+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8pU8Q2qnvA_sdi4MtXk7O8s2Ee28nUy_0 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.453+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11955155881255171023', time=2024-09-14T13:56:30.340916+0000, chain.objs.size()=1 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.453+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NgKgvhfKqIoFAEnMLaxT6Syr8FfDxa1_0 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3752845619798557359', time=2024-09-14T13:56:31.962513+0000, chain.objs.size()=1 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.40kHG_CqYvnP9-87EGAKqro_1UFJ8MV_0 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4671770656578064205', time=2024-09-14T13:56:32.111880+0000, chain.objs.size()=1 2024-09-14T12:16:14.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GAT7OrIj0rp1UYkj-wsPIIFnIbvwooR_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4103175883557187960', time=2024-09-14T13:56:32.621079+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BOyefyTXnXg5uSsxL17qjHVwzsMFkyD_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15629791237518537902', time=2024-09-14T13:56:32.760439+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ye6_Y1wGahPt8hmBc13zM1mU_y8XMFc_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1108883301766503057', time=2024-09-14T13:56:32.809770+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gd6xidonk7VPnTUl-mseGlz2a-wWvix_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2768727655475564681', time=2024-09-14T13:56:33.120399+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bnHF9yC5P-xJW47F8RzWtyYrgOG7efT_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3938038982862611968', time=2024-09-14T13:56:33.632219+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.smzcO2tWVhGKM7LltRfaQkNP_OyWWqd_0 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2591396506320458940', time=2024-09-14T13:56:34.350756+0000, chain.objs.size()=1 2024-09-14T12:16:14.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.chg2cpfMiadp9BIzaEqnjEl8tayS5S6_0 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18129194045000431269', time=2024-09-14T13:56:34.483180+0000, chain.objs.size()=1 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.454+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JZj7R2q0gvzoLsAvsavUqPW4ajU_bxm_0 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12725696000502339159', time=2024-09-14T13:56:34.829269+0000, chain.objs.size()=1 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rIniZpIzxyXfEhv4SCQur_B1IuG9p-I_0 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12747893121388525772', time=2024-09-14T13:56:35.570858+0000, chain.objs.size()=1 2024-09-14T12:16:14.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.t8NbNyOLbbKZxMhhI71PW5Y8hc_ogzC_0 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13731571838116328671', time=2024-09-14T13:56:35.686951+0000, chain.objs.size()=1 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gkHJi5xPQ2t1QnEGo2Y5yktNPSE2y1y_0 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16581279734209075733', time=2024-09-14T13:56:35.713259+0000, chain.objs.size()=1 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Elxq8z9Bj1Xyfec4O8l0H-QjtspzXsn_0 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15303900731516796715', time=2024-09-14T13:56:36.371381+0000, chain.objs.size()=1 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RoZHlvbAr9Ne8QvS8el9gvncCwoWiw-_0 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4544319794655393410', time=2024-09-14T13:56:36.878082+0000, chain.objs.size()=1 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dt6HBDtByQI47KZxUZP88LCgvWcWzTB_0 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12203327263517874606', time=2024-09-14T13:56:37.016062+0000, chain.objs.size()=1 2024-09-14T12:16:14.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.456+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mur2trBb-yC5YoEp556JuIjLrP_W37k_0 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1680371655552927715', time=2024-09-14T13:56:37.044241+0000, chain.objs.size()=1 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eEbq1RWHRyA1e06HvnypwxS0EcFixXL_0 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8774322298261039154', time=2024-09-14T13:56:37.574313+0000, chain.objs.size()=1 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BnP-P7OjOvHV1i1ss1iXj24928NNhlT_0 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10942891163220605930', time=2024-09-14T13:56:37.654166+0000, chain.objs.size()=1 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.J8nQAbUdZp88bPS8c2XB6Csvzk1Zu6-_0 2024-09-14T12:16:14.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5391893529726996115', time=2024-09-14T13:56:37.692410+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Fyhi47fIPCSMbk9II-D4gQoyunRphLB_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17982301483515495327', time=2024-09-14T13:56:37.716033+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9ukfzpir1LoyqZj9ZNaSSQPvHpHSOjX_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8795834909820282958', time=2024-09-14T13:56:37.742102+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gmcjNuyJICakkGZOGAClWWVkSjt7fln_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12633205080146371425', time=2024-09-14T13:56:37.754339+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4f9PVRXVjOoF8b3xcMB9qZwBiDduWuX_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3731118049886436002', time=2024-09-14T13:56:38.847306+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EeuGI52Cb5HA5fNvNvjOZGSN7Aqxbnu_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2127586674987143365', time=2024-09-14T13:56:39.056849+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kEsiSZSg6klF2aJHXeVXJ_-4whPnLoX_0 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14318968761442044875', time=2024-09-14T13:56:39.128199+0000, chain.objs.size()=1 2024-09-14T12:16:14.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mOf2gR7dU1tBAWv2xi01dbEIM_oPg8t_0 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8461130104173689941', time=2024-09-14T13:56:39.128918+0000, chain.objs.size()=1 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bBlaprNEsITCjxbkHBRj5Jyh4SDcmFI_0 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14567201325992654428', time=2024-09-14T13:56:39.684996+0000, chain.objs.size()=1 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.e8WqB-3L8Dhihy0VzPqbAQIycBrsqf3_0 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4814445245850496714', time=2024-09-14T13:56:39.879260+0000, chain.objs.size()=1 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.c9chRrqYT4P9wfC3EpmzKNmDMOjClxc_0 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4564017145556620008', time=2024-09-14T13:56:44.953671+0000, chain.objs.size()=1 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.269__shadow_.FLJfAx4HQ5GHU__ghsQRydKodpZhxNL_0 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14424899590043889491', time=2024-09-14T13:56:49.598193+0000, chain.objs.size()=1 2024-09-14T12:16:14.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.276__shadow_.kAobGwuqsqbyqb1YuvkfIyvihJ2JWZG_0 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15406267229061552479', time=2024-09-14T13:56:55.922590+0000, chain.objs.size()=1 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.285__shadow_.GPa3jzkjZq57sELsCBkjrcuBTURUA2K_0 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14254290216092097932', time=2024-09-14T13:57:02.183863+0000, chain.objs.size()=1 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.pGbZj43RC8J4OgjkOihiTB0FzlYyzp4_0 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15222253984068985831', time=2024-09-14T13:57:04.072938+0000, chain.objs.size()=1 2024-09-14T12:16:14.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.ddJGABOcjwyGKXi2-70akMztHi2BIhS_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.460+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9690884603502010080', time=2024-09-14T13:57:04.103652+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.Qp2EbiPfMfy-FxKFXlR1klz_abU82J9_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5227438849123880034', time=2024-09-14T13:57:05.567000+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.295__shadow_.7CiP8bPUgLtxXW5ZLGq-no93NW8H_p5_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15960100996655274918', time=2024-09-14T13:57:08.593560+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.299__shadow_.GRPtbmM5_HVYi_JQXdXfpP0jxVV52J6_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12364162351434744786', time=2024-09-14T13:57:14.887457+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.307__shadow:NrNtSXnVMYqtQ1UA.JGWKXzvLx0cSQo_.swb65H9PjE37CKNbwVKDCB8fYTA-lGw_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15376530264149418640', time=2024-09-14T13:58:02.400283+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.brfX6mTRV2fajHRdp2TIJT6CHT7DdyL_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6575768434234517493', time=2024-09-14T13:58:03.066107+0000, chain.objs.size()=1 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.c3Z3o3s-qcTuhaJJ9IKK3Sj-VTWmsNv_0 2024-09-14T12:16:14.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1900987894708871753', time=2024-09-14T13:58:03.066868+0000, chain.objs.size()=1 2024-09-14T12:16:14.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.iVxkOr__zvyoR22xGxhuA99uRQfGab4_0 2024-09-14T12:16:14.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15873483322533579776', time=2024-09-14T13:58:03.161722+0000, chain.objs.size()=1 2024-09-14T12:16:14.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Unuufm8j3-JJXgliHRdvQnOuVJIQzXj_0 2024-09-14T12:16:14.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1327220798126611199', time=2024-09-14T13:58:03.853364+0000, chain.objs.size()=1 2024-09-14T12:16:14.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.S69ghgDqS3zrmBxD9mFfgUyo8O_ntyR_0 2024-09-14T12:16:14.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14248908547744053823', time=2024-09-14T13:58:04.000755+0000, chain.objs.size()=1 2024-09-14T12:16:14.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jYNzLmRtMVCDnRbEqMPaSm0U8w_w_C-_0 2024-09-14T12:16:14.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8499783834567273246', time=2024-09-14T13:58:04.229473+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EF8v2kKclTT7UIIeCjuIBXVHaA0Pqu3_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1405425052955534186', time=2024-09-14T13:58:04.345996+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.C8Q0Qr2t4ih3S9Q1ROz5VEmc60syCxq_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1968693552402534650', time=2024-09-14T13:58:04.392012+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LexvQBpAcjyxts_WHRzMqJISiFlmpHj_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11164724755958426108', time=2024-09-14T13:58:04.733252+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Hp1bBAqFX93HbjakCL3dBYL8K73Isd5_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.876706258063683386', time=2024-09-14T13:58:04.751385+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AY62dhQJFDgsQkQSr2Kbkx6btHZVr84_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5645945382415496182', time=2024-09-14T13:58:05.160738+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YuEoUG4egzC1yU5qQUxdR6hpEPG2Zhf_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6002278620763281458', time=2024-09-14T13:58:05.450017+0000, chain.objs.size()=1 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bPTGP-q1BmaJApwE4It_0-GyJ9A70tY_0 2024-09-14T12:16:14.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9854983387445035477', time=2024-09-14T13:58:05.495097+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CpSV-XfTKIP7p1D-LZyeDf8TZy_yO1H_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6515004649065613554', time=2024-09-14T13:58:05.820858+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-EPmZvDQHIXxJnsOkSY9SNjoHQ4y9kL_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1334620356685449394', time=2024-09-14T13:58:06.183871+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nwe47YlwSRk4FqcRLsBIk3EKFMfEK_c_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.818049574569375253', time=2024-09-14T13:58:06.860030+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Z5VQ6uqUU7_EF6BYU8Ce7fzi_os68iq_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13527673097560347642', time=2024-09-14T13:58:07.088914+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ejZjQ0ZbJO9vfruOSq1I4pKfRbWDKLj_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1301787415532573250', time=2024-09-14T13:58:07.196680+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VE8M4IoS9Tr9a_f_2t_5uLR3jojt80Z_0 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4580010912881366616', time=2024-09-14T13:58:07.226278+0000, chain.objs.size()=1 2024-09-14T12:16:14.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GLFPwq0h0tFEPV7fjLIN9FkNbhBD2G__0 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9716220403675480515', time=2024-09-14T13:58:07.924601+0000, chain.objs.size()=1 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0WRST7RpWSLpNpnNR266_hjka9vBY1j_0 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12655567129067365244', time=2024-09-14T13:58:08.471259+0000, chain.objs.size()=1 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BpsUlfdN9o0Twt0tixJ180MPmKPGJUo_0 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6925119472146553730', time=2024-09-14T13:58:08.906412+0000, chain.objs.size()=1 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NiO_QGpIggbiiLrCcByMgy2Gu0jbkZh_0 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9781311385077444726', time=2024-09-14T13:58:09.500690+0000, chain.objs.size()=1 2024-09-14T12:16:14.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.10UDxwCb7tMYTx5ESDTSsarcN9jp8HZ_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18030237713750244393', time=2024-09-14T13:58:09.709979+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.r9rWz1w9LLzt1zAiUaIEtfG_2MD6lUO_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7279197822133551840', time=2024-09-14T13:58:10.112414+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jWdHu8VWNH9W2dIeBQFyovL_44eEPNu_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12556335516176576045', time=2024-09-14T13:58:11.298705+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CCy9oAwfaRRWg-Radgd3dpCCiC7NarG_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10744288558217126473', time=2024-09-14T13:58:11.470727+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KZVLUkSTH5VHlznXfXPp7gPR_VNJ0zN_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1954958680674420506', time=2024-09-14T13:58:11.506688+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CjrlL9KtFTtNYohQj4837_KvJrXiZKG_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2513154270798524195', time=2024-09-14T13:58:11.994410+0000, chain.objs.size()=1 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ay39z82KNH0EJUpOL6oPBYQNRVzfkLX_0 2024-09-14T12:16:14.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17935886370801716057', time=2024-09-14T13:58:11.995149+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZkqNzQE1DB0db65o_opujMCKfVQSDYr_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4745984215609942914', time=2024-09-14T13:58:12.276193+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mmxgFZJ4Igw_9FTVMryIv3qghaFSftr_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4343537517494493112', time=2024-09-14T13:58:12.276932+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rkUPH4J2YLIq3FRANz8PHxJB0MLwAfD_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8651151860011562292', time=2024-09-14T13:58:12.364935+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Rd-4cl9G7Ywg3D65NbdWVAhLTA70t-c_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2676690686650388417', time=2024-09-14T13:58:12.626504+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZYd7P1Au7xRUYQsZhiZ62rnulpyrIpV_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6855547247861517392', time=2024-09-14T13:58:49.041109+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wxte4FnagH-fY2qGHls_lqTSZwDFRkW_0 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10636432345134018005', time=2024-09-14T13:58:49.637232+0000, chain.objs.size()=1 2024-09-14T12:16:14.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WdT9dOhRmKy5qCagam3aeD1PSc8wPoL_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.469+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6662270772549383364', time=2024-09-14T13:58:49.841056+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.469+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2tx6fXzA_pjHWv-i0gYK2q6HmVx9xXg_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.469+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1525050345916969298', time=2024-09-14T13:58:49.976089+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.469+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IDaY0iXxCYRNIh20UoOhixFpnrg5moO_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3376545877875236024', time=2024-09-14T13:58:50.545271+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zg1I9kii6Pk68t5Kw0Ej9uVcGIfXJ9R_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11727775795214538080', time=2024-09-14T13:58:51.401045+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uThyN3Y64NKBox6-hdyzwOCFgl_ARBB_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15867459596647547762', time=2024-09-14T13:58:52.645832+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qxBp1GgtAfY05uBddZjQZe3SyQ3DlQu_0 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8119549599081279902', time=2024-09-14T13:58:52.911325+0000, chain.objs.size()=1 2024-09-14T12:16:14.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.diMHfZxGe8RWsuN_b4uf2Py7rlqyFwY_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1973866996959155426', time=2024-09-14T13:58:53.364057+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XvUkkpg02DWFFZBKRM16gV04LDE5Otu_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.469948317496055456', time=2024-09-14T13:58:53.565579+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LmmU4KV0Dxt8xhBiWzksKHn9I0JMNKC_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7643254814298595615', time=2024-09-14T13:58:54.003855+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gXs1SqnXYg530qVvbbsfa4z1IcRr_t8_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4793124180594175051', time=2024-09-14T13:58:54.004624+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QYpkycVpRCJdVVFp9q0qobMxNZGA_dW_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12358887085291645468', time=2024-09-14T13:58:54.909133+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.470+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.B_9fKmFG4PB7NktOoKN4LtvQYWLIgw3_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10226478691962092285', time=2024-09-14T13:58:55.567845+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WtuDTjkAhz-MuM_KO0cwA661I0Lu0ZB_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1603914871235222083', time=2024-09-14T13:58:55.605857+0000, chain.objs.size()=1 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mGaIpkGyuAGhWFU8RXlPlM96vWdcj-l_0 2024-09-14T12:16:14.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.472+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13641337414598987400', time=2024-09-14T13:58:55.653713+0000, chain.objs.size()=1 2024-09-14T12:16:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.472+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HfoxxdB2D1ta5PhVgdFqM92qJtBshGd_0 2024-09-14T12:16:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.472+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2177603251188361116', time=2024-09-14T13:58:56.676615+0000, chain.objs.size()=1 2024-09-14T12:16:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.472+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qbvoy0BGP-jo7kdCuhdu_r6Q-8VReYC_0 2024-09-14T12:16:14.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.473+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/57841 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10908377510903078036', time=2024-09-14T13:58:57.738516+0000, chain.objs.size()=1 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UVKn5KJCIVqzuBAGlNwuchYefEnEVnQ_0 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4924843820295066352', time=2024-09-14T13:58:58.060835+0000, chain.objs.size()=1 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VOVNaWirNQ4SeHM4wGHWhpgVXCUvLQk_0 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4108223576929782415', time=2024-09-14T13:58:58.255672+0000, chain.objs.size()=1 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4w9T5VXNitHr9wUNNuYTXvFoMOEuhJO_0 2024-09-14T12:16:14.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5558913388883886491', time=2024-09-14T13:58:58.537592+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7wdtNVnlmHNbdRmqPb_Tzek-Pu0MMsc_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17451888600678671040', time=2024-09-14T13:58:58.631222+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pJHHIqxnhDQRflgctnMmXjQxv69Cq2N_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2069059376247644835', time=2024-09-14T14:00:21.042756+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.454__shadow_.h61IXpaiDwIO59JpUybr-RwGLXw6dVy_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9462491073342531059', time=2024-09-14T14:00:28.343731+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.462__shadow_.fLlYK7z5GS1jYWNtvsvgTzWaMo7CPzc_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14325157028812802555', time=2024-09-14T14:00:40.602034+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.AzemU2lRIFFclSz5TO1I7oTwtzMG5tk_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4726480268599530302', time=2024-09-14T14:00:48.765690+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.491__shadow_.xQjPP69EOfqlXXET1KYkuUS4TnXFaH4_0 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8605451377466079609', time=2024-09-14T14:00:49.382625+0000, chain.objs.size()=1 2024-09-14T12:16:14.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.493__shadow_.OucJh7sWdPYe8zTcvX3u9FsBm9fqxP0_0 2024-09-14T12:16:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13209625138658406749', time=2024-09-14T14:00:56.824763+0000, chain.objs.size()=1 2024-09-14T12:16:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A', time=2024-09-14T14:01:41.574250+0000, chain.objs.size()=1 2024-09-14T12:16:14.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.475+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7487465961601495497', time=2024-09-14T14:04:27.132259+0000, chain.objs.size()=1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:nUjq8UKDUwYjXzoduyueSQ0HP3EecJn_.p5Fw7oqnYRW4jr6tkyUzEoZHLSR2Rgw_0 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17686599261121090459', time=2024-09-14T14:04:45.373000+0000, chain.objs.size()=1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:qIF2QVifVTJJoGXiJi5S7Mm.rhiwVNd_.eHWfccW_ZCw0aLDkfFSoOXkDWqAVfVi_0 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.279672104329490329', time=2024-09-14T14:05:30.130873+0000, chain.objs.size()=1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:bYqg.qnoI.CH30slOEhHtnyx1dmHetJ_.zw1sriWUy9QcbBeqpj2mTaOmPQl9NkT_0 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13244316092908352035', time=2024-09-14T14:06:11.601135+0000, chain.objs.size()=12 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.1_1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.2 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.2_1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.3 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.3_1 2024-09-14T12:16:14.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.4 2024-09-14T12:16:14.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.4_1 2024-09-14T12:16:14.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.5 2024-09-14T12:16:14.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.5_1 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__multipart_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.6 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.613__shadow_multipart_enc.2~uApcFH2xUFTq0xE-B9bksFWOwKel7rJ.6_1 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10939534355869809539', time=2024-09-14T14:09:23.417605+0000, chain.objs.size()=1 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.626__shadow_.ya6PTwemyGFpptbUuTRmZZLCZIFRcs0_0 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8975544291172211179', time=2024-09-14T14:09:32.963543+0000, chain.objs.size()=1 2024-09-14T12:16:14.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.641__shadow_.PFM-WSWrRNvBkHEmEnCFhByIFcsa9we_0 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~C1-9ed1JL4HXtNJ2BMVbqQtQECbdW0V', time=2024-09-14T14:11:29.692481+0000, chain.objs.size()=1 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.742__multipart_mymultipart2.2~C1-9ed1JL4HXtNJ2BMVbqQtQECbdW0V.1 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12810471804287887166', time=2024-09-14T14:11:34.185706+0000, chain.objs.size()=1 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.744__shadow_.llFQVA-J5XqpRh_rrZgkWMVmDhbwExl_0 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12796874950266403685', time=2024-09-14T14:12:26.814545+0000, chain.objs.size()=1 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.758__shadow_.ej6ps-yv_wzD8ZCMBVI-0VojAsDEqN0_0 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17016087170340260161', time=2024-09-14T14:13:33.780008+0000, chain.objs.size()=1 2024-09-14T12:16:14.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.769__shadow_.2jN5oQjWSwNwybWgl1kzXDDhJflNssv_0 2024-09-14T12:16:14.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.483+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.486+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:16:14.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.487+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.487+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44940' 2024-09-14T12:16:14.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.742550831006328752', time=2024-09-14T13:52:59.466635+0000, chain.objs.size()=1 2024-09-14T12:16:14.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.148__shadow_.ZxflS2BVtad7cV8szhJmDWOZ3FGhjtt_0 2024-09-14T12:16:14.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~T21SdOfq7EfQWpeWYCdIOCbW8o4dKVU', time=2024-09-14T13:54:03.887822+0000, chain.objs.size()=2 2024-09-14T12:16:14.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.201__multipart_mymultipart.2~T21SdOfq7EfQWpeWYCdIOCbW8o4dKVU.1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.201__shadow_mymultipart.2~T21SdOfq7EfQWpeWYCdIOCbW8o4dKVU.1_1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10731320679160854415', time=2024-09-14T13:55:30.729461+0000, chain.objs.size()=1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.228__shadow_.RKnhgwR-Z6ywjzwrddrnTgYhOm6tGq6_0 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7748755498559670719', time=2024-09-14T13:55:34.507802+0000, chain.objs.size()=1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.234__shadow_.LV6E_PfRpoxV8FTp9EN_LUP6qdFRDXK_0 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10197321728267356010', time=2024-09-14T13:55:47.945203+0000, chain.objs.size()=1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.252__shadow_.Et-tPHnJugJMxAqEn0bq7jU-VPXzUCo_0 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10728612861479491407', time=2024-09-14T13:55:51.393732+0000, chain.objs.size()=1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.257__shadow_.yCbERyMZMMSxb6Vf2SzdME1I9DiiN4h_0 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255295972716022399', time=2024-09-14T13:56:29.635341+0000, chain.objs.size()=1 2024-09-14T12:16:14.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7yB0KlFwRkNsp3Qnx0wXzXb1YKHeHiY_0 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7064829830036017772', time=2024-09-14T13:56:29.741892+0000, chain.objs.size()=1 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uGT2a9e15TEhxpqPJBSOzNdmWkwbZWC_0 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1940857376648993260', time=2024-09-14T13:56:30.121683+0000, chain.objs.size()=1 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dokhDWjfdQSMDt9AJBDP6ERAMeduC6H_0 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13344692304213136575', time=2024-09-14T13:56:30.404297+0000, chain.objs.size()=1 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Dlh5FGMD0hby8fBcCiF-FNMDVXu2fOg_0 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13979143253849956762', time=2024-09-14T13:56:31.308122+0000, chain.objs.size()=1 2024-09-14T12:16:14.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.488+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WWmFvWHzSlwQU1UKQX4tzkyxgl7BJso_0 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11585905556531828045', time=2024-09-14T13:56:31.664760+0000, chain.objs.size()=1 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.q4CNAwVmJaTqE9OLsSXoEzDfWQ9Ukh0_0 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18255388644928018469', time=2024-09-14T13:56:31.836803+0000, chain.objs.size()=1 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.x5cxylL55DUwBPfd58FIhdhG6D54M_p_0 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14254658261162268043', time=2024-09-14T13:56:32.034858+0000, chain.objs.size()=1 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yG4ErYCIOvCJ2EknvPkVWNyB2MhmgHx_0 2024-09-14T12:16:14.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12129084180649768053', time=2024-09-14T13:56:32.660567+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2RE-b58ZKJk3ySuD_aAtbV8fngz_z2E_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12235248771118439884', time=2024-09-14T13:56:32.759254+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YkdbmmSzQy4LFULxfjNkfb3XfEwrQfM_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18375104538786065198', time=2024-09-14T13:56:32.932964+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vbEKQuw68FVAP7UwBK7y0Iv4uG5HpvW_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4292806609627558547', time=2024-09-14T13:56:32.935162+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IWkHJrhAcYxJy_87-jiKbO_aO6Jl89q_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15969685512370148787', time=2024-09-14T13:56:33.382047+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VRJ1T2-6x8It-XVxJZsgkgUW8tUTnac_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4577245546482864114', time=2024-09-14T13:56:35.025202+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.g84iKHg5cx0QQNjdi05clm5XmHfGaFJ_0 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7789357089174275780', time=2024-09-14T13:56:35.066207+0000, chain.objs.size()=1 2024-09-14T12:16:14.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.490+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.irurAhEQzRBlt-uFYxHsyO1e6JhvK9L_0 2024-09-14T12:16:14.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.491+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2717936175210852798', time=2024-09-14T13:56:35.820115+0000, chain.objs.size()=1 2024-09-14T12:16:14.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.491+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tn7YEIgvyKi35OfQEM_pVbk6IvL02Rg_0 2024-09-14T12:16:14.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.491+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15301029751045998867', time=2024-09-14T13:56:36.262406+0000, chain.objs.size()=1 2024-09-14T12:16:14.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.491+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6UyfBVAFswDgt_CVvityW99bFOWSnw4_0 2024-09-14T12:16:14.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.492+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16444870509721164057', time=2024-09-14T13:56:36.263081+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.492+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kP_u80rC9BIxVp7ZgAZA3lV4n7U3yVF_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6645584829321076737', time=2024-09-14T13:56:36.386835+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WIK5dFv5n5Vy00CEJ7Dq19_wLNKuZ9f_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14589266893148573908', time=2024-09-14T13:56:36.760988+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.So0IaJBbiVbqQsMx7oPRnD5X5Se8g1-_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.271114405218783369', time=2024-09-14T13:56:37.055339+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ei0NQfsvphZoXzfMbZjLy_lMFyAcoG8_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1554120475430888518', time=2024-09-14T13:56:37.262430+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.98jCEty9oAALfgElCvEQOhJsvk82ieU_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11957255986373307761', time=2024-09-14T13:56:37.694869+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JTPSrZ6NAbDqMEM5GcPZ7DF7lcMkVlY_0 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.575791637601940775', time=2024-09-14T13:56:37.733774+0000, chain.objs.size()=1 2024-09-14T12:16:14.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uZK-Ca5M010adhNhb6-wdksak4IsDYZ_0 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7006874037002107932', time=2024-09-14T13:56:38.305806+0000, chain.objs.size()=1 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Aesf2slt7NYCM3gV9zPecE29IyOaBd-_0 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3284137385029155789', time=2024-09-14T13:56:38.403538+0000, chain.objs.size()=1 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.K3I6ZTzS7FKDCHfJlaBzH5dXgjOFBXI_0 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1975613045825072895', time=2024-09-14T13:56:38.489321+0000, chain.objs.size()=1 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.E7qYbTOZ2tGCVKkpuvTan0gTmm6wwS__0 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14883111553421021570', time=2024-09-14T13:56:38.540954+0000, chain.objs.size()=1 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.493+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8MbUJNvM8B60X1b3c8BGuS4_ovTm-kp_0 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10454708421524518731', time=2024-09-14T13:56:38.941036+0000, chain.objs.size()=1 2024-09-14T12:16:14.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sVFJhMgKflRzWyzsGojXYUFwLnoANF1_0 2024-09-14T12:16:14.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7912611168271412892', time=2024-09-14T13:56:39.051264+0000, chain.objs.size()=1 2024-09-14T12:16:14.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.77lRRRbsR1A6c_7Uy0Nq4LwuEo4vHs-_0 2024-09-14T12:16:14.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7287867637947925830', time=2024-09-14T13:56:39.796656+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4POprQHHuxOY8uYavm0xlEJVsmvOLLu_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17401741628249947129', time=2024-09-14T13:56:40.258494+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XI-OXYfZn9F23gG3In5hR9ucjDwo0Yx_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4414461138044680944', time=2024-09-14T13:56:44.958739+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.269__shadow_.e2rkkSa3-lAO_uUl2dH2jGNBmF1v_R7_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.494+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5640840234815782165', time=2024-09-14T13:56:51.690346+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.279__shadow_.kBMY4w7IAdqRG0GRrqglek6iLAy0Uaa_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17651431220317990340', time=2024-09-14T13:56:58.058086+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.288__shadow_.CEsgvzxLhPAuIhtaGz5h-VCM5egrD3M_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15735966062974368731', time=2024-09-14T13:57:06.313049+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.296__shadow_.cFo6xjgbD7_CUNmbTYgYvE3KHvYABNY_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10824338372787974849', time=2024-09-14T13:57:09.297955+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.300__shadow_.k_QS6JlODIsSst20VY73AwcwuRu0gN9_0 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8294096973464000025', time=2024-09-14T13:57:12.096524+0000, chain.objs.size()=1 2024-09-14T12:16:14.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.495+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.304__shadow_.o5jEXOdajIHfssm3lr6G4SPiK6TSmIB_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18300740815785010464', time=2024-09-14T13:58:02.561903+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jcELPDApAj0y3FHvnokgF9gVoIogD8W_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7361504893758187041', time=2024-09-14T13:58:02.601522+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M31kU8xHbLIiffM7eiaunD7v3nNamwf_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15737391290305094365', time=2024-09-14T13:58:02.879796+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ax6aLzsghy_MIexe-ZWhRHT6s6S7M-T_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4106975179081357707', time=2024-09-14T13:58:03.932586+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jxNtysXGOxexhSxwSyU5TbzbU4FB0dJ_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15479264158219207709', time=2024-09-14T13:58:03.933210+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PJMbzgH-pU2DWuhqgr758V075tTE-_8_0 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6653170142374115332', time=2024-09-14T13:58:04.323107+0000, chain.objs.size()=1 2024-09-14T12:16:14.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.496+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9ZcioLtdhf4Lwi47muj9ou2E6BhIXRW_0 2024-09-14T12:16:14.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6329067172799526315', time=2024-09-14T13:58:04.391434+0000, chain.objs.size()=1 2024-09-14T12:16:14.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vVhu1KR4uCLHpBo9g8nSe-aOndWEZ6e_0 2024-09-14T12:16:14.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15643281139574960624', time=2024-09-14T13:58:04.512618+0000, chain.objs.size()=1 2024-09-14T12:16:14.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jQrQHBCO_YoDhtsId7UgTnSofmERFQB_0 2024-09-14T12:16:14.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18291984376244863813', time=2024-09-14T13:58:04.661749+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7GC6fzQ1dfa4f8g1wv06nubfEtb4c4Y_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8077229707454093779', time=2024-09-14T13:58:04.746304+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.497+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.quC643WjqgiAqB27dHL4w8lDdgCsjjX_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11007674508740159726', time=2024-09-14T13:58:05.382651+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.U6zU2fc-BD5U959OyYVTXJYv6p7-GpE_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11981873634477738689', time=2024-09-14T13:58:06.058878+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KLIZjvmvcCM0ts1gXWW5eMAc3KpwZPO_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6221336399512895289', time=2024-09-14T13:58:06.747963+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bsjTVb8pcY8ruWvyByCT15IH7V5sTad_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11170793263671404531', time=2024-09-14T13:58:07.194321+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DRKJVw5-Xp3zUlcYNxi4uVqH31kHr8t_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8772291353395008087', time=2024-09-14T13:58:07.194957+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aS2hnDV8IMTMTm9WhBSggz47aPRiDwE_0 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14634100973078761488', time=2024-09-14T13:58:07.353000+0000, chain.objs.size()=1 2024-09-14T12:16:14.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qEQ1F8R_Zb13S_El350sTx4zO4sfCh-_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10499772921810811852', time=2024-09-14T13:58:07.923525+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.498+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.j-qInczVQLWa9Rri_4mYnnBg3NRCnG2_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11600533502830880358', time=2024-09-14T13:58:08.496883+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DAvTPFG3I4JGlMDsygbHN1zx_L0yrCN_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7588006276300930097', time=2024-09-14T13:58:08.544937+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jcOT-tR7zKso3lHUHtpYs8ERCnrqIKQ_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4881579058533516153', time=2024-09-14T13:58:08.662573+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rSzzF6j07L0VFjTmfiMCTKDvxKMML0f_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5677878696973552054', time=2024-09-14T13:58:08.764392+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.499+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5CQoNBFY6jxNB06TnC7oiTuRFR0BcDg_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5922740061625329210', time=2024-09-14T13:58:08.880751+0000, chain.objs.size()=1 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K6mKfL06UMqlKQgI-eEkVG7ZkacwD1e_0 2024-09-14T12:16:14.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16428506652905816082', time=2024-09-14T13:58:09.280481+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jbknFERiMtRUsYP3wqn70YvOSeSllcm_0 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15256423501586404122', time=2024-09-14T13:58:09.456703+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lH3MrB-5SsLWgr_yEU9vJWDDbt4QpRJ_0 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7674717781159918168', time=2024-09-14T13:58:09.493990+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.f3hq85NNkvdt5Mt5cLG6bmQ1WIzBKzA_0 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18094920549806079624', time=2024-09-14T13:58:09.556834+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wMRQmjp-4uVQNSnuKr464q65L21-KxV_0 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6079594499752257440', time=2024-09-14T13:58:09.760143+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5ysTkG0_2GlogNLvDxalE_f4MZrc1sK_0 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13053456582111193989', time=2024-09-14T13:58:10.113034+0000, chain.objs.size()=1 2024-09-14T12:16:14.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.500+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.J6iN5-hRe1BugY6J9Ox4uXGallCoig1_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.181546232979516695', time=2024-09-14T13:58:10.242964+0000, chain.objs.size()=1 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LV-_XwXwZfHhZj77vqlBZzpW9JyPIad_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16064696380625332924', time=2024-09-14T13:58:10.914704+0000, chain.objs.size()=1 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IaNO3GmdHejOcpeAUyF_m5wdiEEi6Kz_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17021805025589237320', time=2024-09-14T13:58:11.036155+0000, chain.objs.size()=1 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.iK2C7Vs28oxQLLhFGp-F4xfhFGs9nr1_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6564476793099436780', time=2024-09-14T13:58:11.082421+0000, chain.objs.size()=1 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RSlQ7TosSaZlH94h0MZSOZYqGnfPo8l_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1881390744031281682', time=2024-09-14T13:58:12.104536+0000, chain.objs.size()=1 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UUmzk3XK4OnTo1tuJDnJsCUjW7E0yU3_0 2024-09-14T12:16:14.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5266664669343192051', time=2024-09-14T13:58:48.972096+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.502+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9ZDqDQ-tccLSAE8xwP4SFE6owi4Xsxv_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4472809251493864801', time=2024-09-14T13:58:49.273499+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CuBfk3aEsxXPxsjYPOIC_f-lHo50e53_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7278127930965298657', time=2024-09-14T13:58:49.630955+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tf6cWZtTd69ozc-GHsXdPzR-Su099a8_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9050493246701750179', time=2024-09-14T13:58:49.631691+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.X4FAWFbd4pGt7m0FMP0npZsDtoDxs34_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3788820424981889124', time=2024-09-14T13:58:49.904327+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yTiMDu8lsyFfy5bOQUgrwSLnzH-vsYA_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10994173723151441200', time=2024-09-14T13:58:50.537117+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.503+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.G8C01TQYOuCX0nZ6vL1UjsHYevl3BkJ_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7488496974421547568', time=2024-09-14T13:58:50.589295+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mCGiLSE6c60Kpg9-ChcXEQmvkH9remk_0 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17327533328446694623', time=2024-09-14T13:58:50.842494+0000, chain.objs.size()=1 2024-09-14T12:16:14.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pTztPrsBPT14KeRrOjbAeCDuNovwyAu_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14533661410510596642', time=2024-09-14T13:58:50.870739+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zcr8AfhtOzHphbO_x99w36sfLkiwegQ_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12043405952076309515', time=2024-09-14T13:58:51.137585+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.SYuyHSR94LYqk5BV-BuZ_5Lvhjrjacq_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10391187198528784766', time=2024-09-14T13:58:52.323039+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ciuav58TVJ3dT9LJr6UQP-nihCEdEsm_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7219824393183017721', time=2024-09-14T13:58:52.404630+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d5BMGGDoguUJr62-T8gQ_EUYO3cCWy1_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3638905598061726037', time=2024-09-14T13:58:52.611879+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wrSmcjy6FcQJOLL4IhrfXDdjCcUcB8Q_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6340840854771323738', time=2024-09-14T13:58:52.874317+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.A7v0_pggScBdTcECb2feAUR6R9xuKX5_0 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11284548074231633256', time=2024-09-14T13:58:53.608619+0000, chain.objs.size()=1 2024-09-14T12:16:14.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fvFtCrklCnGA6B8Nkc3A5oOETlh9AtU_0 2024-09-14T12:16:14.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10699059967421219622', time=2024-09-14T13:58:53.768366+0000, chain.objs.size()=1 2024-09-14T12:16:14.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.s1wtL7m8dUv45AlXa76smCKERKCtUwT_0 2024-09-14T12:16:14.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3189000376892363338', time=2024-09-14T13:58:53.972580+0000, chain.objs.size()=1 2024-09-14T12:16:14.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.505+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0X5ol5r7wdOTBEWMtWLCH7lCHKYrtca_0 2024-09-14T12:16:14.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.506+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10531912407149874795', time=2024-09-14T13:58:54.837117+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.506+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.h5z_a3IOVdaTIxWkhKOsG1BuOciIkBc_0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13226809703574427699', time=2024-09-14T13:58:55.331802+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j7U54M_gFrLnHSDRQ7ayTzCOOTdfoP__0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2776134968658538659', time=2024-09-14T13:58:55.760136+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rqhvgV0k_k_wBC_UihW8gkK1-YUdlmV_0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7448227230609460044', time=2024-09-14T13:58:56.378680+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aIu2P96Rpgqror1gnMTo6nJPgxSJuRR_0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4502472082542843821', time=2024-09-14T13:58:56.405777+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.up22T7ABBBTUHi4hUWkR43HaPUCdbVW_0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1182202504169656350', time=2024-09-14T13:58:56.435088+0000, chain.objs.size()=1 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.507+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JD3rqA1owKgEwE358tvwXxujRRyAFuR_0 2024-09-14T12:16:14.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.509+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/44940 2024-09-14T12:16:14.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-14T12:16:14.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5162621575244652485', time=2024-09-14T13:58:56.822786+0000, chain.objs.size()=1 2024-09-14T12:16:14.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aB3qZEv6ymxXcBHNft_mS0vocr6Hvgx_0 2024-09-14T12:16:14.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6184384928303475524', time=2024-09-14T13:58:57.071261+0000, chain.objs.size()=1 2024-09-14T12:16:14.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UcKNnHvrwvgL9_ISAHeCyHsdfy_Vd_s_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12840962228324008285', time=2024-09-14T13:58:57.348973+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-kE7_WjKlXgFsA3oHBmFrEbt7AbXuAk_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15548787020058814583', time=2024-09-14T13:58:57.349838+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uyEpMqyjVUA6wxk4pPPpJzdJzvSaSO5_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8045501921574409531', time=2024-09-14T13:58:57.403452+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DVUi54bMgY2wDYgY80kwmxyFNZc4hlB_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5920470252431377794', time=2024-09-14T13:58:57.823475+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.X5nL5YPaRo4ZGWOJRwPWg8bqGssju7Q_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14539963239852792609', time=2024-09-14T13:58:57.979447+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YrDVrgzMQBc-aqcPDB-eR1BfNpab967_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7296191289574245326', time=2024-09-14T13:58:58.183147+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.t42A6pHwJnAvX8Ci3VmjqcaemJMI1Od_0 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7962474735065320781', time=2024-09-14T13:58:58.682324+0000, chain.objs.size()=1 2024-09-14T12:16:14.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aHB6_yW2N6zhQXqvMcbyLhInQlTilZn_0 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6707814141814224114', time=2024-09-14T13:58:58.980756+0000, chain.objs.size()=1 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RAX7Wifw9dF0EclGJAL-MC_qQUy8fc0_0 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6819804389907130057', time=2024-09-14T13:58:59.127071+0000, chain.objs.size()=1 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-m1m6iCdnlCcXKN5bEfZCM9m7DdgXAE_0 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6063112139566912019', time=2024-09-14T13:58:59.233648+0000, chain.objs.size()=1 2024-09-14T12:16:14.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.511+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JlhasXBbpSJ5mdlcZ78Zx8G6Ex9ldKL_0 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12291115714084103965', time=2024-09-14T13:58:59.680163+0000, chain.objs.size()=1 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TCK8vy0R7OKYx6se0qAD6FvuBjHWhmg_0 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11339381244839163161', time=2024-09-14T13:59:11.542555+0000, chain.objs.size()=1 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.343__shadow_.U4COqWQPiigTjq9dPxmZUSmSwVL2u97_0 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17524339201426048552', time=2024-09-14T13:59:12.667523+0000, chain.objs.size()=1 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.345__shadow_.3aOfODdm6YJKA4LgmKSb6MqU692hGIU_0 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4883983123013287770', time=2024-09-14T14:00:48.513403+0000, chain.objs.size()=1 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.491__shadow_.xQjPP69EOfqlXXET1KYkuUS4TnXFaH4_0 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1131762576171618732', time=2024-09-14T14:02:30.647678+0000, chain.objs.size()=3 2024-09-14T12:16:14.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~c1nepYgFR1TZpoVSqHKn5t2LfTws6Mz.1 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__shadow_mymultipart.2~c1nepYgFR1TZpoVSqHKn5t2LfTws6Mz.1_1 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~c1nepYgFR1TZpoVSqHKn5t2LfTws6Mz.2 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h', time=2024-09-14T14:02:50.052054+0000, chain.objs.size()=10 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.1 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.2 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.3 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.513+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.4 2024-09-14T12:16:14.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.514+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.5 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.515+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.6 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.515+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.7 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.515+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.8 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.515+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.9 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.526__multipart_mymultipart.2~J3zbUHYm_jPjA8NuJKDFjHWKBL57l4h.10 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~aakaLuPHSYmCtBNfYWqe8HcKBXGo33W', time=2024-09-14T14:03:00.256354+0000, chain.objs.size()=2 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.529__multipart_mymultipart.2~aakaLuPHSYmCtBNfYWqe8HcKBXGo33W.1 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.529__multipart_mymultipart.2~aakaLuPHSYmCtBNfYWqe8HcKBXGo33W.2 2024-09-14T12:16:14.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14152359199426737385', time=2024-09-14T14:04:01.119596+0000, chain.objs.size()=1 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.557__shadow_.VkESyUZ-t2P85MsNMn472ft4vpArga2_0 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12710137851497016760', time=2024-09-14T14:04:07.030916+0000, chain.objs.size()=1 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.zLuE7jQLaKQ5PgjfddhQiT4YCLnsf52_0 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12243583954822191990', time=2024-09-14T14:04:21.110775+0000, chain.objs.size()=1 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:t7jwJ9ktd1bDHyHS.RMG1pa4TZUp70m_.qHGRhm3e4NHktcsUMDUPytp3VyU0WcL_0 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14133431701667956269', time=2024-09-14T14:04:47.502365+0000, chain.objs.size()=1 2024-09-14T12:16:14.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.516+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:nR.kXveAPNn9TRk8OKePqDk8TkkBkSI_.sVld3xYx2P4I-7JKbJKkIZLFaHqSLAb_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.517+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3580012732467596964', time=2024-09-14T14:05:21.891635+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.517+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:jbia7E7sweMdiCpxB9jj9zNINh8JZFd_.HGzF7y_PM1_HwtV9mV9AJLIJgveDh6B_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.517+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11496709393648567720', time=2024-09-14T14:05:42.831097+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.517+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.608__shadow_.jdrf7RFOZc_nvV7JV4K_iPqAfNeus6y_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.328334642839982590', time=2024-09-14T14:10:13.407870+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.668__shadow_.Tn9Z0JxEOG7L7Bp2hKfOIwYAtAfiIjU_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5893211243194619202', time=2024-09-14T14:10:27.388723+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.693__shadow:g1wFmaMLNjA7yKQdSTyyYo5eR3UFdmk_.y6TVAJGSbvJHXUjTZj7Yx6q_dkRlsC1_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12169334088000171216', time=2024-09-14T14:10:37.147315+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.707__shadow:WCXQ0--0cZWcW027EAVFqIsTKsjWlPZ_.tKHUJEzgFbHtRsi7mKBuaAbOyTgVb1C_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7248940814216701809', time=2024-09-14T14:10:37.914261+0000, chain.objs.size()=1 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.708__shadow:eT-zFP-FEY0gVs9Wvm6fSNR5rjoFExP_.DvUJWai8-AKGjuuGB9tg0F1JfMZRuNx_0 2024-09-14T12:16:14.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4312125059843841925', time=2024-09-14T14:10:40.041612+0000, chain.objs.size()=1 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.711__multipart_file1.2~otg3GCWSaYB8HBDdKyOqttVaXsmJ96y.1 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15675292721934543340', time=2024-09-14T14:10:41.862622+0000, chain.objs.size()=1 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.714__shadow:tAMBpGygSV.e7aahI61KviY2caOF4bv_.CsuXFo4C98qZzJAw2Ng4ONTCWdTbkEg_0 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17149680257223942703', time=2024-09-14T14:12:30.360062+0000, chain.objs.size()=1 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.518+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.759__shadow_.P2tPrwx0qgY-eSJn1m9Y8d2PkqDTiyA_0 2024-09-14T12:16:14.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.520+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.522+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:16:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.523+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44991' 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6178715896477280514', time=2024-09-14T13:53:12.747710+0000, chain.objs.size()=5 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-LUKEWARM.2~jj4We9Id7SJNhKH053z00n5qHnUiHST.1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__shadow_mymultipart-LUKEWARM.2~jj4We9Id7SJNhKH053z00n5qHnUiHST.1_1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-LUKEWARM.2~jj4We9Id7SJNhKH053z00n5qHnUiHST.2 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__shadow_mymultipart-LUKEWARM.2~jj4We9Id7SJNhKH053z00n5qHnUiHST.2_1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.159__multipart_mymultipart-LUKEWARM.2~jj4We9Id7SJNhKH053z00n5qHnUiHST.3 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3696231806240295802', time=2024-09-14T13:55:36.899171+0000, chain.objs.size()=1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237__shadow_.byEb3UDUiNMCrMbomOTkxVN83WG0gba_0 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8297387835370885692', time=2024-09-14T13:55:37.867787+0000, chain.objs.size()=1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.238__shadow_.7GSDHSrS4pBW8Txf9RgBxvXDyU3w1li_0 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11526796785537121646', time=2024-09-14T13:55:47.261891+0000, chain.objs.size()=1 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.251__shadow_.YStq1JYRoX0rGx6fk9Kv7nwdbZhdUep_0 2024-09-14T12:16:14.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2336126340117380242', time=2024-09-14T13:56:29.624821+0000, chain.objs.size()=1 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.MOzMrRnxAUf-VycBOeGp_Jsq9mJrDdR_0 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15710648999742367527', time=2024-09-14T13:56:29.625969+0000, chain.objs.size()=1 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oQe4Yl6Gcc80a79flajoC_iaZmncBO0_0 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9955522362104187405', time=2024-09-14T13:56:30.144173+0000, chain.objs.size()=1 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NqNnMCNa1j5li04A-lt4_BLKvWnwrWX_0 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3710279568784428852', time=2024-09-14T13:56:30.409700+0000, chain.objs.size()=1 2024-09-14T12:16:14.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.524+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lcxauABd4OehLHfUrAuqSTRU0u3Ek7G_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10697064855747730507', time=2024-09-14T13:56:30.622605+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OWQdrw8JqDzxCiSar8avCgtvDFR8-X4_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5100396774649973667', time=2024-09-14T13:56:31.304080+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EkTlW0cHn3IEQ7M2rsep4Ofdemeez6u_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10725915605205356253', time=2024-09-14T13:56:31.305139+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.527+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5LtNg1Jz6s1OWksTfRtmkvAUBa9IlzS_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2940285765062535716', time=2024-09-14T13:56:31.382754+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.V1y0Bka-rMHA3W5PlsRVNGAuB7gbsn6_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4834584000437367903', time=2024-09-14T13:56:31.509217+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.diLCHTFMmrLPp_qyWz7rBLjE4O9mJvU_0 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4371510856249484871', time=2024-09-14T13:56:31.624687+0000, chain.objs.size()=1 2024-09-14T12:16:14.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wqjHO_cqgInq5O5hXecpzZmA0ssZYj9_0 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11959378781981230897', time=2024-09-14T13:56:31.791052+0000, chain.objs.size()=1 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ovi7q2OsPs0Ze-3lvE_inrMM4L-y5NT_0 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4474625046879511610', time=2024-09-14T13:56:31.964392+0000, chain.objs.size()=1 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SJ2H8kdKOx4DD2BPLGZ8ROFvNJy_Tq-_0 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4654617999223790735', time=2024-09-14T13:56:31.995096+0000, chain.objs.size()=1 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._INQ-kjb5r1MFSXxaJXi7A3YfEojODq_0 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15495318828656801397', time=2024-09-14T13:56:32.618957+0000, chain.objs.size()=1 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.A4fmWjGFC0Pv7E1wnQHzrkRk15q9n3E_0 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4604382513268878716', time=2024-09-14T13:56:32.807437+0000, chain.objs.size()=1 2024-09-14T12:16:14.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.528+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mI7t4rbIr6RO2SF3rx3DVGBvi0JTu7X_0 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1123465323768367965', time=2024-09-14T13:56:32.881255+0000, chain.objs.size()=1 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.W1aC7Jqs3bYYyFxPLpQBG_lxoiyA2xh_0 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5396633694592185999', time=2024-09-14T13:56:33.073850+0000, chain.objs.size()=1 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.E7sortnV3bii8ITbLYEyz0WETlSxNt0_0 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18197968788549694280', time=2024-09-14T13:56:33.620115+0000, chain.objs.size()=1 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6zH4STzOCmIyXAl_jkHr4wW3QVFCgM6_0 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16117194567547680122', time=2024-09-14T13:56:34.019996+0000, chain.objs.size()=1 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._7UJtrdEDWnxHxXZ6zNkytFTKW5XvP8_0 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8693489270947427183', time=2024-09-14T13:56:34.020757+0000, chain.objs.size()=1 2024-09-14T12:16:14.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.529+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5iFXGUObqyU9yE0ZuhKfggm43Tmku35_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16760253334660745770', time=2024-09-14T13:56:34.058561+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7jgseuKCnXLAE0h8Nhax5Sr4mQlPKxy_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12789853663174875981', time=2024-09-14T13:56:34.290575+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fRJFLrpnUAyFU92mEdQbUJazjnD2zRP_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3043884932162398416', time=2024-09-14T13:56:34.532737+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FKfciUXJmxXinBIJ9_HLwJFPQkjmTw8_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8627220978257050276', time=2024-09-14T13:56:34.832588+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.04SUVBvf0umGJaQVCw4lLS7QexR5fS1_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17299768138320610342', time=2024-09-14T13:56:34.980411+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.h4RwzaiARJP08Y9m9Ib1mICWVEgwF0F_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13136084299175983879', time=2024-09-14T13:56:35.617218+0000, chain.objs.size()=1 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.530+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tdYtjijfXzySkNA8Kr5PhGoyxuqH8DM_0 2024-09-14T12:16:14.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8068362514873084559', time=2024-09-14T13:56:36.066329+0000, chain.objs.size()=1 2024-09-14T12:16:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.q7UwcSAoH01yrN80_nkDa6Qwp3ZyDId_0 2024-09-14T12:16:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4208787737474230321', time=2024-09-14T13:56:36.414031+0000, chain.objs.size()=1 2024-09-14T12:16:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Rf2mBJqoK6wNzM3C2iG5OY8i5oZft7D_0 2024-09-14T12:16:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11775001597939377080', time=2024-09-14T13:56:36.931727+0000, chain.objs.size()=1 2024-09-14T12:16:14.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.531+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UFO1tzCr66u4TPi-bxovpIJSiVKRBi5_0 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2873069400314602504', time=2024-09-14T13:56:37.045674+0000, chain.objs.size()=1 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VL3dzBvTvxgzHxUQebLaIniu4dheqZA_0 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11200431501545195795', time=2024-09-14T13:56:37.123953+0000, chain.objs.size()=1 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Bzrl6MTyT3eXYizpYT7GlH4b6RkMEmx_0 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17602033480732362205', time=2024-09-14T13:56:37.381773+0000, chain.objs.size()=1 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6uQFf_JNQh9CdKciTPOM8MARUW812xW_0 2024-09-14T12:16:14.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16293825418952512598', time=2024-09-14T13:56:38.197949+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9_CFZ5u7a9CWEod5E5Dh5U1Au56RDqT_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8020362705739923975', time=2024-09-14T13:56:38.299202+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.532+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wmfgup44_qmBFKG5xNLaU2DrBRAmZ68_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3774598463643493267', time=2024-09-14T13:56:39.672188+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2egjE_HtbVs5SyOo0fF1Ik1E5QRy_2N_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11078961033244416381', time=2024-09-14T13:56:39.744510+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dGwr43oShH_Hf2PqLuf6w4cY9U9KE-5_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2823260021399625164', time=2024-09-14T13:56:39.795368+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nXGzFHkVIS6CdQSPaJPvyXnw81G03BR_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14199220670109706317', time=2024-09-14T13:56:40.130299+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jWwrMWZ5BzLp0s_zZU-GsqKjncfcguu_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2474896728468513954', time=2024-09-14T13:56:50.322345+0000, chain.objs.size()=1 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.277__shadow_.efo4Jg8qC4N4DJcQuEOt59WTrK37WpR_0 2024-09-14T12:16:14.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9795970238203016615', time=2024-09-14T13:57:06.303665+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.533+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.296__shadow_.7u7LqP6MBZIY58it1S0nxgOnB640Syj_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2805514598085261498', time=2024-09-14T13:57:24.630228+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.321__shadow_.RuES42T0r-5abCRdd41AeCXT1HsVw3g_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10195658948731503616', time=2024-09-14T13:57:25.473767+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.322__shadow_.excpYC4HIWO9sl9wu1jzNRDP3uQeOA7_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.412079322135454970', time=2024-09-14T13:58:02.234255+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hv4774k94T1N3Ueb4UOoAZ5qfTjSIzq_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17295786438402963681', time=2024-09-14T13:58:02.342745+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wQI0pMiV_JufIC8H870hMlVj5z34mO8_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17237194111202231052', time=2024-09-14T13:58:02.832815+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i-L9vfV6M1chh_Iv-nqr6FVu29KQblO_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3581991046392525907', time=2024-09-14T13:58:02.882398+0000, chain.objs.size()=1 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9umIJfWlwa47ZcC7-CxQAHBYRN8F4rh_0 2024-09-14T12:16:14.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7588072820897467208', time=2024-09-14T13:58:03.196835+0000, chain.objs.size()=1 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.sfQJ0_M8tKw1d3dn8Mg2SI99Nx-nHgx_0 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1049142450520930197', time=2024-09-14T13:58:03.753716+0000, chain.objs.size()=1 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SxDvzeZKwk3M19mJrPa_fOOWvYoNauG_0 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10661091210214643362', time=2024-09-14T13:58:04.019141+0000, chain.objs.size()=1 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.534+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4U-PZQN_XHTiXbRVLZe90uLwVT43XoM_0 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.535+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2634032819254391895', time=2024-09-14T13:58:04.474460+0000, chain.objs.size()=1 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.535+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TnsAI_4hSAWBkCXGBbww21HUXHQqXcg_0 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.535+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13646656363048817997', time=2024-09-14T13:58:05.308299+0000, chain.objs.size()=1 2024-09-14T12:16:14.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.535+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.frYkWaTj0qauANehx8hO-SGotNvFPii_0 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17909997859846621588', time=2024-09-14T13:58:05.408595+0000, chain.objs.size()=1 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.k5BqinmLygdi_0hXj3QBTp4ht2FYh1U_0 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17246348804701420165', time=2024-09-14T13:58:05.606891+0000, chain.objs.size()=1 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i3pTdHYO23HeJxwQWq01FYo8aNgZTvv_0 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5957798036587694914', time=2024-09-14T13:58:05.987582+0000, chain.objs.size()=1 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YjvhgQddDQ7fDG3xf5pPwuEQby60r2k_0 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5773484951139379047', time=2024-09-14T13:58:06.966536+0000, chain.objs.size()=1 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xgtR_zQhZzjvhwObiJ2AeMELa4kCu4R_0 2024-09-14T12:16:14.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9363936730554657606', time=2024-09-14T13:58:07.194957+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.536+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qzsfkCyTRlcLAPs-duonYfVETmAfDj6_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10108729972944124788', time=2024-09-14T13:58:07.430908+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cn54ERgeQAgnvAnyc_cBlhtTJTl66UF_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17514270725009052991', time=2024-09-14T13:58:07.468271+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.quDiRmbYQbDW9s2LcuYdjDc0pc62J0x_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.239938735263080868', time=2024-09-14T13:58:07.478590+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DfptrpKm_AIdJgh9-2whqFmR61v1rfv_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6763457742585242130', time=2024-09-14T13:58:07.903630+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jEy4tBfU9otuo7wmDKDSkn0PQH9fpjY_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2777754235540212367', time=2024-09-14T13:58:08.103911+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hRzydqU2hiqze8TaJPRVUbrArmrcu7G_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9509064362349693303', time=2024-09-14T13:58:08.266620+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.537+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.D8M_1dxHpXIl50vsyWjgTeZyuEswhSj_0 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17723944581766106777', time=2024-09-14T13:58:08.320611+0000, chain.objs.size()=1 2024-09-14T12:16:14.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ofpgS8IMgbYku6hbBKzx9woZql5ztjG_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3789768112636847536', time=2024-09-14T13:58:08.457280+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.g79E-pzSSpYaasDceF-axSp8ZAtEICQ_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16454755306129396816', time=2024-09-14T13:58:08.767491+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7zFcgEs3MAXhyarLmGtjCVI3q2E0k9h_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9109512825560142129', time=2024-09-14T13:58:08.842563+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qgADzo9CnLDGorFgRUWVAFe7zX6fAI1_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18327871112434618048', time=2024-09-14T13:58:09.223877+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.538+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Z4rjp-jKivHaWJhQoFs2FURMuLgMFqs_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3048648272852477076', time=2024-09-14T13:58:09.252630+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SSuBOeNZgTC5U7_CiWYJA0Pwgrud1h4_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15461735078395496975', time=2024-09-14T13:58:09.373441+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XaWWq-ZIwspSoHY-5C4yOZZs8UblqTT_0 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12664246645141285435', time=2024-09-14T13:58:09.709124+0000, chain.objs.size()=1 2024-09-14T12:16:14.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vkEowa326mgmqL7aaEbaggetI2SEX4U_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15514784825039208593', time=2024-09-14T13:58:10.221935+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zIakKooErUi5s3j1TcPWMibfn-gJaGh_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3605054803971573806', time=2024-09-14T13:58:10.853886+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Lg7LgYLzW_94S3E2nG58jFQj4FgrltQ_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10970675674408249046', time=2024-09-14T13:58:10.942669+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3Fh437exzTBVWu1C7ghcETI189vIgfX_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15202500555488430044', time=2024-09-14T13:58:11.819044+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8rss3n-FJ6-T2FbIM1hhFpvA0HcyWI8_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1610070644776608614', time=2024-09-14T13:58:11.964915+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vTJpcTwaYd34aByuKhbhDLajUj5EA7G_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18074999702090207957', time=2024-09-14T13:58:12.107073+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QZV6k4P7Ka8Wm-SRYShE6wq-q_Obm4y_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6232493345124546130', time=2024-09-14T13:58:12.609950+0000, chain.objs.size()=1 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.539+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hpNtyu1zU9v9vjR9KSGvb1R9E4gz6I4_0 2024-09-14T12:16:14.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.540+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17457989984476084440', time=2024-09-14T13:58:49.931511+0000, chain.objs.size()=1 2024-09-14T12:16:14.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.540+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lL1Q7Dcs4OvmrhyuWqgZerbqiZFP_le_0 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.541+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2854722236635772361', time=2024-09-14T13:58:50.658850+0000, chain.objs.size()=1 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.541+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.v0LseivrwBy3Gr7nRLEurtK7nEnDFFg_0 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.541+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8251647740032030165', time=2024-09-14T13:58:50.922206+0000, chain.objs.size()=1 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.541+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ryF9HUbux3dtRN0492-VQHBkDubuLtg_0 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11749736182093270526', time=2024-09-14T13:58:51.072437+0000, chain.objs.size()=1 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-JKOv69b3Bvn0jEkYuk6oDP_QNInHYA_0 2024-09-14T12:16:14.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12751519188788654274', time=2024-09-14T13:58:51.212297+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jjyC2EtVZuQzn7mKA-fC0sDJxhTXzV1_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8095580025811089379', time=2024-09-14T13:58:51.964180+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fMcjLpzx7og9BZ0CoU7Gy4Fo-CD7D2e_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15323016822765360291', time=2024-09-14T13:58:52.085684+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HTepibza3j-K7Jfkv4Hb548-qaTyOAb_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9338296056184359314', time=2024-09-14T13:58:52.145376+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rvwOdRZPe65Xzn2W8tpSRbdt0n51F4I_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1703575758729080523', time=2024-09-14T13:58:52.403343+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mcXK0EhvBn7IJ8oiEc98z7YRv3N7WQx_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6658063436906606834', time=2024-09-14T13:58:52.646280+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mGY3XqOlb9gKsWdmex7HQ5-VbHjnAnu_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1587269977478074551', time=2024-09-14T13:58:52.710371+0000, chain.objs.size()=1 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pfdN0QUY7XLiEdOxcsDVXnZ1AZ59wy4_0 2024-09-14T12:16:14.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1734531799518437002', time=2024-09-14T13:58:53.849467+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.542+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zOEpMitFU1ukMnbfdnIKypjv4yq7xvF_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12912627827460744853', time=2024-09-14T13:58:54.362262+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vd1ezB6orpBt4TqI5kVWlc44fVXw6Cx_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3915220697470361493', time=2024-09-14T13:58:54.362972+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9HK5U8xjHDL4iisE2nkT0vCt3L9XiWN_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5127332917931109168', time=2024-09-14T13:58:54.935368+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.U3vWMBlEDHJxGiagj0W7_6Bx0r4Mr7M_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.291050182357804292', time=2024-09-14T13:58:55.211800+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.M-rEM33shd1oA7HhfyFt4M86ULTiaM7_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6267434206149724285', time=2024-09-14T13:58:55.248309+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.U3bf2sJiMSbMlFYhf-7sd1vCi30YxSI_0 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10983239026656672235', time=2024-09-14T13:58:55.355591+0000, chain.objs.size()=1 2024-09-14T12:16:14.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CsahxSi4VVIHZsLB_r6Ix7rBsKxAEhQ_0 2024-09-14T12:16:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2147413840143270166', time=2024-09-14T13:58:55.442529+0000, chain.objs.size()=1 2024-09-14T12:16:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.544+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yAT47TyQ3_JVbWStTpHKvazpoLgrJoE_0 2024-09-14T12:16:14.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.546+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/44991 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13310004083731284764', time=2024-09-14T13:58:56.417936+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2vvT43Hng_okMDdhakN-NMij9-PDByb_0 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11585523279976155903', time=2024-09-14T13:58:56.559167+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1uE5k1wbeDY61oSkdLwc7DDCQJ1H1fF_0 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.177628335300328664', time=2024-09-14T13:58:56.951205+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7ZmHLkkB3VACaN6tfYyD3laMqoTJOTi_0 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5523980014045287494', time=2024-09-14T13:58:56.982490+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XV_8yKtWfs_9D2WPdV55gMngdC7hjTd_0 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1090776269440843727', time=2024-09-14T13:58:57.223501+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7LuTq6c4vdfNHtOmHugg01IudhQMUId_0 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16104047994978697128', time=2024-09-14T13:58:57.363274+0000, chain.objs.size()=1 2024-09-14T12:16:14.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UVvKy9HGiL8iIRJW-rnvszQKCGr3Qg6_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10693524168670629185', time=2024-09-14T13:58:57.366715+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mDBYZfuV8cR-TdapN4q94-tXDWcMUgb_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10909204378035050215', time=2024-09-14T13:58:57.758573+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6uwEzysuInmUE3giNr3QMbOaXilt8Tg_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10449324380188457251', time=2024-09-14T13:58:57.983926+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.P3jlf_wposdZLxV2oSicnYvm0B8Jxny_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4397397702891728265', time=2024-09-14T13:58:58.295393+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R-g0Y5gNpdr4DnongiZtOY6M6kz6vkJ_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17114085192398248087', time=2024-09-14T13:58:58.296078+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gZDBx1GPGwL10Q7KgxZeDt8qeVg-i4a_0 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9888709345186354365', time=2024-09-14T13:58:58.680841+0000, chain.objs.size()=1 2024-09-14T12:16:14.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.548+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8c6K1bwtE6cizclLsgJdQQ5xZXVJG2-_0 2024-09-14T12:16:14.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.549+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10974301473370820923', time=2024-09-14T13:58:59.145014+0000, chain.objs.size()=1 2024-09-14T12:16:14.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.549+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DIB2fDbg1COS1nmAn6hLDa-jp8qz8jl_0 2024-09-14T12:16:14.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14096335160360434995', time=2024-09-14T13:58:59.428688+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VcIpJkQtAHDLNDC2CuHTwHt66mYDzA4_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14687807427508534571', time=2024-09-14T13:59:03.561051+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.330__shadow_.qssWelp0wjbSS8G7sYkeXA82qH0woVu_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9934174169622126640', time=2024-09-14T13:59:30.421311+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.376__shadow_.L09vU4bwQi-agB61yPqN7Wa7Z23_Jby_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16616355591407730374', time=2024-09-14T14:00:22.834170+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.456__shadow_.z3Mn5ZIAID-XTx0QMaD1vhdCORy-28o_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15143549731004558148', time=2024-09-14T14:00:25.584806+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.459__shadow_._df5aqrFUI7BIdQslOYWr0zTGAU53p7_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16981489179237424792', time=2024-09-14T14:00:44.961385+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.486__shadow_.Xs20y0c0CReRgL3ClpR80PnQ-xpcsga_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8002985645325797464', time=2024-09-14T14:00:45.697176+0000, chain.objs.size()=1 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.487__shadow_.bqPvHV59h0n-Ue9x-aRpK5y8rpNwwWE_0 2024-09-14T12:16:14.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4914114010376033564', time=2024-09-14T14:03:58.118925+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.556__shadow_.dJTEKzXUHetLGrYhkyg29Pz3PIzVHrT_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3899570760000660162', time=2024-09-14T14:04:33.546785+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.572__shadow:cUV9lOzkR5bDDQ0XpJrh5AXHbyOOB4D_.UQeDT8q8_-V75PRfGdCvB7c_5ky0On5_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1763985741050835453', time=2024-09-14T14:04:52.058399+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.550+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:iVry0e6-i6kggRkHkGxrJo7m2DeaiSu_.kWJf3DVMqAj6P8CJyC4m2O8wudy52S9_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.551+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4833203941483670218', time=2024-09-14T14:04:57.267767+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.551+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:QhNRPgZs9DF7baOZFc-ycVjDhp3ni4z_.8wvumLdN8rezkbQ-Blq06Ypv1O_hpkT_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.551+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15307857303531642823', time=2024-09-14T14:05:24.252528+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.551+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:j0nCjM207WjAZhz8TjJiV6.PcJgLrCe_.Br6YReF9eSxKmy1PZKWvLwEQRJ3LpoX_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.551+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16009345505641080144', time=2024-09-14T14:05:42.215641+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.607__shadow_.DhRNVXEuLVmLXUqQflrZ1fLKwUrJytJ_0 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2207254423457380799', time=2024-09-14T14:09:25.607662+0000, chain.objs.size()=1 2024-09-14T12:16:14.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.629__shadow_.YR1AFQjg6alMKyoeEyKnP7sWRX5-EsB_0 2024-09-14T12:16:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13077248621518918196', time=2024-09-14T14:11:32.977746+0000, chain.objs.size()=3 2024-09-14T12:16:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.743__multipart_mymultipart3.2~bx_gRbMeQ7DRdjPnjFsvhGWANbE1rln.1 2024-09-14T12:16:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.743__multipart_mymultipart3.2~bx_gRbMeQ7DRdjPnjFsvhGWANbE1rln.2 2024-09-14T12:16:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.552+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.743__multipart_mymultipart3.2~bx_gRbMeQ7DRdjPnjFsvhGWANbE1rln.3 2024-09-14T12:16:14.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.554+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.556+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:16:14.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.557+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.557+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48522' 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8357830850544608668', time=2024-09-14T13:53:23.300233+0000, chain.objs.size()=5 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-FROZEN.2~gvc9ybbKdtOgLEj0v9ZsoiebZhKmi7X.1 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_foo-FROZEN.2~gvc9ybbKdtOgLEj0v9ZsoiebZhKmi7X.1_1 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-FROZEN.2~gvc9ybbKdtOgLEj0v9ZsoiebZhKmi7X.2 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.558+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_foo-FROZEN.2~gvc9ybbKdtOgLEj0v9ZsoiebZhKmi7X.2_1 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-FROZEN.2~gvc9ybbKdtOgLEj0v9ZsoiebZhKmi7X.3 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15677105805027118010', time=2024-09-14T13:53:44.519240+0000, chain.objs.size()=1 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.178__shadow_.gfoSKsG1zQU7qsnz3S1yCl_u_H4TNsW_0 2024-09-14T12:16:14.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4586821366968403786', time=2024-09-14T13:55:43.083496+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.245__shadow_.rio6dIHGk5kjmHJHO5R4-DQ5hisClEx_0 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11431793141473461401', time=2024-09-14T13:56:30.033140+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._CoP5TFW7jydjFCsLZ-0Q1Nk0_Lm7Rn_0 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1861936928271443902', time=2024-09-14T13:56:30.493353+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nLdgM6zByD3XNpB5EIeLvbVzUFF2EF4_0 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9799249555147466954', time=2024-09-14T13:56:30.543615+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CKhP4tY0h43UNokhWFM1hYDfxF0JeAf_0 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3718516540849963909', time=2024-09-14T13:56:30.686842+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CBgOv1tGY6gt1WTSebjSzDLzjnfq3Pu_0 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8847106006393700114', time=2024-09-14T13:56:30.687549+0000, chain.objs.size()=1 2024-09-14T12:16:14.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.559+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DOSpu4jqN4O_cDPWBhasGGA8_u-AlDq_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5041486774149713301', time=2024-09-14T13:56:31.219094+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qNwd35Rb4lvH4D9eIK26IS-5zab3KLP_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3243678979007271309', time=2024-09-14T13:56:31.478193+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ro2ARj0GVH2QRpvCAqxFPrNaghs6RQ1_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13535181100597078237', time=2024-09-14T13:56:31.478700+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.b68MsTfIYv4RC9WqPWnrJ1rsa-gOdM6_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9940274501144318070', time=2024-09-14T13:56:31.756378+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yHh-Y0dwEVLNU_7asy4DmS2RrPiBLwn_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13519738532213619945', time=2024-09-14T13:56:31.836788+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AygJCREJYjcvspX1eJO8IaH7OXYjPpn_0 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10027645222069913516', time=2024-09-14T13:56:31.873912+0000, chain.objs.size()=1 2024-09-14T12:16:14.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3SsULhBvjCJyoqRSHEqGC0EdhbTqPRS_0 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2771724513832915577', time=2024-09-14T13:56:31.963610+0000, chain.objs.size()=1 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZFb9T9182GemXzihH1rayLDD0T1AlgN_0 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7201836287284945078', time=2024-09-14T13:56:32.080186+0000, chain.objs.size()=1 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uueyR9sJ5LhupvVdeWnDSfwdUjV0Q3b_0 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12101132946116939023', time=2024-09-14T13:56:32.178815+0000, chain.objs.size()=1 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7lvdrZyZzye6ksnQfsAWliasWyIy2iB_0 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7150130543062325275', time=2024-09-14T13:56:32.965909+0000, chain.objs.size()=1 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.B0guVgyKROU6BWD5vSF5U1L4VE64xVz_0 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1078163458109487495', time=2024-09-14T13:56:33.030951+0000, chain.objs.size()=1 2024-09-14T12:16:14.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.562+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y81K0AN0JeIoaIulWmsdJe5hHO78NHY_0 2024-09-14T12:16:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10834911636366485296', time=2024-09-14T13:56:33.172037+0000, chain.objs.size()=1 2024-09-14T12:16:14.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6hCdIJMw_ui26cmp4fUluieGF9j_f1u_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15550427027499863365', time=2024-09-14T13:56:34.237920+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fGClPV9eThGEgkqo90pyI_HJFOxUwum_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18258336063529940399', time=2024-09-14T13:56:34.410297+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VMA8AelnPG0hMxv-_L7RYdOcXKh8hR1_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7578695629171343671', time=2024-09-14T13:56:34.745609+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gDMQ8odSK4_a52y_15FqYaoE4wsY2aH_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14937835255192959800', time=2024-09-14T13:56:34.775038+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WxVlFCIIqpAvE7o-koMMPgzM3XJOu01_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7992148374484079750', time=2024-09-14T13:56:35.046554+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D-kttV-lCsDXSmAOEczcHZ4Msz5-pUi_0 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17962599549848302027', time=2024-09-14T13:56:35.698917+0000, chain.objs.size()=1 2024-09-14T12:16:14.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SZdvlXsh5SC4x0PFBLO0FbNPQlnJcxb_0 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15553611038374209564', time=2024-09-14T13:56:36.011859+0000, chain.objs.size()=1 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.L4kjvgzqe1xxpp0lZaHDXxq90e-yZ1m_0 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.747295445492457252', time=2024-09-14T13:56:36.045684+0000, chain.objs.size()=1 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.55WmsPGk6cTqUUf7wqDFB1eltn55RFl_0 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7043285471977560463', time=2024-09-14T13:56:36.158002+0000, chain.objs.size()=1 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GBcRGS-K4VgSjkufQP6ohalR7A6p98H_0 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8483483771400398895', time=2024-09-14T13:56:36.373795+0000, chain.objs.size()=1 2024-09-14T12:16:14.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.564+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.g264X8DhGhwXTuO5ldcU6qrJYlhkz7z_0 2024-09-14T12:16:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5736491502738604491', time=2024-09-14T13:56:37.262408+0000, chain.objs.size()=1 2024-09-14T12:16:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CpA5FowXWqGwwW1nzApREM_eQ5e8sas_0 2024-09-14T12:16:14.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.398193221277940113', time=2024-09-14T13:56:37.265003+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.R1Q3QitpfBHTgjkUUU1atvszgorDtN9_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14933797971521071334', time=2024-09-14T13:56:37.416949+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DHi_x7b7HohBjcTpounHBSRikoDBPaC_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12838743061485739515', time=2024-09-14T13:56:37.573054+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eMcFmhgAGFHLwEstz5SF7tlcxO-egiw_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12737076120803600731', time=2024-09-14T13:56:37.591598+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TZV-bzRp1_Xr0xBCG6MnWdIGUdThHUc_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6552073549894804265', time=2024-09-14T13:56:37.780510+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ixCDNbRYTbyr-PCI1dRvKEZM7KGg0H0_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12801104405163829309', time=2024-09-14T13:56:38.090700+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sjkLN9FdS7ZJUgx9pxcaffHwmhT4Ey8_0 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6155592202160589385', time=2024-09-14T13:56:38.123717+0000, chain.objs.size()=1 2024-09-14T12:16:14.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LAzY7IdcFoIRXKNm8-383OP-3bLEYM6_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5401953478419692813', time=2024-09-14T13:56:38.208594+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HwuCOQDMeFWP20Fn9v1_vw0ydJZL-uU_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12950087118102302334', time=2024-09-14T13:56:39.651413+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6mRPKErAAJCZWAlFH9nZV5APmIXvCUT_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9968806162099617552', time=2024-09-14T13:56:39.880268+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.566+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ahaJrxELMzbjKe-ZyXVDelhIuLXvl7b_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.567+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17850693507395658667', time=2024-09-14T13:56:39.914881+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.567+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nfzW-riBeSO7zPJAzz-mzYSG22_icvv_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.567+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11827458924370588241', time=2024-09-14T13:56:39.990755+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.567+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.drfoZrIsaOrL2UHBjFcm5l2uFqOh_1S_0 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.568+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18254166538927656646', time=2024-09-14T13:56:40.008527+0000, chain.objs.size()=1 2024-09-14T12:16:14.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.568+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Vx6Dr8GVvUrif6VRTGajP1vYs4Iq6Ry_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10317768053602032500', time=2024-09-14T13:56:45.604312+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.270__shadow_.DHwoRwEhppY-yrWr0EfbsAECxfcAEO0_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5731133542795544696', time=2024-09-14T13:56:51.000659+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.278__shadow_.ptAxhanFArZpm88_fkOOVOvwGhxKRtf_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6219039555435741056', time=2024-09-14T13:56:52.373977+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280__shadow_.VgQQTMbziuoxqUHQd7sC0-E1ZB2ZeAQ_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10474108178255453142', time=2024-09-14T13:56:55.173919+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.284__shadow_.VABz0N-akSbhu_Pps4ACjSDC_Dy8Xte_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10874618208922225417', time=2024-09-14T13:56:56.690960+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.286__shadow_.ST7zgu58DTcgA-oIBek6LM6JsvhKZWl_0 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12516649314810133082', time=2024-09-14T13:57:02.141324+0000, chain.objs.size()=1 2024-09-14T12:16:14.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.lHor5B_i0jmKVmCMPAIFJ5oLIUT7OPl_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6315251308091827276', time=2024-09-14T13:57:04.177137+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.Rz6IymEWpBEFc8oV0lEZx4vS4vCAFy4_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5691899057411904824', time=2024-09-14T13:57:04.177890+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.xO6vT2SzB1AYyv6UXwj8ewVMUrbeO3d_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1238014131818635251', time=2024-09-14T13:57:04.188805+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.QdxM8kDWY99y79XstFohixs4C8Ph-Uw_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17208077660103540622', time=2024-09-14T13:58:02.412428+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.569+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZeQXADJ43CTk-Bqd_41f_ipAwuMk-xJ_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13254538540812826790', time=2024-09-14T13:58:02.566671+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YVt51qO4ebXIyhfzoyHqMy1KrMb17sf_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12035146850018606293', time=2024-09-14T13:58:02.776433+0000, chain.objs.size()=1 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.c5zzGB7wCvj71dMv4_Rr-IX6Ua7negW_0 2024-09-14T12:16:14.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11630590754550576429', time=2024-09-14T13:58:03.039602+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.570+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cFnifLveP7uA6XX6Vmj0sbKAMV3DX18_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15741848719555643175', time=2024-09-14T13:58:04.055194+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fMuwxJT1Yg7ZGBu1BYMI4NrVOJ04Kjy_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12292462454568273355', time=2024-09-14T13:58:04.150253+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ctr5ULct3s0VWka8QN56woZmIv8Bzwa_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15367840236060797820', time=2024-09-14T13:58:04.192524+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jxPkwr3yA0aO7bvmGYF5o3Oc_pqvaba_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15188522404171480989', time=2024-09-14T13:58:04.318594+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PWm78O04qAUS7itXpjwbkwk-WUt3eLx_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4953185064532681971', time=2024-09-14T13:58:05.605790+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.D28gPZX0_TqdUFCAciQnA4EGMuh3WOh_0 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13978559606176790004', time=2024-09-14T13:58:05.697964+0000, chain.objs.size()=1 2024-09-14T12:16:14.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BrRe-o6_Gtm_-E4E5cNRYjZplP4xnl6_0 2024-09-14T12:16:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17666467256128159855', time=2024-09-14T13:58:06.129982+0000, chain.objs.size()=1 2024-09-14T12:16:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ko5POK0tDh0Fdh7sDxuKyGORBNCd7Zh_0 2024-09-14T12:16:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6901648514121576171', time=2024-09-14T13:58:06.632286+0000, chain.objs.size()=1 2024-09-14T12:16:14.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Yl5yDMfwlh-gEWJPJEKQhXLWU2n1pdA_0 2024-09-14T12:16:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3482030681370477999', time=2024-09-14T13:58:06.742999+0000, chain.objs.size()=1 2024-09-14T12:16:14.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.571+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NSvIAINyuYAX0DMhKwogAQIAEB44Vlp_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.572+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.553494784647216389', time=2024-09-14T13:58:06.828961+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.572+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vIsyVh-asIb4EAIq5knv1QrF7Yg8fz5_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3285513703037064348', time=2024-09-14T13:58:06.861860+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1U24sZCugRlioGeCvzYgn7_FH_daTdx_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6508318554582325967', time=2024-09-14T13:58:07.194839+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.L5mZkYSSErPGhGA6U03zJbQ1VwIusle_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11144283601095248918', time=2024-09-14T13:58:07.357643+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EZ8PF3iNPsbdaX6dMBYoHBAMF14-QFy_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13450551844389943403', time=2024-09-14T13:58:07.923559+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.L_jSsAX5zuTJHqJygnrw2CjbHD_PkWz_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.573+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9740761933626338052', time=2024-09-14T13:58:08.305695+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DDjG1rAxU93fqqa2ME4wLBHzgdpGFur_0 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4833044193219955648', time=2024-09-14T13:58:08.880551+0000, chain.objs.size()=1 2024-09-14T12:16:14.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PMcolftU7EdN5DJd8nyweraG5HbOHZF_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6834109090142979098', time=2024-09-14T13:58:08.902906+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UrHiyBfL2e6oGZR0dHpriZuPhFIMTIj_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6792301370931382534', time=2024-09-14T13:58:09.237698+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KwFXx-zPKeE8ZS2w1TMcZKYnQY88WUe_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16663231188348679140', time=2024-09-14T13:58:09.909955+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DFy1DoFaWbTFNoM6tk1mPCFdViMzwns_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17880875492384183143', time=2024-09-14T13:58:11.080835+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lU3jzKTL7ld9XHEkQxLZhzLE0SXKzxf_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18042108198599961697', time=2024-09-14T13:58:11.363235+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AIltTVfRWPr_ZYNgul765O3cx8h0xO3_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5828651540519758085', time=2024-09-14T13:58:11.834674+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gWBGU5ss1vnfx2ebhuhGKsT8oWHNERk_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6403685982346906554', time=2024-09-14T13:58:11.835367+0000, chain.objs.size()=1 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.574+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XrjwHDmiWUwtCOd2z5Ce66h9R-KIyIH_0 2024-09-14T12:16:14.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5238329002164236067', time=2024-09-14T13:58:12.057035+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KQ363Xr2Lsl8q6zYtM0PDwzHkYuT4C2_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17173311917002835964', time=2024-09-14T13:58:12.312965+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Bo9dn0mD127_yWr8-zw4faQbmxJEi6w_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4571226403362798802', time=2024-09-14T13:58:49.122632+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.575+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.a4fLfHDRlNq-zpZVPzuS7QyR0LU5JIr_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4356755745711091357', time=2024-09-14T13:58:49.353321+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1t469dsrwmAckhDhmNgL2Niw3TP-khJ_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17176663301914988530', time=2024-09-14T13:58:49.629842+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.G8qe09YpQHOg6z7EraJwxdsAkbx78ka_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.935803144790866077', time=2024-09-14T13:58:49.720169+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2xzTEYQeHwfDV-okWX0oWP_I_Rx69YO_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10429202610182685645', time=2024-09-14T13:58:49.750561+0000, chain.objs.size()=1 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LTowc_dwnOfzGqPJ4QX48xMhoEX2FhA_0 2024-09-14T12:16:14.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9832670576414444848', time=2024-09-14T13:58:50.593993+0000, chain.objs.size()=1 2024-09-14T12:16:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._pDX5UznJ8s9ihFClpv3mYVYYvBuG0e_0 2024-09-14T12:16:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8616655001147576858', time=2024-09-14T13:58:50.663116+0000, chain.objs.size()=1 2024-09-14T12:16:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1I445mrU_Yjo5cwMb2KSMpMTInQQ5-O_0 2024-09-14T12:16:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14364934520423519354', time=2024-09-14T13:58:50.997469+0000, chain.objs.size()=1 2024-09-14T12:16:14.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xNSlBNHZO03WNsB9Mu1fnTJGG7glAa3_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11497272403842364342', time=2024-09-14T13:58:51.525672+0000, chain.objs.size()=1 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.576+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pdf41lu-WVx_8LZSNZ6-AOUzmBCbsQQ_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18398291391091095863', time=2024-09-14T13:58:52.471095+0000, chain.objs.size()=1 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.o3ILaqn7uLyZfevQDcDZnGl6gw1KRx0_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13695844695570256390', time=2024-09-14T13:58:52.874286+0000, chain.objs.size()=1 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BrlTYE2z_PGGXYLfwogW_4s3c4GI2Gs_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17442471832666682360', time=2024-09-14T13:58:52.973723+0000, chain.objs.size()=1 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OM1Mde4QUKhTf4xROJSOTivj1anM1Og_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6470543302199084984', time=2024-09-14T13:58:53.633660+0000, chain.objs.size()=1 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.577+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yiB_KZUTYIIlWO094tS62r2aPBkUQvi_0 2024-09-14T12:16:14.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14686768771734387079', time=2024-09-14T13:58:53.830280+0000, chain.objs.size()=1 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.li6t0oROI3z50Ol7hQGbYOe1hKAq4tm_0 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8560257928367568844', time=2024-09-14T13:58:55.062082+0000, chain.objs.size()=1 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KzV-0yifRyyePBybjycg4bC5Iol74-m_0 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17387127988598912702', time=2024-09-14T13:58:55.063278+0000, chain.objs.size()=1 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._bRoUZAecehESA_jb9FWbhVKBci8emO_0 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16726211954200373889', time=2024-09-14T13:58:55.383290+0000, chain.objs.size()=1 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pf9HToHXBacmODA-8CpQy2NGsWgmBEr_0 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17404528145380411228', time=2024-09-14T13:58:55.384011+0000, chain.objs.size()=1 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.578+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KY28JDbBXmAeAsEOnQ1pa4euvbyORvx_0 2024-09-14T12:16:14.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.579+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/48522 2024-09-14T12:16:14.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-14T12:16:14.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14075796786004250042', time=2024-09-14T13:58:55.417944+0000, chain.objs.size()=1 2024-09-14T12:16:14.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CiaalB6I6hRll0sKg5mEXE2JoCbfwpZ_0 2024-09-14T12:16:14.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7538766137478546726', time=2024-09-14T13:58:55.495369+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Wrgm4-0XDmEP_65hmYfmUoVOvPDpfAQ_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12164299683360396731', time=2024-09-14T13:58:55.693750+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AciVkOs6mgJ4wBroymSwMnSuQMiG1Ag_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4279875639661572200', time=2024-09-14T13:58:56.405289+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ngjiwecbYQt14ePOtPQG8k_GrGlyg_N_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11131650070679522142', time=2024-09-14T13:58:56.544880+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pGRZj2NVMLpVdcF7QLWesZ8Zlv-QGwT_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17472686904194703013', time=2024-09-14T13:58:56.807597+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VWOlSVOpJPFw4gEJgaW0NqY896J37C4_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13466036677729817188', time=2024-09-14T13:58:57.024771+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rwwf0QgoFtFztdHEVFOC2HAHUW8kbxI_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17852753411305315245', time=2024-09-14T13:58:57.227015+0000, chain.objs.size()=1 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9rW0CPOIuUWXX5ggMfl4jkkWGK_tr9S_0 2024-09-14T12:16:14.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6282571565326267246', time=2024-09-14T13:58:58.091167+0000, chain.objs.size()=1 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8IOB3JsxhmDqnyKa3SrUSQES7117yfQ_0 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15172521262330178779', time=2024-09-14T13:58:58.358386+0000, chain.objs.size()=1 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hA18mDjv5Xs2NNGp0c6AQ5GOiaYoJyj_0 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5783649850326714308', time=2024-09-14T13:58:58.433711+0000, chain.objs.size()=1 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dHW5YtwTt-LvLqCKRhJ5_O8aMYegHLJ_0 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10875093330512482561', time=2024-09-14T13:58:59.150779+0000, chain.objs.size()=1 2024-09-14T12:16:14.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.582+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.n3-wIro833uK7dMJ1XaxPBjd5F_GDUn_0 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12216112098225517950', time=2024-09-14T13:58:59.380360+0000, chain.objs.size()=1 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Jl9tYSALnvNeq9-zTqNpp2fdJ4XwvHu_0 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17485495296982315767', time=2024-09-14T13:58:59.494914+0000, chain.objs.size()=1 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ezg0jxHLGrUL6-jhm7SjuLZZ2eFXBTv_0 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1822565913399004102', time=2024-09-14T14:00:08.318876+0000, chain.objs.size()=1 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.435__shadow_.FiBxZq7y44kyONOCMEbUWp2Pz2nMS1N_0 2024-09-14T12:16:14.583 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.154858473895792886', time=2024-09-14T14:00:40.575469+0000, chain.objs.size()=1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.TK0IIzBTLMx3whmqAOUgyvKGSJoYZow_0 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3890303586870244268', time=2024-09-14T14:00:40.578874+0000, chain.objs.size()=1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.X3LTV3Fo5rbDX1E4Yy_YSWMXItj3-r2_0 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7783203759488404763', time=2024-09-14T14:00:50.988252+0000, chain.objs.size()=1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.496__shadow_.LbrsrIsRNPtumDP0jAbWo2X-8egyGen_0 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1676796922003627725', time=2024-09-14T14:00:56.325994+0000, chain.objs.size()=1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1104661715310720419', time=2024-09-14T14:01:09.275717+0000, chain.objs.size()=1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.515__shadow_.vpodWl9RFlxg-njlWA3wg593tW2Zn-X_0 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10670253727057982754', time=2024-09-14T14:01:33.283844+0000, chain.objs.size()=3 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~27-c10JEyv70kOy9bj0VspccjwjgU5G.1 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~27-c10JEyv70kOy9bj0VspccjwjgU5G.2 2024-09-14T12:16:14.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.584+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~27-c10JEyv70kOy9bj0VspccjwjgU5G.3 2024-09-14T12:16:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18440015709975099719', time=2024-09-14T14:04:00.354905+0000, chain.objs.size()=1 2024-09-14T12:16:14.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.557__shadow_.zarpJwTieY0bJOk1eKOFUSlOL7svr_j_0 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~Dm_BO2UcoNlmF4AlVay8UwzOjji_2Fz', time=2024-09-14T14:04:09.746826+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.561__multipart_mymultipart.2~Dm_BO2UcoNlmF4AlVay8UwzOjji_2Fz.1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15751190797501859709', time=2024-09-14T14:04:17.466073+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.565__shadow_.RrAaJnsX6GTUa2XRZ7Un9NG0SLIMm_e_0 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2684459170754565647', time=2024-09-14T14:04:35.952995+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow_.0grKlNBjiBqagco6GZXBYDQojUCqEiq_0 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.504320803871288589', time=2024-09-14T14:04:36.051071+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow_.iglJHRjOOSJ3HVL4zlFPzUDKWebSjqI_0 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1676023220540387273', time=2024-09-14T14:04:46.085086+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.586+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:VgwjQBcZZM11sij4-3FyqbiXU11Rdmi_.SvjNDvNsaO4cDATq8_lse7Zv5yN3n_M_0 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9426503045998910173', time=2024-09-14T14:04:51.813789+0000, chain.objs.size()=1 2024-09-14T12:16:14.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:OE.sSe6F92EswWY1ZC9J9wxADi6OW3O_.1S1_5rLJhivU2qmItDalyvg5b98SB6I_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11790987947797559026', time=2024-09-14T14:05:03.809967+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:AqoLBMofLc191sqz1HHMqxTvFnxhX2p_.Xm6JlxJB8K126-TXT5PJssR3qT_uhwq_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6675212357610108890', time=2024-09-14T14:05:07.031170+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:dclm.pl.KSeSkW6GJTcTXpWt5By7Aq9_.OXIEda_hjst80_ptCrhD-hpCugjFyiT_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.756648943846082840', time=2024-09-14T14:05:21.908639+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:QP8rqVCLLZUY.uFr8eJ6TFF6naMwF7-_.y2mF8kMvpvIeTi1Ugqnbxxov93DuZNr_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2369751648807467926', time=2024-09-14T14:05:29.045748+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.586__shadow:wAd4.d6kEPHnAM7mKBJm8GYZ8IE04wd_.qJc2-FzVxkpD07uB4XsSlXuGKBOYZ_-_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6381472287052223687', time=2024-09-14T14:05:30.495752+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:aCfAz.ARo1UER9FHd8xw8OPMG8SFIbm_.JQ6aR64y-NBy-aE9YCMXeJDL5pxUpUW_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12757818477637831148', time=2024-09-14T14:05:30.539571+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.587+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:v8WMnyHIsCugP587EQJH9PSWspu1reg_.vjJ_EryoNKnnxk6QKLmMxvYFxLDVCjn_0 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3758051998422108537', time=2024-09-14T14:09:43.892914+0000, chain.objs.size()=1 2024-09-14T12:16:14.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.648__shadow_.VKFO-OCc2JaDAoX87uOldd6HxVIaFXq_0 2024-09-14T12:16:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2178858606938236738', time=2024-09-14T14:12:26.167096+0000, chain.objs.size()=1 2024-09-14T12:16:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.757__shadow_.a3aNQueH-riGRjD-NKae994lX7AyZx9_0 2024-09-14T12:16:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11236642467353360776', time=2024-09-14T14:13:38.748344+0000, chain.objs.size()=1 2024-09-14T12:16:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.588+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.770__shadow_.88wIga83sZF-z-QPmszL6XQ3Q3p3iWo_0 2024-09-14T12:16:14.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.590+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.592+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:16:14.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.593+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.594+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56448' 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_AllZB6gTJ7jmtacaSrcLR-DdxAoN9Kc', time=2024-09-14T13:53:17.481150+0000, chain.objs.size()=1 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.EefaKCwspsuCQAOJG3Sf7_16qZazsd1_0 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15222372736549035825', time=2024-09-14T13:55:31.650208+0000, chain.objs.size()=1 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.230__shadow_.8TpCPqCNZyZt2HfKZ-OSRDaXIl1GDgm_0 2024-09-14T12:16:14.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9346518092384243756', time=2024-09-14T13:55:37.877930+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.238__shadow_.8uF2-7HhLSK5Gvghh0rS3uT3wdZjKmT_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3723967320057603270', time=2024-09-14T13:55:42.405765+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.244__shadow_.LCSW4c_FI46OPEFeYvyOhoflGHo5hcr_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301763815155924631', time=2024-09-14T13:55:48.670037+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.253__shadow_.dz3lNsFycT01D4SwxM9VWlApMNV48wT_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8717788315884634225', time=2024-09-14T13:55:50.072858+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.255__shadow_.hE3_Zh99k7VTWW3qGAyL3pu9539ujoJ_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.173993688635907233', time=2024-09-14T13:56:29.632797+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AYa_sZAqOnQH6LIvVm9aWjrT3i3W54K_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17955137325078744839', time=2024-09-14T13:56:30.086538+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.46LhTSxcG_szwIJOD431peQG-wL0ENF_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2621826216223756037', time=2024-09-14T13:56:30.225734+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NHCPRXjy8Px88g0OVlsgjJJpWWfjlLC_0 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1414284052822332017', time=2024-09-14T13:56:31.308160+0000, chain.objs.size()=1 2024-09-14T12:16:14.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WmgvQBj8aYhogCiUEqigFS4ygpCNgrQ_0 2024-09-14T12:16:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15042720914651766169', time=2024-09-14T13:56:31.546330+0000, chain.objs.size()=1 2024-09-14T12:16:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FgJLygjALO1jiDRyNLtxFfcunIHYSCq_0 2024-09-14T12:16:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8110452035536658754', time=2024-09-14T13:56:31.599479+0000, chain.objs.size()=1 2024-09-14T12:16:14.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.595+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.26_SOIF9fkkaURFeDMEld7nvj4MDyd7_0 2024-09-14T12:16:14.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16575025695341944022', time=2024-09-14T13:56:31.696620+0000, chain.objs.size()=1 2024-09-14T12:16:14.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Vo7Y--6RseZ1G7dl7IaI8Q2_jtU9qu5_0 2024-09-14T12:16:14.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13482848404354656931', time=2024-09-14T13:56:33.160415+0000, chain.objs.size()=1 2024-09-14T12:16:14.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rAOv1zkNmS-P5Z8CLPcItx5yjZntn2M_0 2024-09-14T12:16:14.596 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14953886820344898450', time=2024-09-14T13:56:33.307719+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.596+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HHVowokN1HlFzPdBQtFxmg0ejsX1khj_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.461171294164066800', time=2024-09-14T13:56:33.501750+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hlU6lwiLwx5gnA0xiFBeABELrWc8Jn9_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16837465154367771184', time=2024-09-14T13:56:34.094684+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y0zCIz1gHqmBTP5yfHKeuDOX8vYAgZ0_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8960338579203749681', time=2024-09-14T13:56:34.430521+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZFunwF9HqUBo_M9JyroICM6ZHGUK6QN_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15735764902311935315', time=2024-09-14T13:56:35.425409+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.99TGO5O_1Sx0JzlvUnlYZKGgc4l6Nng_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14752961773058881806', time=2024-09-14T13:56:35.471965+0000, chain.objs.size()=1 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eUlm_h_DBrigMvzzMWnlX69OAPhKai9_0 2024-09-14T12:16:14.597 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16527523075513695610', time=2024-09-14T13:56:35.867882+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EC9nqPKlYU0kRaU3oR3pDqK9TlAN4IM_0 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5969392580514204436', time=2024-09-14T13:56:35.917220+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.597+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.I0ZHFCAJD6iVl1RXqpJr_tDYdfqU97N_0 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3170884904889923718', time=2024-09-14T13:56:36.101559+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.MBZfnWEJL9O5kGWPpQrLhE4q6-WAXFJ_0 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17201672510219533113', time=2024-09-14T13:56:36.297982+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KtQm2f1qIfDi7fsuQNljOEjsrJSnrUj_0 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2101368458287499806', time=2024-09-14T13:56:36.760925+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9oSz7lSo93BoG52u3B_ul6Hp5qf8yLA_0 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1785143995707813374', time=2024-09-14T13:56:36.808666+0000, chain.objs.size()=1 2024-09-14T12:16:14.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.598+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HkX3pd1WWGSnZGQgnbyRkM_PCmlABPI_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.353343264876903504', time=2024-09-14T13:56:36.888813+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.G5-bfZ9C7EajjcP1dT-HBjLs1uLxCA2_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15102244404491471375', time=2024-09-14T13:56:37.491610+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vdJIwWo3cEsVinMwu5Xx8IJHNKzs1om_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7665555133319051143', time=2024-09-14T13:56:38.323036+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gIUW-wMwRpWaqsT3CASHKucXfpfEkMf_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6407355835133771273', time=2024-09-14T13:56:38.412983+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.599+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xICu_ILLWO6Z-Cs_LBDp96s_bBOC3Ie_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7416302712213259660', time=2024-09-14T13:56:38.583873+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._OIehvHSKATMFJE_AvyYkPQBb5aXn_2_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2236602703672490744', time=2024-09-14T13:56:38.584419+0000, chain.objs.size()=1 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wU1iucBP6j8bz4-Ze233X-onDzi2KKS_0 2024-09-14T12:16:14.600 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18264242903113799270', time=2024-09-14T13:56:39.526860+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nlqTz1AzGQpqA0ELwok3ndn99uq_nIB_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2150067656778225230', time=2024-09-14T13:56:39.651325+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.r-Z5Nij0mNYWTEcUoXbCbB-3Q_eN2WG_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9590108686527876850', time=2024-09-14T13:56:39.914872+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZRFzEFCI6o77lMzsY2Env42Mlws6lGa_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1229719467153430349', time=2024-09-14T13:56:40.259697+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y4gtMI9b1iijoKQedTkp7i902eYaPd3_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.555227997902926277', time=2024-09-14T13:56:40.332334+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.600+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qwQvI5tWfAS24KngaSvS-kP11sgr_If_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.601+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5687025154808503912', time=2024-09-14T13:56:40.332952+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.601+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZWQPsXAlu6MipvsICwczH7yQvay7jFt_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2902888992454165971', time=2024-09-14T13:56:47.567981+0000, chain.objs.size()=1 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.273__shadow_._JF4m5YMm80SNjTkzlH2svPrv-aTP96_0 2024-09-14T12:16:14.601 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10959371053780430401', time=2024-09-14T13:56:48.896942+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.275__shadow_.gYCwWPMymZU99VspxxMYKkX17rez3Xj_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18296899424956961011', time=2024-09-14T13:56:57.374238+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.287__shadow_.doorEnzx8RXWP1zO_uuGTeyfYv2YVMs_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6546111414321764291', time=2024-09-14T13:57:04.893892+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.294__shadow_.kVGAb4Jv2tp30ShzGNGhuga6cyhL2Dh_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10603499536620058743', time=2024-09-14T13:57:12.771656+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.305__shadow_.U35u3e4OptTdtrsJ7kt2O5t8_tWfU-o_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4146441955294014489', time=2024-09-14T13:57:23.342533+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319__shadow:bD.7j0ilH88q5I5VSUiuBZmqlxaU1Gp_.oid1eY384zp32IbP96jIWnlos416y1T_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.594125443827953258', time=2024-09-14T13:57:24.619862+0000, chain.objs.size()=1 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.321__shadow_.qFUqiLS3AF0NPMgvG_SaOIN8Dk00E_X_0 2024-09-14T12:16:14.602 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3813966087612717780', time=2024-09-14T13:58:02.385138+0000, chain.objs.size()=1 2024-09-14T12:16:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xgSV4Y_Vn1Bbe4sboxSs5-I7ylT-YZ6_0 2024-09-14T12:16:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12184440104407602642', time=2024-09-14T13:58:02.832226+0000, chain.objs.size()=1 2024-09-14T12:16:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fM5fxEcdy3JVEg1HKBii3NMcW0NXEaC_0 2024-09-14T12:16:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16458543499076224553', time=2024-09-14T13:58:03.218244+0000, chain.objs.size()=1 2024-09-14T12:16:14.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.602+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BL3pM9rcOpYYquT9G8wuIO1AkKID5Rm_0 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.603+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9490095149394612662', time=2024-09-14T13:58:03.749791+0000, chain.objs.size()=1 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.603+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.sXEFhfLp9qvn-O8BPsfmpMHAoUm_5jc_0 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.604+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14486329381675833191', time=2024-09-14T13:58:04.018353+0000, chain.objs.size()=1 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.604+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BD6G4vCeFLhLuTdwhWmNbn724DJVuf__0 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13343605301761273888', time=2024-09-14T13:58:04.266336+0000, chain.objs.size()=1 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.l5PefH00cnN58tBHJzNpzfCLQDtMZli_0 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.353040235382964774', time=2024-09-14T13:58:04.414810+0000, chain.objs.size()=1 2024-09-14T12:16:14.604 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KSOnWL9zB9R4D5TeO7LN0w1gkQv8hjb_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1316279255400414876', time=2024-09-14T13:58:04.512042+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FCn91sywMm3ZyV-Mrq1P2mHluYcCOmy_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8684023342355085233', time=2024-09-14T13:58:04.544583+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZWo9FCa6QNS5_4WnH3VVxZ-CFF7bkGc_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8246794979570572232', time=2024-09-14T13:58:04.661723+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.D2GhPYE_34l3DAl-_7XnMeBzGILhzVr_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16056944597632178675', time=2024-09-14T13:58:05.291620+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dc03tNfJ-YDF-hAC2pMfad8QCcnVBbc_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4711726927601510060', time=2024-09-14T13:58:05.292856+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.26Me2QrQtfT44HgrNnZ2PT9Tybi-_5J_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3563424856994977035', time=2024-09-14T13:58:05.696731+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YxEPakmquLQ8vv5MD2mT9-1YVMSK54z_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9104873741393774502', time=2024-09-14T13:58:06.177301+0000, chain.objs.size()=1 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-Qx6wgRGwehNxTqSWvK2o23Y5hA-yqZ_0 2024-09-14T12:16:14.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11141239660937966450', time=2024-09-14T13:58:06.581780+0000, chain.objs.size()=1 2024-09-14T12:16:14.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.605+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.riz1D6SoC2DCwlPW9ZL1_wsgSVgVX8l_0 2024-09-14T12:16:14.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.606+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11271767983352490589', time=2024-09-14T13:58:07.184044+0000, chain.objs.size()=1 2024-09-14T12:16:14.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.606+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cjYsxAWabWB50-4evFeWa9HY751e2oL_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17713684812451259335', time=2024-09-14T13:58:07.452064+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.algCSlUa5499_lp_SpeXlxvaH90P54j_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15636098250926844217', time=2024-09-14T13:58:07.540255+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i1Bt6uPA8bhVGwvC-xnc1lG_Patnl-n_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1645521189264317689', time=2024-09-14T13:58:07.545402+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.607+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3l47vGVPNDUlcGNA1FUfrH3etf88SMs_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2247190125721471014', time=2024-09-14T13:58:07.546152+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Wfypp9BDHDA56tMtIduukXtbiZSN7Aj_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14596254786608057462', time=2024-09-14T13:58:08.337663+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.b7nCA4rkGXyvtRMWixrABNQ6GyILSUa_0 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17184271101445253682', time=2024-09-14T13:58:08.533178+0000, chain.objs.size()=1 2024-09-14T12:16:14.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ycWoa3am82BgrBKuWiR8s7R30O20YWX_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13025567515568978856', time=2024-09-14T13:58:08.600102+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Tue9Dguk9QxahK0P-__Kf3CnqsvITG8_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12405162889651021822', time=2024-09-14T13:58:09.522848+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hRti0P_eOpEm2K0hN9Kxw4NEnoeS3i1_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2258434085903993768', time=2024-09-14T13:58:09.826066+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WFApzcgG9qLYdLVBKFMLEbh0IibNC6O_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16653539984811283425', time=2024-09-14T13:58:10.075555+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mrdrhjjgjifsE75mGNO9OK95gOOF-W5_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17110424116445734779', time=2024-09-14T13:58:10.076746+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gM_f04YZRTV609RMePmRPsaTRL3JC3H_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13891024060296425902', time=2024-09-14T13:58:10.690818+0000, chain.objs.size()=1 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.608+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._sHR5dYA7qJFyhaGocLALN8BaqZDegu_0 2024-09-14T12:16:14.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.609+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16521198102559100856', time=2024-09-14T13:58:10.692199+0000, chain.objs.size()=1 2024-09-14T12:16:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.609+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VrRxx_z0GgIjnsv7QConmHm-4m0GPBq_0 2024-09-14T12:16:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.609+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.792069659552499745', time=2024-09-14T13:58:10.699227+0000, chain.objs.size()=1 2024-09-14T12:16:14.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.609+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6R-AztgfwVpV-7Iz13zfcekJIQwwl0X_0 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6136296607791644092', time=2024-09-14T13:58:10.710307+0000, chain.objs.size()=1 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SXyPYPg8iXUoFlddCrEBDnyldRTCDxT_0 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4865433471516727451', time=2024-09-14T13:58:10.777724+0000, chain.objs.size()=1 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.pHCe0eiyoZFxYOxWkMNooMfdKClA4fw_0 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12228964821864998789', time=2024-09-14T13:58:11.932204+0000, chain.objs.size()=1 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.610+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZKlgrE01HjgkHfa9GOwR2F0lqfofy_M_0 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14072485147030481600', time=2024-09-14T13:58:12.539314+0000, chain.objs.size()=1 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Dyz0JaQlx_THXVU8uZaAuF1GvFshCnm_0 2024-09-14T12:16:14.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17262426489901368654', time=2024-09-14T13:58:49.042839+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0Tsr92K6kl3f1zCM_DUiRkoKNuwFnm2_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12566961060653614777', time=2024-09-14T13:58:49.440057+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MUGqn14zQ3hJwi_UFtCDsN9LXyiU8lI_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.864935019947401477', time=2024-09-14T13:58:49.631035+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eb2aBF2ziTdFUxv_0ODf_fo_1m7BaKZ_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4050030100693218182', time=2024-09-14T13:58:49.846306+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5nOuzsWtlKduUMm8Rdd81rI1QNPyC6m_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8044271128934698517', time=2024-09-14T13:58:49.964422+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4XUDaKnuQ9WamsL-YuHpjj2JjIPw0Dl_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14455340252199496888', time=2024-09-14T13:58:51.137628+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.611+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jSriHFg357b3x1cXbLtLa-5TBsHh29o_0 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2956628615028452445', time=2024-09-14T13:58:51.472978+0000, chain.objs.size()=1 2024-09-14T12:16:14.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-VNPkGZYehchF3hFRw4ybfAWNxYI9p6_0 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3051649308098209057', time=2024-09-14T13:58:52.014312+0000, chain.objs.size()=1 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.G25YS5SJHq-rK2zd0JpznIFCebBJ5A9_0 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.268492457490534019', time=2024-09-14T13:58:52.280750+0000, chain.objs.size()=1 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zJhj3JqIA76nBHUBOJil-W-FO4PTyVo_0 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16537815407377928697', time=2024-09-14T13:58:52.822871+0000, chain.objs.size()=1 2024-09-14T12:16:14.612 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3hJGw6RzoxUaV51jMMBgvzumkgfOTGD_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16915266329804133818', time=2024-09-14T13:58:52.858523+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.W2G8IXHSWNPIeKcdOi8G8Mo7stNc_GO_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11419328758930931976', time=2024-09-14T13:58:52.915379+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.612+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1ZAm_Ky-U3G1Z53VQqzBx26DsxVh20-_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7674769295400784732', time=2024-09-14T13:58:54.334961+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gMM4DhH0Oz-pmbmFhzpzwqgWzKzW98r_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13795916728468376651', time=2024-09-14T13:58:54.360948+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mEEuZ6Acum86XMpxF9lCmY3e5SigqNg_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4151015162736485888', time=2024-09-14T13:58:55.270030+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KGk49ZD4AtXGGxa4UZPNmtuFAc093Vm_0 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4139628627851371205', time=2024-09-14T13:58:56.703087+0000, chain.objs.size()=1 2024-09-14T12:16:14.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.t57XrLEk6d5fHaLR7NhZ1gvaZoKTLRH_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4182164465681609649', time=2024-09-14T13:58:58.297281+0000, chain.objs.size()=1 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.613+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pwqoMcfeGfeM7qnpo5tkfT-Zov8mAoc_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7775185948434116974', time=2024-09-14T13:58:58.572933+0000, chain.objs.size()=1 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8xfLbVbT5JeeRAFmHDcMfBK6U4Z8hvD_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9992969639628210804', time=2024-09-14T13:58:58.959342+0000, chain.objs.size()=1 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xfzq-j4FnJ8p86RxpcWQmNvYOs2nLPi_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16050968385193669286', time=2024-09-14T13:58:59.423949+0000, chain.objs.size()=1 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bTS3NUjNzAjmz5bP0BKRYGsTVOjPjSH_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11333265554393731875', time=2024-09-14T13:58:59.680145+0000, chain.objs.size()=1 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.614+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0MqwjRavTjttDIRR6ByISNQURRZqUzF_0 2024-09-14T12:16:14.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.616+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/56448 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18268713958254722365', time=2024-09-14T13:59:10.417141+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.341__shadow_.YEHawrmBKD4hUt4KBW6OsXmJrtiZmNA_0 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9896286834895242681', time=2024-09-14T13:59:51.235622+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.407__shadow_.kL2JnNy_5W3-jpAa_zFbXOTcwovl3Ji_0 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1817412889424190903', time=2024-09-14T13:59:52.389690+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.409__shadow_.90kNlDI601hkDiTUhIrj-piwAgyoOvP_0 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10222732617941666043', time=2024-09-14T14:00:14.713667+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.444__shadow_.88GDtuuk-ke5m9ATuZpaaHz-h4BcBU1_0 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7351558015259358505', time=2024-09-14T14:00:31.165715+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.465__shadow_.uX0SSEN955beGubxugivNHBfkuGcfb3_0 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5057292461237268910', time=2024-09-14T14:00:40.576869+0000, chain.objs.size()=1 2024-09-14T12:16:14.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.7DDNiGNM-dTYQbnA-efSriFa1z3K7ak_0 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4547585633887000721', time=2024-09-14T14:01:23.035113+0000, chain.objs.size()=6 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.1 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.2 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.3 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.4 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.5 2024-09-14T12:16:14.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.618+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.519__multipart_mymultipart.2~KiyUqYrA8MvbV6lk22SH0-7kGoEVYAX.6 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI', time=2024-09-14T14:02:00.784930+0000, chain.objs.size()=1 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~7opNvFVjB8xXIqVxmjenjAZlyH_u5bI.3 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12302120889396239937', time=2024-09-14T14:02:41.052589+0000, chain.objs.size()=1 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~oNs-r0M2epqoRbJcawF7ptGbQyHfIz0.1 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15684089674070735836', time=2024-09-14T14:04:25.294633+0000, chain.objs.size()=1 2024-09-14T12:16:14.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:-yyq0GUA75EkHjRhiojeD1-Xlo.fOKG_.Bxs6p_0L4W8cKifjiFNnzQN2F6aMIJB_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16837299066682719358', time=2024-09-14T14:04:32.616020+0000, chain.objs.size()=1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.571__shadow_.XKIc26Bt6YqaaIQLsMAGRZwagFg-q_p_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17882174307100742932', time=2024-09-14T14:04:33.659279+0000, chain.objs.size()=1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.572__shadow_.k7h6eW1HCPZ8_mz0PXDm7slXfdwreSh_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4427226424055700629', time=2024-09-14T14:04:37.036229+0000, chain.objs.size()=1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:Tpje-oxPxNkTM.gOw1zPIw81KeZTYYm_.y-YvK3IThrpKDkwY24rPX2g6OHGLPmg_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5711369853457824475', time=2024-09-14T14:04:38.553820+0000, chain.objs.size()=1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:s5Rbrd8yHpNGss4RJ8-vtfq-cGvFdl9_.wxNl69RcI0mEJ69VGpYKtZr6rbfjMKn_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3899731107417001119', time=2024-09-14T14:04:40.549660+0000, chain.objs.size()=1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.575__shadow_.bYz6wuxn07_NSztFbOgsRgDTmLF2uAb_0 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12871301758240765747', time=2024-09-14T14:05:17.996003+0000, chain.objs.size()=4 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~DehKLsBHcJ_n8Ya2oT3Q7UyeUbyIt_u.1 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~DehKLsBHcJ_n8Ya2oT3Q7UyeUbyIt_u.2 2024-09-14T12:16:14.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.620+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~DehKLsBHcJ_n8Ya2oT3Q7UyeUbyIt_u.3 2024-09-14T12:16:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.622+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~DehKLsBHcJ_n8Ya2oT3Q7UyeUbyIt_u.4 2024-09-14T12:16:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.622+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13175642921835515018', time=2024-09-14T14:09:53.708482+0000, chain.objs.size()=1 2024-09-14T12:16:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.622+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.656__shadow_.V4cPIb6FEaY5rNK5JlTYCJC8bYhOhnp_0 2024-09-14T12:16:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.622+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2055487325856393504', time=2024-09-14T14:11:38.990639+0000, chain.objs.size()=1 2024-09-14T12:16:14.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.622+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.745__shadow_.dp7MvqfJg8QR4PxAd9TPr2DU7FmbG7T_0 2024-09-14T12:16:14.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.623+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9301426436954722450', time=2024-09-14T14:13:42.682351+0000, chain.objs.size()=1 2024-09-14T12:16:14.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.623+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.771__shadow_.zhctVqzA_hA9QSRbNNKGKBBCnmnI7ZR_0 2024-09-14T12:16:14.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.624+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.624 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.626+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:16:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.627+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.628+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55106' 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6098287861979132519', time=2024-09-14T13:55:41.415541+0000, chain.objs.size()=1 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.243__shadow_.jdCPeDYjWPMvB1jr51SKfcCdVtAVTDb_0 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13116593187775778848', time=2024-09-14T13:55:42.402594+0000, chain.objs.size()=1 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.244__shadow_.Pc6vs5WhfMlL6a2hfviKIejujc0Qbrd_0 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9276453901515413748', time=2024-09-14T13:55:54.133728+0000, chain.objs.size()=1 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.261__shadow_._ZjLCMAU8tFj9AYZlHQmISI9AqMD6Lu_0 2024-09-14T12:16:14.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11245295691579218082', time=2024-09-14T13:56:29.927047+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.51zt-5jGxKfs0fPrFtyz8z1IzC0wIzV_0 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11008666984664582712', time=2024-09-14T13:56:29.943972+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qGgSmfzuj-BnIrK_9IAiRVrNKeto_gx_0 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16960860515372193907', time=2024-09-14T13:56:30.084674+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IgMgLGCY78KHLrr2OcEAzQqVEKXQ2Vd_0 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13622170137677126569', time=2024-09-14T13:56:30.406025+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VDV1FVXgt5y8yz2qZFUuzga4-pHQtdx_0 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17831802676059612073', time=2024-09-14T13:56:30.455037+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.055u5l9I07oQEDBuorn1zk5E_75cfps_0 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15499458618967812912', time=2024-09-14T13:56:31.167606+0000, chain.objs.size()=1 2024-09-14T12:16:14.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.25v_ZR2btavQ02Gr4-l3Hp5jVyI5hY__0 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17029441462038060033', time=2024-09-14T13:56:31.418623+0000, chain.objs.size()=1 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lUaP02eZcTyHl9wT3BoDn5mU04lVirH_0 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4559185280274569765', time=2024-09-14T13:56:31.731636+0000, chain.objs.size()=1 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.c9ahzHokdH1ngPVygIfQSipL7nYsqkH_0 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1681523413733450164', time=2024-09-14T13:56:32.080580+0000, chain.objs.size()=1 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.629+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7AgQYU3B7rmSZQYrHh0H6zv5Bn-vPuZ_0 2024-09-14T12:16:14.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3220473711885856169', time=2024-09-14T13:56:32.149970+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7l-liSw5LZsjDd6n8erYYmlFNeOFt99_0 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16127042811350685562', time=2024-09-14T13:56:32.773866+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dM6MFK5KQXbSYwD4H_WHuux9XWXm5I8_0 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9328378458854207433', time=2024-09-14T13:56:32.803592+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.630+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-aWZRKCUbtgVssi5kJpkh5P5aXS7XIK_0 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2903254527096289719', time=2024-09-14T13:56:33.326082+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VMurq8Ss1io0iNrQCDfBS3-QAteduKa_0 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15723680612317083719', time=2024-09-14T13:56:34.047737+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CIeyehZB8ckZT_7fX5uNHWF_jrQkZnx_0 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13765603999357255823', time=2024-09-14T13:56:34.154739+0000, chain.objs.size()=1 2024-09-14T12:16:14.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IWh-nWUWifEK2Yz8BcOqy5l94kTsoru_0 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17142650135315568163', time=2024-09-14T13:56:34.228570+0000, chain.objs.size()=1 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.64qhOHBUGtEVDBIlN97zZ65EGXaDY4Y_0 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2994419522689978992', time=2024-09-14T13:56:34.290375+0000, chain.objs.size()=1 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qI8TVGbvqUBUSTZKYubfSZKdBmdsvbq_0 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7550455652465089720', time=2024-09-14T13:56:34.672777+0000, chain.objs.size()=1 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-zhoWZ1jqsDXpsxwYfg0bvx6AD0zZIN_0 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17602110056303515279', time=2024-09-14T13:56:34.937989+0000, chain.objs.size()=1 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XttGWOYd_GgGihichQLmPPsUDIO746g_0 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.201593098169487661', time=2024-09-14T13:56:34.938740+0000, chain.objs.size()=1 2024-09-14T12:16:14.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.631+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5ZjUokOYzYdw5UC9HPJce2FGeP6e4Rq_0 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10417677033233241024', time=2024-09-14T13:56:35.589354+0000, chain.objs.size()=1 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5Lju3TyozFgbTL4NN2nif0WpzLjQBsH_0 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.403232294583699420', time=2024-09-14T13:56:35.614885+0000, chain.objs.size()=1 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PweItb7DqVIUtuZvnIPDlxsDV_dkjq4_0 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17616705687015750848', time=2024-09-14T13:56:35.910223+0000, chain.objs.size()=1 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.632+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-3fXqyi3Ned9YKbjRVSI76cFyh0cWVn_0 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6170044676197627068', time=2024-09-14T13:56:35.928256+0000, chain.objs.size()=1 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Omb_IGii5hHRZVi3szIvvrMVNqJygNd_0 2024-09-14T12:16:14.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14255705337285708554', time=2024-09-14T13:56:36.370583+0000, chain.objs.size()=1 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.s9rexmGlT8PuPfzmksDoxFxpLOQudui_0 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9542575890023262882', time=2024-09-14T13:56:36.371296+0000, chain.objs.size()=1 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uChi48yLo2pdgBNtbn3tY1mJwCbOn6F_0 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7036442167576093752', time=2024-09-14T13:56:36.428505+0000, chain.objs.size()=1 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lUdLI3eUFOqA4DV0Q8Y33bFoESGjfND_0 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15253760805037059097', time=2024-09-14T13:56:36.788449+0000, chain.objs.size()=1 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.A0PBhdfwnZqYwcKaNXeCE96Ru6KU7PI_0 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1016205802276160971', time=2024-09-14T13:56:37.437688+0000, chain.objs.size()=1 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pm1PpRkPHXLPJJSSG41vF58ZIyQK8YR_0 2024-09-14T12:16:14.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11232458490073011527', time=2024-09-14T13:56:38.235481+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AzVyBymaOIYjwQWmDicMgo77LQe2hpt_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11719833805958744362', time=2024-09-14T13:56:38.304718+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.633+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y6lHW_xmVt7QzrCYq6_M4gpKES4fYrD_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15295494598693061589', time=2024-09-14T13:56:38.334565+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cirB8vELiCjz2_SCazcGUmqp30o99Ea_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6061451623496537087', time=2024-09-14T13:56:38.336276+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hAJXRTANMdzfZHJDMJqAvBjgxEYT3Ko_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7093162608826847665', time=2024-09-14T13:56:38.633928+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.l_xehDKYh1GIdfkXQ83PHSyJLV_W5cB_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15061479157162327284', time=2024-09-14T13:56:38.819092+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZeeDi-_YxfsufBinMbynTETwkrYVwjw_0 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16399185164906357765', time=2024-09-14T13:56:39.521134+0000, chain.objs.size()=1 2024-09-14T12:16:14.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.634+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.thSYo5qUWH5sleS7LlXFqkqJp6Q1V3s_0 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17546567252761259724', time=2024-09-14T13:56:39.734434+0000, chain.objs.size()=1 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1NPMrIg-jhRXoolbUv5-qguKYMcKRT9_0 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1510170467749756937', time=2024-09-14T13:56:39.959060+0000, chain.objs.size()=1 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HFrw8I7uNVJnOF1kxofQGIueBu1SorV_0 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4083006376763846617', time=2024-09-14T13:56:40.077064+0000, chain.objs.size()=1 2024-09-14T12:16:14.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VhpEGA-z41uiXTDWLu_Bv-tl8n8ThNm_0 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12612343921439580595', time=2024-09-14T13:56:42.340799+0000, chain.objs.size()=1 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.265__shadow_.iaIYcpDtI0I8d-68KUr06tvATuTtM69_0 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578289294446455038', time=2024-09-14T13:56:49.603577+0000, chain.objs.size()=1 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.276__shadow_.H0I-fQWxVqxsOM8XaULM-L0FKYRKHBb_0 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.635+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5248006833216310951', time=2024-09-14T13:57:04.117920+0000, chain.objs.size()=1 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.636+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.vDL_WItXP1pTEE87rBigvQYrnlQd-3Z_0 2024-09-14T12:16:14.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.636+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6932514821604504045', time=2024-09-14T13:57:07.839008+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.636+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.298__shadow_.UnYg4bBPy6jWx1JK0gtApOdvWSu_kTG_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.636+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15103034100538102577', time=2024-09-14T13:58:02.263461+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.636+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Izkz5suvlWyLhz5U3kxcvqS0vdmM2GX_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5129900840990445591', time=2024-09-14T13:58:02.562398+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xH0coCj8ds1NTNIozOUR8SpggpnYI3N_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3819516057718780758', time=2024-09-14T13:58:03.075551+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Mx0REPNTAXeg51aJ7DNk8vi6m2hMYXg_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15050827673027316765', time=2024-09-14T13:58:03.857613+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dUCpq9Nmp49AyhI48YAkrP51RSTWnWM_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5780365540443710744', time=2024-09-14T13:58:03.990303+0000, chain.objs.size()=1 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DDEXR3YZnBtmLtdxXcODtLhxi_r0KDt_0 2024-09-14T12:16:14.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3973696426133981681', time=2024-09-14T13:58:04.207428+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wDbsEPAZAxH6TqU6QEHBhWh9SiusT24_0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9850477321604243929', time=2024-09-14T13:58:04.245784+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rUbPqqDhdn76DBpsc2ZsB3UVl2BjCcJ_0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7915579795587791844', time=2024-09-14T13:58:05.286288+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gToIOf5oK8yetsFwWwXIoUgmQHSNHtJ_0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7503285442084477531', time=2024-09-14T13:58:05.515108+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.m7qwxJFrZrZZSXgbXhIsOsu0HO20faP_0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10775549105980733346', time=2024-09-14T13:58:05.792668+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.637+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._-uhMcqmwMmWOKiUSZAzQUL4Gh3rCU__0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16276145775724541581', time=2024-09-14T13:58:05.876923+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YBVDmKcb44ymzrnahj3rF1W7o5J2Lbl_0 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10745296317902273460', time=2024-09-14T13:58:06.712451+0000, chain.objs.size()=1 2024-09-14T12:16:14.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DIUi1UMv_ypZuMoQZAxAUbJ7NRNqtfB_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6690189345747805911', time=2024-09-14T13:58:06.831734+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.639+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ICg4gfLdhrbNTnEyVvEcIP-iU-3OEX5_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15254654839540699757', time=2024-09-14T13:58:06.975019+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gi-MSoYaqxCloPG0N3x5jqg8WWjSFKW_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5763049580712472989', time=2024-09-14T13:58:08.728619+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4DGEPeFyuXMTFMHV6bgnz5k3z9Q8aSu_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16754929820624968901', time=2024-09-14T13:58:09.234542+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kHtAjjePD3fXuP8JV8cnkWWCyyJOryT_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10464960086172656551', time=2024-09-14T13:58:09.860477+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Td68L-2yYMQC4DgA5UxiJuADVOozD-Y_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3036288673299550880', time=2024-09-14T13:58:09.956464+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0VJTjBiMZ418LqkUvkSb-qpNK5NcEfA_0 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15758500491756724860', time=2024-09-14T13:58:10.563690+0000, chain.objs.size()=1 2024-09-14T12:16:14.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qfcAv7RC8W2-fFhT8IuxASy4qseYQ8n_0 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4951363228228260873', time=2024-09-14T13:58:10.564515+0000, chain.objs.size()=1 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HnaP_4s6xGJ7KJatuYbFRz8lXjTP8YV_0 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11509488226092444929', time=2024-09-14T13:58:10.565308+0000, chain.objs.size()=1 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ndjFLKcd0r2TCf1jz7-iD7jSSeBKnM2_0 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7309384576720582429', time=2024-09-14T13:58:11.098116+0000, chain.objs.size()=1 2024-09-14T12:16:14.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.640+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GcltDOKg_xlQYnwDVPp4454bJjv6r-Q_0 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.641+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6466741962254483981', time=2024-09-14T13:58:11.218161+0000, chain.objs.size()=1 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.641+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K2NchB5uPSZ0zmGsd49bPRxvjFMWIkq_0 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.641+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11524536861287772195', time=2024-09-14T13:58:11.299903+0000, chain.objs.size()=1 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.641+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AGNbujVMdGMWTT-Ad1tXcifAGkKh0j8_0 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9625602616967237884', time=2024-09-14T13:58:11.527493+0000, chain.objs.size()=1 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hANzW0k0SAmP9K7dEvGuniuruoVVfoA_0 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11262953264945050424', time=2024-09-14T13:58:12.049417+0000, chain.objs.size()=1 2024-09-14T12:16:14.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Q4Z47_3PpUmur9W-T2-iLuYb3gmrA4Q_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9826152629069126708', time=2024-09-14T13:58:12.382442+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wGbanIXADh0awwEzatNm7D6f97SdYE6_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5817620636004677914', time=2024-09-14T13:58:12.444245+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rjUmq8LqFtnlQS1oWUO8IScxElrsKua_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6736467117217614019', time=2024-09-14T13:58:12.571316+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ynu81dvwj08tjX_arY1wwhXXMGySsup_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13913412789763047793', time=2024-09-14T13:58:49.197070+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vVPiQ0RRb82PnvSI5SbGHFXH2sSmzbt_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6785205030846522933', time=2024-09-14T13:58:49.344703+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.642+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8v88vi9_mDegVYf33Ua7eqRvFSwzR4T_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15338839956146612878', time=2024-09-14T13:58:50.714828+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ztoG3JUOLp3TGMXJw29Fyd0IX6rfxp5_0 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4159278072312492279', time=2024-09-14T13:58:50.956812+0000, chain.objs.size()=1 2024-09-14T12:16:14.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.E4OUs50bc6z3lsLaNCsebFOpNgB9kvM_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13580978570705536565', time=2024-09-14T13:58:51.017034+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ap9LgSQA23DtOC8wuKtWHCH6zdVgQ1w_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13629914453811205737', time=2024-09-14T13:58:51.137384+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.643+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jmwKujjkRPZQkdsNxXY3CjAnbmDWs_5_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11675949756606526223', time=2024-09-14T13:58:51.166907+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.u0RYvYND_AhD0CAy513Hn3NxKElbku8_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7271140939456022169', time=2024-09-14T13:58:51.273072+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aLVum9zLAtYK7zy9kQ9WV__Ho_jDlMj_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15147364666774527094', time=2024-09-14T13:58:51.440770+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3sITBnJmqkSs-8fWvhV-y7BUJL0Hbyr_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16669155001776118523', time=2024-09-14T13:58:51.968239+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Zl1GPdVzIyn6AePkxoqrx-OAcVXsIOI_0 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4840706665964270533', time=2024-09-14T13:58:52.115834+0000, chain.objs.size()=1 2024-09-14T12:16:14.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bJgKTFWOS4qxiBnsrTmH4cRtDPbMBcU_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2783044181996408393', time=2024-09-14T13:58:52.278678+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.g6ylaLonZeUjFt7ZsfKJ0Zl4oGZmFcj_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4449284788495117553', time=2024-09-14T13:58:52.467609+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PvBrUzCoAeyxvrc9vq8_6DTJgTRHqTE_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2996982244503235055', time=2024-09-14T13:58:52.587559+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qayMcandY2KyboOGW6FsmgGLULLJcnD_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5854265686816943662', time=2024-09-14T13:58:52.745062+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7SrIMh8lR-d2rQjtk8e0rUP_0Xj3-A6_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1542513660686807360', time=2024-09-14T13:58:52.874606+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mopZHaxLGN6Vvc_FhRN1nfUAvadJOYV_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8566310291172141613', time=2024-09-14T13:58:52.947446+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.644+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6q4cd8dHQJvXW_Xii80MOB9ggJdTW9q_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6440909795268791679', time=2024-09-14T13:58:52.971509+0000, chain.objs.size()=1 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1RRWiKcNbIlr0cFHk30upm8vR91RAGR_0 2024-09-14T12:16:14.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8766578381562044244', time=2024-09-14T13:58:54.131185+0000, chain.objs.size()=1 2024-09-14T12:16:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.80-It3Kj_gcUywNKCWPr1Tx39atKQAi_0 2024-09-14T12:16:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6239314233916284427', time=2024-09-14T13:58:54.150169+0000, chain.objs.size()=1 2024-09-14T12:16:14.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.646+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.k7RZtoo0-6omDkGQntzdM-u0LH8VE26_0 2024-09-14T12:16:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1263862572562777193', time=2024-09-14T13:58:55.063863+0000, chain.objs.size()=1 2024-09-14T12:16:14.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZNf63JqVBXLUoodIRjrmjH9CpfWKxp3_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16313629751883806297', time=2024-09-14T13:58:55.333426+0000, chain.objs.size()=1 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9R3bAKM0skhz806UVIs1zSv8xwrni8D_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3267727608211638121', time=2024-09-14T13:58:55.533121+0000, chain.objs.size()=1 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ui35mKZuTM793O8zY4KDsPE77giyIxB_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7190606827025480980', time=2024-09-14T13:58:55.592805+0000, chain.objs.size()=1 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QxYvp00-MmH5kEXKt9PK1OjLqylxdNi_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9196028575015320179', time=2024-09-14T13:58:55.654790+0000, chain.objs.size()=1 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.647+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TzdmTyEq6rBmCrd7fq06HYqrHOPDAqs_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.648+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/55106 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18015328064784235287', time=2024-09-14T13:58:56.380486+0000, chain.objs.size()=1 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zhLVJ4lJiTTx13kqroAjGyAk4ZucqaV_0 2024-09-14T12:16:14.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6330151694888365787', time=2024-09-14T13:58:56.542781+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fteY-yR3RQyc2XnGYTYndt2LILBPgDi_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8241729723939289949', time=2024-09-14T13:58:56.751390+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FmkvMxsJkFpiBe5bgjTbE8ss4sGsryw_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6090219863839258120', time=2024-09-14T13:58:56.752133+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TeQ0S-LMadL1iyiNIJnJkOu7uJGMWsu_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10572760058366401402', time=2024-09-14T13:58:57.046558+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HZv-xjmT-__QApgzUoR3x9S9oORYlBA_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2866297861083290953', time=2024-09-14T13:58:57.814236+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1enqPW2bgSG2HU-mRkQR_f6mAqBUyyh_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9143930987122510119', time=2024-09-14T13:58:58.511351+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.s-XOIc1ZYiTX7eSJN_B29vm1FYZFUiT_0 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2862320359529013101', time=2024-09-14T13:58:59.678765+0000, chain.objs.size()=1 2024-09-14T12:16:14.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sxDXVvDWSr-NOsosCEgLJXGDGi5A572_0 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3460556838636895398', time=2024-09-14T13:58:59.762034+0000, chain.objs.size()=1 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.o8JUmqmH0UASO5L-yWDf8UqVdukaH3d_0 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18138791664763069344', time=2024-09-14T14:00:31.156815+0000, chain.objs.size()=1 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.465__shadow_.fqHDWYTmhqZkw0pB06PiGjxjI4lL7Y3_0 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11421427483206260629', time=2024-09-14T14:00:31.842052+0000, chain.objs.size()=1 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.466__shadow_.idzOcvsCvS5XckBFwByzkOIoOG126XW_0 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8790798578872602132', time=2024-09-14T14:00:38.388456+0000, chain.objs.size()=1 2024-09-14T12:16:14.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.651+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.481__shadow_.LErw4sAc8wXBeMkN2EP4cRy4RjS23lu_0 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.652+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1401098825245195023', time=2024-09-14T14:01:03.712113+0000, chain.objs.size()=6 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.652+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3817319716662843731', time=2024-09-14T14:02:36.525003+0000, chain.objs.size()=2 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~N4hY_zmz-Y5gWILO7CmQbmSkgc7G8xz.1 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~N4hY_zmz-Y5gWILO7CmQbmSkgc7G8xz.2 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9351112849993761010', time=2024-09-14T14:02:58.100733+0000, chain.objs.size()=1 2024-09-14T12:16:14.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.528__shadow_.MaCk1sQ9IoSGPlvSdHEcQZgWtgy74Le_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15047687870597312830', time=2024-09-14T14:03:44.971533+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.550__shadow_.ZVIL_VwvsflSAs9lgGisa_H7Y40WGxJ_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9839907884871540728', time=2024-09-14T14:04:21.421266+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.653+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:zCtblrdCD5rByaCw9LHi-kCgsTDD-nT_.ALms6db0rJg7wezgA5Bp9ushsUlB-lU_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.654+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13852032379904020828', time=2024-09-14T14:04:40.438703+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.654+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.575__shadow_.bYz6wuxn07_NSztFbOgsRgDTmLF2uAb_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10549280153854553451', time=2024-09-14T14:04:54.788132+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:I8Jx6GfcufyWSKo5--btw1OJkkzuGts_.1d-m7sH6Oe4CHq2n8IwkGtp7QJQNPPe_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9038005387684268558', time=2024-09-14T14:05:05.713071+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:zAXjtB1cu-6Tg9fuTTmGDQJHaoX5Yz._._VSHyJ_TfdhflwXQh8BGTUrGBKGnTZB_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15487550887870238776', time=2024-09-14T14:05:21.788442+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:N4DHki1uAxbz6.N0yc-4dQOIuOxIK2T_.NNL9ciZOwRhs8g4E28V9xTItbTuWImw_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2792620419097035947', time=2024-09-14T14:05:23.983462+0000, chain.objs.size()=1 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:j0nCjM207WjAZhz8TjJiV6.PcJgLrCe_.Br6YReF9eSxKmy1PZKWvLwEQRJ3LpoX_0 2024-09-14T12:16:14.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6902714398053984056', time=2024-09-14T14:10:29.324742+0000, chain.objs.size()=1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.696__shadow:GgazisSpZDzKzB3QyDEOoVRJdaN4d0T_.7lmGuBjnID0ezexT6sr7NY7nyypuw-K_0 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7455248294360940636', time=2024-09-14T14:10:33.625208+0000, chain.objs.size()=1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.702__multipart_file1.2~T2oM3rPqobXJPxEBqgba2HHljdneH7E.1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14890095987257275341', time=2024-09-14T14:10:35.876405+0000, chain.objs.size()=1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.705__shadow:COoITFahaVH.gd8fKv8SbK8tU6iCvH2_.nln0hyX4yQodmZGtoQ2o46ZlvrIUzXZ_0 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5417526458063143630', time=2024-09-14T14:10:39.224906+0000, chain.objs.size()=1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.710__shadow:f-BE8-P2PV2akDvXjVm31fTH87zQR18_.1bJtfGyTGBh5P6Ztlp-MqrpOdssBKWP_0 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11984597908455073036', time=2024-09-14T14:13:22.846913+0000, chain.objs.size()=1 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.655+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.764__shadow_.OvCSXw5IxvE6l9_KybeZ6WlvzGlfWEO_0 2024-09-14T12:16:14.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.657+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.659+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:16:14.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.661+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.661+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50480' 2024-09-14T12:16:14.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_dvNSPsaVcWmtoPoYIlPY2cuizzwBT4N', time=2024-09-14T13:53:24.077920+0000, chain.objs.size()=3 2024-09-14T12:16:14.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.Owf8fVP0OwIeKCn-RTAlSg8Qp3DgUyO_0 2024-09-14T12:16:14.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.Owf8fVP0OwIeKCn-RTAlSg8Qp3DgUyO_1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.Owf8fVP0OwIeKCn-RTAlSg8Qp3DgUyO_2 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5093995984191868942', time=2024-09-14T13:53:50.548598+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.189__shadow_.eincbHlNOcc5qfl79UqtZi8GZbsNfSF_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15729724765227424669', time=2024-09-14T13:55:34.502624+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.234__shadow_.vsnpZaHK-YjWAtkfhGpHI5x88rcl7Cb_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4871432849042623351', time=2024-09-14T13:55:35.914869+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236__shadow_._Ranfx8HqCblOwxKMMaXCkhnGSLpBX7_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18331386141176306926', time=2024-09-14T13:55:35.919669+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236__shadow_.9JCAFl5lylOiU7dzSE4tXAMUQyfKY5H_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5272078260285470005', time=2024-09-14T13:55:44.520913+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.247__shadow_.VPLpOFEGidUNNB3Fha8B5JEmE9Bd9-p_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16500444318874960026', time=2024-09-14T13:55:53.428456+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.260__shadow_.7XE3IOKFjVajhnWm9Eb8KYChNPox_LH_0 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7539165482367819312', time=2024-09-14T13:56:29.626794+0000, chain.objs.size()=1 2024-09-14T12:16:14.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2Dfv_vSyjb77g_jaEqUq4MRalB__0LM_0 2024-09-14T12:16:14.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8731719104079092365', time=2024-09-14T13:56:30.037079+0000, chain.objs.size()=1 2024-09-14T12:16:14.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7mkn_iAkis74EmDsReQKUao22ayA5me_0 2024-09-14T12:16:14.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11439588866620884936', time=2024-09-14T13:56:30.401943+0000, chain.objs.size()=1 2024-09-14T12:16:14.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.662+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CM_nFhKLLk58KRLxRM-_04mSkHZtGAj_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11822402310281128830', time=2024-09-14T13:56:30.530419+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jCxJAIkI59Fcxjf510sx8X2jSYi4--F_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17189429504908701646', time=2024-09-14T13:56:30.639900+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.skRsB4bHAKJuSJxrY3_K_FrwHjXzI-k_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13789921016725754022', time=2024-09-14T13:56:31.166028+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3Ee3xsNmYXq4ES38WRqvcRhJAXGY22O_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13129329123898124188', time=2024-09-14T13:56:31.695141+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6bnHMnxJpXDA3DhlJQCayFzDrhFcDJO_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6940176278581104661', time=2024-09-14T13:56:31.729345+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.93dwfSfLTrn3PSPlgQfJgC0V_FvXYZ3_0 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5301371628913996740', time=2024-09-14T13:56:31.831381+0000, chain.objs.size()=1 2024-09-14T12:16:14.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oAB830NcGfMMCDE3-JJJ30EMvb0vYk3_0 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12469923826003348563', time=2024-09-14T13:56:31.831863+0000, chain.objs.size()=1 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oAKkZF0LbH43LnOuVbf_72slISE5yCK_0 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16748156937058356966', time=2024-09-14T13:56:31.853598+0000, chain.objs.size()=1 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wxUO2INxfVIlldZJeJG90-YNm7PBtwr_0 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2877025433306851715', time=2024-09-14T13:56:31.991244+0000, chain.objs.size()=1 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tQBok94myJPTuKJx2-RqItgibaU9Tc2_0 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.499683175710244902', time=2024-09-14T13:56:32.624359+0000, chain.objs.size()=1 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uX4GiKak7ZAsdQJBoBe1WqFq8WTGTMn_0 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7146479105091845031', time=2024-09-14T13:56:32.639028+0000, chain.objs.size()=1 2024-09-14T12:16:14.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.665+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.huK3I2rjigv5JCG3TLixXTiKvqgeySp_0 2024-09-14T12:16:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.666+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10596546836398015759', time=2024-09-14T13:56:33.278258+0000, chain.objs.size()=1 2024-09-14T12:16:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.666+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pdj5ne0o8MusAdBi8Q_BiFjhlc2C1VY_0 2024-09-14T12:16:14.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6205780028637931168', time=2024-09-14T13:56:33.358219+0000, chain.objs.size()=1 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iVaUB43zdryyhNyInsCSXm1G21nzHLP_0 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17073583726844763698', time=2024-09-14T13:56:33.528352+0000, chain.objs.size()=1 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7FmV7hdb9TnxEkNr_fCqwWEkAftB1zg_0 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11082324461339109371', time=2024-09-14T13:56:35.575933+0000, chain.objs.size()=1 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JqAGq0bEfuIMcy8de3IVDnM8APRWgc7_0 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7953790030630322948', time=2024-09-14T13:56:35.576931+0000, chain.objs.size()=1 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.I2q15CFZ9w_i0bC8ScWYkbuo9gVtGy3_0 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18233600137543059590', time=2024-09-14T13:56:35.747187+0000, chain.objs.size()=1 2024-09-14T12:16:14.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XtX58OtodhRmQgRAiCYLuS9D4WMAbkP_0 2024-09-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10315396959696715792', time=2024-09-14T13:56:36.059983+0000, chain.objs.size()=1 2024-09-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UNZaulii02FIV9BfuGo-NxUxTqxtVt5_0 2024-09-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14357482401791077178', time=2024-09-14T13:56:36.752536+0000, chain.objs.size()=1 2024-09-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3gMsc_mMywlANUHeYEQwsKxu9f4ZLlb_0 2024-09-14T12:16:14.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7182171556915599550', time=2024-09-14T13:56:37.305958+0000, chain.objs.size()=1 2024-09-14T12:16:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OEXO80P40sKUb29nyr0vg2XAlpndLW1_0 2024-09-14T12:16:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16264037914764734663', time=2024-09-14T13:56:37.658965+0000, chain.objs.size()=1 2024-09-14T12:16:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.667+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yI7ZHbg3LrAb8MHp_136FVHAGgrj03v_0 2024-09-14T12:16:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5495568529362855151', time=2024-09-14T13:56:38.489551+0000, chain.objs.size()=1 2024-09-14T12:16:14.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.W0fe4_FvEXhMJENEeTWXd0d3kB5o18b_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10442404057830744148', time=2024-09-14T13:56:38.559420+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vQO_YDYPL82HZJ88mfodC6r3Bl5EjqE_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14712742605029962885', time=2024-09-14T13:56:38.592213+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HcaUSOS1dj0UuYdtUVO9cTvJ4CHECE6_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1108993681142286804', time=2024-09-14T13:56:38.895166+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.668+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cLEWDtvQ0fuVHgI1nK_icy3K-cWgmiq_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4010024140804290813', time=2024-09-14T13:56:39.076635+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BDYpJiPxKIyUavFezz6NC0Dz_ClwKkC_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5619884068541450162', time=2024-09-14T13:56:39.128491+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mwE0v6MYTKuxordLLO7630zn07JTY-l_0 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5125380505009143858', time=2024-09-14T13:56:39.217978+0000, chain.objs.size()=1 2024-09-14T12:16:14.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.669+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nPdKXvPpUJp_9xp_ZA4qm5nsorzjFVi_0 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.670+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13783190466835572076', time=2024-09-14T13:56:39.519359+0000, chain.objs.size()=1 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.670+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tOXGoH8GKVPAaAbFNDyVVCwnuP-NThW_0 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6578803503067445424', time=2024-09-14T13:56:39.520747+0000, chain.objs.size()=1 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.783GIj6mP6tqZOwM1OHzy7w7arUOIFT_0 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5787537751719574835', time=2024-09-14T13:56:39.563584+0000, chain.objs.size()=1 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yjeUz9ML3PNxD2qUEcJan0NwCirjW7M_0 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.751701356207121786', time=2024-09-14T13:56:39.847422+0000, chain.objs.size()=1 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LLTMPYjZvgxoMgDS4Ezy3Tyv8ERVfih_0 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14772042868640063294', time=2024-09-14T13:56:40.212610+0000, chain.objs.size()=1 2024-09-14T12:16:14.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.672+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GBBC00iJecJeNVaONXwFl5cisFLZdn-_0 2024-09-14T12:16:14.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8905771640669896351', time=2024-09-14T13:56:42.984742+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.266__shadow_.Ib6R1US-sT1Bg8rDUmQEYVnyxy5-Wtq_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3341275036225450795', time=2024-09-14T13:56:47.569709+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.273__shadow_.atZbw12tW_h35xdPGD_u9PUgPb03aXO_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6985865740154262548', time=2024-09-14T13:56:56.682711+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.286__shadow_.dJ8UT2vu7_q2mFsLCMkR0keMGlqdOpv_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5468343981065865850', time=2024-09-14T13:57:04.094358+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.8byx8rkScysKJcn4SHkLw4zM9YhfgWw_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1912630078785413821', time=2024-09-14T13:57:08.589869+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.299__shadow_.I5VoUzIMSXBqDwDEG0o9heIcyd0A95V_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12163570087261443187', time=2024-09-14T13:57:20.658172+0000, chain.objs.size()=1 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.315__shadow_.qVllwzFq2xfWgqVhuixftiBwJVE9RhW_0 2024-09-14T12:16:14.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.144935104084423341', time=2024-09-14T13:58:02.216952+0000, chain.objs.size()=1 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aHMIBO1aWJ9zpGsD0yJ5_231D1X2hJg_0 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11089428955483189013', time=2024-09-14T13:58:02.468680+0000, chain.objs.size()=1 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qSEwDJo4TychMtzS57whAWk_oMbLwRd_0 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17452025342770015815', time=2024-09-14T13:58:02.509653+0000, chain.objs.size()=1 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8vO-PkEj1zCmx87-SIDoZbyojHLkSz5_0 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8501397075562675836', time=2024-09-14T13:58:02.695261+0000, chain.objs.size()=1 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6MAZ-NF4yMTV6BrnxXaVdf3rj4-eH0F_0 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.965266043547653991', time=2024-09-14T13:58:02.734434+0000, chain.objs.size()=1 2024-09-14T12:16:14.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.873+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LzXsuBzkI08zVIzQn8Do4-aMt0rpwxh_0 2024-09-14T12:16:14.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.875+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10922721607034754168', time=2024-09-14T13:58:02.769865+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.875+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Xg1icaPJdPk031mK3c2Os_coHBhN7nm_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.875+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6652164439994402319', time=2024-09-14T13:58:03.106321+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.875+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nBAk9kARsr6XoZ15VySE284a8Rclmue_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2768150806788848927', time=2024-09-14T13:58:03.107423+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.e5pRYV5LwmwHn8HCTEjwUfp2pMJdEC2_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4976597084407710139', time=2024-09-14T13:58:03.146085+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qgyDC79U3oekjbzjRMet-WFZX4eXGqT_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12601792753493247871', time=2024-09-14T13:58:03.733829+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Mmwlpfnnvbq1VWaClhsSyfetkC4xSbi_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9170224690610593887', time=2024-09-14T13:58:03.885319+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2VTQ5ymzILk6CyKfjJFqg3PkexZHUXe_0 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12742978459226510114', time=2024-09-14T13:58:04.327232+0000, chain.objs.size()=1 2024-09-14T12:16:14.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cEWQ41tIA37-XX8Rodh_WHPPgHV8olx_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12578466348018779454', time=2024-09-14T13:58:05.202485+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.iJ8yf-nj6t1NaxHKLDGOW7yBnkhnyog_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13163285278655501505', time=2024-09-14T13:58:05.283724+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kOXc1p-K36UwniQeFcGSCZyD4HFahHm_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9209839167609407103', time=2024-09-14T13:58:05.480560+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CBQpYh1WNejl6EkzOjp2zd2Zhk8Lsrj_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18029945456118577911', time=2024-09-14T13:58:05.985864+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.876+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IQrRKq08RW0EF3faoce4xkEF3P1CfCv_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16612023494578636356', time=2024-09-14T13:58:06.006851+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OcRaGdFrq6c5sE5FMKGQgbP0Uar_twt_0 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16067189038088792603', time=2024-09-14T13:58:06.576934+0000, chain.objs.size()=1 2024-09-14T12:16:14.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KAANE2ajThRUkklUx7DG089RYDGEdgm_0 2024-09-14T12:16:14.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16606511183040517186', time=2024-09-14T13:58:07.453226+0000, chain.objs.size()=1 2024-09-14T12:16:14.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.877+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qTgBsZVb-TFtZRlXR-bOTePrZf6jTRC_0 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16531162672166661206', time=2024-09-14T13:58:08.054412+0000, chain.objs.size()=1 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cliwMtqO91Q0BIlwLg7BM2zhcUW0Vka_0 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10355471908037695786', time=2024-09-14T13:58:08.380117+0000, chain.objs.size()=1 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HEqnOTPtiMAN2vgrrnPZ1dzVEjmobuk_0 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8363968527099677768', time=2024-09-14T13:58:08.524153+0000, chain.objs.size()=1 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.878+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i3rv-xEArULbhuvcGzFBcM_Ok2NzI8-_0 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1066573462588954233', time=2024-09-14T13:58:08.577113+0000, chain.objs.size()=1 2024-09-14T12:16:14.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aNOJondKgrIi7qJDqDIHZ0bjh3FVxtS_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3535772032682612332', time=2024-09-14T13:58:08.649142+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZdBMn0lweSeyqAlyh5Ma5vYC29gH4vz_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10848473904893173212', time=2024-09-14T13:58:08.813866+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3Nxxm3psfDIuCNdYsOjkMY_2GjPBh8D_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16920625629787476285', time=2024-09-14T13:58:08.858897+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Py2Bk7Uh8nmQ7CchRm-pqIjQlA7277x_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12802931539351867958', time=2024-09-14T13:58:10.037670+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NqFGeUowI63y8x-R3PcMSHRC6pEH_Qw_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18253941785825229766', time=2024-09-14T13:58:11.145570+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EjhkE1EctFFnX7CB1ZiBwTkLx0gzG3C_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4674042697024986288', time=2024-09-14T13:58:11.312129+0000, chain.objs.size()=1 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HNFWf5PSVU453IfIoHgAnkt8YZ6aSmh_0 2024-09-14T12:16:14.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13986384627525410171', time=2024-09-14T13:58:11.517159+0000, chain.objs.size()=1 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dbu6gy56lsgiSooGHW66N26G6-zIg0u_0 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1659830444348644349', time=2024-09-14T13:58:11.967469+0000, chain.objs.size()=1 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.w43fyw1vDqfq4c6R0O6BihSRuQqvaP2_0 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1442024359860650581', time=2024-09-14T13:58:49.304433+0000, chain.objs.size()=1 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.879+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.B2KBDWykVd7mXd-JEXg53Jdyi0vAMQd_0 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.880+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7483138559208391737', time=2024-09-14T13:58:50.021700+0000, chain.objs.size()=1 2024-09-14T12:16:14.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.880+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FcR1Ka9sQbn7ezxUjoS4ZdNkvj4-kOG_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3867471295480039327', time=2024-09-14T13:58:50.565675+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.D34fj1mWyQ7E_RMlFXU--KVVaaRPZSJ_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1202182549883032221', time=2024-09-14T13:58:50.761884+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ekXCe-OQ8ejp7Z1R8E9PshIgKcSTBdg_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14492040115813325008', time=2024-09-14T13:58:50.954967+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ovkaUI-2D7a5mG6JOVXcAbLqjlPy3QO_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9160403964878376383', time=2024-09-14T13:58:51.527412+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-wEjTskdt8oFNEt8pL_uUarSGBdHb53_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16188603222550199340', time=2024-09-14T13:58:52.102236+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KHX3KN38uuvjNjeejW_qXOxQwVk6KYD_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2241409013699133481', time=2024-09-14T13:58:52.681974+0000, chain.objs.size()=1 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7f6jjj_o0I4TetqXVnT4DyojRM5LwBW_0 2024-09-14T12:16:14.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15104393582142459616', time=2024-09-14T13:58:53.404954+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pXVYPx_c5sHKvGzA0TIFXoiIWFILEI3_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11116939741968075037', time=2024-09-14T13:58:53.406020+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._Rq1AV6S6B6H4W-sy7VEBgHFbKU1Ll7_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13663259868029718054', time=2024-09-14T13:58:53.417736+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zRJImOYWtwaBf-Yu1TYklVhFgcgjOjC_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7451417056915032967', time=2024-09-14T13:58:53.557252+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XTvZBkyNf8RG6ckEROQg91C2VIgCh6J_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13143219725916588533', time=2024-09-14T13:58:54.021116+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.881+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.szGbedYpXsoefVtQVA6fiUo2QyX0FCc_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.883+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9441612315869527894', time=2024-09-14T13:58:54.253537+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.883+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xiPHuK4gg-MUULjJ8yNssgcvIck3txK_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.883+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5263154846142601245', time=2024-09-14T13:58:55.016846+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.883+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JoYloiVAiisc-ww-Xt6QNom7yGoEhvJ_0 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7565037021626816916', time=2024-09-14T13:58:55.501426+0000, chain.objs.size()=1 2024-09-14T12:16:14.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R99oFJsww4qiaVpOR1yyhZM7H5OlxCh_0 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6869219788388983211', time=2024-09-14T13:58:56.564499+0000, chain.objs.size()=1 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zUyYpZ8f7xAuetsbNeSmRoRl27fIu1c_0 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4058615777439826826', time=2024-09-14T13:58:56.565103+0000, chain.objs.size()=1 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4IcPIB2NHie5JUckHIgFFhAthlnRmyJ_0 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6446483770134918291', time=2024-09-14T13:58:56.872519+0000, chain.objs.size()=1 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0bXlKAQhWB4GRL8ng6H0SzYe1CHD7ue_0 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6950329383695952046', time=2024-09-14T13:58:56.950597+0000, chain.objs.size()=1 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.884+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hUSk42LgBgepQ4281X950wtMpzHk8Q__0 2024-09-14T12:16:14.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.885+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/50480 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15277927224641272959', time=2024-09-14T13:58:57.374035+0000, chain.objs.size()=1 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6CIbJRBEtgZdDRufIodzTfqM7grMVSv_0 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18137955745916687770', time=2024-09-14T13:58:58.276200+0000, chain.objs.size()=1 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8dGor5_QGefVORok00l26qP8xhoGY1g_0 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15664547215934699575', time=2024-09-14T13:58:58.305562+0000, chain.objs.size()=1 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eLnDkKdR8T6HYWZmi_mhdZU0QX0NSV__0 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11819834713641844457', time=2024-09-14T13:58:58.359144+0000, chain.objs.size()=1 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eMpDsujdRxshxMYvNNtA1V_etJS7ig8_0 2024-09-14T12:16:14.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.527998411569874238', time=2024-09-14T13:58:58.667469+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WRdDm4x4W8685qH8N5oWYVuM9vyZe4o_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.357071832473653696', time=2024-09-14T13:58:59.401750+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZSkxRy-vuyyUK9H5cj7Mh5rzpUX99Ih_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16532309018646042095', time=2024-09-14T13:59:27.509342+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.373__shadow_.xt3DWnxUG4Ht-XNJjpwWfH7mTcFBviu_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4565026895974670120', time=2024-09-14T14:00:40.595639+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.P71bIljbekUrbeZNL-IekrC7x2GwWqd_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8601118127429242330', time=2024-09-14T14:00:50.403652+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.495__shadow_.WHZm4Gjx9-lai8cj12fYcqq1DGviSz3_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10089261601426216574', time=2024-09-14T14:00:56.320238+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13316005211470049859', time=2024-09-14T14:01:09.522653+0000, chain.objs.size()=1 2024-09-14T12:16:14.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.516__multipart_mymultipartcopy.2~KqGOf_eMSXiG9kwoNs2odu_SL0EB0_y.1 2024-09-14T12:16:14.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16796764630554780060', time=2024-09-14T14:01:50.556396+0000, chain.objs.size()=6 2024-09-14T12:16:14.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.888+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.uL4TTiO-XruhuUJezjq87EnLYHJADCLJ.1 2024-09-14T12:16:14.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.2 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.3 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.4 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.5 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~rHaBGAPHuMTRm3nDZKjdEOuv0bEzr3A.6 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8390513634170810146', time=2024-09-14T14:02:00.803918+0000, chain.objs.size()=6 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.1 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.890+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.WS0SzrC88TbgmPCS_yoKdOFSMe260QA9.2 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.891+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.3 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.891+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.4 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.891+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.5 2024-09-14T12:16:14.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.891+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.6 2024-09-14T12:16:14.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17456740796347493028', time=2024-09-14T14:03:27.501317+0000, chain.objs.size()=1 2024-09-14T12:16:14.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.537__shadow_.SEMkKDYf7-KWcmMEAdSi9M7if-a-LwZ_0 2024-09-14T12:16:14.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10930322536711070173', time=2024-09-14T14:03:53.696430+0000, chain.objs.size()=1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.554__shadow_.ohJAWcf89dqfSU0EIyJeFwnFaIH1MPR_0 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17583755636220654449', time=2024-09-14T14:03:57.065276+0000, chain.objs.size()=2 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.555__shadow_.s1mOOeoGD7_JwLP5FNzS9M2yUU19rnw_0 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.555__shadow_.s1mOOeoGD7_JwLP5FNzS9M2yUU19rnw_1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.831683846638768612', time=2024-09-14T14:04:08.010747+0000, chain.objs.size()=1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.559__shadow_.kMEHwfxHhP7prB0UcGVyCXztVfZfLZ3_0 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13470379466963649887', time=2024-09-14T14:04:09.556642+0000, chain.objs.size()=1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.561__multipart_mymultipart.2~4FP7wpMzljWG7q2JoVaNFaIpBa4X17Y.1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12724746573372013817', time=2024-09-14T14:04:22.540896+0000, chain.objs.size()=1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:y1cHNQR.NCiUTvGHwNFqBSkRDESyzmF_.KCRwOwLxrdhw8K3blsKUBCoIYRS3DNU_0 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13730251441020233038', time=2024-09-14T14:04:23.474045+0000, chain.objs.size()=1 2024-09-14T12:16:14.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.892+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:uNhDsI9TjfHUzpF5M6raiHIGdnsfowu_.h_1aRoXupZbBPlAd1pwsOrj-hwQKqx2_0 2024-09-14T12:16:14.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.893+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11135266983285202699', time=2024-09-14T14:04:50.686206+0000, chain.objs.size()=1 2024-09-14T12:16:14.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.893+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:TW-BmAEY17XB03b1xcCZB8XXLFxQSXG_.1DYZ-k_nT_DCirvR_J5mmnIVrJ5TeTe_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.894+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16996703453290209207', time=2024-09-14T14:04:55.359337+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.894+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:CAzcSOiQ8MzhrRr5yFB38xzb7-mZ2ID_.GUBXWEfj_UUkeWkOPUjIfBVlfDHvPmC_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.894+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3723088002374567019', time=2024-09-14T14:04:58.653720+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.894+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:Rt8xKwn6TywggC7NcL3Sv5MsQY767Qx_.0xoi9Gn0-c_911tZ0HaiwdkCwz4NYNh_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9091877569019017363', time=2024-09-14T14:05:21.920149+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:hnlozdl0CZnsLEpmevM.Dr0E0gEyhSV_.QhFMXvTpeXohTNll1huN8OK7AXJvj3W_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17687156898268753675', time=2024-09-14T14:05:24.891848+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.582__shadow:fYIIQemoHpLykSPuRFum92DeNabEWw._.WV4aGVVlHFBrYg0BuQLVH7Lk-zdRdco_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7386355348091743599', time=2024-09-14T14:05:29.023968+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.586__shadow:jmECagKWNvc5ynYwX1mjEt7pLsqqHot_.Smrvre0puqfIAQQuq8s987ReAgR-njI_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8165965639515254868', time=2024-09-14T14:05:30.604259+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:HBIVBWsU0tvPSBHi5KlPIEHksQlDOkc_.UidzzwzcNAMaA3_e64nst4UVDR80KwE_0 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4652276534382224068', time=2024-09-14T14:10:19.515405+0000, chain.objs.size()=1 2024-09-14T12:16:14.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.895+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.679__shadow_.XFxOHCk7NO8ySnIwAqvoatnKroQSrHx_0 2024-09-14T12:16:14.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.897+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.900+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:16:14.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.901+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.902+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46060' 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_Oo2Ll02yzOH2D8iWrkpy5rAFeAoTZIE', time=2024-09-14T13:53:14.083071+0000, chain.objs.size()=1 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.5ViDtaCXZ5_LYZc0TxyuPgnsYMrkZRg_0 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_K5jM0T1h9NXBPE4aScKhN58Y0abNU5o', time=2024-09-14T13:53:15.612191+0000, chain.objs.size()=3 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.VOrKGa3FkCMrAOxKD5SpL2FcGuSVn3F_0 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.VOrKGa3FkCMrAOxKD5SpL2FcGuSVn3F_1 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.VOrKGa3FkCMrAOxKD5SpL2FcGuSVn3F_2 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_nlBbpJ5SOEj6BdvP5CBOYSFHGTn_phY', time=2024-09-14T13:53:27.770936+0000, chain.objs.size()=1 2024-09-14T12:16:14.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.165__shadow_.PS003rwooNqCyaS4u61LNQBWhmAhnSI_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1458786335342495673', time=2024-09-14T13:55:33.806171+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.233__shadow_.ebLLfLtWY3wQDyIESyYfFsHOZnaiz3j_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.470351819946205050', time=2024-09-14T13:55:45.205751+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.248__shadow_.w6qBfL9qvllodc3iE8pb7Tv3VlCW55f_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3496542022689916512', time=2024-09-14T13:56:29.857747+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oHCpKGOo9MTCAAGVpUJuSFlzzfZeTpm_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12283598560547943137', time=2024-09-14T13:56:29.974415+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.K8Jpu4ErK_1nlCrBNvqxryObULQJioF_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9263558738971980723', time=2024-09-14T13:56:30.405404+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5rnaFO654ozF6oY7wFo0PnL7IbLqaDc_0 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7126671112819779420', time=2024-09-14T13:56:31.364763+0000, chain.objs.size()=1 2024-09-14T12:16:14.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.23C0iilavWAwMLPTSqntBArJ4Se1B7X_0 2024-09-14T12:16:14.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11022797973588771777', time=2024-09-14T13:56:31.890573+0000, chain.objs.size()=1 2024-09-14T12:16:14.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.903+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.p1u4-WIBr3POu2I07zTqlt4MeGqd1HP_0 2024-09-14T12:16:14.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5876662501622771098', time=2024-09-14T13:56:32.194429+0000, chain.objs.size()=1 2024-09-14T12:16:14.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bflz4R-7vMLea81guah51lJPb5dCwEk_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9704446023766035867', time=2024-09-14T13:56:32.211764+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hFGLqoNbbp-nAROJOVkhP3Jn5Jmx1To_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4305306191850029901', time=2024-09-14T13:56:32.678384+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BpM5aGspDNfh3UR92_VpufJ5qQKjEF6_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.268513496552472060', time=2024-09-14T13:56:32.803648+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5o0PF-jIufhHiJ2fI3rI4HlVvQ_DD-2_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7611249253530283111', time=2024-09-14T13:56:33.640261+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PURkYrH1bsv2Hz-TQVBqzGRMkDOXsj0_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6117763202136010718', time=2024-09-14T13:56:34.048063+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1bxUlF3JaM7cd6LKSs_vn1tl8tL0uWr_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.905+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10746232119142224517', time=2024-09-14T13:56:34.477336+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-K2hO1pJliWdfG1ywhXj-z9Zt-RUJzq_0 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13526030858866328193', time=2024-09-14T13:56:34.569875+0000, chain.objs.size()=1 2024-09-14T12:16:14.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.c_UTPPWb2QZM3W5PhrezVwAmBv-Yzt8_0 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3466240001016071148', time=2024-09-14T13:56:34.828293+0000, chain.objs.size()=1 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZZOF5ddNHUi3nQIeR8yJW5eME-mENih_0 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12476793499562877661', time=2024-09-14T13:56:35.711290+0000, chain.objs.size()=1 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.geGD3FiOwd53fMOHs8FTqtODEtv_R69_0 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6687796293650374084', time=2024-09-14T13:56:35.928192+0000, chain.objs.size()=1 2024-09-14T12:16:14.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OgeoW5iVZgjBrIRHmcxkHzxoGjarxL5_0 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2724914900990885689', time=2024-09-14T13:56:37.467607+0000, chain.objs.size()=1 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.906+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Bi3kfTUOgLtD35BRub0YWv42Yg2vmoo_0 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.907+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9863845604267511902', time=2024-09-14T13:56:37.468340+0000, chain.objs.size()=1 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.907+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Aq1QQBuwki5gREpdVd6XNpM4tznI_J__0 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6845207104047198713', time=2024-09-14T13:56:37.742881+0000, chain.objs.size()=1 2024-09-14T12:16:14.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qkpri_m2IJwv_Ieo3g8whB7oEtMghJN_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.427282519380902811', time=2024-09-14T13:56:38.235442+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wSAnEUB3zw9Ekofcqjy2rBmD4PvllmO_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.52879991027902874', time=2024-09-14T13:56:38.442165+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.zqzexWpwViH8sgpND-g_ZnP4pdC0DFM_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16824532996834017522', time=2024-09-14T13:56:38.648741+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jWnJmCs9KITpRQaGcuminte-5CaPi7s_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2267017640920171654', time=2024-09-14T13:56:39.208562+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.zO8uoXQHDdUEibxDdf1bGK3jREng3vB_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8807801664967824605', time=2024-09-14T13:56:39.479203+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nmGg_9hKkGAm4SHJ5tPfGiL9GlhpRoN_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12470763159375450407', time=2024-09-14T13:56:39.645592+0000, chain.objs.size()=1 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wVIuTHoKReKTHy8JH8tgDDqRUx3qiAg_0 2024-09-14T12:16:14.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7476726490077924662', time=2024-09-14T13:56:39.812094+0000, chain.objs.size()=1 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BuR5G0989hgwvm8vr95JDycsruYpByv_0 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1097006329317900434', time=2024-09-14T13:56:48.210973+0000, chain.objs.size()=1 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.274__shadow_.6CqBKeHGND3tYBtkkDSagAUbeegRU_U_0 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15332959371903292385', time=2024-09-14T13:56:51.692010+0000, chain.objs.size()=1 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.279__shadow_.U0odCiCCTuIZk8FyrLXNUQZeCZcSESG_0 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14970201003327251276', time=2024-09-14T13:56:58.738548+0000, chain.objs.size()=1 2024-09-14T12:16:14.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.908+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.289__shadow_.5bSUcRT-OybxJzoyY9DIDv7GmIe5Tow_0 2024-09-14T12:16:14.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.909+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2388331208542837176', time=2024-09-14T13:57:02.257646+0000, chain.objs.size()=1 2024-09-14T12:16:14.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.909+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.sxpAmmL04c9uE48ND-mqamfjLVAwlSU_0 2024-09-14T12:16:14.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7189932277805655991', time=2024-09-14T13:57:02.258234+0000, chain.objs.size()=1 2024-09-14T12:16:14.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.XaoK0AuJ3s9JY7MY0c_RFk23tS-496T_0 2024-09-14T12:16:14.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13754283371261060516', time=2024-09-14T13:57:04.117964+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.3EJ2S37VNb-bVLvYwiWDhLyydJkgYE2_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3272712205873406177', time=2024-09-14T13:57:04.153461+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.1aRIEo6hGLTr7zdmkTUbY2iSBK9XV_q_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11472932296548995487', time=2024-09-14T13:57:09.998366+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301__shadow_.VoWSznOB3JqY577a0DdZd1-JkwKlWR6_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13767524264197439723', time=2024-09-14T13:57:10.725009+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.302__shadow_.y8tfq-7C2HFNtvCMuK8yg3qIKUzV3rA_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7792792999704275232', time=2024-09-14T13:57:11.412986+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.303__shadow_.scFmlSwGY_kRmt0__wFdoozg6xTurGi_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11867706220360440556', time=2024-09-14T13:58:02.643797+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4CEENpa6uCRn79Hg-eNMJ49BGV5bzxS_0 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14024207550123706848', time=2024-09-14T13:58:02.701552+0000, chain.objs.size()=1 2024-09-14T12:16:14.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.soC6skzpdRE6EWThKqLVJctcMXz90KR_0 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16141182443964214758', time=2024-09-14T13:58:02.983854+0000, chain.objs.size()=1 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IoiiHlmcldkwfgE0VhflL2qPz4yP2_b_0 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4625571264579806497', time=2024-09-14T13:58:03.218975+0000, chain.objs.size()=1 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.910+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.j9tPKlkqlajg0AXnXWNbG5qrUkiHjxt_0 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.911+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4704191189596445776', time=2024-09-14T13:58:03.746712+0000, chain.objs.size()=1 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.911+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.12l1yQEmzPo5W7kbg7XucGlJ4q2qYKm_0 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.911+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11860216288540021956', time=2024-09-14T13:58:04.361160+0000, chain.objs.size()=1 2024-09-14T12:16:14.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.911+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hMexFMKHBbyZBllchojfAfytxjyWp4d_0 2024-09-14T12:16:14.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14718450253209303741', time=2024-09-14T13:58:04.448745+0000, chain.objs.size()=1 2024-09-14T12:16:14.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XvLnytDqIR86kLweAgyHAOQV0as9BIx_0 2024-09-14T12:16:14.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14131328461199158151', time=2024-09-14T13:58:06.170553+0000, chain.objs.size()=1 2024-09-14T12:16:14.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PUgFLyhglWD8fHk3pOanNdug9O6-ZM__0 2024-09-14T12:16:14.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1610725767707352571', time=2024-09-14T13:58:06.712443+0000, chain.objs.size()=1 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0yC5XzwQJqR_aqt67HfHJVpT-lpi2Xu_0 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2365113767241353979', time=2024-09-14T13:58:06.859357+0000, chain.objs.size()=1 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7rmzcX_tzNiEm5ytIneGzjx39KE9qEg_0 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17672435844940061094', time=2024-09-14T13:58:08.032567+0000, chain.objs.size()=1 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NTMF9UnJNy-ULuu450HgP8oSAs5a3tD_0 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12414562838439462606', time=2024-09-14T13:58:08.117491+0000, chain.objs.size()=1 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Suio_EBpBMU-P4aZEcjYEOzrrfsUGfW_0 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8710240536844513164', time=2024-09-14T13:58:08.231526+0000, chain.objs.size()=1 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.r2jC7vT1uCfeoivINcfvGRQ5kYVes3s_0 2024-09-14T12:16:14.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1022554805760824795', time=2024-09-14T13:58:08.232202+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Tf-dj2j_Uj9FGsj_DcoKjMcTfBvtfPP_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6580421438498821466', time=2024-09-14T13:58:08.413384+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qwogiw2cZy0v9PZgX3kIjmOtVN-HOrv_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1907154060004950351', time=2024-09-14T13:58:08.880146+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.912+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GHxFmJa5CJ9qdWCI6RfD00un1N8IMjT_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.913+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10404526391150899595', time=2024-09-14T13:58:09.266706+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.913+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XLcbeTVN4h3CISO8jUUL8VtKh2D9yIJ_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7586908121879214981', time=2024-09-14T13:58:09.399523+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.p-D6zJ8Mvjhm_cThQLnj2aO9z39OxS-_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17421957250468033000', time=2024-09-14T13:58:09.436229+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.v0vLOAj9FiUz3tKHB1qtPp-Gn_FuRLr_0 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3360650682968782569', time=2024-09-14T13:58:09.497012+0000, chain.objs.size()=1 2024-09-14T12:16:14.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.C8yJoa5Whu9sMsXu6JpyOWecNSDWM_A_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14580994663420601497', time=2024-09-14T13:58:09.589589+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.atD7Wf6gvDZwIqxEl09AHxEfZKHgTWv_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3282777405204693654', time=2024-09-14T13:58:09.886263+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fNEjHHK4UwDEtPVO_b48YoynsHrJqXJ_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.415379147709231459', time=2024-09-14T13:58:09.985408+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PhdB4xrXZIpHt7to3KxVLBCu1m7epq9_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2777749068654122449', time=2024-09-14T13:58:10.024855+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TGWkZMCj15TAyJFs--m4TIuBxyFJVUy_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.258692626937724205', time=2024-09-14T13:58:10.563734+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MNowto-rdS9IW7iVE-hzp4eZtOjn3e5_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8721786688995814784', time=2024-09-14T13:58:10.708770+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mxDYGXgSviMP9zfAMV0_pHsy-1rLh8l_0 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6490723752654751621', time=2024-09-14T13:58:10.819269+0000, chain.objs.size()=1 2024-09-14T12:16:14.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.914+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IUMxdULTLsMlQar-nfvbhZkZMzr1deX_0 2024-09-14T12:16:14.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.915+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.271724896647595821', time=2024-09-14T13:58:10.819889+0000, chain.objs.size()=1 2024-09-14T12:16:14.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.915+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xWvhJUBuJCKkt4WwZp2eUFXOY5iYxWC_0 2024-09-14T12:16:14.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.915+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7916684882140969244', time=2024-09-14T13:58:10.907456+0000, chain.objs.size()=1 2024-09-14T12:16:14.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.915+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.s2szGAH1DOz2olph_sGWGsee_yYNk6Z_0 2024-09-14T12:16:14.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13728336379573646757', time=2024-09-14T13:58:11.145484+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HCKm6lEhder5QD_F3kZLRxrpVm44-Un_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9936365373856980091', time=2024-09-14T13:58:11.410426+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Zq8eZIVutAnMy8MDhoUGD9gDg4DPCAu_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6616927636226780334', time=2024-09-14T13:58:11.430405+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nZ5fiyrvnykyyp7yndayJHE1Yp89R21_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3714502744390546710', time=2024-09-14T13:58:11.467675+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.916+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1sDkd4gBuqTbvRfv2JSyLwVwXN_MKfu_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17291231508336847765', time=2024-09-14T13:58:11.841953+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.87wNRXFxhse3xnV5mtZLjPvsbUbZLcf_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10288157043886484823', time=2024-09-14T13:58:11.842539+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5dD60R1hF4USiDO0yZP1V-FVNlf8-4i_0 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5441314277632477692', time=2024-09-14T13:58:11.843037+0000, chain.objs.size()=1 2024-09-14T12:16:14.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vmFywmGfzIWJH2BRVZL6zGSHcv3ueCp_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1196309237076228780', time=2024-09-14T13:58:11.939339+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eCYWLeunKQIYK-PwzTCyb26h4DK9k9a_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18440564681958435080', time=2024-09-14T13:58:12.101628+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5Am1vSx4YEdWoEZ1lSqM07GX6kdTLAR_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4254437231916474231', time=2024-09-14T13:58:12.239996+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.917+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kp7exw_lCqJifnQ1eb9XVy9OZhQMv_o_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18172866799635561479', time=2024-09-14T13:58:12.417209+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4w15pi2dfqiSwSi-TWJcH_VVrra6Xvx_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13594761834208858611', time=2024-09-14T13:58:12.517855+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qbmFXAglQUpZ3MDZTIVJb-DhvUoEiUj_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2998525238611302756', time=2024-09-14T13:58:12.518616+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OtfrZJkc4nr5ZT3Ea59-NjoicPqffzF_0 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8481826964063306294', time=2024-09-14T13:58:48.991828+0000, chain.objs.size()=1 2024-09-14T12:16:14.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.oNd_PF9K98qldrMpONVi-5f5wBikn34_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5768007173556044570', time=2024-09-14T13:58:49.296358+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Pr-1f1WVNTEpvsrGDvmec7casGLsdAU_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4119568235556046792', time=2024-09-14T13:58:49.663529+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yZ4Kj_QmZE5sePz2GPED6M5hZjGBvaz_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10406585010855285279', time=2024-09-14T13:58:49.978014+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.918+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rCHcLWedTitxLUEBVWPF-x7Hqyfuhww_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8231125330194212814', time=2024-09-14T13:58:50.683125+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QUL8Fj_3HwPh9f-tf1cKbxDZhqAO9SQ_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2946907408762227867', time=2024-09-14T13:58:51.137472+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d4AYpgktfJeFI9o3WlhVGIPkbt2sZ_p_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14532492412196420703', time=2024-09-14T13:58:51.330168+0000, chain.objs.size()=1 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.a4m7XhN_7fZDwzvDIWDwANUAlo_knOr_0 2024-09-14T12:16:14.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10761231557249674006', time=2024-09-14T13:58:51.475326+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mVr2_dyh9nshDWwR2vsiPWdTuUmi8f6_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8223701541387763420', time=2024-09-14T13:58:51.526637+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.920+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sM1Wu0NybcOJxkLzy3UOsal3byDApAz_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14756390811587414852', time=2024-09-14T13:58:51.527325+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._2u6CLi14ya2ebL4WNy21NGT9yBx-3Q_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15948541819913742659', time=2024-09-14T13:58:52.097527+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uMgbCfy0G-d2-yInNXgvuPpc_FyyYPy_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4532497452470831460', time=2024-09-14T13:58:52.154675+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.T4srUDcmOnvBk_XgMvpUhF1J0DH0Hvm_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13653306102496936747', time=2024-09-14T13:58:52.638039+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fnpNgBv6NKAU6wHnhlbPYrHJ79KgltZ_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3176427674426967787', time=2024-09-14T13:58:52.641971+0000, chain.objs.size()=1 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OVwFtyaesq5oXfjt0uPVQrjIvqG0_LM_0 2024-09-14T12:16:14.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9703082925770915976', time=2024-09-14T13:58:52.971521+0000, chain.objs.size()=1 2024-09-14T12:16:14.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.921+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Xii9SjrROrs2c3MFyxmJMmbtQgoKLuy_0 2024-09-14T12:16:14.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.922+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2173934214451668537', time=2024-09-14T13:58:53.698931+0000, chain.objs.size()=1 2024-09-14T12:16:14.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.922+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JB_4WgqJdkFBa-H_R7VZwcE8t_bZNbN_0 2024-09-14T12:16:14.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.922+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11250000467784442979', time=2024-09-14T13:58:53.764273+0000, chain.objs.size()=1 2024-09-14T12:16:14.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.922+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LstDXZzwPDKxyoCJ954f2RTawc1RpSM_0 2024-09-14T12:16:14.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.923+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/46060 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7348936660241234183', time=2024-09-14T13:58:54.135670+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dt5Cu-rtHKmqdgXFJWJZ73m15-uxsrC_0 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.101481974320621441', time=2024-09-14T13:58:54.897613+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Tx_dti-_J58pR-U56ZTKMy32SrYuxYc_0 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12036561268979551978', time=2024-09-14T13:58:54.985816+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6j__A_-eW06Ter2HeL6yRhUI9l9UNqA_0 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3541940053419099128', time=2024-09-14T13:58:55.214298+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VF9Z77gePCfmEJuv5FefjtuIeRYyfk-_0 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16035396275287885128', time=2024-09-14T13:58:55.649859+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GFzozfThlz3oUAetoNG6vMR3SzoA4bu_0 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10515900961601399091', time=2024-09-14T13:58:55.659188+0000, chain.objs.size()=1 2024-09-14T12:16:14.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZPFfuBHlEaaYzGn17TrPiQ4-o131hyA_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2807476878771808343', time=2024-09-14T13:58:56.751972+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d00gBiUCF-w49cUayu5Bopij4JsjqWF_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15099927189225019984', time=2024-09-14T13:58:57.207240+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LS5v3SPAGWVi1eUIVeTpPioFBgXH1iG_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.925+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14509036793767195729', time=2024-09-14T13:58:57.251209+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gz0HiphdSNQhIGlY7AT6ncOqWDGtxyP_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14801362305776588996', time=2024-09-14T13:58:57.400953+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.osFMOBMQD08fOUvcAcgeM2Uf8G8hfVh_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5023648093480677657', time=2024-09-14T13:58:57.981213+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qlf9usVysIZ3cH1Wkxyg6-wQDIcPi7E_0 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9200027012551497522', time=2024-09-14T13:58:58.026453+0000, chain.objs.size()=1 2024-09-14T12:16:14.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.926+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nnep2-N6CI2HKZxbbPC8ylvOJ_euF3F_0 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14223470859411590803', time=2024-09-14T13:58:58.072613+0000, chain.objs.size()=1 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pGIM9loAF0dWSsJ-m-sQgOMSYSn3UXV_0 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1624482625545104529', time=2024-09-14T13:58:58.696598+0000, chain.objs.size()=1 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.puopsPItTyLbrRg2pId_NBfCLcaHRnO_0 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14135619865042168272', time=2024-09-14T13:58:59.015191+0000, chain.objs.size()=1 2024-09-14T12:16:14.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.l8A-0-2KtSvDQpJNhAY6Zf3uC5j2zBY_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16354034146121814180', time=2024-09-14T13:58:59.495692+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iwiQLyOVmQFM4ubJ769yPn8-GMJIfp6_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6552311669040050617', time=2024-09-14T13:59:00.925707+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.326__shadow_.3UhLlYFqpvMXahBBs9fMoQPgGCLlgcT_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15211359744335250933', time=2024-09-14T14:00:05.030663+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.927+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.430__shadow_.gxQ6Cai-jZaBNf6OGforDnxFld4le6r_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3007699873799698427', time=2024-09-14T14:00:16.785330+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.447__shadow_.rsLGb_NsArpgg2jIZwCJ6oxkXw8DIpS_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2154317057659875124', time=2024-09-14T14:00:32.092706+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.466__shadow_.Pt0v9kHnflAUBpNy8lq80ho2gxATzfR_0 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18196641921034716952', time=2024-09-14T14:00:41.819632+0000, chain.objs.size()=1 2024-09-14T12:16:14.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.485__shadow_.4e3wsf36h_08INInzbPagKjiRAWPWGP_0 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.502282291213661150', time=2024-09-14T14:00:56.589095+0000, chain.objs.size()=1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2976422313537502888', time=2024-09-14T14:01:15.169831+0000, chain.objs.size()=1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.928+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.517__shadow_.xxNlcOR_RS-B4NKR5uhSuFaAuUnSWje_0 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~aTqjWMlpNFEEg-k98RHGQDi8ir3c3nN', time=2024-09-14T14:03:05.638259+0000, chain.objs.size()=1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.533__multipart_mymultipart.2~aTqjWMlpNFEEg-k98RHGQDi8ir3c3nN.1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.230912135870929105', time=2024-09-14T14:03:51.474686+0000, chain.objs.size()=1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.553__shadow_.hxRvLytKeeP86BJvMnGl1SzdMt8ScuM_0 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11427751451130643379', time=2024-09-14T14:04:04.149448+0000, chain.objs.size()=2 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.28mgVYMHhqwnlkbAyfmmtlioxDH8_5h_0 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.28mgVYMHhqwnlkbAyfmmtlioxDH8_5h_1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13632077381907594537', time=2024-09-14T14:04:21.668032+0000, chain.objs.size()=1 2024-09-14T12:16:14.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.929+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:fAuBXigzG6jGdNAgwC-fPUemez.DabI_.IOGVh_3FrSNsO9tJq6IcvdNub0ksOfP_0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4644211940030567674', time=2024-09-14T14:04:34.709870+0000, chain.objs.size()=1 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.573__shadow_.8FnxZXmM53lPaVqHEXmUeCJ7M9ArC_t_0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6645475278880467848', time=2024-09-14T14:04:40.638171+0000, chain.objs.size()=1 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.575__shadow:qAr7Xs6nEMUVLnYIICUUgp4MiIRh9D0_.UnjHTNeG6SU7GFAFZCbyWcaj4V7uCg__0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.272195538551891201', time=2024-09-14T14:04:56.331746+0000, chain.objs.size()=1 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:.zUExXqnXxtzOsur4H2paatG57.djQI_.HMgNKImenCP0d6KJsBV7ZMY4BHTuqUQ_0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16302920463479102377', time=2024-09-14T14:04:57.019679+0000, chain.objs.size()=1 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:kdobUFE8PdchVyQ3lsp0etpfYSQ1f0U_.QVuw4INgnQrhBM30oKfeWWbnWKL_Bp-_0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9856295404994380310', time=2024-09-14T14:05:30.567230+0000, chain.objs.size()=1 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:1m-uqYWlg6Ob.SvrsDsIKBCgR0Zz86W_.oZwY2vTZJ806AAQ4tARGHaaa6_ppoFq_0 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a', time=2024-09-14T14:09:22.919154+0000, chain.objs.size()=12 2024-09-14T12:16:14.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.930+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.1 2024-09-14T12:16:14.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.1_1 2024-09-14T12:16:14.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.2 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.2_1 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.3 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.3_1 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.4 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.4_1 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.5 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.5_1 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__multipart_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.6 2024-09-14T12:16:14.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.932+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.625__shadow_multipart_enc.2~uenoZQapgHTmMXPtOkX0wUI3SeEE0-a.6_1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5456430909134648297', time=2024-09-14T14:09:47.838423+0000, chain.objs.size()=1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.651__shadow_.JPALlyvCE4vgzHr3AoKAFeXbC_MfQr__0 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14839473109400628941', time=2024-09-14T14:10:09.165917+0000, chain.objs.size()=1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.663__shadow_.vQSWsrNsytKEBSOgGCRJ4ScoumgvEi0_0 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~DCPgdUNpMeaMNosR_wp9ZMhUny6ANs3', time=2024-09-14T14:11:29.676617+0000, chain.objs.size()=1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.742__multipart_mymultipart.2~DCPgdUNpMeaMNosR_wp9ZMhUny6ANs3.1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2700177909843780192', time=2024-09-14T14:11:44.424403+0000, chain.objs.size()=1 2024-09-14T12:16:14.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.935+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.748__shadow_.cHdUDK3xtlXYgsVnlmwLZWdJnCygyqd_0 2024-09-14T12:16:14.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.937+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.939+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:16:14.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.941+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.941+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45306' 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5870198276148785206', time=2024-09-14T13:53:15.296706+0000, chain.objs.size()=3 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.elKdapJ6PoWoU5NWc0tLH3xsytAfAn9_0 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.elKdapJ6PoWoU5NWc0tLH3xsytAfAn9_1 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.160__shadow_.elKdapJ6PoWoU5NWc0tLH3xsytAfAn9_2 2024-09-14T12:16:14.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6672445152951218620', time=2024-09-14T13:53:21.145260+0000, chain.objs.size()=5 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-LUKEWARM.2~c2qCkpNXKZ4IEDF5V_VJVqE7FrvhRxs.1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_foo-LUKEWARM.2~c2qCkpNXKZ4IEDF5V_VJVqE7FrvhRxs.1_1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-LUKEWARM.2~c2qCkpNXKZ4IEDF5V_VJVqE7FrvhRxs.2 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_foo-LUKEWARM.2~c2qCkpNXKZ4IEDF5V_VJVqE7FrvhRxs.2_1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-LUKEWARM.2~c2qCkpNXKZ4IEDF5V_VJVqE7FrvhRxs.3 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1463280901318361406', time=2024-09-14T13:54:07.168569+0000, chain.objs.size()=1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.204__shadow_.E61pzoiWJngJnDoYrRA0K8QwmitWRd3_0 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18229802843489312039', time=2024-09-14T13:55:31.655993+0000, chain.objs.size()=1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.230__shadow_.AVmSFbHZsr00UsVEWhIH3RLsTswkN4c_0 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9582110780655287918', time=2024-09-14T13:55:43.091000+0000, chain.objs.size()=1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.245__shadow_.Y37PVrSZ2faMNdDCtz4n8qk_qjehTyW_0 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10298592820190976498', time=2024-09-14T13:56:29.632356+0000, chain.objs.size()=1 2024-09-14T12:16:14.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.942+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uYN7U-7KTqIeYgyLmKQDHh9NhVWcVGd_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17954100634267495036', time=2024-09-14T13:56:29.862156+0000, chain.objs.size()=1 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4ktXaO1ereV_koETpqhdepXYYZZdVTx_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5426730546220252196', time=2024-09-14T13:56:29.948062+0000, chain.objs.size()=1 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.drSvZolIcjfSJdOthdgX-TST9GjHFwJ_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1216381483574070559', time=2024-09-14T13:56:30.583325+0000, chain.objs.size()=1 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.e0IOBwDEbkx8z-FJDOhlHYBIeN8px0b_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18357512285941528563', time=2024-09-14T13:56:31.545251+0000, chain.objs.size()=1 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hhf42QJLji5AwwtXCZAYrTiJLwt96T5_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14893550340521148351', time=2024-09-14T13:56:32.759687+0000, chain.objs.size()=1 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pFDFhDZAdP3yWUxwJuQA8K2v5P-tBOx_0 2024-09-14T12:16:14.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18087732648891905915', time=2024-09-14T13:56:32.952085+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.guPXu_oynQEZu5iAy3CGZzfGXK-JBl0_0 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7991206577422863917', time=2024-09-14T13:56:33.206395+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rStFqOYy_seqD9cfZBZFfeHG7gwQn9G_0 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10724817867398729019', time=2024-09-14T13:56:33.578608+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xa93rPAFwuFmn-k08I2C5jvp0tUFPny_0 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13635016624975275090', time=2024-09-14T13:56:33.617947+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.T4DdQmNJTM6hK5vrlA3KDZ7HHFRYmuY_0 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5520078847542128786', time=2024-09-14T13:56:34.261475+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.irS_R7fUIP6n4bQh-zqctX2f8GxkyKa_0 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8434363684295856389', time=2024-09-14T13:56:34.262448+0000, chain.objs.size()=1 2024-09-14T12:16:14.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.945+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.u3TyM0ybocbf8U4rhe-qOpn_DbFPGrw_0 2024-09-14T12:16:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.946+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7624589665932672050', time=2024-09-14T13:56:34.483203+0000, chain.objs.size()=1 2024-09-14T12:16:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.946+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lxvRy9_jKij4PDCeTAal3Cvkm4v_Ucb_0 2024-09-14T12:16:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11909286287343998690', time=2024-09-14T13:56:34.572187+0000, chain.objs.size()=1 2024-09-14T12:16:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8hlIz1VQ9ldGgdObdgE5a5MSIUTr1v3_0 2024-09-14T12:16:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.44062966204976187', time=2024-09-14T13:56:34.712894+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._ny6iB-5fX1BS6l1XhWKXDGu71Xx_Ev_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1326860125425513043', time=2024-09-14T13:56:34.915265+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.24QVPzxEYCTyt4NxggAjLd0zQN-ZMis_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13818615456067907257', time=2024-09-14T13:56:35.570826+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QDoHaPv57-s2UWgOY7vRPEfs2C2VWDH_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16729990141942591099', time=2024-09-14T13:56:35.713281+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.M4gR3EPLTSDJatxfMDTV4xRU8B2tr6s_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17486609179697348655', time=2024-09-14T13:56:35.834404+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DNPh6biTrhh4uqyHi3eNOilgAc3uniD_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15300824465035178432', time=2024-09-14T13:56:36.295558+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.947+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PK1fprfX8b-9O-gv55t58wL4wK_y5kD_0 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11872822017414884194', time=2024-09-14T13:56:36.296286+0000, chain.objs.size()=1 2024-09-14T12:16:14.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XlX_xi_2rgXzkoyVGqKMMmUBpCTizKm_0 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10027752809695108363', time=2024-09-14T13:56:36.933080+0000, chain.objs.size()=1 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mCIiJat2DWtgQ_F8mv066psgiBGXkGR_0 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7348312055439444615', time=2024-09-14T13:56:37.187488+0000, chain.objs.size()=1 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.948+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FC8F8Q6BaUXw1VH1F31LBHgiJph2IrT_0 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9073947303898162628', time=2024-09-14T13:56:38.082353+0000, chain.objs.size()=1 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AYkZZzX_xCo8lMN46nQ5RvL2RBNYSfu_0 2024-09-14T12:16:14.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5129598938934244686', time=2024-09-14T13:56:38.185865+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6FVbd_qGkDohDQhScYoKLeACTFGndZ1_0 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280553004720360441', time=2024-09-14T13:56:39.180441+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-ssNLy-IikCkubFkHeq-c5fpIMTA-W2_0 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15698385797189775595', time=2024-09-14T13:56:39.645324+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.adeaxsxmezYt9JwYKVKNTAc0p6TG5co_0 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16194820034496978296', time=2024-09-14T13:56:46.924717+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.272__shadow_.o-xd8S3O6ESa2JGlenJ3DzmDILNmFHR_0 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3230640337663555642', time=2024-09-14T13:56:50.329278+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.277__shadow_.dOt1BrAGSTvVbI4PhY1ObDSrlQq0A3c_0 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.192523617488290394', time=2024-09-14T13:56:51.688597+0000, chain.objs.size()=1 2024-09-14T12:16:14.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.949+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.279__shadow_.-FGrKH3poCdW6dMgzvTu9BetWSY633v_0 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15211749732565049798', time=2024-09-14T13:56:53.750782+0000, chain.objs.size()=1 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.282__shadow_.4wlfWAv-nBE61SzvelddrEoIduA1lS3_0 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2905878407574946769', time=2024-09-14T13:56:58.748015+0000, chain.objs.size()=1 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.289__shadow_.nqT0uMdw08t_7iknpRlbOGuHxfeKcSz_0 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4081171356954144552', time=2024-09-14T13:57:02.152980+0000, chain.objs.size()=1 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.JJrrUfkIwR5XkZ7zXg_L9nvhOakJ7Zd_0 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2184622938392034529', time=2024-09-14T13:57:04.151303+0000, chain.objs.size()=1 2024-09-14T12:16:14.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.950+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.R6-rNAHx7TiP22oEN2UM7dRqHeteOcY_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15900478522077189583', time=2024-09-14T13:57:06.303937+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.296__shadow_.tdEr5XQHcRxxzb95bP1o9EKsRxO1bID_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8512512969555683935', time=2024-09-14T13:57:07.085726+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.297__shadow_.-ad0uRWG2fgOwBnCbDMxr7SbLlnjGxC_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18140421155894399785', time=2024-09-14T13:58:02.231295+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NQWbKAV1qCkxDcFWY-9AVhk2B9dPEYQ_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6368686440871866980', time=2024-09-14T13:58:02.560469+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KQWkEF1fyCNEWYhzxKH-fNAxbuoyerW_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8773908217223658082', time=2024-09-14T13:58:02.907248+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DD5xKIhLtT4t8uynL7Mm32QLbT8Hbbg_0 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10765330248697016007', time=2024-09-14T13:58:03.138643+0000, chain.objs.size()=1 2024-09-14T12:16:14.950 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6LmfbQwbfYDDatXgESGaNJFljMare6u_0 2024-09-14T12:16:14.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12649178529969349006', time=2024-09-14T13:58:04.107009+0000, chain.objs.size()=1 2024-09-14T12:16:14.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.951+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M-Yjwv06NZMsmGgeIisTB4DG01ijwvk_0 2024-09-14T12:16:14.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2813707142661424891', time=2024-09-14T13:58:04.318828+0000, chain.objs.size()=1 2024-09-14T12:16:14.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aaKHMjx_mBQL64KOunHOtHk6mHuPFJ__0 2024-09-14T12:16:14.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10366013642014555287', time=2024-09-14T13:58:04.628853+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.R2ZHe5gk0RCM_IqtBfa5cKjLB41zVdf_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4618037695550199743', time=2024-09-14T13:58:04.678630+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NhYSnT3ShY_iuUEIeyt44Wx1Or6b9lt_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7257184823641221347', time=2024-09-14T13:58:04.679362+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.952+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VRQbZVBLx4pNQ-uQ5ClZSIOuEV3nJOy_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15420905275055235251', time=2024-09-14T13:58:04.733229+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dQB8CXJ4RNuu-4FWZXgyxQpWq8nDvnk_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17143476753337487794', time=2024-09-14T13:58:05.548979+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.v7hc7i7vxqK73g_SkjEbqwFQtwEl_Gg_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7660805332619328648', time=2024-09-14T13:58:05.877956+0000, chain.objs.size()=1 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZiTbx5-3Iuawf3C9w3JAKb9FkgT0BZN_0 2024-09-14T12:16:14.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1411337886213174186', time=2024-09-14T13:58:05.915872+0000, chain.objs.size()=1 2024-09-14T12:16:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HvYXEiqfvcLRD5MfQ4nbNH3jXqr-iW0_0 2024-09-14T12:16:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17991347219284183773', time=2024-09-14T13:58:06.130088+0000, chain.objs.size()=1 2024-09-14T12:16:14.953 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.953+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X42a4Y2orE7iqJbnAu1Rn3An8iyS_Lk_0 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10471348335228115756', time=2024-09-14T13:58:06.557967+0000, chain.objs.size()=1 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NrlPMcG8wpIM1cNgXvBTxG7zXlnaxYu_0 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3147729687414066196', time=2024-09-14T13:58:06.860111+0000, chain.objs.size()=1 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Y7w4SfVSob90G7jhiY2FodnGrOGEqV2_0 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13469025493697971599', time=2024-09-14T13:58:07.083367+0000, chain.objs.size()=1 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cTohto8e_M37D-L_oq2-zUuPCjB7qnU_0 2024-09-14T12:16:14.954 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8369701397671839109', time=2024-09-14T13:58:08.439734+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EfSCEkBFeeVc99eQrcl5uz_QtBy4b9Y_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10518168260367304144', time=2024-09-14T13:58:08.521144+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QpNOVKZyOvnbxPtCsCQ9ivLGmspw6Iq_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16515476154174243473', time=2024-09-14T13:58:09.709988+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.954+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._33QLheM3gl1Tf_zirs9wxFIs-wQrRz_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.955+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.585411174754202168', time=2024-09-14T13:58:09.883009+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.955+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NE3MvUeL8iVlInyltpy5f6a7KtvAFRt_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.955+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7689493608635164967', time=2024-09-14T13:58:10.143894+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.955+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XARnCXuuOvLvMMIztdsYL-h3L9D83sI_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2765227936264605240', time=2024-09-14T13:58:10.179676+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5p_DojosnYEeLTQ6SNUo8mvbt9CfRZ2_0 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3176358885692457291', time=2024-09-14T13:58:10.527487+0000, chain.objs.size()=1 2024-09-14T12:16:14.955 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6T3N7fn7OLx2ELV1fDd7g-4TTStfm_6_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7311207720852779404', time=2024-09-14T13:58:10.553650+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OYpd6FkwTFOPuwBDnyvw6q7-UVunr-6_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18304439206705395100', time=2024-09-14T13:58:11.006648+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YhwiJ-4KDFMKv4-k3itGjquC8BmMPyT_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8657226165975763815', time=2024-09-14T13:58:11.231790+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rY86CsnnDGFxQl0jHadV_iLa8ZUicuH_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5454048532261951527', time=2024-09-14T13:58:11.232649+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WEdQmioDhY4oYxBmPdgG3pQ8ABv_338_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16554994837620349718', time=2024-09-14T13:58:48.993900+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mR4TDckf_aG9DEq8s4VX0CNQ52OREGb_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18383277017117995759', time=2024-09-14T13:58:49.179067+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JD2Cvgu_9IxexQWOi0_d0VY5nDrj9RQ_0 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6981632844961111218', time=2024-09-14T13:58:49.201871+0000, chain.objs.size()=1 2024-09-14T12:16:14.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.932OWodk0Veb9qEJ-0JrNPkibsR6jkT_0 2024-09-14T12:16:14.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6206900899319438118', time=2024-09-14T13:58:49.209255+0000, chain.objs.size()=1 2024-09-14T12:16:14.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.c_FPvIFygUuOUvzeF0skFSOPvQu_wVR_0 2024-09-14T12:16:14.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2953347827046191801', time=2024-09-14T13:58:49.440184+0000, chain.objs.size()=1 2024-09-14T12:16:14.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.956+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ttvzfjmnR7VsgOwGB48-5gqzJDmU87R_0 2024-09-14T12:16:14.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.957+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17778276549390377853', time=2024-09-14T13:58:49.501551+0000, chain.objs.size()=1 2024-09-14T12:16:14.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.957+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VmQVtHodvKIj8UaL1aYlFGr0NJJU9Rh_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.958+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6596312014131800518', time=2024-09-14T13:58:49.926624+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.958+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rWnhOHfS-8PXapZKG06tw2LpdtpBJL1_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5053336183429984863', time=2024-09-14T13:58:51.423684+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DYJ25ecZTGblZlIiwbriolXS2eYV3RR_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9872578582365192722', time=2024-09-14T13:58:53.403103+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gsi1jGLdYbChvOKjpzWD6NJosoRHetP_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2091569787384934612', time=2024-09-14T13:58:54.247291+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Uaxzthg1Z8LrnOy9CzKmyGFEAbu-o2K_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10302478209008307015', time=2024-09-14T13:58:54.757137+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IMlw2K4qLf_IWKL1FVazmmJDWBx_uBD_0 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17641784455007485360', time=2024-09-14T13:58:54.757728+0000, chain.objs.size()=1 2024-09-14T12:16:14.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dM_dL_SHryn0AL3VxIs6rOyNZ0OXC1G_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.789791114326722331', time=2024-09-14T13:58:55.055321+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-_L49Dy2LBoqv591V6fHtadwyoE5D18_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4533089099583168837', time=2024-09-14T13:58:55.460282+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rD0q1Rafr1WJAryA8EtDY0h-SHXIXRg_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6575361588126179384', time=2024-09-14T13:58:56.568855+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1z3rnC2NlvwK1BIC4b6vfeq-YWvclF0_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16985802661532592206', time=2024-09-14T13:58:56.654330+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IcOAS64I3CFZmugJpzLI4ITT1mydJTK_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.681302307740122329', time=2024-09-14T13:58:56.980531+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.n_747ORHTv-NWLzjXzGZ3tl2xei1F9g_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10456070426441908045', time=2024-09-14T13:58:57.081293+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.959+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CAVoO20yy736bPvfQ9w9WS_3kqI9D_3_0 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.961+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1558355694219546800', time=2024-09-14T13:58:57.918695+0000, chain.objs.size()=1 2024-09-14T12:16:14.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.961+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KPV_ez6rNWVvenCoz6S_T2btx86e-oB_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18265835029884747964', time=2024-09-14T13:58:58.255653+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jZMLzEN73axSjGdowTV63xa9fy2E-7f_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9868087433062547712', time=2024-09-14T13:58:58.351732+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2KtJ51Jur1arQ9YYfhp1R8STnjGTTe5_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12243752436970248911', time=2024-09-14T13:58:58.478643+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4q3FpN1F2xyIqO8Hq6At5Fd2XI3wV2z_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9311233094411472351', time=2024-09-14T13:58:58.662026+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zzw-YyRdjg6VaDhHHTbDnaqdRmojyL3_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1945226788445958606', time=2024-09-14T13:58:58.943023+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jru_CJaTSg9kSt-0-udJE1QegJ7ZWDy_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5748597293507974717', time=2024-09-14T13:58:59.111687+0000, chain.objs.size()=1 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.U8H6cUwd7T02xOwlr7NYOjUeLY5ceji_0 2024-09-14T12:16:14.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13059393933381505890', time=2024-09-14T13:58:59.556195+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zZwqsZo2eVV0EBRp8aUYRFr6Zx0Ah2C_0 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14813901608167439038', time=2024-09-14T13:58:59.644729+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hsWoOhqMqUu3rAaL2sWtfe-XHBli8M2_0 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13586818305195240092', time=2024-09-14T13:58:59.759784+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AKrRoRCsNyWXFOPazyKh143JAIoNw66_0 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17610900194420770406', time=2024-09-14T13:58:59.776664+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.962+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4Q33GD_44DW4CJfuG9VgtCoi2A4VqyI_0 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.963+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17886701886601072634', time=2024-09-14T13:58:59.781891+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.963+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nBAcOdRSOJYo0ZzhbOe5RnTmungHi3M_0 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.963+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4696694089419515062', time=2024-09-14T13:59:26.272167+0000, chain.objs.size()=1 2024-09-14T12:16:14.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.963+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.371__shadow_.MCD8HHwdKP554TkJZ_UxZmquFyPEr1j_0 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.965+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/45306 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16467060629755873890', time=2024-09-14T13:59:29.125760+0000, chain.objs.size()=1 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.374__shadow_.1pwBFzuO5ISy5K-A8ebi0rf-GwcSsQA_0 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6819358304670497926', time=2024-09-14T13:59:33.723823+0000, chain.objs.size()=1 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.381__shadow_.-DzKHoM6YY50PwjeeE1TaL_hOhgG5HO_0 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13371224526281550953', time=2024-09-14T14:00:09.881935+0000, chain.objs.size()=1 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.437__shadow_.itlI84g7FmqSJpQF9e4ZVRXSCLVtlvO_0 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1848226112843404264', time=2024-09-14T14:00:27.387453+0000, chain.objs.size()=1 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.461__shadow_.ic9aeV7Tz9S-LGQtLY5IzkgtdgYQx9X_0 2024-09-14T12:16:14.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18418840213036984661', time=2024-09-14T14:01:36.023415+0000, chain.objs.size()=1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.520__shadow:TbB8nK1WvfYeO6YCOT7Xk3PFbdFKaEo_.jfgDW_N1LXt8jin_Gt_4eJjob7Pyves_0 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9795315712277415398', time=2024-09-14T14:01:36.318234+0000, chain.objs.size()=3 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~0oCHes35qpTYiVVG6nIB2o98twzO2ag.1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~0oCHes35qpTYiVVG6nIB2o98twzO2ag.2 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~0oCHes35qpTYiVVG6nIB2o98twzO2ag.3 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14367077571255698380', time=2024-09-14T14:03:46.656285+0000, chain.objs.size()=1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.551__shadow_.11xxP0x6XUbHMmnElkGMQW3xHNvZRmw_0 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13336165711646491320', time=2024-09-14T14:04:29.381303+0000, chain.objs.size()=1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:myNTvMbbal3YVVDnPKd3UCNTwcoPnQv_.gNT6EqyzfoL0n0t8IyQhoaZI0S3sr-1_0 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.872543861015386334', time=2024-09-14T14:04:44.926996+0000, chain.objs.size()=1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:yDW5oBNouTfvlCOnTa9zuewHaB.KrBp_.dUSdVl7Q4kR_To_ULRPqKDFuYU1U-pD_0 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.760238160138421056', time=2024-09-14T14:04:48.261365+0000, chain.objs.size()=1 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.967+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:8HMBmX0MMQbfJi62IRujNG.-n5wzcu9_.gQObkcO5-XvLizSNiCoUElVMlTvhivr_0 2024-09-14T12:16:14.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9991268437014253334', time=2024-09-14T14:05:24.245173+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:iGIKlkv6AYoaA8da8Zwg3EqLgkYivgR_.PBjCwhyD1FakUnozwxFHD5YEiNZumDB_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8273714950025812996', time=2024-09-14T14:05:40.323425+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.604__shadow_.CuZWci5vFnlfBw8vvVfg2blyqeLBWUv_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4014002698928774735', time=2024-09-14T14:09:45.562599+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.649__shadow_.Y3LoJH3WsSgzBFFAa5r0TqnNc6yoxBE_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4789311357964651857', time=2024-09-14T14:10:11.131100+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.665__shadow_.nppQikAeylk0tRaDiCyx5sBEt5h8XtC_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.488872224634079156', time=2024-09-14T14:10:26.823465+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.692__shadow:6MVlPquqQ7MPoNCYwnp0pyxtPIsnI6e_.QyniUeIKEvebf7vyxj_AMF4bsPC-40L_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8382796833960035267', time=2024-09-14T14:10:35.103914+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.704__shadow:FvALG1ZbsPu.x0F.dHWB.NTk-z4lC88_.ywG08cSmuw52kCkYAmhm9H1kM09bf1M_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1063670926746500003', time=2024-09-14T14:11:04.481089+0000, chain.objs.size()=1 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.719__shadow_.GRdN8aXdVgWM_s278ttwiA4tsWbgcOT_0 2024-09-14T12:16:14.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6229552656789060708', time=2024-09-14T14:11:28.418110+0000, chain.objs.size()=1 2024-09-14T12:16:14.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.969+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.741__shadow_.h_Xz8pYEMTl9LO26WNGQ9RHzLmM3dql_0 2024-09-14T12:16:14.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.971+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:14.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.973+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:16:14.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.974+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:14.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.975+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53208' 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14543467047904614562', time=2024-09-14T13:53:25.663640+0000, chain.objs.size()=1 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.162__shadow_.9vvAYrKO6UCAb6kD4DewQrHA74S4l5V_0 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5050393502214062251', time=2024-09-14T13:53:46.718002+0000, chain.objs.size()=1 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.182__shadow_.4cyMKF7fVsYrDxhNJHhfusWx-d9lN-Q_0 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16608533924454817793', time=2024-09-14T13:54:00.600653+0000, chain.objs.size()=1 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.197__shadow_.gC2CsQ-EgNo8RgvYrvBCKGgT8JiFuVj_0 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12908879754117380062', time=2024-09-14T13:54:06.383428+0000, chain.objs.size()=1 2024-09-14T12:16:14.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.203__shadow_.DMYMRZjQtmX-ToyY7LElJOTBR83EK9Y_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17441997688189148137', time=2024-09-14T13:55:38.437570+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.239__shadow_.K595yvYfN_W0slQQJ9c1N3UZxAABPS0_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8975934328794520463', time=2024-09-14T13:55:41.424083+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.243__shadow_.NgX-RLDMk8bIypeqwsglD3hCTnCOVEY_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7493688732862031528', time=2024-09-14T13:55:45.888321+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.249__shadow_.PCU1Dxf0qrhrMkKu5cHNCMdtf7XKYzq_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8283443490006067763', time=2024-09-14T13:56:30.098419+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JUfy1JU2xsWRJ0IXbAvqoLIoWcbYL0__0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8495122158696140059', time=2024-09-14T13:56:30.111963+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lMx25lCYIcuotCCSl-K2tlOf4D0yhP3_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16197377359641579164', time=2024-09-14T13:56:30.527399+0000, chain.objs.size()=1 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dJcr3ytSIEc0sit_8UFkqi0ZIxwYvj0_0 2024-09-14T12:16:14.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1887134062193146868', time=2024-09-14T13:56:31.193902+0000, chain.objs.size()=1 2024-09-14T12:16:14.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fiKiH9ULS84y0u_hdGhOFm4yjLcR-a9_0 2024-09-14T12:16:14.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12257350478559499707', time=2024-09-14T13:56:32.091719+0000, chain.objs.size()=1 2024-09-14T12:16:14.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.976+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DWkp-tpTGZpUlGk79K1sBm4T0kka6DA_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13164047278388790366', time=2024-09-14T13:56:32.178330+0000, chain.objs.size()=1 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HViPSOqEVz6JbKqCUG9vYMN3g9BLk4e_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1873738381719099521', time=2024-09-14T13:56:32.905399+0000, chain.objs.size()=1 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.clSnI6yj4Z0ggTzCX0BfjcQ2gi8JMRS_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5401543879215757152', time=2024-09-14T13:56:33.561552+0000, chain.objs.size()=1 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PXyz3sSbwr4zPQcMQHrwIS9GtFAmSIs_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5981207960502297760', time=2024-09-14T13:56:34.047671+0000, chain.objs.size()=1 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vpPPtUWSHL4b04HhjzNLL0HZ9QC6Sna_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4746549182176652219', time=2024-09-14T13:56:34.089598+0000, chain.objs.size()=1 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RABro5oN6JxZ5zL_9dt3EAT5oa-zCVC_0 2024-09-14T12:16:14.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11191804380187327898', time=2024-09-14T13:56:34.569848+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2T3ihReeQrt3f-lmr-mNfRQEWMrcZIp_0 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4952067254039320546', time=2024-09-14T13:56:34.672851+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gOME9xQFwKu87FOyPUk_2K0-5F9iHAl_0 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17584182887878313770', time=2024-09-14T13:56:34.921934+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yfL6zAOUjlDxWsciqCeRQF_Ft2pLepa_0 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14039233338061714647', time=2024-09-14T13:56:35.066829+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EDX-HuzBkmcg5mgjsM9-jxBJd4bOqyY_0 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9662539240358525607', time=2024-09-14T13:56:35.734215+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.viBqVq6gY4lpZd-20AzNUGmDgpCGlXq_0 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17963109755153459832', time=2024-09-14T13:56:35.747210+0000, chain.objs.size()=1 2024-09-14T12:16:14.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.978+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XzjsH1XVBHnBv6B_8fmIhT3iKkM9iWV_0 2024-09-14T12:16:14.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8066563117800913664', time=2024-09-14T13:56:35.981886+0000, chain.objs.size()=1 2024-09-14T12:16:14.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YHQk3Or0c8zvJJtfCTS31Ank4pJSHFJ_0 2024-09-14T12:16:14.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4201374359749977071', time=2024-09-14T13:56:36.105741+0000, chain.objs.size()=1 2024-09-14T12:16:14.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._warePp-QHAiqI-jNwXc0JWLfi0Jbfc_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9939286691738396259', time=2024-09-14T13:56:36.335137+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SPwaXNGWW-YcE3vez42UAvUfmNQGb-c_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5561123138932652050', time=2024-09-14T13:56:37.529053+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bpzDqR1zBZfW4Zq3q2ofcy8DjFphmGn_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4551042473956398305', time=2024-09-14T13:56:37.530440+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-vgRm85tYR5oy4CBFynyTXwiz3qqMA2_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10148639503620211098', time=2024-09-14T13:56:38.081195+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lBauEyUZjSgt8gdtB9T3gBi_sCScihV_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15405628263924216894', time=2024-09-14T13:56:38.187611+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.980+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.68mP_Ltw7k-tESjpNtZYbGcAZ9MSPit_0 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9493446845694330913', time=2024-09-14T13:56:38.536238+0000, chain.objs.size()=1 2024-09-14T12:16:14.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wNW4nLooS7iyPsdZGONFk3DnawhMF7y_0 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3996052472791209365', time=2024-09-14T13:56:38.553466+0000, chain.objs.size()=1 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TdRkEdOtiCMkQHxpTHZdrv9Wsm25qJ6_0 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15583452930158460177', time=2024-09-14T13:56:38.963884+0000, chain.objs.size()=1 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7cCsp65oIXbWcOR1Er7Ui0WLt3qIRAC_0 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2133912607874440610', time=2024-09-14T13:56:39.135236+0000, chain.objs.size()=1 2024-09-14T12:16:14.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.981+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eHVJ4BdNvghITeBVfTD1RTPfOCk39Zi_0 2024-09-14T12:16:14.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.982+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2967760576619833084', time=2024-09-14T13:56:39.521257+0000, chain.objs.size()=1 2024-09-14T12:16:14.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.982+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DFWPOMHT562SA46tzjYVpmoVv-jpu0E_0 2024-09-14T12:16:14.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.982+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10924143424134760438', time=2024-09-14T13:56:52.372019+0000, chain.objs.size()=1 2024-09-14T12:16:14.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.982+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280__shadow_.6b9CMjQl3RO6ncehUOKtDbgbfffbX4r_0 2024-09-14T12:16:14.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11211395172116076636', time=2024-09-14T13:56:54.456202+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.283__shadow_.qZqgkvEv6UQjIo1TOe3ripNlqqa_lHt_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9660696721477241666', time=2024-09-14T13:57:02.138147+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.lnm6soAiqWDZmhcqd6o61z6tK60EDdw_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7673471565171953708', time=2024-09-14T13:57:04.176411+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.Dn3IAi6wc_95BMhvR0iulKnkrLlSwrE_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10531165049074691294', time=2024-09-14T13:57:04.198895+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.vigDG4pGE6x70ImfMxF9ToPn18AAbUN_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15627145044510190988', time=2024-09-14T13:57:08.600051+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.299__shadow_.O6EjrJnxziNa3EqUiJnR7tuKC0t156P_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.449729141164736676', time=2024-09-14T13:57:09.988780+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301__shadow_.D73o-0997JNuWGO-w6zNj1YEJ2um-dE_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6917898235582831296', time=2024-09-14T13:58:02.232605+0000, chain.objs.size()=1 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eoIAycNRtfDbjnQMvT9cup5Pfdm1hzq_0 2024-09-14T12:16:14.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6070469196944284891', time=2024-09-14T13:58:02.233240+0000, chain.objs.size()=1 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3eWZzssJCVsqizte9fRDXz1ojTb6U2k_0 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13263516293159674615', time=2024-09-14T13:58:02.390059+0000, chain.objs.size()=1 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1OdAXJEns07AHl25MqQp_yBzxQ93402_0 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16979533119859690288', time=2024-09-14T13:58:02.514201+0000, chain.objs.size()=1 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uXgzzTVwlYn_xu7LD1XXFp_XIt7VqVe_0 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3486706663889629072', time=2024-09-14T13:58:02.606080+0000, chain.objs.size()=1 2024-09-14T12:16:14.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.983+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WEgMIt3C2BmxGPQBfyHiXtg_iGUZKXz_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4067118794746499047', time=2024-09-14T13:58:02.631363+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.H_VOnnqiZinwJg03IvEVRqs1pHc_mNF_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17996568177288327174', time=2024-09-14T13:58:02.728410+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.md2k_wQ84C2WqlEO6xMsupCbCE2ZF7-_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16253079997347567409', time=2024-09-14T13:58:03.140827+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.S4cV5a4iXZtAYcuIAw09UY640tjyeLJ_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13828895504229532378', time=2024-09-14T13:58:03.229729+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kgMw0DnGuoQNv-Kw21WPTLHVyNJW75d_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14198147686540800814', time=2024-09-14T13:58:03.746750+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.64Pt6M-cWAterEh9SjcxB_q8IHkkYjl_0 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13590262309654430095', time=2024-09-14T13:58:04.016628+0000, chain.objs.size()=1 2024-09-14T12:16:14.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.m7Gnsz2H-LkaHEkgCwmqw7HAGl-mCU__0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12296680632940820276', time=2024-09-14T13:58:04.512680+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4_jBalq2C1JERddRAGTcI3Q73uthsvy_0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6300559299706744714', time=2024-09-14T13:58:04.571637+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KiiIJfSEIPs8XzAiImpEygijbQWioSU_0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2201379852215311900', time=2024-09-14T13:58:05.636375+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MRkIFLJH-ReC9_OuCJxTcWqUR8HE8F__0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13044586477519570501', time=2024-09-14T13:58:05.637058+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-RWARi_3pKS1dGk9y83Vh73LL6HAKze_0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6922610850164726449', time=2024-09-14T13:58:05.818710+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.985+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3BzpdWrE3eYlU1nqEkCpEVO-kBGCLmR_0 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1972672275884570259', time=2024-09-14T13:58:06.859371+0000, chain.objs.size()=1 2024-09-14T12:16:14.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.tmfBRmxds7URnJeBKTDsAmVMAE2ZAcu_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7407305804162371075', time=2024-09-14T13:58:07.056466+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bY_-rW1Y-yhvBktX-kZc46HvAD1ijS9_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1765036558120065090', time=2024-09-14T13:58:07.302787+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.C8nW2VMV5h-lZmkIhOViZQU7ZqOxFEE_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9020350449301508853', time=2024-09-14T13:58:07.336501+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PjdcrREHZ9MjFNI1QE1CC8_02A1N_wF_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16423031892560618070', time=2024-09-14T13:58:08.165562+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.987+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.V6JbZc6CWcHM_7RKR72_bYwhQ4JoHBu_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.635661388267204054', time=2024-09-14T13:58:08.352410+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-S7m_P_O6WCiDn2JTdbgr-G7UmnoRaE_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10515353192218317410', time=2024-09-14T13:58:08.457565+0000, chain.objs.size()=1 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bmXTu3JZ-tFsD7vAMnrPQvn7KGaPmJK_0 2024-09-14T12:16:14.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16290488246198357986', time=2024-09-14T13:58:09.399427+0000, chain.objs.size()=1 2024-09-14T12:16:14.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cOWZfmrCTaVdjeobVOiku78IO2_96wV_0 2024-09-14T12:16:14.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16020070408521577827', time=2024-09-14T13:58:09.540060+0000, chain.objs.size()=1 2024-09-14T12:16:14.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._055IibWvB2-3mVhb7waanVsJJgX1XY_0 2024-09-14T12:16:14.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9616779196887962163', time=2024-09-14T13:58:09.540783+0000, chain.objs.size()=1 2024-09-14T12:16:14.989 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.988+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6iprZ53iWI5Gos_6Z9U8hm_pHtLT_cf_0 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2510482303489723569', time=2024-09-14T13:58:09.876255+0000, chain.objs.size()=1 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0W1TGIXkwCI2Zw61T_sTjMzX-NXKxt9_0 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7699463218426305314', time=2024-09-14T13:58:09.908467+0000, chain.objs.size()=1 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Z6X1Fr63eV7RC8edAS161qJiwIEIY7U_0 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9927981607250462960', time=2024-09-14T13:58:09.909204+0000, chain.objs.size()=1 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K1tJf0nCzi21Tng2wZFPK7E_E7T1IiR_0 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13201310195146424168', time=2024-09-14T13:58:10.178832+0000, chain.objs.size()=1 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.989+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.E9rL9dBTFm-Wo0MTZlydSBlDlgCABj9_0 2024-09-14T12:16:14.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9741060861394411552', time=2024-09-14T13:58:10.256228+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.frr0K48P0dRbxueOmichwu5RqbrUdKy_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16352619228940763399', time=2024-09-14T13:58:11.030345+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OyE4kXo8aSqy1eZqftEfRVdt2dIcyZT_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3416044931019701396', time=2024-09-14T13:58:11.807538+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PTvsH5pZsaT_44Chdoyop1QUifkBIbJ_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14946166143895805906', time=2024-09-14T13:58:12.610572+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SIbEgIMyOp6aXyMi5VrHR17Ykx1beJZ_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15197227808363362095', time=2024-09-14T13:58:48.997966+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vVfxRJUYh2dY-fnRE2rTuLAr6qxym6S_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.170793781963207928', time=2024-09-14T13:58:49.044174+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aZmwnb3jksm2kP2xGdiELVblVD7LDaZ_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10800022637477263897', time=2024-09-14T13:58:49.163100+0000, chain.objs.size()=1 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UL_sdaNSfiEucldiNJWG5RTrK2cx5Sw_0 2024-09-14T12:16:14.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14409294958391245101', time=2024-09-14T13:58:49.296407+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R_BciMAiY6EfQjcOgcvgQJhIlVIlggV_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2450551553074076019', time=2024-09-14T13:58:49.373371+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.990+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.SVYxhTVHIP85p8Id89Op6eBnWAdL06r_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.991+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13267661518794332673', time=2024-09-14T13:58:49.399581+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.991+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j2SxB1O9q6oEnGZZnTaS4qRJJW10-My_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2852304911340720275', time=2024-09-14T13:58:49.752823+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QWGrsvN9WWj-eCbjApIFpOqQ1or3KKU_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16011756085637209357', time=2024-09-14T13:58:50.034471+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vtwCIzFb2NUvJIRU-O-ujWKTP-mxDDD_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2898609601728689932', time=2024-09-14T13:58:50.525411+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ipCQxxArSXw-S45DWWws4KfNuqid9me_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13244070238466473977', time=2024-09-14T13:58:50.880117+0000, chain.objs.size()=1 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ecF7KY3dS3EVp5ovSu07aNrNTAREg4W_0 2024-09-14T12:16:14.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9244174897366903495', time=2024-09-14T13:58:50.956828+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FRTwjxi-_72VdkuUGrgqXz5VddlV2UH_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10551220173551404498', time=2024-09-14T13:58:50.992788+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vn1K-mcFHP28QEYCe2qOHCyjtstZTFG_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13406717290628166008', time=2024-09-14T13:58:51.105556+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R51G-DQiXiCmXV2CMtlb_kDyZu4byFn_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.347824457149914009', time=2024-09-14T13:58:51.492051+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jS8nmk98VDGhsPDrI7AB8IWUosSU2RU_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11197051924247079439', time=2024-09-14T13:58:51.968118+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GC-JmLXsyuB_OI-l3Kz62jsU27p7i4V_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2910849134531288898', time=2024-09-14T13:58:52.076471+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dkcLoKCMQ0B0NSfhY6cpB6KsVndiDz9_0 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.548970505855066142', time=2024-09-14T13:58:52.529735+0000, chain.objs.size()=1 2024-09-14T12:16:14.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.992+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BsDdjBQhfq5bbdbJYPFnlEgw_DI6cpO_0 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14331349007064326213', time=2024-09-14T13:58:52.530402+0000, chain.objs.size()=1 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cV6cmyUKojW44rYdABPEMCpHFi5_GNX_0 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.426312304446175623', time=2024-09-14T13:58:52.683586+0000, chain.objs.size()=1 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ujCnh1Y_WJt9wMke2z3eoLNMFe9tGNU_0 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4182454891495389722', time=2024-09-14T13:58:52.777276+0000, chain.objs.size()=1 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.m3lcdMX7cQB5crTlpdzYrSamTBtB55U_0 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14919922457840772961', time=2024-09-14T13:58:53.358649+0000, chain.objs.size()=1 2024-09-14T12:16:14.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uXGjEvFcfOudQNwBQPpsTztTy_cJ6XL_0 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4719327949620362350', time=2024-09-14T13:58:53.409299+0000, chain.objs.size()=1 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.10EiFeZlKccw8vWI89yRz47bQvlutp-_0 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14919469146265133291', time=2024-09-14T13:58:53.821827+0000, chain.objs.size()=1 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XIQNL4LwB_mvpzRRpMBlCFLFs4SVVJC_0 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.497757456218910382', time=2024-09-14T13:58:54.086348+0000, chain.objs.size()=1 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.994+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mCP0GocrQvFYktYIXOJDOIAxq-GMsns_0 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.996+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/53208 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10537859377074715683', time=2024-09-14T13:58:54.211991+0000, chain.objs.size()=1 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rQtQuGQgW5l1YubPWIoMA2u3RTr1sYP_0 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13351196423803037848', time=2024-09-14T13:58:54.314931+0000, chain.objs.size()=1 2024-09-14T12:16:14.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tx-uTCLXZaBFmZjBs8S6Q5Xn77NMZeC_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14625157275794097337', time=2024-09-14T13:58:54.746695+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Fc4zfAzj5kuk-E4DpQGdRbeozXCNWZ2_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16508115102446028021', time=2024-09-14T13:58:55.246746+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2i2P-QekJ5xRHrLs8sqlTkGdLiQqQC2_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17013118302503813667', time=2024-09-14T13:58:55.533635+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qbk75W27_sbiIaEJx458CLymI7peXkb_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5071877773209844620', time=2024-09-14T13:58:55.534417+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UUH-cN_7-PtMOC7zJAM-snTHsB3gN8Y_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14611381131254776986', time=2024-09-14T13:58:56.786438+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eRMQJPO6IE2Cz5VSD56wNZJnMVaPLSo_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15999166170955683011', time=2024-09-14T13:58:57.126823+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.58zmnWVkUSOS1_0vxZmDp_PHYZYOoRU_0 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3509678177734202003', time=2024-09-14T13:58:57.170399+0000, chain.objs.size()=1 2024-09-14T12:16:14.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4-uwhveR50faPw6Cl1EBTSC-_gVhLbx_0 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5408087907954076977', time=2024-09-14T13:58:57.283182+0000, chain.objs.size()=1 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.INAxgdG3DbDYVOI2jIE_cAkCvpkvbQF_0 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5728273368547043150', time=2024-09-14T13:58:57.842187+0000, chain.objs.size()=1 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nfXz3fgxFlqdjWxunijGvcun-J4iSsz_0 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2156799136536103325', time=2024-09-14T13:58:57.889735+0000, chain.objs.size()=1 2024-09-14T12:16:14.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:14.998+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nUApwsneS72GD-vBFwZltZqbABVYZiK_0 2024-09-14T12:16:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.749952421100595485', time=2024-09-14T13:58:57.890480+0000, chain.objs.size()=1 2024-09-14T12:16:15.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lx0ZWlcETee1zvy9IQWGIrwBHHG1kLN_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7476379874914791844', time=2024-09-14T13:58:58.183555+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YvvYCqs3D2wh-VyoBqZ1DcQx6k0hZ1f_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12546965623804492255', time=2024-09-14T13:58:58.262604+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wY_74QuCRsuVeuDHQfRdVpC-IJjIe3K_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18269038101973114991', time=2024-09-14T13:58:58.324017+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rqIoTywMPTs1IYJDXANp963IiZOsIdw_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2632001575885797861', time=2024-09-14T13:58:58.415703+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._wi8Rob_O_nqZpOYPKat9qE-9k_FGyc_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7352757598274969264', time=2024-09-14T13:58:58.512206+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jwpkQ-nRNwiGTlnmXIGbRb_QXJ5Zrgr_0 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1107635159470632256', time=2024-09-14T13:58:58.986013+0000, chain.objs.size()=1 2024-09-14T12:16:15.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1rGvkBcelmZkS-iCKovgkpkdF13Fchk_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2181517139484203396', time=2024-09-14T13:58:59.110192+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ni9rZ9u_d5ddNmzBli7CNSTR60Kg1nY_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1927162375414289514', time=2024-09-14T13:59:25.689307+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.370__shadow_.g6kyO2rB9GnqY6dcyWKP4fnUD60sULA_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3277466295131533313', time=2024-09-14T14:00:07.570938+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.434__shadow_.XaIZPB1wFxVYyI_aObNtrAnGZbdelIS_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9994436575712751410', time=2024-09-14T14:00:09.214676+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.000+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.436__shadow_.EHQ_HkEzhrR7ys8jmYa3fFJtetx7Pbs_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1353832505629292466', time=2024-09-14T14:00:29.855098+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.464__shadow_.7IPrebINP8WcJju_BkhwnMk2Hwe6FCP_0 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10653176704669647138', time=2024-09-14T14:04:08.974593+0000, chain.objs.size()=1 2024-09-14T12:16:15.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.560__shadow_.zZGoslBARIN1ay2brWYyvgD33Os8Slo_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12235654223499000802', time=2024-09-14T14:04:10.051659+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.561__multipart_mymultipart.HMDJ5ZANFobL3nTJoEke5lvVaGyuuljF.1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15469002546348954787', time=2024-09-14T14:04:43.857340+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:bZP9usCUEoZYGfZlHZvo8NMZguvTFqW_.mywLOQOMEKCyNdZnRNQ2Tpq24nJZ8sB_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12640198234981964829', time=2024-09-14T14:05:23.920243+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:iGIKlkv6AYoaA8da8Zwg3EqLgkYivgR_.PBjCwhyD1FakUnozwxFHD5YEiNZumDB_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8277759161534146034', time=2024-09-14T14:05:29.067344+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.586__shadow:2jraqyQpDko-F2eHwFOgNUj-3JkkEKB_._SU9CQ0p9-6nvj0vnK__2X3IYmPRMjy_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15421050224893328198', time=2024-09-14T14:10:12.217865+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.666__shadow_.6oCdinNL4od-wtAU_dPIFyLtWkNOBW9_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.196810277502799838', time=2024-09-14T14:11:03.783968+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.718__shadow_.wUhl_F7NIwDjw0rtTdQz7VVHQ-mhjCw_0 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1565689842062087068', time=2024-09-14T14:13:19.338691+0000, chain.objs.size()=1 2024-09-14T12:16:15.003 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.762__shadow_.6Q60PngXb7pLYVH62JMc_STW8YeclkG_0 2024-09-14T12:16:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15266174450733885944', time=2024-09-14T14:13:48.389826+0000, chain.objs.size()=1 2024-09-14T12:16:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.002+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.773__shadow_.zaMUkf2Ssv-8DWc1bEi-xJM9H1lHdOM_0 2024-09-14T12:16:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.004+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.004 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.006+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:16:15.005 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.008+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.008+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51859' 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15033515535846885350', time=2024-09-14T13:53:05.905931+0000, chain.objs.size()=1 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.157__shadow:1.J0LT9.-vuNgAQ-lXZP6aH8mOru0Q4_.0I7WI6yE0zV5E9yworE0SLDfegPr7uN_0 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16449161391721547293', time=2024-09-14T13:55:37.864810+0000, chain.objs.size()=1 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.238__shadow_._he03Cs9NGXOdPtCfQVovBt23lh8xh9_0 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9395835822545494470', time=2024-09-14T13:55:39.712557+0000, chain.objs.size()=1 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.009+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.241__shadow_.7me9rVWR8nvbZ5sj9zHxegQx2Ste_Kq_0 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6907358730711458815', time=2024-09-14T13:55:42.403762+0000, chain.objs.size()=1 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.244__shadow_.tjJoAV6Jr_YUbl9lPmgSAdIrVVuTixE_0 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9633425600337928154', time=2024-09-14T13:55:45.892747+0000, chain.objs.size()=1 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.249__shadow_.Cf7FFbSe_Zwl0VmTi2bt7-mx0RE-Y5g_0 2024-09-14T12:16:15.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15120750197586263269', time=2024-09-14T13:55:48.675491+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.253__shadow_.C5taHeM7K4FvUAtbzv6u5OfGxiFsvbB_0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12317455747746960755', time=2024-09-14T13:55:51.400342+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.257__shadow_.weg6TdU6Q-4gNW_Avg9b2iwP5gJhyaT_0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.193659748308016362', time=2024-09-14T13:56:30.218631+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4ZetmklOAcajw5zIcOCIaaWRX0-JWh__0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5972288418302728953', time=2024-09-14T13:56:30.276323+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QvXzN8x_YMXIbTIOAfMcVOsnVsi_0LJ_0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13222980867034026484', time=2024-09-14T13:56:30.396132+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.__EKfkuQdlC2BnkX8pPBmM37DwDCO8S_0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14928011978230204132', time=2024-09-14T13:56:30.438741+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7bWMg0E-R3cI16Xjj3PcTAHUSOpFZlR_0 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5335263038680233366', time=2024-09-14T13:56:31.307421+0000, chain.objs.size()=1 2024-09-14T12:16:15.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.010+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ngibU4ttzmsywlvagkTvIOxq_0_KwY7_0 2024-09-14T12:16:15.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15954693884721846859', time=2024-09-14T13:56:31.652005+0000, chain.objs.size()=1 2024-09-14T12:16:15.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HqMYV9D5ZciY6i-ImnHg5c9S6_46gp1_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9411473280890063418', time=2024-09-14T13:56:32.102043+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gxbaMjvm76dcFiCxRAfuB8hQfN1cDpY_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8387590437226514409', time=2024-09-14T13:56:33.351176+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qKLkPDqxQbOSZTHyeaigA_wW8rkUyk3_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9049741325188104053', time=2024-09-14T13:56:34.175896+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6sFxpjTSjPlftJyPUuHHYwyVl0IYUeJ_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9233248784431445171', time=2024-09-14T13:56:34.176486+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.i5389llLiJFLe2gBFHcTWaaS3l2QAWJ_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7275991657644532493', time=2024-09-14T13:56:34.841011+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6gocBtQ9sg9oLHSdhgwfqI7_awNvMay_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13609590784402828077', time=2024-09-14T13:56:35.021683+0000, chain.objs.size()=1 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fvfCrPsFDpJw4nQrlD7ja7Qu1EN7CN5_0 2024-09-14T12:16:15.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8422433812468611823', time=2024-09-14T13:56:35.471820+0000, chain.objs.size()=1 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2PPsWEee8-92jk6swkmKGEBeFNlt5Ts_0 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8765912460999022603', time=2024-09-14T13:56:35.572965+0000, chain.objs.size()=1 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8VTr1BH90OJlJN23SAuZYlQ9FoeKL9Q_0 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15505154466632164533', time=2024-09-14T13:56:36.182895+0000, chain.objs.size()=1 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vxCwFHWuXvNlcYPWbqub8GMj-6snoYR_0 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14113569663251990007', time=2024-09-14T13:56:36.768106+0000, chain.objs.size()=1 2024-09-14T12:16:15.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.012+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XpvAiCXgfszAQ_ocnetCbR-2RkLCRuQ_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.013+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.99630657129998365', time=2024-09-14T13:56:36.804022+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.013+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.P4W6ll3gmhMHitytFDY0OJUW9QDvayY_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.882714925676522158', time=2024-09-14T13:56:36.806088+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._TMYRvVc_9C3CCmr1PQYoTWyMbAayEg_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4088305666994513646', time=2024-09-14T13:56:36.931924+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0L5QXP4K_JH05vcr8Q5E9C04ZOR0N5G_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1032610770840181178', time=2024-09-14T13:56:37.184952+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.j2rpQHdTH_jvOQjegHTPFGdVvSgJEBK_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11793137660176160064', time=2024-09-14T13:56:37.330893+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bVj3ODVO6cnbqKN9PgvylY1HiNWSBku_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1119856397716872115', time=2024-09-14T13:56:37.435644+0000, chain.objs.size()=1 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.faVIeG8HHyMk7_Ha0-VwiqFSZ_KGDLh_0 2024-09-14T12:16:15.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1136570260598568195', time=2024-09-14T13:56:37.774094+0000, chain.objs.size()=1 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2lFwiiyS_c3_zDFPo_uFpwqpv6lHoQw_0 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10341325658975287703', time=2024-09-14T13:56:38.189704+0000, chain.objs.size()=1 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.E28dFzRNgoX8NlC15ACRjOFfUePCfTj_0 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9866616075274591185', time=2024-09-14T13:56:38.874067+0000, chain.objs.size()=1 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UpDRdRy4BFbS4xDbGbH4lgDyRWdsF9n_0 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12521055193312290821', time=2024-09-14T13:56:38.894813+0000, chain.objs.size()=1 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-fA7R5aaRug775WiB-qAuX2tX4cUTSP_0 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8062184742337057496', time=2024-09-14T13:56:39.144364+0000, chain.objs.size()=1 2024-09-14T12:16:15.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.014+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gp1vFVAuppPhPDbA4CJutA6Bo72ShQb_0 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5643157413574725855', time=2024-09-14T13:56:39.694415+0000, chain.objs.size()=1 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HH0b3sCtDY-A3iOxYSJDTeEgIgOin3X_0 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16954802573361444244', time=2024-09-14T13:56:39.992950+0000, chain.objs.size()=1 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.o3ePiRCR99F_kYj7zIV3V5uKrJIAJyR_0 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7450735715151258333', time=2024-09-14T13:56:40.079255+0000, chain.objs.size()=1 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OSQPWZLmJAmFiLIwnhCf8_W65EfCO7i_0 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10390887886358113373', time=2024-09-14T13:56:40.218271+0000, chain.objs.size()=1 2024-09-14T12:16:15.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.016+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.motIYy2VKAw0m_pPZVbjRtI7b5qIOAr_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.25769305352432086', time=2024-09-14T13:56:44.306445+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.268__shadow_.8Buvaugj9KbojZIZXJyM_wWeV5gn5v6_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6110032357272273219', time=2024-09-14T13:56:53.750041+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.282__shadow_.deFV6C_obAkRDwwDwbWnfvw8NX0XRc__0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5775325895902814133', time=2024-09-14T13:57:02.225485+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.YgSNBxZFd8gx6WTXAdXDx2Klz_ki2MZ_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3132352832544486510', time=2024-09-14T13:57:07.837136+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.298__shadow_.aKbDdGQAwXrGHwzQkU5YP15i9L6yMe8_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6117930243311263676', time=2024-09-14T13:57:09.290472+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.300__shadow_.6__lgBCcoSdXzX4YFoQqW3tQdd3XjhQ_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13095744920514207377', time=2024-09-14T13:57:12.769485+0000, chain.objs.size()=1 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.305__shadow_.565CgqqXDn58dgZ64rXfHpu4G6zjy1N_0 2024-09-14T12:16:15.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4818791269220028437', time=2024-09-14T13:57:12.770144+0000, chain.objs.size()=1 2024-09-14T12:16:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.017+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.305__shadow_.F70kKe8AgneuEaC9dZy4_GmrHbCYNtW_0 2024-09-14T12:16:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16226358853221784456', time=2024-09-14T13:57:14.894400+0000, chain.objs.size()=1 2024-09-14T12:16:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.307__shadow:gCXwpyOqIOWsXroPKImZmC1GTDJNErn_.kdsdd7yBrxsa7tvWAHyi9NHrBuJCspX_0 2024-09-14T12:16:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6074023765464314405', time=2024-09-14T13:57:18.136866+0000, chain.objs.size()=1 2024-09-14T12:16:15.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.313__shadow_.wwyyc0r3ZM5J3AVs0Z1fSqieEXkLFRm_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15694337086667993522', time=2024-09-14T13:57:23.340330+0000, chain.objs.size()=1 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319__shadow:JnxHA57XDRST-XALq5iuzqVgyUB-Cez_.NZtIEzuU5NIEcuQlOic4tIfUB2YSu7M_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3307360860806911916', time=2024-09-14T13:57:23.347226+0000, chain.objs.size()=1 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.018+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319__shadow:E3OwQidq0RiEJRLS.EsS.-i9-8SATYq_.TtiSfWLS_whSfC3sUgTj4jVyMfvwes5_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12812467794289061558', time=2024-09-14T13:57:25.469552+0000, chain.objs.size()=1 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.322__shadow_.TaaQmQZiLf5inFcAwuAaThKcqIPl4nX_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16200726811803324030', time=2024-09-14T13:58:02.389946+0000, chain.objs.size()=1 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hQxwOVbSm-_eZNHo_E5UA4nAPSQDVfi_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12926313059715887902', time=2024-09-14T13:58:02.499620+0000, chain.objs.size()=1 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.d8oYwXXZa4mBjqjw07uJKxGQqXo0SXc_0 2024-09-14T12:16:15.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13750892521733083169', time=2024-09-14T13:58:02.810438+0000, chain.objs.size()=1 2024-09-14T12:16:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7VV5BRIJaHDYBJ4isy4FW7ciuLWQDKU_0 2024-09-14T12:16:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17206075938423673979', time=2024-09-14T13:58:03.022710+0000, chain.objs.size()=1 2024-09-14T12:16:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xWOPTgU0tBY9R-IggDANNVAsNoNsMDG_0 2024-09-14T12:16:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8404423114865773620', time=2024-09-14T13:58:04.017700+0000, chain.objs.size()=1 2024-09-14T12:16:15.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.019+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TV8VkI4RBOzFs4ZWfdJUP__YXjjpn_c_0 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.918048512994559947', time=2024-09-14T13:58:04.173541+0000, chain.objs.size()=1 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8Wf4m6bpGOcPgSB0SpBUQUUwdEEguDV_0 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.799972987357638104', time=2024-09-14T13:58:04.179382+0000, chain.objs.size()=1 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qeXw4MNl1tw0SODjerriqZgFLFDjTcb_0 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.915483551338348211', time=2024-09-14T13:58:04.584711+0000, chain.objs.size()=1 2024-09-14T12:16:15.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cPdB6pzk3OprfJerpDELHHnDDuV2Htj_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8823948529747382842', time=2024-09-14T13:58:04.679967+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.I26-n_xPX6WqG7AY8hnOHXrbVthW8m8_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4931424178298549578', time=2024-09-14T13:58:05.427013+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.020+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.54WYJbSD5eUVgsNCGfxeAkU4Hn5zS5j_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15898254851930487678', time=2024-09-14T13:58:05.836961+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ucErevw48NMS9n4Ewl6XVidcEkvtg4s_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6886711497409810839', time=2024-09-14T13:58:06.709268+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3ZgfMLt10SJfxdXBzPPuxj2-nvIcP0a_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1669111477446967099', time=2024-09-14T13:58:06.905417+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XKZ8ybofgtTHhg_gqUn2ju9p-7j662D_0 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18102290341861138786', time=2024-09-14T13:58:07.307106+0000, chain.objs.size()=1 2024-09-14T12:16:15.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kmAgT7sIdM8hlcoIEKterx81Umxm9gK_0 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2656866712679934774', time=2024-09-14T13:58:09.313221+0000, chain.objs.size()=1 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.021+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oB6vNveP5rkJuC_YD-u9-WFbjjzkEHs_0 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.022+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.250871007229838396', time=2024-09-14T13:58:09.666748+0000, chain.objs.size()=1 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.022+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5uwbzippeqBr9ehVgapaV3cARppXeVk_0 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14994794676736624912', time=2024-09-14T13:58:09.752121+0000, chain.objs.size()=1 2024-09-14T12:16:15.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.94f0CajF-7MzmkMt60wfuiQDheSQlIu_0 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11987137578998449791', time=2024-09-14T13:58:09.786495+0000, chain.objs.size()=1 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9LkKNC1q_StVA9x1QQNprYeOtU8pfPe_0 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10923179692503900857', time=2024-09-14T13:58:09.991382+0000, chain.objs.size()=1 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.023+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.doWh7QVKOHb1lDjfUrL4hQf4KH0mk3k_0 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.450481973218574874', time=2024-09-14T13:58:10.148251+0000, chain.objs.size()=1 2024-09-14T12:16:15.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HREtj7B6AibPRIPBTECz59WXsrcvNBB_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1346245931993504766', time=2024-09-14T13:58:10.748184+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YTxCLVDl5ehBzZEHBMEqDHzhSELTf9j_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14753788534963331788', time=2024-09-14T13:58:11.170975+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0-DN7DHEnqDM0Pebc7vAVsQE3HxXsIK_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11044340261456792394', time=2024-09-14T13:58:11.301849+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-5P8PdPwM09Qa8dQ2SG5k6z1HkQZgCb_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1987505426589425793', time=2024-09-14T13:58:11.310006+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7LG34BnzD3YeZ3xGDAvpkZZOJpst2wG_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5110871229585124325', time=2024-09-14T13:58:11.385750+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JylE2HGnKPWjrcq3d0y8V2Y6_qiokvq_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14020650754645707573', time=2024-09-14T13:58:12.306909+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.024+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WdzxGTeT4lsP-8AOy6KJnhdIVbACJ2l_0 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9397210718908103143', time=2024-09-14T13:58:12.416504+0000, chain.objs.size()=1 2024-09-14T12:16:15.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9inP8IpFsG61xTlQItZ3yIuKyLpritU_0 2024-09-14T12:16:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12505199907554255918', time=2024-09-14T13:58:49.288528+0000, chain.objs.size()=1 2024-09-14T12:16:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8tWque1JfLkYuL7P__-YLW1hRBugT67_0 2024-09-14T12:16:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3347352602095339972', time=2024-09-14T13:58:49.375455+0000, chain.objs.size()=1 2024-09-14T12:16:15.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.025+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TJpOg2e_Alq1SDIXMYtx8zkEjxibeQ5_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4907711194825001660', time=2024-09-14T13:58:49.391228+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.voVDBdMJUVkQAeHKuDoLZGP8NULxWfk_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3995706087410625018', time=2024-09-14T13:58:49.758880+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.M0f4BT6yB70t1YnzNXm9grrW3gVPL5G_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14306112185186751354', time=2024-09-14T13:58:49.885608+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UfE96TKld5KYNO4__diujL49aEJp8bH_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8151809138285667357', time=2024-09-14T13:58:50.567327+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8VVWKUODvZ_t5Uc92OIiWY-YkJhZEmV_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8149614860977665663', time=2024-09-14T13:58:50.652167+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.--jIgfYflD8C7thnuCKoCnX1L6AKLdK_0 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11731781413992230255', time=2024-09-14T13:58:50.675743+0000, chain.objs.size()=1 2024-09-14T12:16:15.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4d8D_f_LGiyaiuE3YvRA_-ELiY9NsHt_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17675988463529679284', time=2024-09-14T13:58:50.699764+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JUFr04zTqKjGqoewc5n3bIC6hA1MKNA_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4141124636797044525', time=2024-09-14T13:58:50.803505+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.026+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tTjcVw9Ylzi0epDjNDk02x5YlPRMOvf_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.027+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9635908308431789084', time=2024-09-14T13:58:50.920616+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.027+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WH5h8f9wraaCIJsZSn-qVSyuQqHPJCM_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.027+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10350856278871292631', time=2024-09-14T13:58:51.003316+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.027+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JUKsZJvt3J9jqveMyfAO6SH6gNBFx5F_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8232942465620142295', time=2024-09-14T13:58:51.360439+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sLDhF6Q1_j9EH5vUnROBBy4l9F8JE62_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10966202340769362124', time=2024-09-14T13:58:51.380955+0000, chain.objs.size()=1 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.EbzBRN84DI1XyZfzfdxkHlHhq0UF47Y_0 2024-09-14T12:16:15.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18229424911327056316', time=2024-09-14T13:58:51.450252+0000, chain.objs.size()=1 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ldh9GxbQyMFDCTSMN-icTRmHXrNy0bw_0 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6011430028586777481', time=2024-09-14T13:58:52.250410+0000, chain.objs.size()=1 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lYIdYmvEun5Qe6x7nV0kTI8B6h_Co3n_0 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13094662498680810939', time=2024-09-14T13:58:52.768631+0000, chain.objs.size()=1 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aUl-60LCzsKflSaDqHM3_YcPJXRfyGE_0 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13644736645821249612', time=2024-09-14T13:58:52.812203+0000, chain.objs.size()=1 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xyCeSQTN4qdTLs7bk7bIHIllgZBgnhf_0 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14866088089694000580', time=2024-09-14T13:58:53.362668+0000, chain.objs.size()=1 2024-09-14T12:16:15.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CnHGvbsiRcjtJvFuNJl-dYhONtqS1r8_0 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11070881659794642441', time=2024-09-14T13:58:53.404043+0000, chain.objs.size()=1 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wpNeprPWnBsYyxfWMKKvdRZJrYxpZn-_0 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1330499567458446023', time=2024-09-14T13:58:53.598201+0000, chain.objs.size()=1 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.028+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.X7We9UXMB43Q4IRuViAfyB2CaYXVj6q_0 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.030+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12280012928433860978', time=2024-09-14T13:58:53.871260+0000, chain.objs.size()=1 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.030+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tKwW9Y4v1i_cgNAGb9yG9ERfOHHcRln_0 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.030+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11110406184441980846', time=2024-09-14T13:58:54.076421+0000, chain.objs.size()=1 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.030+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ggy7goDrxgG1QqMtW8AMISKLCIK5O0K_0 2024-09-14T12:16:15.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.031+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/51859 2024-09-14T12:16:15.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-14T12:16:15.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1159128427850931786', time=2024-09-14T13:58:54.236935+0000, chain.objs.size()=1 2024-09-14T12:16:15.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.V_E44z76YPcg5UuUcRMZ94UAFeV_NFp_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13430390560375836597', time=2024-09-14T13:58:54.293527+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Yjm7MoXLUKGdwXKFCBeRd06EBwgjbf7_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16380000942058405505', time=2024-09-14T13:58:54.336179+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YumjQFeqry9QSbnIifGygdajriTgR3v_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16058884761211560073', time=2024-09-14T13:58:54.375347+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4tkcI7uJM3aNQXsaA9IVN8huQmglrio_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8705599292292706625', time=2024-09-14T13:58:54.777834+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Qdxe8x5goxn54tiwNDMN2rDubq2sqg6_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9381021060887017975', time=2024-09-14T13:58:54.851689+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jnJxJMKnPuNRGfya7AhSH1O5djPnBjn_0 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.837991770587266999', time=2024-09-14T13:58:55.054104+0000, chain.objs.size()=1 2024-09-14T12:16:15.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.S64rzB1GEwvCJP_Y3rcfGNsDZM3Bpk-_0 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11270052463352996162', time=2024-09-14T13:58:55.350048+0000, chain.objs.size()=1 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8OBzpFV9Dkxg4pBiaReA0nbim-l4Zmt_0 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1264400635243811314', time=2024-09-14T13:58:55.350736+0000, chain.objs.size()=1 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5AeC5x2CqFYWgYgkAKypkj-UGYuwLBi_0 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14428372310879153816', time=2024-09-14T13:58:56.526895+0000, chain.objs.size()=1 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.oVLLhwb1ze2wh_3uYVRtRVufhx-6DVP_0 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18434569936591016301', time=2024-09-14T13:58:56.818058+0000, chain.objs.size()=1 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.NQMODJrwYP7mPZ6f1tJulNQZBKGjUqL_0 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3332043301147510307', time=2024-09-14T13:58:56.867314+0000, chain.objs.size()=1 2024-09-14T12:16:15.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.033+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R68L8BOtR9hEGGSW14TZz8DD11v5zPW_0 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5990903379583065908', time=2024-09-14T13:58:57.243193+0000, chain.objs.size()=1 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5ENxLTyE7qBL4pEJOpIMz8e6_RzBym3_0 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18345471025413270534', time=2024-09-14T13:58:57.670047+0000, chain.objs.size()=1 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.m6hZrB14wV7LCUXO7Obl-TuwJ-KpLci_0 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8469122493117615116', time=2024-09-14T13:58:57.703295+0000, chain.objs.size()=1 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rEVr-lBB35lgWenbrTP2NAsPHioMi5__0 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17655053886077384484', time=2024-09-14T13:58:58.031545+0000, chain.objs.size()=1 2024-09-14T12:16:15.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.i6IVLOestVUv-eZxR4UDH1aeRjFqYHb_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13286277165127314135', time=2024-09-14T13:58:58.294295+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Fj9b6kkxMdxnuqrRuI_eDctnvWWxi-Q_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7448931924293160600', time=2024-09-14T13:58:58.382078+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pl9cx5PS49KXNURcagKYdwWSfx8eJHB_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8305419615915620246', time=2024-09-14T13:58:58.447244+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9h5qZNYxEQEjMq9kV9-wHM1oWxE7eXC_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1706527691376954659', time=2024-09-14T13:58:58.629720+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ud-1HaojbhRaPKHqRW3wNzRIQLACYv0_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12970011646633967249', time=2024-09-14T13:58:59.129890+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yTfwelpSfM0zOwy9be8i7IIF7sOyP7V_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7169166045061389120', time=2024-09-14T13:58:59.139838+0000, chain.objs.size()=1 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8MMqe_dnowqFxLq49EC1wD3Lm8IfapN_0 2024-09-14T12:16:15.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7868854740576115637', time=2024-09-14T13:58:59.291756+0000, chain.objs.size()=1 2024-09-14T12:16:15.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.035+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UCLmNTRaPe1593adMiu0QYtTqIm3XcX_0 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6196370577160002665', time=2024-09-14T13:58:59.390327+0000, chain.objs.size()=1 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.baGJR-c10hRpWop2C9FZDsBnKH6nCoY_0 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4003421485303604088', time=2024-09-14T13:58:59.555339+0000, chain.objs.size()=1 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RoZ1q1OKpPTHtUySAUXipd5jZ5VyreJ_0 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8424854017561771382', time=2024-09-14T13:58:59.602093+0000, chain.objs.size()=1 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.G2MlhqQUHaAam2D_rXpLD_ve4MJ7L89_0 2024-09-14T12:16:15.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5179108977761061550', time=2024-09-14T13:58:59.777392+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BoPtGslWX1KmxtxNoywvL9EfX0Qwhsl_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3121291598880525426', time=2024-09-14T13:59:01.499148+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.327__shadow_.0UDpM0vVn6sAJLoJ4vrNltlQ_gkmYGR_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9780180584353843104', time=2024-09-14T14:00:11.086950+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.439__shadow_.yj0-mKZSF3rUrMJtFkb_Jlha1tRx6S6_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18362263961409163333', time=2024-09-14T14:00:40.587343+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.037+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.rFf7kMFwhRG-9P7CLacEbzakzN89grT_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14807263557564285967', time=2024-09-14T14:01:05.463633+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.511__multipart_mymultipart.2~2eQ1j4eC7UGZYKO0pkzUPAf5p5yp7bq.1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3849179309677865372', time=2024-09-14T14:01:08.294333+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.514__shadow_.l5CYrbly3DHxeoDdzLzZ9op1f_L_uqi_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3919648918567232244', time=2024-09-14T14:01:36.043634+0000, chain.objs.size()=1 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.520__shadow:aNW7Vv2HmNotOar8lrRT3RxcmhxOPRe_.6Zwi1apXdeOQWVUprX5Xev9N9CEdB_n_0 2024-09-14T12:16:15.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13770681076978548677', time=2024-09-14T14:03:51.279006+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.553__shadow_.7114xObFXn7nhamwM0hZ-Jb48ouuTFX_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6575490657198405590', time=2024-09-14T14:04:16.842430+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.038+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.564__shadow_.uuA4C8x9SoRVELejSNTQEnXUIvVEIEV_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7957222951839675018', time=2024-09-14T14:05:07.588428+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:SQUJEmSjZo0zIB8MFqLSJx3NtlbhJTT_.qdh8A1NXSHZr8QIWXZJTsLRVmNjQHOe_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14407377927686743419', time=2024-09-14T14:05:39.467705+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.603__shadow_.PTQFdnGXDPsaaM-KcSfuVg0RlXhjAk__0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10227020040318819496', time=2024-09-14T14:07:47.218733+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.617__shadow_.RRoRbuTf2W7y9C5v5nd1GSSqkUPaULL_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7837921091773982589', time=2024-09-14T14:09:52.164011+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.655__shadow_.tbjWzXKvx7FtPX8FrFIIZADz5F2ca48_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5013655170424619542', time=2024-09-14T14:10:36.468818+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.706__shadow_.NYCU5uOwd3mDDpI4fj1j7sWY2n7eiCj_0 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8184580227130513001', time=2024-09-14T14:13:21.116458+0000, chain.objs.size()=1 2024-09-14T12:16:15.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.763__shadow_.QSQJ-TJE5HNKiO8jITysSRNF7_FGBsC_0 2024-09-14T12:16:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11496194227617363485', time=2024-09-14T14:13:57.478617+0000, chain.objs.size()=1 2024-09-14T12:16:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.039+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.776__shadow_.1Irli-k8_MN4_J7hkxjp6tjtytqoSA-_0 2024-09-14T12:16:15.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.041+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.044+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:16:15.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.045+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.045+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45290' 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11937657624505479004', time=2024-09-14T13:53:28.264345+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.166__shadow_.z26nx1WLZW1fGWPyLsDcWaGUCqLOcPk_0 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15711195845700254418', time=2024-09-14T13:53:46.178064+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.181__shadow_.QWGpv1FtnQ3m060e37aZXSgbf0NDvF4_0 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.443227315105319207', time=2024-09-14T13:56:29.968047+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Prq6wzxpql4tzYrs8CKvcegH4XyOJ4F_0 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2197174185180404157', time=2024-09-14T13:56:30.120780+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tnHFpRk-g8pwl1etkQSrzVmLHRJtZda_0 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8395533139452441717', time=2024-09-14T13:56:30.294491+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AMZ7ZN6RHwFBFlTguMElAZUk2JBmcIV_0 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1956941813590365981', time=2024-09-14T13:56:30.437651+0000, chain.objs.size()=1 2024-09-14T12:16:15.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1kIqZGLtiO1bWltoC6MbV51WKK23Tm4_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12098216337704033090', time=2024-09-14T13:56:30.644139+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oI4wAwCgcOtzEIg3jtHNiNM1tI6u5OV_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10592050687714316165', time=2024-09-14T13:56:31.183869+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1t__vAzdyE2Kq2E_WRZHEKpDd_mbeul_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4013232115636175233', time=2024-09-14T13:56:31.339381+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QwSKvPseED-ke_jj21yYmRr7QJH9o3j_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11340274594290159314', time=2024-09-14T13:56:31.995106+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rK7VVvyp7KevC-5yZTSSrYVI1FMZxmE_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6753032856255564424', time=2024-09-14T13:56:32.028146+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HdpVD3RB3B7U2TS7ae1ogNC4VfKwsq7_0 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1828968301597429053', time=2024-09-14T13:56:32.619000+0000, chain.objs.size()=1 2024-09-14T12:16:15.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.046+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hglUmhOSaa8rILQ4ok04ehOCfljU8In_0 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14852565921443271533', time=2024-09-14T13:56:32.659752+0000, chain.objs.size()=1 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nhAPqiNRIfjPlGnWmKaNQ70zIU6YWOq_0 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11832908026380373809', time=2024-09-14T13:56:33.153026+0000, chain.objs.size()=1 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2WK4sGgZdT2WJ1ElSBBTf5FpkHzBx2R_0 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15657721396481921190', time=2024-09-14T13:56:33.421651+0000, chain.objs.size()=1 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.A5FSgXILiFzt_-Ks12Q8vTEWglQ2NHy_0 2024-09-14T12:16:15.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9901203509265182800', time=2024-09-14T13:56:33.619234+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TAMedsEIsH4s_SVKSgDG_wdAS9i3G9Q_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10946316508048376622', time=2024-09-14T13:56:34.058470+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5tAN7lDYRW5Yv_2TQV5UpA9ZKxCsBV2_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14915665630902573399', time=2024-09-14T13:56:34.670761+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.x9U2grp8XHH5ROAH0lwQJRgMm3A81Lj_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9140460291380172973', time=2024-09-14T13:56:36.011578+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DvYMW4tqu_TPYBkDb-ZF4S5knyoltLf_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15288972450836857381', time=2024-09-14T13:56:36.066325+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.A58QDxLB71VEVZs169TCHnLoswTKqy2_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2686415902299941940', time=2024-09-14T13:56:36.192132+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Zuq6lcDL4_Tg4_xYe0VqjS8u5nAHSO8_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17355867172397749204', time=2024-09-14T13:56:36.234137+0000, chain.objs.size()=1 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kTt-ULMbYIlj-QhaMBhDxpg0kFQnWR0_0 2024-09-14T12:16:15.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5350911773549681017', time=2024-09-14T13:56:36.333164+0000, chain.objs.size()=1 2024-09-14T12:16:15.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.048+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hLi8-jshu6TbYYIUIgnPf-CC3tHkGxf_0 2024-09-14T12:16:15.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3146778576643385702', time=2024-09-14T13:56:36.846068+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Z4hhV8gWOA5hINNRD2ggI-2fqCt9QX-_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3244796327788035339', time=2024-09-14T13:56:37.505844+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YXJnEsoGcuT1CWRZ0kAoaPBHFFDBNzl_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16573472590801726791', time=2024-09-14T13:56:37.653274+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Co_g3JOf6frBH-WVeZ8vXGAhqeVbRQa_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7696817190775476475', time=2024-09-14T13:56:37.654057+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IrKdikEHSCuwILYLd8iu9DG5_M7za5P_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9809587418316304547', time=2024-09-14T13:56:38.247026+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5GNJeOxydb77kUTC4zG3rhlqasmuGm3_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16463585009794998015', time=2024-09-14T13:56:38.473443+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NtxWRHqZWkg-b-E7j3fzLVuhm-1V9Qw_0 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16159754442350488995', time=2024-09-14T13:56:38.511332+0000, chain.objs.size()=1 2024-09-14T12:16:15.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iL6Hrukd54z4ZdjUFZnVs0O3xQB-t58_0 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17017982272917619454', time=2024-09-14T13:56:39.030537+0000, chain.objs.size()=1 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nzJVbaf5nVU54CSvOUl4wjowc8aEa-d_0 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4278117828935673650', time=2024-09-14T13:56:39.762726+0000, chain.objs.size()=1 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.050+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tEfnyEcnlOVBUCogPzCr9egnteiMaBA_0 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.051+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9371430628808396091', time=2024-09-14T13:56:40.254774+0000, chain.objs.size()=1 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.051+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Qs_Yj3amhh4aDUzqMelfI1qLER9T31M_0 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.051+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18251039984427930462', time=2024-09-14T13:56:40.318726+0000, chain.objs.size()=1 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.051+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8b94ibpH2hQHrBAgp_igL1t92n7_icL_0 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9591566766320532478', time=2024-09-14T13:56:46.923090+0000, chain.objs.size()=1 2024-09-14T12:16:15.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.272__shadow_.XvhLIZvd-bEuUmks5c6W2emQ-kqedBj_0 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6500773262347729480', time=2024-09-14T13:56:48.215751+0000, chain.objs.size()=1 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.274__shadow_.AhJv_ChPqWOdPzVgfBho3h-wK_e1I6N_0 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17483336906554384156', time=2024-09-14T13:56:53.061114+0000, chain.objs.size()=1 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.281__shadow_.UgbTST9WN7ghgTZAkFN0f2a4_ZmPvZ7_0 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8297320511231684142', time=2024-09-14T13:56:55.937174+0000, chain.objs.size()=1 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.052+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.285__shadow_.5NowDLvsQxnkNN7D5rya227HIBVx5zT_0 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9523753293366609910', time=2024-09-14T13:57:04.894994+0000, chain.objs.size()=1 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.294__shadow_.pUtjzE_XENqDl6UIDBf11NoxrCUMSqq_0 2024-09-14T12:16:15.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2083682117005599076', time=2024-09-14T13:57:08.600810+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.299__shadow_.xFofpa-Lzx7awa_StgwyUee17TMsGQ7_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1743323971318621120', time=2024-09-14T13:58:02.431425+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ht0TDYVXaAU6uqkaYvHwtEB4JMvciIC_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9474877042053519642', time=2024-09-14T13:58:02.589484+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2rxNyQL52Ug6HmIDuqBFQ_GfpxBVTTh_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4656355077980316023', time=2024-09-14T13:58:02.771611+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.053+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Nabn6vMe7WyXd0A0tdsLRyPs7Nk00W6_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4532963908896760749', time=2024-09-14T13:58:02.899367+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XJ2lMjrRYgvcPwMBxiDYEsHEYlh_dUE_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8295957415384064704', time=2024-09-14T13:58:03.919820+0000, chain.objs.size()=1 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qBXgv6bN1KXyu0r8gbBdrTBqSiAy4AG_0 2024-09-14T12:16:15.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9459935661620833814', time=2024-09-14T13:58:03.946615+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.egCLxQaCx2UvEuGrrjapYotE9QoGEvY_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17061611648043599064', time=2024-09-14T13:58:04.019147+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uiMno4SfDyr1CGbs-GMrZccwLLA-bVO_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10951544454018994085', time=2024-09-14T13:58:04.694475+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uGSbClSPcRKsQqZj5-4nlhBhOC2PG-J_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13673445129816365467', time=2024-09-14T13:58:05.204146+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.05_o2wDdgh9vMjH7O6_inY7K1Xz8h3h_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4847354354549456668', time=2024-09-14T13:58:05.338101+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.054+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wDhKBf6zoKonyDdUHEjO2oewi-sQI43_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2739212782912796455', time=2024-09-14T13:58:05.565224+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.z79XNO6TLi6OyLiJmz7SZ5AhrDydnqH_0 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6554546933541698269', time=2024-09-14T13:58:06.040307+0000, chain.objs.size()=1 2024-09-14T12:16:15.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.c_PsIdtUmLdelGYHpUWqiBv9Xma7DFU_0 2024-09-14T12:16:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.115186980759935714', time=2024-09-14T13:58:06.593904+0000, chain.objs.size()=1 2024-09-14T12:16:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IHr06OfxXkjG1oiPg8h9FCVTFEfyXtH_0 2024-09-14T12:16:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8831361153698977089', time=2024-09-14T13:58:06.738786+0000, chain.objs.size()=1 2024-09-14T12:16:15.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.055+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bU5ctNdXrIIKF-S6TwZAOUeny02MmBx_0 2024-09-14T12:16:15.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2104390594872682965', time=2024-09-14T13:58:06.861168+0000, chain.objs.size()=1 2024-09-14T12:16:15.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AhjKCe-CXdRdvlVJvffuCWT8Ks0zWQ4_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7764257754570719693', time=2024-09-14T13:58:06.966577+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hAK09PjfwenKzHoT_Us9_Ngo_2gk5FQ_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2790592704071686192', time=2024-09-14T13:58:07.319335+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.A2xxZWBmG9ucWDQSxt8d_M8VlV2hhIb_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3213391083591405779', time=2024-09-14T13:58:07.431418+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xCHMb8lnLKWCfJBNtsSKezn_GzkShmO_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16680843750104999796', time=2024-09-14T13:58:08.046097+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IvTBQFYrFsyDqt0_hsbhKROgEW_-7y4_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11628760993969500567', time=2024-09-14T13:58:08.377868+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._GfJsZBVjSCHJUHoZpkMjW68q7rdaFT_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13004969840135284761', time=2024-09-14T13:58:09.709137+0000, chain.objs.size()=1 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.jGaWiBNqVjTMcNjN7CcsVopB1wM_qtB_0 2024-09-14T12:16:15.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7455304260370246269', time=2024-09-14T13:58:09.967148+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aSFKp437WI_M8o88pFI07D9rAg7b7rn_0 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15871506342206432146', time=2024-09-14T13:58:10.179011+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bfu3V8L5jHLKm6QiSb9nWCll0wMtGea_0 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7877437891862191553', time=2024-09-14T13:58:10.565291+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ixd2yokFT4mtR4ubTTnwh0MW0aL4BKk_0 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7534673873500060554', time=2024-09-14T13:58:10.854605+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.057+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xUvv-lbGvaK67CluIKgCN1gueKOJJNp_0 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11604367295802327097', time=2024-09-14T13:58:10.855157+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wA0Hf1xbFKkKio8EPCOMmmt4sb3pERZ_0 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14325919017808572345', time=2024-09-14T13:58:11.798041+0000, chain.objs.size()=1 2024-09-14T12:16:15.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9c8O0NGrbVHklYhUmKYscH3rdiXbapC_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11772956062955251525', time=2024-09-14T13:58:12.420070+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.058+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.q6AhNrSWjDCq0eacGC4VNeCo3u6wOjH_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11714388137802183141', time=2024-09-14T13:58:12.482992+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ed_cFldtSCSj801gQ_uDCL_dV5T6mNR_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6004803192230989976', time=2024-09-14T13:58:49.014041+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FP8LiqZd87ySAU6yzs4Dqpo1j6F9nMh_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10721815642437746076', time=2024-09-14T13:58:49.771859+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ts87Tq7dJ3ulacI0RTrXJDR7uqWi53l_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8346415895638498983', time=2024-09-14T13:58:49.931507+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5pEWP54T8G8NkGR-cVo548QkbKVXD3R_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16775129766089731066', time=2024-09-14T13:58:50.572027+0000, chain.objs.size()=1 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MFEb3gzYvG5RHKJd4waA9h7NpemFGWa_0 2024-09-14T12:16:15.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15099747209359554507', time=2024-09-14T13:58:51.056200+0000, chain.objs.size()=1 2024-09-14T12:16:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1HrUdm-T7wdTolsgVr4Mj5y0a6OT_RL_0 2024-09-14T12:16:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8022641560205783427', time=2024-09-14T13:58:51.361035+0000, chain.objs.size()=1 2024-09-14T12:16:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hZoAyvbltXfU3FuLrkAWj5liz9EmCOH_0 2024-09-14T12:16:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6812987720953781905', time=2024-09-14T13:58:52.369028+0000, chain.objs.size()=1 2024-09-14T12:16:15.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.059+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.691RaDOsJJyBcldYKGv740933bBMVq6_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16980049245823597014', time=2024-09-14T13:58:52.509428+0000, chain.objs.size()=1 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LXr4Is8UhgQDpjfCVMBJSUMzvv947Gp_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.468339652824118209', time=2024-09-14T13:58:52.646280+0000, chain.objs.size()=1 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.V8W3lhVw4nreXXU78iYo65MDoY3fGze_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5130357086051720865', time=2024-09-14T13:58:52.819915+0000, chain.objs.size()=1 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.060+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.P-KPS3i85cDA906YzIHng9cIrL9cNfI_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3874950927888285339', time=2024-09-14T13:58:53.517004+0000, chain.objs.size()=1 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TvZ5hQYEHT6ec2ZBRxHX9QAnI2bFI8x_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16953854312323864881', time=2024-09-14T13:58:53.517774+0000, chain.objs.size()=1 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MC0BwgCDj87f8vFoXCBhs66Ko1LNFev_0 2024-09-14T12:16:15.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18025841703012668189', time=2024-09-14T13:58:53.642611+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.061+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Xtphq3gYllAH-D5k9ASuA8eO1LqqFoQ_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18392787869272330822', time=2024-09-14T13:58:53.667014+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KDIJHPooUFCy8KOLDGsSzCUJWhHCXD-_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7271595883132006119', time=2024-09-14T13:58:53.715149+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cT_wgeQs638pl0KCfiygmf-d6XC8Lh5_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2344616996411444995', time=2024-09-14T13:58:54.904766+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RT-qpgEcpKOIdQu6_5_23BfhB0dMkz7_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1933668895909697241', time=2024-09-14T13:58:55.138626+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QvWYWOtzcgwaNq_kADvhRCi7kqVr02l_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17283466840340975516', time=2024-09-14T13:58:55.302280+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.97TGnLNaDHomr0alWwOJMQAhsiwXetj_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8188967055156152177', time=2024-09-14T13:58:56.418732+0000, chain.objs.size()=1 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2JwllZqvLgV3WwbCwz5ZAfCQi9y087n_0 2024-09-14T12:16:15.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12052029435568393224', time=2024-09-14T13:58:56.509095+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ixrnNmL5o_IruRQ5-webKvchPyTjrZB_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3052617259567458783', time=2024-09-14T13:58:56.751747+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nsD-G2J4AGUzZs972f0G5TQvZv7K9kp_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2481715154077232660', time=2024-09-14T13:58:57.069672+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.062+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._Ot_W9oO7xTtO2t7LqL2djGHjVJjKsx_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13068461943024892852', time=2024-09-14T13:58:57.309083+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d8dA9Lk0NpVhrKJ6eFLiPjeHobRtQuS_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9596178304498589474', time=2024-09-14T13:58:57.314234+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1s7f4lvptIlQuHymKDiMNkJx8UztPRJ_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11791489412775873121', time=2024-09-14T13:58:57.924985+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.063+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.unIB0YsfwaroTCgnOFoKcSZAVn2vVFL_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10367035938130268631', time=2024-09-14T13:58:58.159768+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6oeP5SoqAW5bVGcOIPJ-W4RAl9KVysj_0 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8337628568599336833', time=2024-09-14T13:58:58.457334+0000, chain.objs.size()=1 2024-09-14T12:16:15.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bkpvD6byPVDZXlth_NTzzNMuO-fFz2g_0 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11633288560584827551', time=2024-09-14T13:58:58.492955+0000, chain.objs.size()=1 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aeRekR163Ql-mw4peCLOAu9it9VSg8M_0 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10859231293013023426', time=2024-09-14T13:58:58.585857+0000, chain.objs.size()=1 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9tc-WMBgSTCVNiNpOLyhWJIXGoluWC7_0 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4077816538188767639', time=2024-09-14T13:58:58.960408+0000, chain.objs.size()=1 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.064+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sSTGIKrbl4WR_wfbGtHPUy8iKP1ggca_0 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.065+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11804841275650677456', time=2024-09-14T13:58:58.988181+0000, chain.objs.size()=1 2024-09-14T12:16:15.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.065+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.l4c6E_BKHuLlVJpC_M2A7pcglC0O1H3_0 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.066+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/45290 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17599986223452890150', time=2024-09-14T13:58:59.109070+0000, chain.objs.size()=1 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.icRz_YNMzPg4nFN8wCyspw-y_zZEMLn_0 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3990057740308793304', time=2024-09-14T13:58:59.229779+0000, chain.objs.size()=1 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1P5XBp2mddW3dYlGkOKykW3jiWbP-xb_0 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14120966374225210718', time=2024-09-14T13:58:59.291911+0000, chain.objs.size()=1 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jGw-6_JiAq_C_QVYKoafcMfebW1iFlR_0 2024-09-14T12:16:15.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12798229992987324373', time=2024-09-14T13:58:59.605308+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lvKZs1nljLsW7E8OHzXndzU7A5eS615_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15450055214275989763', time=2024-09-14T13:58:59.630716+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RgJrbEgsoFvUh4AA2lrI0GMSyDKQHwQ_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5080235467013345072', time=2024-09-14T13:58:59.735928+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.h8fvMuWMBl3ye_9p4PsXZdnlzRaJCKU_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13101994539825406814', time=2024-09-14T13:59:02.602722+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.329__shadow_.ba6sQuxu4bJj_fuI1Y_d5zsthKJ9-T7_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9627262304102437958', time=2024-09-14T13:59:23.933477+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.367__shadow_.L2NZ-J3WQK3ipmGTx7h6yKOoMhiQ_tt_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12746282777371251085', time=2024-09-14T14:00:19.248345+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.451__shadow_.Tv44-xH_iOL0X07MN6X93jQCBYKJU3c_0 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6523834333403710676', time=2024-09-14T14:00:30.227122+0000, chain.objs.size()=1 2024-09-14T12:16:15.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.464__shadow_.gfgmjKkGpGuuh83GSlYgdiluic_Dph7_0 2024-09-14T12:16:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15125155545655809117', time=2024-09-14T14:01:15.167852+0000, chain.objs.size()=2 2024-09-14T12:16:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.517__shadow_.I6NtkCtjTmo_o3fKfIkiauSTwikhbSq_0 2024-09-14T12:16:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.068+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.517__shadow_.I6NtkCtjTmo_o3fKfIkiauSTwikhbSq_1 2024-09-14T12:16:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.070+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13493577952278634453', time=2024-09-14T14:02:27.840745+0000, chain.objs.size()=6 2024-09-14T12:16:15.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.070+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart._XVpjfGE7lpCdqbfvfKPdnJMCYKkJmns.1 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.070+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.hAljmatVdcFEsa0oFlqvI2gT3gHcNZwz.2 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.070+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2WMMMvaNaHbs4ekRm4un1lBbP1Wttqq-.3 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.070+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.jM2Levy6M_8htTYeLD9zsIiFQMlSujDV.4 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.071+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.nV4haO3EhgdY-poo4TjvdxEhOlbfz-Hn.5 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.071+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.4AFU84cedrgmLoFglVRWzIW54iFB__Rn.6 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16950419323071559766', time=2024-09-14T14:04:05.943002+0000, chain.objs.size()=1 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.558__shadow_.O3qP4xtAYfy9jVwX3VJFFViPvlfDFsM_0 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3789837543473993479', time=2024-09-14T14:04:08.201391+0000, chain.objs.size()=1 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.559__shadow_.JKTq2b7oenhR7blXyAw0NcJoAkWh1ZS_0 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11440407717133666066', time=2024-09-14T14:04:16.191029+0000, chain.objs.size()=3 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.563__shadow_.QrdtFADx6i0kW350qzU6bSrvMFmH-ks_0 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.563__shadow_.QrdtFADx6i0kW350qzU6bSrvMFmH-ks_1 2024-09-14T12:16:15.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.072+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.563__shadow_.QrdtFADx6i0kW350qzU6bSrvMFmH-ks_2 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17928772949498253294', time=2024-09-14T14:04:26.884363+0000, chain.objs.size()=1 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:hUhx7sMX3S6WDtccHx6Zd8F7pHIGRWS_.Unmqy1ql4hQI9qHhJpT-8CgUTFgCjOT_0 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11367557339849441721', time=2024-09-14T14:04:28.691340+0000, chain.objs.size()=1 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:u61TjIRBT6hqHgSd8Zd6IAV981uIhW._.RjJP4QP1eF5bc0yy5vvO6QKxJ79_gZc_0 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14003999190752153023', time=2024-09-14T14:04:56.708866+0000, chain.objs.size()=1 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:QtFw4CX6nD.wjzxjuktHOd.Ius-ErEn_.Uh8kTUx22vmtr6Sx0fOxBbEvKlRdNEW_0 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4038662547564607566', time=2024-09-14T14:05:21.977115+0000, chain.objs.size()=1 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:C2TsIOAf6nbuGSMekSytnV94GSNG.1T_.A4dtgOBlO0gQVVe1oBGkxXVK2tQna2k_0 2024-09-14T12:16:15.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14235866869834697614', time=2024-09-14T14:08:48.691064+0000, chain.objs.size()=1 2024-09-14T12:16:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.073+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.618__shadow_.fyplmH_r-iTUIBvJpMIFBHIeGDHSI5d_0 2024-09-14T12:16:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4753612105006962687', time=2024-09-14T14:09:30.820845+0000, chain.objs.size()=1 2024-09-14T12:16:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.637__shadow_.s1FtLsLfIH8wddXy64B-Jvq7-RCy1_i_0 2024-09-14T12:16:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8917703095204991584', time=2024-09-14T14:09:36.391440+0000, chain.objs.size()=1 2024-09-14T12:16:15.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.643__shadow_.WygtEEXd1Kf7tkHIkUCqe4_hGjdirVR_0 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4054957647857951840', time=2024-09-14T14:10:10.156593+0000, chain.objs.size()=1 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.664__shadow_.NNx3BSu_Rj_Lqc77ktJmDbvIw6cBJtv_0 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6611618602786558044', time=2024-09-14T14:10:10.157281+0000, chain.objs.size()=1 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.664__shadow_.hvpHhs_DE0rc6-DjiI7DQt1sbwwz6ba_0 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14501166354931495065', time=2024-09-14T14:10:14.309596+0000, chain.objs.size()=1 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.670__shadow_.VUn56-5aomg7vmk32rEltJqc99U-YAy_0 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17472825634871467266', time=2024-09-14T14:10:30.832269+0000, chain.objs.size()=1 2024-09-14T12:16:15.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.074+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.698__shadow:S3uvSq9kRSsJVlsaTE1JjsBHhyuZ0Bi_.wbjNslg6HC08Vk2xCO59p0GFOMejCEu_0 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11886257755214881350', time=2024-09-14T14:11:26.353893+0000, chain.objs.size()=1 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.739__shadow_.9W75HvzDix03CA7ocrBSN16EYB-jyTQ_0 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.640093642369925539', time=2024-09-14T14:11:44.618519+0000, chain.objs.size()=1 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.748__shadow_.qio5o8K35UeEl_IrhuKj2N02WUE3U0Z_0 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8618324850254920528', time=2024-09-14T14:11:57.927834+0000, chain.objs.size()=1 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.750__shadow_.gXw3ovNn5UR06-0qD66sYP8ureHvDZB_0 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1766989980367243310', time=2024-09-14T14:13:32.588497+0000, chain.objs.size()=1 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.075+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.768__shadow_.AMb6KnUilQl3Bi8dskLr1zwjzUwyGTC_0 2024-09-14T12:16:15.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.077+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.079+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:16:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.080+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51819' 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_v1yu_XgCa5rbV_NLf2HMG42kdyDyJoW', time=2024-09-14T13:53:27.746373+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.165__shadow_.-yyv2brxxtAYCikb8NJWdJM3DFLZYxa_0 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17668471788886119475', time=2024-09-14T13:55:39.025774+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.240__shadow_.a4g5optzmDhiEqJTxPVaPiLpI60y6aR_0 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18160670650637130825', time=2024-09-14T13:55:43.766777+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.246__shadow_.50E_QvlGJD5RalwQBMiFUFU2LGRzFG3_0 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15465802545186252356', time=2024-09-14T13:55:45.202515+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.248__shadow_.zlnQUfwBjfD4KFM6Wye_20r3fun0FTP_0 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11382270924171558768', time=2024-09-14T13:55:46.587958+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.250__shadow_.eYKRClUNtItpcIxPfkJmCW097ZXrHSd_0 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3254759014037698408', time=2024-09-14T13:55:53.432383+0000, chain.objs.size()=1 2024-09-14T12:16:15.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.081+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.260__shadow_.Pp7C532Hjy3byNIeRhjtL_hGpMVHSzg_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16066149927044549075', time=2024-09-14T13:56:29.739355+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jtZewJNYwP0bv3UJYmxbFZ_TSukAwzD_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14329098714354508467', time=2024-09-14T13:56:29.973048+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vt3IyCDQsYPHi6d3BMq3ugWojww1YzW_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1006462859010351127', time=2024-09-14T13:56:29.973759+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VQva5KmkI7whT8tkDRLwFg2_IGAWXv7_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13370467588206829813', time=2024-09-14T13:56:30.033695+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-TGe3lNYAAuhhGaO7lueBD7K78J4IuB_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13012019147812723209', time=2024-09-14T13:56:30.259461+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FOF9LEt0JG9kQs1JzSMeoUvj6tpzlfg_0 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8326796239156178278', time=2024-09-14T13:56:30.260464+0000, chain.objs.size()=1 2024-09-14T12:16:15.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.082+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XsDU29QQBcEqNQc_3Z-kssvXQPYl6QO_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.083+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12378989791935895793', time=2024-09-14T13:56:30.263268+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.083+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FOq1Lhe8nfgo--zlOcny7HQijNmxyaP_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.083+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3228921748885930684', time=2024-09-14T13:56:30.350512+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.083+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AzxcrCsXNaLYMScJvgO-Doyvu-gGPmL_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8847148170417594316', time=2024-09-14T13:56:30.700189+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3J4pY0b878vOt8RhZJ9fFoD_N0xw9W0_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18103864762491155', time=2024-09-14T13:56:31.964720+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7NhDfp98_R_1r6CndQIfIgtmE-EBlu7_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17775365919618733072', time=2024-09-14T13:56:32.849825+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WlPXgiAmQW8z_y0b9LMjrMsOdJtl6XZ_0 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7382759841770578546', time=2024-09-14T13:56:33.029747+0000, chain.objs.size()=1 2024-09-14T12:16:15.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.U4LXosbhwm4n8OZrBCQPrISbOXWBJhI_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14262702950332225580', time=2024-09-14T13:56:35.425411+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oaHnBAPtB9hib2KHP3qtzfyQfQuyQcA_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7196029261374641194', time=2024-09-14T13:56:35.467829+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Amnw9qzUlTG1JnWTKb2aGO6tB0XRjqR_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6220139105732750622', time=2024-09-14T13:56:35.571475+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Pv2diWGN29l-4l79k62qXJeACjzllCA_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13886572057779538629', time=2024-09-14T13:56:35.593652+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BFpGI0fvODbO518SjUO9L5wEmCJxDFi_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12454952043406749614', time=2024-09-14T13:56:36.263081+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.084+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._klnHnRho9OyU6Uu1GDUQfSb6lcgUqr_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.085+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6359754357269652653', time=2024-09-14T13:56:36.787521+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.085+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Suwh8jrFt8UbrVouu6tDHIwytiCc4cy_0 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.085+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12596089213482273604', time=2024-09-14T13:56:37.490260+0000, chain.objs.size()=1 2024-09-14T12:16:15.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.085+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iJJ0Jk7e5F6GV1aO-8xVafGF4Ee3Dlq_0 2024-09-14T12:16:15.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12171383739742648366', time=2024-09-14T13:56:37.612677+0000, chain.objs.size()=1 2024-09-14T12:16:15.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vfAy7U8Ur1tAVruF6H3CgHXDGDUEMLk_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236269653428895582', time=2024-09-14T13:56:39.193189+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TotxCidBuhZF4vuJRM41BDWDdn0yAdU_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14289422625567681875', time=2024-09-14T13:56:39.524783+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wOlSCJetzuwMAd6jWQZjQgJ75FtZ-at_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8499106280994314510', time=2024-09-14T13:56:39.954069+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-mEjXvVQRDABjyxzLL6t6h6h2ZGbWDt_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16901516453490354563', time=2024-09-14T13:56:40.070113+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LdkIXee6FeBAsBM0BVOQjUoMAy-4yzj_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2396782687986121044', time=2024-09-14T13:56:40.107750+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LRdRNkAsAApbgzk10K8tQf4gajLczvL_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18292579729942999874', time=2024-09-14T13:56:56.691514+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.286__shadow_.fSrLWhGNiSlbPLv8TQCHL-_8sJqIfgM_0 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10113383992976143030', time=2024-09-14T13:57:00.297346+0000, chain.objs.size()=1 2024-09-14T12:16:15.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.291__shadow_.Z578zr_rAImoZlkhqDXGiIiI5FLPz22_0 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8800378644966537385', time=2024-09-14T13:57:06.302931+0000, chain.objs.size()=1 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.296__shadow_.aRPOZOT3tC5dWM44czcda8upN4oSZvY_0 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.086+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2916052807304286102', time=2024-09-14T13:57:10.000092+0000, chain.objs.size()=1 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.087+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301__shadow_.zKzQwTyaomcaOyHvLzPJcUFkdNl1pEK_0 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.087+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17663944939535943793', time=2024-09-14T13:57:13.698808+0000, chain.objs.size()=1 2024-09-14T12:16:15.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.087+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.306__shadow_.vX9nCs1t9-_vX_nB6l92nDA-53o25a0_0 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11715510760844059739', time=2024-09-14T13:58:02.237791+0000, chain.objs.size()=1 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xIUapBXMT_u2toskVO8q7ywRYdINGfH_0 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8482692604315957388', time=2024-09-14T13:58:02.693063+0000, chain.objs.size()=1 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TG9F8s8FOea_Mh94-_QKf_uN7Z6OhQI_0 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15056332429658842281', time=2024-09-14T13:58:02.910327+0000, chain.objs.size()=1 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.088+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QuLiSaURvGiPiPp816jmBqZ0iP0s4Sw_0 2024-09-14T12:16:15.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8399829087406410386', time=2024-09-14T13:58:03.022154+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X4bHddcz0SCh0gSW-L7uQUvl12lNfJc_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9384101418356982417', time=2024-09-14T13:58:03.747964+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QUPqqZnbuRLhGMLFBStcAB4IthJ12UX_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12821192111517432235', time=2024-09-14T13:58:05.664912+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.089+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rC3O_rv1O8DB4Tp1z5m9TJxK5UbFLnP_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17293911472937335363', time=2024-09-14T13:58:05.876609+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PNz6l-pHRm4ckqY4J0Yh5nlDTRQvsQa_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12388121666095254522', time=2024-09-14T13:58:06.580903+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FqCiIyzULW4l6jhXHFw29NnfR4yU6v8_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17912353811726244193', time=2024-09-14T13:58:06.714727+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0RNfva_6xBisS-IlokRB_ZKn7WudL2m_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6833673946421155002', time=2024-09-14T13:58:06.741854+0000, chain.objs.size()=1 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yBtCTua8R-bvd02lNfpdXqS9ciS-bAD_0 2024-09-14T12:16:15.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9058518322750087273', time=2024-09-14T13:58:06.976773+0000, chain.objs.size()=1 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ywcsHBgo-OhlDewImiy7g5C6X51YBCG_0 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14378250773445795237', time=2024-09-14T13:58:07.109197+0000, chain.objs.size()=1 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7KcttwGTSxq_a2_XpOSa7JoIZWzKLfe_0 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4318469774770101108', time=2024-09-14T13:58:07.183628+0000, chain.objs.size()=1 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8NXPaMDsdlCo1QI8GlR9_Bzz7YVv7rb_0 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.210593197406049404', time=2024-09-14T13:58:07.240178+0000, chain.objs.size()=1 2024-09-14T12:16:15.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.090+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ICVMVmCJsqb2qheQnPl9mxiWHzTXKBz_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11823878205737542546', time=2024-09-14T13:58:07.350487+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.j22C_A9oFXIcRaEa5PmwCyZW74K0c4P_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7254537105907535997', time=2024-09-14T13:58:07.540256+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0w1iG99SXMm9eRCei5g8qpSf9bwpIPU_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15108591406505713003', time=2024-09-14T13:58:08.218067+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MrC2fuN1tdY-ysrpJcW0mfb8HxccmVH_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12815612739982650428', time=2024-09-14T13:58:08.304326+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eunqsyZoUWNK07bghvFyaCN0QNPlJ70_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16287958548647084963', time=2024-09-14T13:58:08.437131+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SIvJw2N1Q9X-G1RbiMI80KtMPikz7jt_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13299729784428372324', time=2024-09-14T13:58:08.556350+0000, chain.objs.size()=1 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NZCsyflPWaWwWwambKb_sHsfw_LG2w7_0 2024-09-14T12:16:15.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16565850284905901624', time=2024-09-14T13:58:08.598971+0000, chain.objs.size()=1 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.091+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IchcBsznA0J_PiOQjd5EFmjYpQoj892_0 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9200845227404144564', time=2024-09-14T13:58:08.699471+0000, chain.objs.size()=1 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.G20K1KSw7vtLUxxKZx8JR0OgMHnhD7X_0 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11078673781436305842', time=2024-09-14T13:58:08.709025+0000, chain.objs.size()=1 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eJdeJuzlzP1FGkC4bvNu569qJEaaLrz_0 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3742135573326176724', time=2024-09-14T13:58:08.817309+0000, chain.objs.size()=1 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.sRfWCzVZrVER11okdCMY5B3-RgL7OCo_0 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4573932649073830214', time=2024-09-14T13:58:08.881237+0000, chain.objs.size()=1 2024-09-14T12:16:15.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.pnvqj4zDLtWfO-Aw86e-pLsBUhTQiDU_0 2024-09-14T12:16:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7403415821841571591', time=2024-09-14T13:58:09.421583+0000, chain.objs.size()=1 2024-09-14T12:16:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PaJF12-wfDCY6iGTn2o_k7zTyMtHQzS_0 2024-09-14T12:16:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1017140549093389605', time=2024-09-14T13:58:09.709006+0000, chain.objs.size()=1 2024-09-14T12:16:15.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BNpZGelkPiv_-lUVXJLWRlSSjWTuv4v_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18333752422533108461', time=2024-09-14T13:58:09.827355+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.a10_4WJcfV7N8iAlwoLiKOdSRlbGuj-_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10401569560054492166', time=2024-09-14T13:58:09.827852+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YBciRzqj-0t3dB5xH99CFA_Ll6H51JD_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5161164917097296743', time=2024-09-14T13:58:10.176885+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.093+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Gy4p_rhE8xwdpR04C9fOiqmu2vLC0Zw_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.094+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10486284933177292753', time=2024-09-14T13:58:10.240698+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.094+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NQzrmSYoef3Cg9KT5cQ8duNsuFPiQkQ_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.094+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8243360617388416199', time=2024-09-14T13:58:10.749002+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.094+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._UF5_hE19Un6GEjGhL-Kt1HVUQvZC5P_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2294070335493392824', time=2024-09-14T13:58:11.040249+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HD3f9LnUjA2Bh-xY8Zb9de0aCHsc77v_0 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14111634595691166772', time=2024-09-14T13:58:11.503442+0000, chain.objs.size()=1 2024-09-14T12:16:15.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bqACVQcMSTTWu3Wz4fVGRnXfsQCuQFK_0 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8965030070971172320', time=2024-09-14T13:58:11.803482+0000, chain.objs.size()=1 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Txd13HzML7CEU62mrY85Jp5-SPFjzbu_0 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18328236556881739576', time=2024-09-14T13:58:12.103360+0000, chain.objs.size()=1 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.L7V2lSlGTznIRpNMjyASuGUK5HuNBP0_0 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.980381092341990735', time=2024-09-14T13:58:12.104260+0000, chain.objs.size()=1 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.afu2ClXleTZj4LKfckKh2B5shgZ3d3e_0 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14232897134408068108', time=2024-09-14T13:58:12.253908+0000, chain.objs.size()=1 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.095+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.89TvNk0jWoUaDjoGIAlsvCGpYetjmbq_0 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11890533611154611751', time=2024-09-14T13:58:12.360471+0000, chain.objs.size()=1 2024-09-14T12:16:15.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rhWQ3jugVNMEaIv92JufRCgi9K1vNLD_0 2024-09-14T12:16:15.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12427824658767756298', time=2024-09-14T13:58:49.273506+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.1Y9Bu6L2BNZMRjHVW83aNF2tOWteiYF_0 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14271158473518879253', time=2024-09-14T13:58:49.305409+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JgWwvplqgAAE4hV58CSzQmPOJBN_lYp_0 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2700360561199826007', time=2024-09-14T13:58:49.720861+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tTSFmj7EcJgHI2fkHrwtcGiZKbfnPnq_0 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6672943158306302932', time=2024-09-14T13:58:49.804822+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aMH7PTyx3hU9y4ZdUxMBIFTwK4AY4PK_0 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7104527524824901997', time=2024-09-14T13:58:50.753143+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.096+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XBvS29dJXAudIzCVR6YtBVpGmTFE0XL_0 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3790104879362902896', time=2024-09-14T13:58:50.950245+0000, chain.objs.size()=1 2024-09-14T12:16:15.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ecfV7WNbGSM9UI-wLmy9Jz4gdgEC3Uy_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6337672507765298527', time=2024-09-14T13:58:51.206893+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fw6GPvlIwdlFfq9mkbCiwxOVE_OY6tD_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14455483750327283607', time=2024-09-14T13:58:51.207594+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vykHXhQXT4SzWsnS9549mHcYamRu-hk_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18234356678330180119', time=2024-09-14T13:58:51.289683+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.097+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZDpUBP1N5D_J4_ziz0CF-LscRhbeOTX_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11894831343681440057', time=2024-09-14T13:58:52.100159+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.b7pkkz9Zre5ERgs79gCkKhFLNiOkhNI_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2538864234270921726', time=2024-09-14T13:58:52.364960+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fQRCGhJ3WhxIJO1UBirXDApaG5DqLN1_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9238506885603440466', time=2024-09-14T13:58:52.611886+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ylwB-gS02UMGHRPybEfQOYi-AiwZx27_0 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5820196672320742577', time=2024-09-14T13:58:52.743152+0000, chain.objs.size()=1 2024-09-14T12:16:15.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.098+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nK3lu7khoDYRxoEYJS8olPkxmoY8Txs_0 2024-09-14T12:16:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.099+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16743658432566660431', time=2024-09-14T13:58:52.778744+0000, chain.objs.size()=1 2024-09-14T12:16:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.099+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iicdBK1X8WnDf9QROnN-MNg_uld8LEP_0 2024-09-14T12:16:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.099+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14053058460643866569', time=2024-09-14T13:58:54.891954+0000, chain.objs.size()=1 2024-09-14T12:16:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.099+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Or6hIi5R3Gef6yk4lapCEWX3sWtQged_0 2024-09-14T12:16:15.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16856922281573290684', time=2024-09-14T13:58:55.063757+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gYwcoJ0CZYgRDXVWmvXe-wev96UHVGQ_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.775766284939926868', time=2024-09-14T13:58:55.084594+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qWGUL8K68YMtGrWYUkuxF-YybXUQAYW_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17169683169522142118', time=2024-09-14T13:58:55.233363+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PY9mW2EJKpizqojMhKuNxRH9wo91ub5_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9862835512396872957', time=2024-09-14T13:58:55.728003+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hxsjC-rCg0PEky8dSo1V8J_vtUpsgdX_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18062597768860851772', time=2024-09-14T13:58:55.756208+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Vwjm9AujaMszEop1GBmR4aWQl2JPXpG_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15643267468587076826', time=2024-09-14T13:58:56.955291+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.71N3iJT_L0R-7lE-JjRWSTzA3iXA3Ye_0 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16602464955029241975', time=2024-09-14T13:58:57.699874+0000, chain.objs.size()=1 2024-09-14T12:16:15.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ePL4ls33FLzXiWNvltOun8puV0eq08E_0 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9312027341011563460', time=2024-09-14T13:58:57.817864+0000, chain.objs.size()=1 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aR5_kD5pbptyPpbonG0UuL0lLEktto__0 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2990223923137194913', time=2024-09-14T13:58:57.923590+0000, chain.objs.size()=1 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0KoE0zTqajYt0fiKbk8oYosCLf9m_O9_0 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.928398580408471939', time=2024-09-14T13:58:58.260470+0000, chain.objs.size()=1 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.100+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OFflMOqfZ64AHf1gh3dbcLToPLwQ2rN_0 2024-09-14T12:16:15.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.102+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/51819 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15767454518518567941', time=2024-09-14T13:58:58.543491+0000, chain.objs.size()=1 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.M7cO1Zf44nr4nZ8bXMh4x-xsH6zWjZT_0 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10774357677024342628', time=2024-09-14T13:58:59.082482+0000, chain.objs.size()=1 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XbqQpTmLeXZUK35ea0oSGczDTD_r5qZ_0 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17081172443686020298', time=2024-09-14T13:58:59.295354+0000, chain.objs.size()=1 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rdnFZgjwwwvvnCahEVIriQuuUmU70UR_0 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6425517998091060019', time=2024-09-14T13:58:59.381643+0000, chain.objs.size()=1 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.oxrhId89S8RHBCrfrDWYVYL-Xhh5AHE_0 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3463531760277118899', time=2024-09-14T13:58:59.506052+0000, chain.objs.size()=1 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Yz1iQC5BbqdfYL_oMDdbyzftbFyeJKK_0 2024-09-14T12:16:15.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.681287827144567750', time=2024-09-14T13:58:59.552675+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mu9Xo0R-QjIR7qnjSz0JLeN-dFoZ0xr_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4312422286791556649', time=2024-09-14T13:58:59.553407+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lNzhLkn6RJY1mfWMi8bAvv-SOjjnhIo_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10769768449228491849', time=2024-09-14T13:59:31.141786+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.377__shadow_.VnV2EE8JJOmuw30D1sCOH58xNVEmWwm_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4962950023973135971', time=2024-09-14T14:00:05.748649+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.431__shadow_.ib5C2CIegK49BhZ4bDIm8yH3oNUAfpa_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14462605755190057011', time=2024-09-14T14:00:40.576848+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.TGwN4f0sn3EIpP6x71GzaYT-eQEd_OC_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7834771913357000856', time=2024-09-14T14:00:40.577970+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.A1ZaIW1-MKtlzOcUDo7PS4LZP5CWweS_0 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14576913875684536157', time=2024-09-14T14:00:46.411680+0000, chain.objs.size()=1 2024-09-14T12:16:15.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.105+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.488__shadow_.sVz0bf9WFmc9gKIXL5WUZqnyz3vJzDP_0 2024-09-14T12:16:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.106+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17632330316192613574', time=2024-09-14T14:00:51.191312+0000, chain.objs.size()=1 2024-09-14T12:16:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.106+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.496__shadow_.LbrsrIsRNPtumDP0jAbWo2X-8egyGen_0 2024-09-14T12:16:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.106+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11139882142149023453', time=2024-09-14T14:01:03.967309+0000, chain.objs.size()=6 2024-09-14T12:16:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.106+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:15.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1595975100347396314', time=2024-09-14T14:01:12.356255+0000, chain.objs.size()=1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.518__multipart_mymultipart.2~Kz0RhoZ9tkTjFhh1oOcwUv3Byirp_5Y.1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17513405065428897820', time=2024-09-14T14:01:14.785247+0000, chain.objs.size()=1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.518__multipart_mymultipart.2~HCEoXOtmR3GhDmI-pyoaLHwHalgN3cL.1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.538615+0000, chain.objs.size()=1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.542602+0000, chain.objs.size()=1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.2 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.107+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.545983+0000, chain.objs.size()=1 2024-09-14T12:16:15.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.108+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.3 2024-09-14T12:16:15.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.108+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.549522+0000, chain.objs.size()=1 2024-09-14T12:16:15.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.108+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.4 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.553261+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.5 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k', time=2024-09-14T14:02:24.557189+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~4j9UYgMbgOSU0uQPYC7Z1uIF68Koi_k.6 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~BOsb2ZHX4Brbj20GxTLx32-Doh4k3oX', time=2024-09-14T14:03:06.266902+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.534__multipart_mymultipart.2~BOsb2ZHX4Brbj20GxTLx32-Doh4k3oX.1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.457896360268041034', time=2024-09-14T14:05:03.042614+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:ePjEbN0fluZEtKhIeGBOVRQ1q2MEkPr_.6Pc3Bghk9kfiENYGnnbkoZ0wHvIplfY_0 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3031458721440404260', time=2024-09-14T14:05:24.875637+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.582__shadow:qToYP17YoBHjyOPe3VGvjeZ67lVBDxU_.GhMNE3LvD5mYBirdl1zI4NF6ZL8UULk_0 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14632929462189055539', time=2024-09-14T14:05:25.878203+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.583__shadow:838KPLvOMIXduJbJB5eldb5t1HyS9Xq_.X0nmBWCSUrwz9kxsDKaeyFVqFH1meSa_0 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5649312682453505931', time=2024-09-14T14:05:28.016307+0000, chain.objs.size()=1 2024-09-14T12:16:15.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.585__shadow:x-JHP5Ca6itfLYv.MCVOH.BUI76tTVH_.Y8jv4yhrDJSWHfPgBiqwzpbaSCPBHVg_0 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9068559285391262192', time=2024-09-14T14:05:35.669816+0000, chain.objs.size()=1 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.596__shadow_.o1Buhj7_hizO2quOVSmIvtQQxNCi-Y2_0 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6066451681014066290', time=2024-09-14T14:05:41.597845+0000, chain.objs.size()=1 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.606__shadow_.uacdN5hwmjqUR2hGuudD9lDotCKqoE1_0 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8167469443887555772', time=2024-09-14T14:09:27.463806+0000, chain.objs.size()=1 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.109+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.632__shadow_.ohRRcLEbOng67JDHPJh40xfRz2N-rbT_0 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9298220560230763805', time=2024-09-14T14:09:49.092730+0000, chain.objs.size()=1 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.653__shadow_.iA7OS6v-6RnPzpOBhtRaF_GKQ2V7W6L_0 2024-09-14T12:16:15.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2214847057339446865', time=2024-09-14T14:10:09.159216+0000, chain.objs.size()=1 2024-09-14T12:16:15.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.663__shadow_.yPQ0mWOt-LwB3qMQ-EO91h7X1u9a8tQ_0 2024-09-14T12:16:15.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7355597261746661013', time=2024-09-14T14:12:18.267261+0000, chain.objs.size()=1 2024-09-14T12:16:15.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.111+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.752__shadow_.d5MKzCy8wTD2ohBIO9yEsAia1PZGuYZ_0 2024-09-14T12:16:15.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.112+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.114+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:16:15.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.116+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.116+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49753' 2024-09-14T12:16:15.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6714489612612770710', time=2024-09-14T13:55:32.370710+0000, chain.objs.size()=1 2024-09-14T12:16:15.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.231__shadow_.Tkpc_5Y6XjVuEC5iNi8VvRpahPkLQ52_0 2024-09-14T12:16:15.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13222754030856160194', time=2024-09-14T13:55:49.382644+0000, chain.objs.size()=1 2024-09-14T12:16:15.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.254__shadow_.zrcy3RMFAS4K-zjgdxwRWsVjAuDb2-w_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4368870966154967512', time=2024-09-14T13:56:29.632316+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XUDQbsuk4caq3BWNjasQ4Lo9Zh7FP_V_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5450773783050981525', time=2024-09-14T13:56:29.633168+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UhTzt2o7YlHD1lzYxXkFE11S-4V0ZFs_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18330439787119129827', time=2024-09-14T13:56:29.743207+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.d0LLgK5UJd37ktXXP7Dulsz5V-_XtAW_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10279109175649846548', time=2024-09-14T13:56:30.132435+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vL-nD3oV3Yj2lITLNr_ImlxEWh_xUTY_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4515936405721387666', time=2024-09-14T13:56:30.506656+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Cp5WKANVp8c0u9_KQrcwLhSKY7m4n5b_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14463772848671314333', time=2024-09-14T13:56:30.583774+0000, chain.objs.size()=1 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Q5Iff1jsDS2EGMDVcTzm8fcx2NEGWrk_0 2024-09-14T12:16:15.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6223089230185243332', time=2024-09-14T13:56:30.650674+0000, chain.objs.size()=1 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8dlXOswhB3xWnspPO8t2WKC35dUhrdJ_0 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4059871788177340613', time=2024-09-14T13:56:30.651424+0000, chain.objs.size()=1 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.uqfEEShGYcm8wVtZpIh8ytABlDAvbuB_0 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8075478715042133504', time=2024-09-14T13:56:30.673192+0000, chain.objs.size()=1 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.hGEoJU5SQEMSbdkn8dv3Od4sC-GGBKp_0 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3112006217093768545', time=2024-09-14T13:56:31.179293+0000, chain.objs.size()=1 2024-09-14T12:16:15.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.117+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1bc3mW5nbPvZAflwQorWUFUEwre7pgp_0 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10240012383700268936', time=2024-09-14T13:56:31.228005+0000, chain.objs.size()=1 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bznaisXFUvj2X3Dv0To2Gu7OnRjLbCi_0 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8793321196114881614', time=2024-09-14T13:56:31.335353+0000, chain.objs.size()=1 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.durj5tPEAn9JZ1Dyk4zriBdxDPQeF8e_0 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6722887967189865070', time=2024-09-14T13:56:31.413343+0000, chain.objs.size()=1 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9Cisqwchg8itR18xMK-_vT-4VUhnu5h_0 2024-09-14T12:16:15.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14736749336500491667', time=2024-09-14T13:56:31.440683+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Xn0aGvTLZsRrcZKs6KnzxlfEC92Z0E-_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17767503022804623344', time=2024-09-14T13:56:31.546549+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.119+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Dasky37_hshsr3xhGLLpIzIB0uaQYFR_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1506568042182132318', time=2024-09-14T13:56:31.701688+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pLud2B_CTwI0iKLIEOrnMYjf0TGFIxz_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3438774728655786006', time=2024-09-14T13:56:31.908974+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.S4QX-VLW7ox_6ehcq_o6bgxiWHo7Zma_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6999603504565486883', time=2024-09-14T13:56:32.182373+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HsXTxziXE-nQx4-a2eaxF7nQtd3WZ20_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18002380183252181565', time=2024-09-14T13:56:32.923282+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CwayjCEram9pg6itK1aDDUm1I2KtZtz_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5801019306441736746', time=2024-09-14T13:56:33.309807+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fEclhjkH7olzRBg6zS7fSOKC6ntBtlO_0 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.594064963772695419', time=2024-09-14T13:56:33.395540+0000, chain.objs.size()=1 2024-09-14T12:16:15.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.120+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.UPTsX5FpqUGgOXpQ8T2t4emvMhJX4ks_0 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6180653633381166828', time=2024-09-14T13:56:33.490019+0000, chain.objs.size()=1 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.al2c4e49cEpjO25c9PTrPNVZHbsuZ4f_0 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4309460387594080140', time=2024-09-14T13:56:34.375816+0000, chain.objs.size()=1 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.s4coPRtJvWWh1_goEbvSQSdTkfNW-Vc_0 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12013806025610599771', time=2024-09-14T13:56:34.572174+0000, chain.objs.size()=1 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nkewi8pLzjkwzf_ujhXgy5e4V0Vsren_0 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13579260744290555616', time=2024-09-14T13:56:34.794908+0000, chain.objs.size()=1 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KWq99WKbScL5DVnUBBRts2FgQQ44GLv_0 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10443173792860664715', time=2024-09-14T13:56:35.046214+0000, chain.objs.size()=1 2024-09-14T12:16:15.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iBYVM2RespjqS9UJXhNVcdZqZui6U6E_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17879079524870235689', time=2024-09-14T13:56:35.765738+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.121+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.i1g2bdbiQJ7-ZO0bnuXvLKuokdJSUiF_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17726412465664340648', time=2024-09-14T13:56:35.781174+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RGzCMoxExvJ5dNPHaHrOL4UcnVEdJ_N_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5448907338867150711', time=2024-09-14T13:56:35.821153+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dwfZJadTNoY9tf5UQ5woxnw3-HHJaFM_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17425801291311641455', time=2024-09-14T13:56:36.974109+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.73mFCWMajlkExSrAsRd9UBj26eM8P2W_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14071198132828911046', time=2024-09-14T13:56:37.081085+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qataXbT5dIciuos0j_QlnxcrMftROXf_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15261698187904381130', time=2024-09-14T13:56:37.119568+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.48dEkZkrDQDX6ZorqK9CiVShJJ9nAdW_0 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10245435593297075877', time=2024-09-14T13:56:37.215268+0000, chain.objs.size()=1 2024-09-14T12:16:15.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.G2fkMPhdgAPMCd2C-nsMOnhzBSh2Z0t_0 2024-09-14T12:16:15.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6241710518001914825', time=2024-09-14T13:56:38.276941+0000, chain.objs.size()=1 2024-09-14T12:16:15.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.122+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OuSEvqYs33HCNkyNiNgR4L-HfYNATqp_0 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17587325333881375348', time=2024-09-14T13:56:39.224660+0000, chain.objs.size()=1 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-2q5DEjFs4sLJJCX9KHeDPF6Ugb1JMr_0 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8875714354590176226', time=2024-09-14T13:56:39.819528+0000, chain.objs.size()=1 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DGBLWKdutIGls-52xtKwsfefeFJfwYk_0 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12016580375003497172', time=2024-09-14T13:56:40.004108+0000, chain.objs.size()=1 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Sjrc6TXmMOtb9TRIYCgcPk6Bh8DfWey_0 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3946854171572668146', time=2024-09-14T13:56:40.113912+0000, chain.objs.size()=1 2024-09-14T12:16:15.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.123+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YUdBseURJ1PhzgPfRynCiIU3EHtUgx8_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15175989696754522110', time=2024-09-14T13:56:41.687802+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.264__shadow_.qfAdula7MDk-nnVSjKFhi-IknvkZTM7_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9204488511315404767', time=2024-09-14T13:56:44.959448+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.269__shadow_.do7y_qSPE2Y3iwjVa3BB6bYg3Ntn0Ly_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2618070787691339721', time=2024-09-14T13:56:48.895630+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.275__shadow_.ImQtLtr4oIGV90PolZH1GNrQRrWT_pE_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12696329180915818465', time=2024-09-14T13:56:49.594629+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.276__shadow_.AN5FLlI8vXbHuxbYjeWaB7rJwJX1gPl_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6537993278488813701', time=2024-09-14T13:56:53.060459+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.281__shadow_.c8-5GDHyteK97D9XxljJsV_JpHXCEm2_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11046637146336438428', time=2024-09-14T13:57:02.227284+0000, chain.objs.size()=1 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.VKjSmuGTN05yZlep5654gYh4qN60Nc2_0 2024-09-14T12:16:15.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1351163903453718497', time=2024-09-14T13:57:04.072891+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.124+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.vVC1zRlkkPQ8SIUIIjShffxcrXChVU4_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.125+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16191917515834527690', time=2024-09-14T13:57:10.719044+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.125+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.302__shadow_.rldgZUgEiTqzeyoR1L9ZmSPoALEMWBl_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4707709156118737552', time=2024-09-14T13:57:11.413360+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.303__shadow_.HE0ewkGwiAWrmE9-l3J38wQtKdmyKdD_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2573047429218725174', time=2024-09-14T13:57:12.096646+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.304__shadow_.1chn9L5EjZ2A2DrXml1HaNNh__ZzUun_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13365966246867034865', time=2024-09-14T13:58:02.513619+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.acUP0XGS8tsYy0hNo65zCSKOaKLGntq_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.242517142419628837', time=2024-09-14T13:58:03.023369+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.c7LxAcQyMkSuR9VxCKyCFfKdO5W3Zrp_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1011920845229510756', time=2024-09-14T13:58:03.066840+0000, chain.objs.size()=1 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WzQf455SqMdwQq3XSOgqoCvDo3bGiRa_0 2024-09-14T12:16:15.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6080706331604357713', time=2024-09-14T13:58:03.138146+0000, chain.objs.size()=1 2024-09-14T12:16:15.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LdxarV1thJRdQipxvQaRTstmqC24R47_0 2024-09-14T12:16:15.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1940845264746438340', time=2024-09-14T13:58:04.392106+0000, chain.objs.size()=1 2024-09-14T12:16:15.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ENdzvY5nuB3kTjpVQdn_iQRC49L_bU0_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2585908038479869429', time=2024-09-14T13:58:04.547626+0000, chain.objs.size()=1 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NI-qAQRyovQE1jwZhEECvHAvh8sTDE7_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17478982441360588496', time=2024-09-14T13:58:04.572091+0000, chain.objs.size()=1 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-Y8ltolq6WUxZU_b7Tii0PhKhchOmQx_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15868329860468690971', time=2024-09-14T13:58:05.160745+0000, chain.objs.size()=1 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.126+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.5kVI9S4xnQbgtpQDN5l8b71WpGt4h25_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.127+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4961158776665167405', time=2024-09-14T13:58:05.161579+0000, chain.objs.size()=1 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.127+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M55d-WRyq5Q-qt3tdKXGDHqUrNI235q_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6093123198551880866', time=2024-09-14T13:58:05.353954+0000, chain.objs.size()=1 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AajywkxAHll5fnhcqJbsI7GvZ0fRAxK_0 2024-09-14T12:16:15.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10327974156880559472', time=2024-09-14T13:58:06.003895+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.D4QKA345vGPRPfHzjaYsL0plXFxO8mc_0 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10471750710240510719', time=2024-09-14T13:58:06.099745+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.B-HIGXAF1OS-KO6QJvExTwyI02SHMAH_0 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15ede70640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.116:6802/3246304000,v1:172.21.15.116:6803/3246304000] conn(0x5586fbf9c090 msgr2=0x7f14b8098d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6149241658918100760', time=2024-09-14T13:58:06.129289+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.iGiJUnR7HcBayO5BBmQKH07IKdADBgb_0 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10372219671361542924', time=2024-09-14T13:58:07.083328+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.128+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wRH0QQTRKl_Sh94re_0u1c9jYKcQfqd_0 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13874740178545464906', time=2024-09-14T13:58:07.104899+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UFIuuwOUcpAZcQsidfx59mS_8vnZCbk_0 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8463873527412563689', time=2024-09-14T13:58:08.713827+0000, chain.objs.size()=1 2024-09-14T12:16:15.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TP98w4-U4AHzdJfMVfyftE4iut0qMW0_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16681671813394724296', time=2024-09-14T13:58:08.714525+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.f6mglxAUoO1lhpOTZYyzff-kbmvcduN_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.498815542577156618', time=2024-09-14T13:58:09.253277+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MHK2E6w2AVQNYoA_5dDhubQMzsezvzF_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8930210502919096864', time=2024-09-14T13:58:09.254042+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lAeUr5yque-rgqUMx9JHmk-h3H0kJzn_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5690168822739323247', time=2024-09-14T13:58:09.345161+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.129+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kBkuofBuYfY0gCl4EqyA4Q3tRJg87GY_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15125564515642112049', time=2024-09-14T13:58:09.415964+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.sTEzAadVEs0D5RTQH0wMz1W6yAhVDuc_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7812979899103785422', time=2024-09-14T13:58:09.864254+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YMOnC_Y5oseflJC-jXsm9gqNU37uTtv_0 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17898079369771777922', time=2024-09-14T13:58:10.243703+0000, chain.objs.size()=1 2024-09-14T12:16:15.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mNMni36bmGRM9mPCu8IrBq3nzx0YDX7_0 2024-09-14T12:16:15.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2174311354186257103', time=2024-09-14T13:58:10.552875+0000, chain.objs.size()=1 2024-09-14T12:16:15.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.130+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wIjTSXf8ovwUaFtjhW1lUqf0w4I980r_0 2024-09-14T12:16:15.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14060543077400647188', time=2024-09-14T13:58:11.257840+0000, chain.objs.size()=1 2024-09-14T12:16:15.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O2Eqevx3QgZtpoNebpapZbHmERDi0u1_0 2024-09-14T12:16:15.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3186724097279547033', time=2024-09-14T13:58:12.276293+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Qqne2rySjGVPKWAmjyfY4ntASNUadaj_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16389797214202964698', time=2024-09-14T13:58:49.623699+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JUoJ6lYivzzz44Tk_4XA_A5LU_l5VR4_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10949549024515437926', time=2024-09-14T13:58:49.752046+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BZhJFV9bVKQ1OqJmRXODbkpTG10hKqA_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2239356469273546140', time=2024-09-14T13:58:50.869544+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mzv5brm1gC1BwifDYl1VswsQwMfuAA8_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15303601436526145752', time=2024-09-14T13:58:51.075981+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.t3Qw6oW9219ok9gqzj7NBIrOlkZVKZJ_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4638917979896024991', time=2024-09-14T13:58:51.172097+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.944FEBOSOiQuwsUreGeQ2Fbo1ES6VvK_0 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7626799527651461165', time=2024-09-14T13:58:52.526527+0000, chain.objs.size()=1 2024-09-14T12:16:15.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tqXoUG59p5M4H-T3cg7g6nu8tskBiAE_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.320108006694127822', time=2024-09-14T13:58:52.767773+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7DiS4rAfpBsnL3p-mjDRXp8rhXimGXM_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1298193436084230280', time=2024-09-14T13:58:52.930963+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9NI4iFs2Ne0zNdbnbszC9saRecuSBR5_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15403896098648728070', time=2024-09-14T13:58:53.801157+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.132+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.i5KHNBUvZTcisbnoY-Y3DkaYU5JVjBJ_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15186658023735585508', time=2024-09-14T13:58:53.869195+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wh5uF3NzigCqnsXslRC0K3x55JSbGyN_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9014996728524343280', time=2024-09-14T13:58:54.913969+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.o29_HlaSWiW6rM_k3MwphlSDH_VxMKm_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15ed66f640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x7f15e00abc20 msgr2=0x7f14b8091fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10863924865708385022', time=2024-09-14T13:58:55.179379+0000, chain.objs.size()=1 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PIs0e0urrd9ksOPtj79rQaImjqCAy62_0 2024-09-14T12:16:15.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11335201921192312369', time=2024-09-14T13:58:55.363897+0000, chain.objs.size()=1 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8OHc5ysRknXjR36jRu4rN2UDEktRLfd_0 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17296082767695489051', time=2024-09-14T13:58:55.479749+0000, chain.objs.size()=1 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Z1Du581JPUCdUEci7jK8YEi1VzppiGD_0 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9736725828932198283', time=2024-09-14T13:58:55.550297+0000, chain.objs.size()=1 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PHoGrugaNd87MjcjOQQ-XWrEydhH5uR_0 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7104167814203989979', time=2024-09-14T13:58:56.386531+0000, chain.objs.size()=1 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.k8GG-tiKRQIrPfdqsde77iBh5uH62Qj_0 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12517910823148806549', time=2024-09-14T13:58:56.711075+0000, chain.objs.size()=1 2024-09-14T12:16:15.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.134+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.EqhssvEXJifKrR7XjRQouMoJFiCyMTY_0 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17267058910373830622', time=2024-09-14T13:58:57.131465+0000, chain.objs.size()=1 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.v3kBbHCAUIFaml-ehI2gfrhYZWsw3QJ_0 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5975453503255582863', time=2024-09-14T13:58:57.838398+0000, chain.objs.size()=1 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PY-kPn1hzqtXy-t1KX5mSILlFVoYQQK_0 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4886720567610900366', time=2024-09-14T13:58:57.938150+0000, chain.objs.size()=1 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.135+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ech64u2YndHBivUtpLb2amWUkWNpRAU_0 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.136+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15933854699239691125', time=2024-09-14T13:58:58.555319+0000, chain.objs.size()=1 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.136+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ty6Pzu4fn5uA9rgXUl9x-sC56perWCg_0 2024-09-14T12:16:15.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.136+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9687084062427577593', time=2024-09-14T13:58:58.564993+0000, chain.objs.size()=1 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.136+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pmqiXivy08JZIK4jRCT7f-zyLnorS_Z_0 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.137+0000 7f15e7fff640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.116:6810/4152832586,v1:172.21.15.116:6811/4152832586] conn(0x5586fbf96c20 msgr2=0x7f14b8096820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.137+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17571865920504380530', time=2024-09-14T13:58:58.984498+0000, chain.objs.size()=1 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.137+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lgOR4lWLdYxlfVnC5eBX1OrEqLxvMnj_0 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.137+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579983934299028140', time=2024-09-14T13:58:59.380057+0000, chain.objs.size()=1 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.137+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.c1-Ba7Bt9ubj-KEca6ceULPXshPMVF4_0 2024-09-14T12:16:15.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.139+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/49753 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17869679002699173954', time=2024-09-14T13:59:05.300921+0000, chain.objs.size()=1 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.333__shadow_.B4rh-15negAXfsQZGeUPsIbtElIKq8E_0 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16063647466241504645', time=2024-09-14T13:59:31.894037+0000, chain.objs.size()=1 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.378__shadow_.76sc89paY1yHMWn5T2YdY5aIwBVsstd_0 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1799091358310767768', time=2024-09-14T13:59:51.780676+0000, chain.objs.size()=1 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.408__shadow_.FSOJ3PmRRHAhWKSr5M0bO5KgHQHKZqs_0 2024-09-14T12:16:15.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12052074932513007288', time=2024-09-14T14:00:06.358925+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.432__shadow_.GjCqcPK565lvALjk9F2tSHUK6JjJsGc_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.839237756792666182', time=2024-09-14T14:00:41.365072+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.484__shadow_.-qtmOYozqWT1d1_WUb68fKsaH8hFtbV_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14945568193869638974', time=2024-09-14T14:00:52.469173+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.498__shadow_.PN3L_GE_ca6HV2FKw-Vxg1ZFS8Yq_jt_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6580928164853245411', time=2024-09-14T14:02:48.719806+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.524__shadow_.u-nxovP1Yen5phnu6MYIqmOeW2EXsbv_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3689573807505434814', time=2024-09-14T14:03:50.313316+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.552__shadow_.CFSrC3-6FtlIkWOrI_gtPsAJTWXgRbJ_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15311044149106586982', time=2024-09-14T14:04:31.949747+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.570__shadow:MBmUQHyPBnikMDwKvXQgH5D.LYEDVUB_.c9B5D2rtBpnZ5t8YAJiIe8UEtn7gfsd_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16887697558659516341', time=2024-09-14T14:04:51.501688+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:zmBB9ePMe85GRvapmJDyBplsJvbd.S7_.hcEV9uTEaFhMra6K0QETsIAeSrtGM1M_0 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11868826816161889522', time=2024-09-14T14:05:27.990133+0000, chain.objs.size()=1 2024-09-14T12:16:15.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.585__shadow:sjS2XkyESdXHW0zZz2JvSMvVcDZzDLm_.JstZ4tko7vYGdDv-zZvKKZd7YgcDq4N_0 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10944565131233818454', time=2024-09-14T14:10:28.010891+0000, chain.objs.size()=1 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.141+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.694__shadow:F8VYEKAiNjUVeJ.HJvNe7utdVekz58O_.bFnC346CgVwWFIQY-wqFpox3A52Svn8_0 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.143+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17282654627752094609', time=2024-09-14T14:11:03.083399+0000, chain.objs.size()=1 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.143+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.717__shadow:h0O98h0xl92Nn7boPGW0J49246wsU68_.Ogk3UXEEv9YflQyIYNm8oeEYB2uA1IC_0 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.143+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6667575635543725928', time=2024-09-14T14:12:24.641158+0000, chain.objs.size()=1 2024-09-14T12:16:15.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.143+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.756__shadow_.WeKtG0B4wnN0CsIu4uqxF6SYWJ0njsk_0 2024-09-14T12:16:15.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.145+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.147+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:16:15.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.148+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.148+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48028' 2024-09-14T12:16:15.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13730981793039329232', time=2024-09-14T13:55:35.188977+0000, chain.objs.size()=1 2024-09-14T12:16:15.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.235__shadow_.SLDfEIS0QOMwq4k11A4mqcXPuZl0HMI_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.196595697110018819', time=2024-09-14T13:55:39.716298+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.241__shadow_.aRlCD9192n3qVAHjie-qLureO11CVQ-_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11175172081520354017', time=2024-09-14T13:55:42.397585+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.244__shadow_.QwNq8qV1uMD_dQrH9uoRaJFnawvf-6N_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5240909913306329040', time=2024-09-14T13:55:47.941933+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.252__shadow_._0E1TAQHz9bqNy7xgqAsvJ9UVSyQFKe_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13882341642949410514', time=2024-09-14T13:55:50.750021+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.256__shadow_.A9C-0x11rqxM7wPo0Af-mxx3Z2GPs9h_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8967433087470722873', time=2024-09-14T13:55:52.699426+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.259__shadow_.5G_Dh1Lzey9DerJZ5psdpMEr67PLkEO_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4615000792751901756', time=2024-09-14T13:56:29.596589+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2F80fZFjRz3ixwSNPSzdWU96Jx5z_Mp_0 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18320369371509225207', time=2024-09-14T13:56:29.636156+0000, chain.objs.size()=1 2024-09-14T12:16:15.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4mynSxXYoc2YLAZb7jloxwWKOW20WqJ_0 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4338933645893053326', time=2024-09-14T13:56:30.530160+0000, chain.objs.size()=1 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KSVy9BMfLM437EdbIloXEf5z2X6mEDp_0 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1885930164849126032', time=2024-09-14T13:56:30.559753+0000, chain.objs.size()=1 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Keds8sF4WdU3s4eZDovm-FHB317R5k8_0 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3889246801897272550', time=2024-09-14T13:56:30.560506+0000, chain.objs.size()=1 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QxzVmC1rMCUFZlbHVn9zX_ZH7-w0lSW_0 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17546858451675202877', time=2024-09-14T13:56:31.966250+0000, chain.objs.size()=1 2024-09-14T12:16:15.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.149+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7KH43Q5nTpmapP7bK82KzEVnh45Pv4Q_0 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1068548746390743993', time=2024-09-14T13:56:32.156939+0000, chain.objs.size()=1 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xBhCuR2b4hEeYNf1Yo7ptmf9jbTDG00_0 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8278383351868364979', time=2024-09-14T13:56:33.427349+0000, chain.objs.size()=1 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.h-6ktEtw1OyS-0TrBCDmqrINHyKouBz_0 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16262605723090039950', time=2024-09-14T13:56:34.025369+0000, chain.objs.size()=1 2024-09-14T12:16:15.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PJixpVOIsBK3W050LK_pCEU-2Jln8YH_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15980916374947408694', time=2024-09-14T13:56:34.096424+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KVPr3w3qaUzhLAKUDqvY7rY-0U6pD9p_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13875771483425578585', time=2024-09-14T13:56:34.416837+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qDJ80xdGZYgZXI1f3UOsu2bd2vtu3Ht_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2639144662760518366', time=2024-09-14T13:56:34.512624+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LiIZ6_88G72MAq1Yy8ryzJvdrgvGBnI_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18015798348055971822', time=2024-09-14T13:56:35.431461+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.glrDS0eYoJS1rn7k17HcFPL1UJoHHe2_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14384665919944428267', time=2024-09-14T13:56:35.815123+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oKvLxtivi95LGG3787dLU4QrNdho9mh_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14417569294817161905', time=2024-09-14T13:56:35.975787+0000, chain.objs.size()=1 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9oCqt2t3RvOcQXg5F7M6pREqyhh8FJR_0 2024-09-14T12:16:15.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15401610745846514646', time=2024-09-14T13:56:38.082053+0000, chain.objs.size()=1 2024-09-14T12:16:15.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.afo3N-ZtaZtUx4L4zS51fi9SaCHQeEW_0 2024-09-14T12:16:15.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16131044631200093186', time=2024-09-14T13:56:38.094055+0000, chain.objs.size()=1 2024-09-14T12:16:15.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.151+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._7LCBeY4Q8kKCynHdtJeagGlRzI4hNJ_0 2024-09-14T12:16:15.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.153+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1334162170283781414', time=2024-09-14T13:56:38.959484+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.153+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.P3-RKWESMumO8Q-Gg6OL8JhhhH0Q24-_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.153+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5939777743952849513', time=2024-09-14T13:56:39.614500+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.153+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bN7ivoDsLMtLlFWuZbXRDPdY1dVK4Q7_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16442533159490465338', time=2024-09-14T13:56:39.690288+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.J0sYhOKDTDy2P4nC0Bt9u5NbprpgD_d_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1750178633849983748', time=2024-09-14T13:56:39.807574+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1pqum_gGUnhMrkhw-HfSzX_wiV8i4_K_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9560162039671512091', time=2024-09-14T13:56:39.949617+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jieRylxfaTSbR3NfqTOGoODWXfhwZtZ_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17691823822630993994', time=2024-09-14T13:56:40.346738+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5qAdq9oU8gJmJ7bo-WJl06_G_jljRjA_0 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1251739722049791529', time=2024-09-14T13:56:48.894197+0000, chain.objs.size()=1 2024-09-14T12:16:15.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.275__shadow_.53jnG_y5OryELHpcTw1uWwky4oOeNox_0 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14401002138428929326', time=2024-09-14T13:56:51.006131+0000, chain.objs.size()=1 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.278__shadow_.ladQuBBZsYZ4pM_xjmyMWqQKlJJdgcV_0 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.568523853965899566', time=2024-09-14T13:56:52.377350+0000, chain.objs.size()=1 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280__shadow_.307T8p7oMonaYM570ZPdE2S-zOfYizP_0 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13976871531233101723', time=2024-09-14T13:56:59.443634+0000, chain.objs.size()=1 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.290__shadow_.WDHsDfJDRBVjvRjN3dacI_uRG7jGAZN_0 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6361425215702209233', time=2024-09-14T13:57:02.148143+0000, chain.objs.size()=1 2024-09-14T12:16:15.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.154+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.KzN6KMUV5VKolQYXLMCVcP3Vh8zwUzJ_0 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8158493540538614786', time=2024-09-14T13:58:02.379034+0000, chain.objs.size()=1 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X-9lxhB1j28loHkDTCq6akyPaARo6j2_0 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5275984832047268914', time=2024-09-14T13:58:02.591888+0000, chain.objs.size()=1 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OalCZ34G8k2nU2O6ru0BwoeeXLypwBK_0 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16426216912760177179', time=2024-09-14T13:58:03.080897+0000, chain.objs.size()=1 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NIvB0Ifk-u67Px6FbPnJoS6wf2OY92D_0 2024-09-14T12:16:15.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3705343208277836082', time=2024-09-14T13:58:03.203627+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.I3KkSuGuNjNHp61FAWPsdCUQ2fI-oLW_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6405390612371603818', time=2024-09-14T13:58:03.882890+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EbOn4woc4lEXOYL4_ygQ5zzN066HOLp_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6341679771528337700', time=2024-09-14T13:58:03.883646+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.156+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.94OBEjkMMxmNYdU8dtGhbGFE3TCntOq_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5622954764406876557', time=2024-09-14T13:58:04.110166+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Uqa8pfMaobGLj07wfikMQARs_TP4O80_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12206268705626019031', time=2024-09-14T13:58:04.113334+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.u4wkzk0cbGkSsIUZSxNq3WGOl-0T5a-_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16065280036888484688', time=2024-09-14T13:58:04.266906+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zPgSK_tefgtgDagSBllhgsS_YduvusB_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7138634470621604421', time=2024-09-14T13:58:05.366738+0000, chain.objs.size()=1 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ax9GIaO93SrKBNCh83YSYbMT4vQrAJc_0 2024-09-14T12:16:15.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6697754753619145649', time=2024-09-14T13:58:06.135204+0000, chain.objs.size()=1 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.PmDJut-SavoKgUihBS9ap0enQL6pmw6_0 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5841730971487061228', time=2024-09-14T13:58:07.923771+0000, chain.objs.size()=1 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1ArY1jAni9IKAVSPw0U25XotRhkIhmm_0 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10031157910036091818', time=2024-09-14T13:58:08.025411+0000, chain.objs.size()=1 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cpejKSjfsG1lIg9K1qjJeYS0MIB1PHU_0 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14766778786679323200', time=2024-09-14T13:58:08.083800+0000, chain.objs.size()=1 2024-09-14T12:16:15.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.157+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.k93ccTnKi4li6aSiEJF-7iN33T1fF4Y_0 2024-09-14T12:16:15.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.158+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18322783503471120488', time=2024-09-14T13:58:09.453812+0000, chain.objs.size()=1 2024-09-14T12:16:15.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.158+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WOh20faeOHLTrfpPFAaGAVkSrkvwT1R_0 2024-09-14T12:16:15.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13298839815143072387', time=2024-09-14T13:58:09.587822+0000, chain.objs.size()=1 2024-09-14T12:16:15.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mN8rheEqn1alEXhUMu-zAOJ3MBl7Y18_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10759722972541364724', time=2024-09-14T13:58:09.827645+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JqR8PimEJjkMqSEOtBK-4PmCKeYrNdb_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12060542432309670536', time=2024-09-14T13:58:09.987537+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EWzR8dbKSz9HswWMCjfGnVs0NNYejxs_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.27630612715179324', time=2024-09-14T13:58:10.044968+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.S8g8QyxfnoNG3i5qy8w0WSsQvtUfCVw_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8988305591422406902', time=2024-09-14T13:58:10.535292+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gWS6wSg33yGC2Gerzn47fXpgvFBfse9_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14068257938418513008', time=2024-09-14T13:58:11.145979+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1AAWh_AgCuh6O0MZhHCyWBLQnthUEpl_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7330542500662490588', time=2024-09-14T13:58:11.170639+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._4uKuioPmZpApauHxqiwxkU9Btg-pPN_0 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.204312634760822690', time=2024-09-14T13:58:11.796017+0000, chain.objs.size()=1 2024-09-14T12:16:15.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.skVtVjfcbJNv4y8DcUu3C3OF6PISYuA_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8489942441290712876', time=2024-09-14T13:58:11.837816+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1CvgM-xfaN7ONsnIXPmSCSsnbryKNVW_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1030289084477786641', time=2024-09-14T13:58:12.019217+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.159+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LOW2k9NsEzSngwDvpCShNmYubMrGPpF_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.160+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6914728454046503481', time=2024-09-14T13:58:12.319093+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.160+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LC_z6iWEL7k_Fo4Gdc6Cn-2cGQaPlSh_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1554078491797032368', time=2024-09-14T13:58:12.560415+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.U0Tp5QIWgUs8psVT-ZmY7I3k0LfkFUD_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7551749296000541879', time=2024-09-14T13:58:48.997025+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.462wmOgsuiajN-PD3-1KpH9IfJzcImq_0 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7239423639821033114', time=2024-09-14T13:58:49.755643+0000, chain.objs.size()=1 2024-09-14T12:16:15.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.161+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ndovLEBU35LPxQ3jBzLDyot_HYCYsMj_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15881484797551938400', time=2024-09-14T13:58:49.804743+0000, chain.objs.size()=1 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.K99lxmiBOTfzxzLar2TX4QSW7Zz6lJO_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12864937320670346212', time=2024-09-14T13:58:50.568291+0000, chain.objs.size()=1 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hxdfJKpsjbcEWHD7hV2Rku1w1BmdWcZ_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9825865551208552862', time=2024-09-14T13:58:51.102683+0000, chain.objs.size()=1 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qo34FjG8exqVoEM4UySeOv8EJ10KOtd_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8370590505809457393', time=2024-09-14T13:58:52.305484+0000, chain.objs.size()=1 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.M5xsiXkebr3s7C-jTAxdk2rgmOYzyUp_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8703429301067327908', time=2024-09-14T13:58:52.336407+0000, chain.objs.size()=1 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZFIIh753NI7O8yah5Xfh0boX-QZjBUV_0 2024-09-14T12:16:15.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15551867216466245050', time=2024-09-14T13:58:52.391009+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dj-b8zv4woXskPGVxD1VZhHtSlBEyvM_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9225306829535675507', time=2024-09-14T13:58:52.527385+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.szYmLBv5eddDhirXddAJxkxtfs72z5X_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11008148215127618343', time=2024-09-14T13:58:52.717748+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.m45vIzvKKNr_o76zosC4peuqRgKlIcf_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9001926999964069985', time=2024-09-14T13:58:52.742233+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.g4s8o63nqhhoWyhmlGQu7l9rkciMDEn_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16060326240825714011', time=2024-09-14T13:58:52.951765+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.162+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RzfQ0ik9T5MW9BRnlv6YodMhfcaE4GG_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.163+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13370555500432891080', time=2024-09-14T13:58:52.956473+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.163+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Lm0FYXFAONF5Cjg9CL4e4ajunR4UwSU_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6734926927745137936', time=2024-09-14T13:58:53.548078+0000, chain.objs.size()=1 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8Mz9Q5GlgGXdCJo5G62GXHOkXLrZ-k-_0 2024-09-14T12:16:15.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15323035866799377495', time=2024-09-14T13:58:53.767964+0000, chain.objs.size()=1 2024-09-14T12:16:15.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RvzZ2goa6AoG-NcOvz7pV6zPfMoLckn_0 2024-09-14T12:16:15.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4499994485500061031', time=2024-09-14T13:58:53.935595+0000, chain.objs.size()=1 2024-09-14T12:16:15.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZJeTldcKM3OuSBel6f2T49tEvjEhRXE_0 2024-09-14T12:16:15.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9385710718689053752', time=2024-09-14T13:58:54.043708+0000, chain.objs.size()=1 2024-09-14T12:16:15.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.opsOfaJ9IqyQyDTX0av6mMRfQgZgkqL_0 2024-09-14T12:16:15.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7550241684109937806', time=2024-09-14T13:58:54.120181+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.164+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lWB2WGBKYQqSVkeMJkRU2-mZSFDgwai_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4466400854589172356', time=2024-09-14T13:58:54.724884+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Zw0i7IqKY8LtArLAXYlsnACTYUUNuOW_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3055424547322304298', time=2024-09-14T13:58:54.936979+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QNQb-W-sl50zpwxiMuc3GcpKFroMoGt_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9953648425291276074', time=2024-09-14T13:58:55.056679+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.SaA2KUKABT0mlkZ1mvpi2kuuC3ZSlB-_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18109848220595890306', time=2024-09-14T13:58:55.165361+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.L7Q8xIVlzTp3jADheBxnQInr1WgbTvb_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12531298798391228532', time=2024-09-14T13:58:55.208599+0000, chain.objs.size()=1 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uVIF8aG5xs2s8bU6ZI6W5y52xS9aYE6_0 2024-09-14T12:16:15.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17163827146241502586', time=2024-09-14T13:58:55.661539+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rvCE6UXEmu4xjSn_q3nJ6mFWn3VefYJ_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18172890338388026812', time=2024-09-14T13:58:55.707536+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iNF7hmM-3Hig9-4_PjijtLMl_4STGgG_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17638173177442993475', time=2024-09-14T13:58:56.379119+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.165+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.p_sAJYgryDGCyS3tyrlBpyyEf_2jLie_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11966027119111553838', time=2024-09-14T13:58:56.410324+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4LjFA4WUFDZBozpep4jc3TAPCUEzgbJ_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12080220621064355015', time=2024-09-14T13:58:57.194349+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fiNGxnT7M9alFXtYmxU07f3SqM6ucT8_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8758206756923088375', time=2024-09-14T13:58:57.731131+0000, chain.objs.size()=1 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.166+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qHJZN0m3Pvsw8errv_kfS7bZ7uhvvzf_0 2024-09-14T12:16:15.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.935097877724544570', time=2024-09-14T13:58:57.837997+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.07FkAfV94v10xFJPWn_cTSLaB-kQPUL_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6665473361450131660', time=2024-09-14T13:58:58.565490+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Ks3WQlt_jh8JXBi3W3E7Ql8QWSPfS-e_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13857019387061313956', time=2024-09-14T13:58:58.982524+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._Hf8Ay7siqSJwVrNiWzzYifxQxsIVGR_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4579922968442815360', time=2024-09-14T13:58:59.128589+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3oyAJ7T9OOdCauXjNzlNwMz3BzXVrbY_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5764043156157111105', time=2024-09-14T13:58:59.231319+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pVRsD272U2WFBCSQ9l2DuTlN0MErxy-_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6502966504560512828', time=2024-09-14T13:58:59.594542+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.167+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UQWeqNyn1bLkUg1MoR4g4xCZ31ffALY_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2564735889494960598', time=2024-09-14T13:59:32.614364+0000, chain.objs.size()=1 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.379__shadow_.UnOPHHEiJDuUTajrW6Moa53c4yxrYNV_0 2024-09-14T12:16:15.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12890048331233865260', time=2024-09-14T14:00:29.958585+0000, chain.objs.size()=1 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.464__shadow_.rLncQ477exFJHXpA3XalYvM1adb6Fyj_0 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17040765803162555383', time=2024-09-14T14:00:30.222150+0000, chain.objs.size()=1 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.464__shadow_.FviyMehoZ_MCNQInSmXlU1LYzdkioaW_0 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12035823381381349401', time=2024-09-14T14:00:38.389099+0000, chain.objs.size()=1 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.168+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.481__shadow_.k9jeCmDjB3hoBpB_zRAq8wWVIGgCBhc_0 2024-09-14T12:16:15.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.170+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/48028 2024-09-14T12:16:15.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9355658616675443975', time=2024-09-14T14:00:50.401263+0000, chain.objs.size()=1 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.495__shadow_.WHZm4Gjx9-lai8cj12fYcqq1DGviSz3_0 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5553926162681547157', time=2024-09-14T14:00:53.511847+0000, chain.objs.size()=1 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.499__shadow_.AkHBRq-275Si8igApgNHlnuF0ilA-vJ_0 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5773684473258966824', time=2024-09-14T14:02:46.329415+0000, chain.objs.size()=3 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~ho7VgvY2ZcasNp7bumkmYs6t5ThNzuc.1 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~ho7VgvY2ZcasNp7bumkmYs6t5ThNzuc.2 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~ho7VgvY2ZcasNp7bumkmYs6t5ThNzuc.3 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16926888385358929917', time=2024-09-14T14:04:20.272679+0000, chain.objs.size()=1 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:-mS7b1nVifACg62iXsgJNohpuWzjGh4_.AUrvwadHlDKMC_ExjNhQA8P3I1dGRe2_0 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.960933626741009282', time=2024-09-14T14:04:24.366994+0000, chain.objs.size()=1 2024-09-14T12:16:15.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:sOZYtmU5YCfNEoQYbqjE67cGW5WR0WC_.F-LFg8Epnxoewj8U_EbdhrTWJ4kPNmH_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.730139349989941723', time=2024-09-14T14:04:34.532061+0000, chain.objs.size()=1 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.573__shadow_.TCNFJeNPntOC7itj80TDa86Rp6r5yZh_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11123962948925007723', time=2024-09-14T14:04:53.451860+0000, chain.objs.size()=1 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:mUWMhdAUgG1zxYO9Pyx.Ru3yEVFHPWP_.jkWOHvXod_cL7fpIt4gW5LPtoEzC_qV_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6694959934251930252', time=2024-09-14T14:05:05.144308+0000, chain.objs.size()=1 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:eNpGR497tKkRfH26MWQ8sGoJdFkdV3C_.6jW-2XmCvY9fyT8u03g5aXA0_IUVk09_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18117359204363232859', time=2024-09-14T14:05:06.216202+0000, chain.objs.size()=1 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:InkmQiccdbOMGWeMgJ5-PKfROd5LCSq_.6rKtxpNqGg3HFCDW_4nfgToKC4nwdg9_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7162886704343920163', time=2024-09-14T14:05:21.735270+0000, chain.objs.size()=1 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.172+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:d-cjOgucse.KpeHUz9GKdxcczygn7-G_.aWNSgsXUPpyfEkhk_Vj9-xkMbYHMgIM_0 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ', time=2024-09-14T14:09:16.451984+0000, chain.objs.size()=12 2024-09-14T12:16:15.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.1_1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.2 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.2_1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.3 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.3_1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.4 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.4_1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.5 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.5_1 2024-09-14T12:16:15.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.174+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__multipart_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.6 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.176+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.624__shadow_multipart_enc.2~mXkOEx6Lf3NFheYPVtXOc1PtLD77HzZ.6_1 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12786036620706962642', time=2024-09-14T14:10:08.254955+0000, chain.objs.size()=6 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.1 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.2 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.3 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.4 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.5 2024-09-14T12:16:15.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.662__multipart_foo.2~vh_5zS5q6WEdZUN7sDtzmPiqSCx_trq.6 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9682543847034582439', time=2024-09-14T14:11:24.101996+0000, chain.objs.size()=10 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.1 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.2 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.3 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.177+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.4 2024-09-14T12:16:15.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.5 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.6 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.7 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.8 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.9 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.179+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.735__multipart_foo.2~Rqsoi-9T9FrEkO-0wjoIq0He5jFFC73.10 2024-09-14T12:16:15.178 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.181+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.183+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:16:15.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.184+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46956' 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~8eByrQAOJtYN6JPUi26knWutZwRCRsa', time=2024-09-14T13:54:05.627300+0000, chain.objs.size()=1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.202__multipart_mymultipart.2~8eByrQAOJtYN6JPUi26knWutZwRCRsa.1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14572201881730288727', time=2024-09-14T13:55:40.443509+0000, chain.objs.size()=1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.242__shadow_.qKLIBH9BLwxg8mpVNEgZXAGt51_46sV_0 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18383032689548939784', time=2024-09-14T13:56:29.738086+0000, chain.objs.size()=1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.U390B7_x7QmaNZ9gNifSEAEflSzhODK_0 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8929802460653006434', time=2024-09-14T13:56:29.761156+0000, chain.objs.size()=1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.n0LVuvHknMDDZDauEFDU5W-psKqSm5r_0 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7067242029247505353', time=2024-09-14T13:56:30.405544+0000, chain.objs.size()=1 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8K7NG33ZiZRfUsrU8CXVdaowFZ-XmKk_0 2024-09-14T12:16:15.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7559566998667618222', time=2024-09-14T13:56:31.392607+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.905L_De3oOR0e9yFxS4Qjb8d79cnXbV_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12665746515292756443', time=2024-09-14T13:56:31.422466+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ww8IXnrMSHwdkjdiK-H5rDXfOm4Bgvk_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8171570714482941826', time=2024-09-14T13:56:31.451102+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D2sNcGTUeAIF0eJSHjot0RSHkDQTBKd_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11422017397285732435', time=2024-09-14T13:56:31.577018+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.MQLw_MA_01P7DkoWCqiv9JMqliYeKg8_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12654370350687346103', time=2024-09-14T13:56:31.964754+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YRX5nSfHV9FLaOiEbeUGhjInKokDrZ7_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14964500721074481016', time=2024-09-14T13:56:32.149372+0000, chain.objs.size()=1 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xUtNqqBFRXgZKmtXjTgwOExz6xY-fp4_0 2024-09-14T12:16:15.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15185596690356637530', time=2024-09-14T13:56:33.230449+0000, chain.objs.size()=1 2024-09-14T12:16:15.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.185+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FNCfIlik6gBDFN5CcKKBJuvAheMSrGK_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13269079453213519919', time=2024-09-14T13:56:33.442226+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qV9ffOxQKMebOURDtPNPiL1SkNn4K3o_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2179992847957564066', time=2024-09-14T13:56:33.564060+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2NlISOzLF4zdVQFE0JWxp-OTiwr2-Xe_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18043256677547292415', time=2024-09-14T13:56:34.169337+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Xb7eys-btiTPytVf5Lp8ZeEvhfCzXlo_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10610619323114864198', time=2024-09-14T13:56:34.453597+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AsozKgfy1nAXoFVjPb53TNw3gH22xmi_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15365893795337592303', time=2024-09-14T13:56:34.654251+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.L-zu5olfbaMrtJiun8h_Gf3Xz42PJUI_0 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2792010894043427345', time=2024-09-14T13:56:34.667216+0000, chain.objs.size()=1 2024-09-14T12:16:15.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Azs9Gt7WZSdHYOBYRL4RyWz1uE4l0HE_0 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10606944082249379708', time=2024-09-14T13:56:34.843548+0000, chain.objs.size()=1 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8Ab6u0xo8cyfbUzCY-nlzy87RKPhRkR_0 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2199465239596320296', time=2024-09-14T13:56:34.900117+0000, chain.objs.size()=1 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.187+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2-0NGqrnI3md6TXuOmvRMvBhG67mjVv_0 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1368833135599493370', time=2024-09-14T13:56:35.421208+0000, chain.objs.size()=1 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CX0dbOjAlQ0NWLAREg07qGjBNbTGbk-_0 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8646985384859921799', time=2024-09-14T13:56:35.467007+0000, chain.objs.size()=1 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Gcd9bEi5VVeGVnTQwu9FNnWgOw7MF3P_0 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7325939015611132342', time=2024-09-14T13:56:35.821046+0000, chain.objs.size()=1 2024-09-14T12:16:15.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.188+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6NdXs8AtcpHRL3_ZQyTnjfDttHqRWlf_0 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12635205315755941398', time=2024-09-14T13:56:35.901835+0000, chain.objs.size()=1 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Dpb6ekLZfk4ioVqK5YwD6begK6CDoU9_0 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6863566248631056143', time=2024-09-14T13:56:36.101541+0000, chain.objs.size()=1 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9AoSv3B5gQH4BoELdowWjj9zDygPvTL_0 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12442855458971821399', time=2024-09-14T13:56:36.158308+0000, chain.objs.size()=1 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1O8n3JdBSJNXrcC6f2MpB8CccXJRpuX_0 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.964393857713622153', time=2024-09-14T13:56:37.184590+0000, chain.objs.size()=1 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NoZS2dHYGuGeQiM2tO8Xuckmily7JSo_0 2024-09-14T12:16:15.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.385949786467018046', time=2024-09-14T13:56:37.349728+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.189+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nQkv4586d7fHozYF0bFubJ6pWrVIglv_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11153232815308576826', time=2024-09-14T13:56:37.657912+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vSdyQ3yDDQKQwFL2Z84bw9r5fh9xhGz_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15863393699679640330', time=2024-09-14T13:56:38.262773+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.56DQb33cC1JjlPIdFr_7TcwUqM-XFWR_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18253645967637812210', time=2024-09-14T13:56:38.808926+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.G78KlTBCTfp0i8wDiOujfMukWy-qSOA_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12675294270094875858', time=2024-09-14T13:56:38.848390+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pjeunfQVg0nFMLHbRSHKQ61yuuRykiK_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15118012871101175588', time=2024-09-14T13:56:39.129036+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NEBzqIIkZ2GX_h8wx1qrhTZocnCs2EN_0 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5719396726964023924', time=2024-09-14T13:56:39.734959+0000, chain.objs.size()=1 2024-09-14T12:16:15.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.190+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0YDeD4k6HE9LSRb86tRKTxRRWta7Ixk_0 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17839026992138984109', time=2024-09-14T13:56:39.881033+0000, chain.objs.size()=1 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D1qp-_7b3mm5cEcCWeONG0TB3rm_nOp_0 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6081482841998207495', time=2024-09-14T13:56:40.217427+0000, chain.objs.size()=1 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sQVaYMX6SgoccRAKlNcCH_Cq7PGG96q_0 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18091334681466947635', time=2024-09-14T13:56:44.308609+0000, chain.objs.size()=1 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.268__shadow_.nOek7gWZ0u0TJfAjRYyWwNCoeljLGec_0 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3557198501556184947', time=2024-09-14T13:56:58.052179+0000, chain.objs.size()=1 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.288__shadow_.MksbT2txr4aQi7AA5WvM83DOjsDETsK_0 2024-09-14T12:16:15.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5322596932830118227', time=2024-09-14T13:56:58.739282+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.289__shadow_.DPV3M-CaIqfsunhckPKzF5VPM3glYCb_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.790067682320079195', time=2024-09-14T13:57:12.778176+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.305__shadow_.NSFkHz-hy8wYfvbaFvADHj_mDWSQUdT_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7686116984150188292', time=2024-09-14T13:58:02.500445+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HEziseU5-83cxeImTPmIg6UCXES5oxD_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5011252188285093043', time=2024-09-14T13:58:02.867059+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.192+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ot1yCCOmknYxPt5Y0m0my1Iuxi4V5y-_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.197580137087746679', time=2024-09-14T13:58:03.246317+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.iaI62Emoxfdz7pcAio5t-VLNtKg33z3_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4469770927050266928', time=2024-09-14T13:58:04.318577+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HJF2Vh9SG9usjRES-70a2HvCTCqyv9l_0 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7463987459407443355', time=2024-09-14T13:58:05.461002+0000, chain.objs.size()=1 2024-09-14T12:16:15.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.193+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ciegWJjbjTfDPa86Nr77g7XurRsFl7m_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5999564661230639676', time=2024-09-14T13:58:05.497189+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.R5jLMMR0A4lovogQX-Rf3KN9B8vvPWL_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15697385603148741333', time=2024-09-14T13:58:05.733236+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-VBjhJxHq165lhPE4CoXFq_8_ks91h0_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.833691059477293576', time=2024-09-14T13:58:06.092804+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QHqcPQilJJT4SW8G067sErYa_rDRofU_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18444690388961475821', time=2024-09-14T13:58:07.505832+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LXRDNoQibf55AQRNhDfNBsyEv6RReps_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5292382406767229442', time=2024-09-14T13:58:07.961478+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GYMb8eguCYJz0kAEViQIOwM1I3SWxf1_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1995769976855778276', time=2024-09-14T13:58:08.077012+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xECAsJJ2dlXapLmqs8RQHZqJdov-XS1_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8806889241417804906', time=2024-09-14T13:58:08.170968+0000, chain.objs.size()=1 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9-6knZlUAwy8EkHkH9OWDFIPnnRS8aa_0 2024-09-14T12:16:15.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14473891810676459471', time=2024-09-14T13:58:08.351009+0000, chain.objs.size()=1 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ji5bdKwL3yVcTiyJEf4mcPKMsbpHT50_0 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10890868800121180813', time=2024-09-14T13:58:08.875376+0000, chain.objs.size()=1 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KSGYHnzyDlRTrhfffBwEPSf1ZzZaRhv_0 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12285028542444688519', time=2024-09-14T13:58:09.236823+0000, chain.objs.size()=1 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dR56Dc4T9HLW1YmYB0VbjFjzmTmwwZQ_0 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17499314769490792652', time=2024-09-14T13:58:10.028827+0000, chain.objs.size()=1 2024-09-14T12:16:15.195 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.194+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zLUWNvALj4NeIeCo0ps7gjDBrxkxK23_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.195+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17599745879497174490', time=2024-09-14T13:58:10.817067+0000, chain.objs.size()=1 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.195+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.y8XELCBIrXclvrnahVqMMBvGVe06AME_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11021540547648459463', time=2024-09-14T13:58:11.225316+0000, chain.objs.size()=1 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eje9ZVInSyqQyTq8PBch4i4JM1LLJ5w_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5381799994127214497', time=2024-09-14T13:58:11.284942+0000, chain.objs.size()=1 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JFsfGrzqUzODmSXrGmFLZUsuQe4xcYm_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2102456839434653319', time=2024-09-14T13:58:11.552939+0000, chain.objs.size()=1 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LJ26ci-bqi-U1BNye7qAu2oWipFc4Ox_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13384391699822379576', time=2024-09-14T13:58:11.836217+0000, chain.objs.size()=1 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VXlzTER5hD7o7jMfj5NiZ_Zsk9djDkY_0 2024-09-14T12:16:15.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11128756352473944736', time=2024-09-14T13:58:12.615141+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.tYHv-R-EUYVfM4SN-MP4W5DkT4hB2z-_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4891574202105042670', time=2024-09-14T13:58:48.974612+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xS9KMw8NDhZ2_qtczE1IdnZTzAXD3TX_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9003476556833538860', time=2024-09-14T13:58:49.043560+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.s0aTLDE1Spu2D0uUj74JcT3i5Zh8nl3_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4391955513685900904', time=2024-09-14T13:58:49.277192+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6g1yvljPduHdcRLTKvvUuY2C5RTpc1N_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7694273485078748533', time=2024-09-14T13:58:49.305369+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j-SyFX1vSYEnZ3Iz8-DsV_7gL-GXCwC_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324159788141574491', time=2024-09-14T13:58:49.330155+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DUF17ngvYkn0VbeuQhwoNOWvwaLw8uV_0 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14858422898214112197', time=2024-09-14T13:58:49.430728+0000, chain.objs.size()=1 2024-09-14T12:16:15.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.196+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4OFxcaYmOZ5LgcIfJgP4dFPHfmBKrPc_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17618854639179191524', time=2024-09-14T13:58:49.484832+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ATPY354eylW1JGoMl1iinerKsijXoTT_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4255177391570139276', time=2024-09-14T13:58:49.713673+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xp-ptuAr-Bd2eXOAk7L7LF5hrpl1AXJ_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8615465554334104259', time=2024-09-14T13:58:49.926946+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3qOmE_-wmTNP7X9ZPUtYxfRSEjF6gj6_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15890835396779952438', time=2024-09-14T13:58:50.032444+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eonGCMXwJgPhuF0h1gEMXwxfqrQzxZY_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4538746105406827047', time=2024-09-14T13:58:50.781739+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IhYd-kQb430w0YjAQ3zZyLxkPM56kfB_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7125929183625741103', time=2024-09-14T13:58:50.917392+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.v63G525p2bDLv_EVdZtDXUij-fmTwVL_0 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10385661243920270881', time=2024-09-14T13:58:52.237298+0000, chain.objs.size()=1 2024-09-14T12:16:15.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qc7SCcheo54H-eZDbeghD4lq_vVDIpE_0 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6234031694189150798', time=2024-09-14T13:58:52.238419+0000, chain.objs.size()=1 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0gjbys2fkzaHn9ihr6xgjx5lmIVG70H_0 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16299289768215514466', time=2024-09-14T13:58:52.513457+0000, chain.objs.size()=1 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hYVWVd6-zjpdKX0TCyinktYtRSMGCx__0 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8544421978703612753', time=2024-09-14T13:58:52.937896+0000, chain.objs.size()=1 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.198+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.A-XEmEuUhU5P_hZMiz5Xcc7trmpmHvA_0 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.199+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2904587334597520045', time=2024-09-14T13:58:53.361241+0000, chain.objs.size()=1 2024-09-14T12:16:15.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.199+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YtufC1B5eJ1b8NTaQYGhGnywFVA3Rmo_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6052985079337558618', time=2024-09-14T13:58:53.672430+0000, chain.objs.size()=1 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.h0uoukym4f4-gm0ariPXIC-312C76bK_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14550439163678269925', time=2024-09-14T13:58:53.899910+0000, chain.objs.size()=1 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XLBJFBUTeAn9BeTn5wjQaa4AaGTnH-D_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1312574711891232395', time=2024-09-14T13:58:57.254035+0000, chain.objs.size()=1 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.P3NmkGWmhAwdz0sU9tQrHjy-Jc9GKLK_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3695734498822858715', time=2024-09-14T13:58:57.307622+0000, chain.objs.size()=1 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WW9qPCELTxWd2bmsJriySJJEccHxfJm_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3236664063549587656', time=2024-09-14T13:58:57.697928+0000, chain.objs.size()=1 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zBYyoLp6ULtOa58JG3GZti1hxEn3jTr_0 2024-09-14T12:16:15.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.367042610505023669', time=2024-09-14T13:58:57.699384+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.200+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yTgxZGEMZolrGR2h6HPcsxjWH3SrCcV_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11851345417290736747', time=2024-09-14T13:58:58.000143+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tTtL4vMg1m7taUySJNQY84ajNe6UKhU_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3955607441402129363', time=2024-09-14T13:58:58.059454+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jt_0EdL3Zpk0vBCOCewb2TLTQXiLaRv_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2706370023387849195', time=2024-09-14T13:58:58.146050+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7RlTuQL5k9mx6Zjajj1_hvhTjlDwJ1N_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11139868945758739768', time=2024-09-14T13:58:58.409623+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4Vf_ipT-O3l_moV93w8cWqCbKcBwhMY_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17558470115475306909', time=2024-09-14T13:58:58.682302+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.201+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-5jCt6FoxKyAqEFiYPXIJx_-6N3SZUO_0 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6921730793741517560', time=2024-09-14T13:58:58.980855+0000, chain.objs.size()=1 2024-09-14T12:16:15.203 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZhCyLLBcqJQ8JNBMrcnCmx8SlslD5BG_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3251552405016102096', time=2024-09-14T13:59:04.677271+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.332__shadow_.i6iSY8RYvAyBWmNBHF59QUwTj-V2KXA_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2091966200936088853', time=2024-09-14T13:59:07.998248+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.337__shadow_.1xDTRgKFjiY5jIWRadrrQNv2hVrO0nH_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16742304392728451294', time=2024-09-14T13:59:39.598641+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.390__shadow_.EIY6TxtCRAbzYk1_XyEwYy5Lb3sg2Yp_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13174977224612557295', time=2024-09-14T13:59:52.998564+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.410__shadow_.yhRe9W6Rq4PQ08cy-6HsAhbhcVosDlo_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4557204372169093598', time=2024-09-14T14:00:04.414705+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.429__shadow_.NCUibZsNnPZcnXbJnkkErK1K5P4Vav5_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16282661889104472859', time=2024-09-14T14:00:32.091011+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.202+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.466__shadow_.0j4vw98xuWlc-Bm-JG2gSO_gQH-OSjQ_0 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.203+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4749654457094372820', time=2024-09-14T14:00:52.216410+0000, chain.objs.size()=1 2024-09-14T12:16:15.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.203+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.497__shadow_.qL14laoKJtCHWTaFJOMDhtvloMTT2yx_0 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.203+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8462527854236119440', time=2024-09-14T14:01:35.245737+0000, chain.objs.size()=3 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.203+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~PCzxSX6vJ_GytfTUCAkavMpnUH6QJ9g.1 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.203+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~PCzxSX6vJ_GytfTUCAkavMpnUH6QJ9g.2 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.204+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.521__multipart_mymultipart.2~PCzxSX6vJ_GytfTUCAkavMpnUH6QJ9g.3 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.204+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18244112437878693467', time=2024-09-14T14:04:24.740444+0000, chain.objs.size()=1 2024-09-14T12:16:15.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.204+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:kvqpmcpHgeCbsCyRNIF9ifogbvYRl5p_.lbwQSkPeyxgYurO58atY-A4PQyBLicj_0 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.206+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/46956 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16048222661981810375', time=2024-09-14T14:04:54.147998+0000, chain.objs.size()=1 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:m2U2OfqAxlhJmKS1H1Qe7JofQhqpTIR_.lDnZwLty1bDwWbnYX3nqFZbDO95t2uO_0 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8811673146572221494', time=2024-09-14T14:04:59.352166+0000, chain.objs.size()=1 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:RaCt4c4wdPkaCwBR.uOmsbwaIoCNJYI_.hgDGJ4UtR3U7k5lYKY4tdzgEujC4k56_0 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10166189448558323180', time=2024-09-14T14:09:28.786196+0000, chain.objs.size()=1 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.634__shadow_.wWAn9u0O7jbGOaJnJX6IrE4kyYt6w2E_0 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.260406027354271521', time=2024-09-14T14:10:07.747949+0000, chain.objs.size()=6 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.1 2024-09-14T12:16:15.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.2 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.3 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.4 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.5 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.660__multipart_bar.2~QtVw0SeP6cfYRbCnJlEO-C3TfRaO8JY.6 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8986153572628319342', time=2024-09-14T14:10:38.511059+0000, chain.objs.size()=1 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.208+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.709__shadow_.G3qRUP5herUKw3O5OcOSIEKXJchc03v_0 2024-09-14T12:16:15.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.210+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.209 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.212+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:16:15.210 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.213+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.211 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.213+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.212 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46067' 2024-09-14T12:16:15.212 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6934897262902197599', time=2024-09-14T13:52:59.093331+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.147__shadow_.GV6CiKSIsVtHSTXACUAIPTVLrk0Iu8H_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5818448531789367080', time=2024-09-14T13:55:34.511082+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.234__shadow_.VRTiKyDll_gFlVZDkRlfvqHRfUOQk5X_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1780546500035235351', time=2024-09-14T13:55:35.194267+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.235__shadow_.kUlZyQ0d1XY04PoJCHQ1B2IaJMwga1H_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17779985972636086213', time=2024-09-14T13:55:44.506503+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.247__shadow_.YtTgh4OwN3--dOGvWEaD7Axdhz2L9yg_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2381103046290153817', time=2024-09-14T13:55:45.198016+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.248__shadow_.rovgqtNb9CnV1Fbc9PCFvEk5bz5QVfm_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13844767342921075812', time=2024-09-14T13:55:47.266782+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.251__shadow_.2_VFLq_imQhQcic6h7orBj4RPAW-eSh_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15535071011974679591', time=2024-09-14T13:55:52.696306+0000, chain.objs.size()=1 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.259__shadow_.X4PRDq1WhcLUE1ROYfOsrJRzmAexhhy_0 2024-09-14T12:16:15.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9338356851922200550', time=2024-09-14T13:56:30.220446+0000, chain.objs.size()=1 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nOXPprREQP8O8gKCOVKdPJnrc4ErACK_0 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4611014218008193172', time=2024-09-14T13:56:30.257337+0000, chain.objs.size()=1 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Tl5fR9YQDwe26qdYjhmFNziOC2g47uB_0 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5107185019287309105', time=2024-09-14T13:56:30.258181+0000, chain.objs.size()=1 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iFcb_2Mg5zqpcgvYCDskbnvr-kEs9ec_0 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10311559707102039270', time=2024-09-14T13:56:30.539288+0000, chain.objs.size()=1 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.b1gUHTeLxZbCdqo5ig9tc6qQm3DxUGy_0 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15957980494577835586', time=2024-09-14T13:56:31.228005+0000, chain.objs.size()=1 2024-09-14T12:16:15.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.214+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OoXGjmih24ggBPVcP2Lj-p8j9TYbCVE_0 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12274335611550935100', time=2024-09-14T13:56:31.304486+0000, chain.objs.size()=1 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qZ_YmHUWzfXSmAARGnvLMyCUPvjWChg_0 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3338629543302234753', time=2024-09-14T13:56:31.673214+0000, chain.objs.size()=1 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bEHmN5VxB9rGfBbUuMswfEG-niAjO8o_0 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9764564994006387055', time=2024-09-14T13:56:31.801057+0000, chain.objs.size()=1 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Y0XF7KkSt6aVpJPlXcXDNLo4H4EfrRs_0 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18053617879751053212', time=2024-09-14T13:56:32.111162+0000, chain.objs.size()=1 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oFrIQmWeQVRDcv2e723yPI1vvsv52Ej_0 2024-09-14T12:16:15.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6739131933349906155', time=2024-09-14T13:56:32.668175+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.akWa4_McEtTL9bCIQv24E6G2LRqcWWP_0 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18236398566858536480', time=2024-09-14T13:56:33.036112+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.l0_1OQJ6J9uyJbcPeYAnVMBFxmwOfEa_0 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17098386315540706533', time=2024-09-14T13:56:33.255631+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.G8uroViD27kKzyt_PNgJarVSH3wGVES_0 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18277543120750209408', time=2024-09-14T13:56:33.474474+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.noJKebV4SmeGMbIW_RxP8rsSLWSYi-3_0 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6671293824270786771', time=2024-09-14T13:56:34.261567+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wF_HGpfx4azqcfq6st0EjB8xp1uLNTh_0 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10482883842219655049', time=2024-09-14T13:56:34.375142+0000, chain.objs.size()=1 2024-09-14T12:16:15.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.216+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Jd3gM5CO-xIeRj2LGB29DqaZXyzyB4w_0 2024-09-14T12:16:15.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10728937391747965573', time=2024-09-14T13:56:34.389893+0000, chain.objs.size()=1 2024-09-14T12:16:15.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.007IgoMekW6NiYzU6KG0fPxq5MutikT_0 2024-09-14T12:16:15.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9634700932137034388', time=2024-09-14T13:56:34.713199+0000, chain.objs.size()=1 2024-09-14T12:16:15.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YmGHZcA639PYG3FSPEwgR3O7rcvLFq6_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2513557015180997074', time=2024-09-14T13:56:34.714709+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.j2nBHekx0pYjPNh4uGnHaPdGefaS3Mt_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16886416153729129023', time=2024-09-14T13:56:34.828935+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xyz61rD8l5hHl9v3kjvrmZbm4cXAVQ6_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6469694043079889374', time=2024-09-14T13:56:35.026011+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.K_2RgWdbG41BwQzwMe1lK2E8W3dk4n9_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12782266614941488168', time=2024-09-14T13:56:36.013666+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.osvzKuJ33CSUsB_EK2HpJsixTJmhELz_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1268676712376071568', time=2024-09-14T13:56:36.261397+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.srWWAvX-Hobx8r8va4YaVIWOj9a5O1j_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14970120826397838521', time=2024-09-14T13:56:36.896491+0000, chain.objs.size()=1 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OxheSw9vvvrWDzVzeAInbP_p3LpvJIg_0 2024-09-14T12:16:15.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16766236597343242358', time=2024-09-14T13:56:37.081018+0000, chain.objs.size()=1 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YebVLaFPj4LonvYyv3gedi96EhqnmnA_0 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.704906915455792343', time=2024-09-14T13:56:37.635449+0000, chain.objs.size()=1 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kB-zjlSHao0yaGRU_5nMsrN14D8T_ig_0 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12871897326688930302', time=2024-09-14T13:56:39.525348+0000, chain.objs.size()=1 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.218+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.1pwJMHrZMO0p2M_36UYs-24ectiHvrs_0 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.219+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8355146502895696497', time=2024-09-14T13:56:39.526034+0000, chain.objs.size()=1 2024-09-14T12:16:15.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.219+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Gk6UQqYpXgQdzKM7c8qgEfstNxb2dge_0 2024-09-14T12:16:15.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.220+0000 7f15ed66f640 0 -- 172.21.15.116:0/1319508206 >> [v2:172.21.15.164:6800/3190735033,v1:172.21.15.164:6801/3190735033] conn(0x5586fbf9c090 msgr2=0x7f14b8098d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11733386586828430924', time=2024-09-14T13:56:39.627461+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Xyoz0iqTwpBUyeKTJxUUHjWfAt7ga82_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10551517574446655915', time=2024-09-14T13:56:39.773540+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BbylSVt-LYIj5V-wLiOVcfWKmFmO-Cz_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12578788664214286577', time=2024-09-14T13:56:39.789375+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ji0-5jWntEXLVK1EQ2xFWMm50Hx6zAu_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4725216219767804130', time=2024-09-14T13:56:40.004170+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BLVKmRLEnVKDOWNMbjT2bpmnuWTQWiW_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7324807510507382136', time=2024-09-14T13:56:41.004491+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.263__shadow_.GPxAm1pOG7I80IVqpJQMT1crGGuztYi_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11853194612750929065', time=2024-09-14T13:56:46.282517+0000, chain.objs.size()=1 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.271__shadow_.-QhQay_FDFZsHxHv-GhwWvZdf8HN5xa_0 2024-09-14T12:16:15.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17730037897404335062', time=2024-09-14T13:56:46.285908+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.271__shadow_.RDknUB5gcDhTdoSlDYB38Qvg173j7ev_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7477983563828179490', time=2024-09-14T13:56:49.598217+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.276__shadow_.ITxu1gJvD03N8JFta-Vi1trpX2VoS_T_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7349096009069864495', time=2024-09-14T13:56:50.316803+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.277__shadow_.rbyQsMkqSvOrk2eiPsCLVqdCO_ry30A_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9571075566106815382', time=2024-09-14T13:56:55.167384+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.221+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.284__shadow_.riYqlwhaa_OeZy_Xefzx5TjlQVGZmqn_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10802321229619770066', time=2024-09-14T13:57:02.125000+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.222+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.J_wjb9h3ttyoDZ8VxhrYvdLr05APk-H_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11125426126883738773', time=2024-09-14T13:57:04.072995+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.222+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.XBD449g-s85xpKfLJXKtjziFxOCW3Ev_0 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.222+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1337915343940705274', time=2024-09-14T13:57:04.897278+0000, chain.objs.size()=1 2024-09-14T12:16:15.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.294__shadow_.KijcQ7aOdqChXkKBH4FqYDvJ5jxeIWM_0 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16544322359520910671', time=2024-09-14T13:57:07.841620+0000, chain.objs.size()=1 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.298__shadow_.9nL1K3umNPOakbcCwJO7cCUaNKGnUJ1_0 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14677950651686212556', time=2024-09-14T13:57:09.286828+0000, chain.objs.size()=1 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.300__shadow_.seiatuFWfnN_AUQs1v1e7HBN8EoqQvJ_0 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14382427633909626438', time=2024-09-14T13:58:02.400282+0000, chain.objs.size()=1 2024-09-14T12:16:15.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.223+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aqT7esxEBGF59HRW4FFF8qmecCvdDLZ_0 2024-09-14T12:16:15.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9891394234005380692', time=2024-09-14T13:58:02.513613+0000, chain.objs.size()=1 2024-09-14T12:16:15.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bMOa-3DhEDN07uqcxpdm5Glr7QwfxGW_0 2024-09-14T12:16:15.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12258319218161398878', time=2024-09-14T13:58:02.553970+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Gz2vt8dDQmfj2djRiVYJFOw1PavQljs_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11085892726617028119', time=2024-09-14T13:58:02.966944+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zWfV-jh1jq4eUMFiZyqwGXa2UbiPB3I_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6556308869615983838', time=2024-09-14T13:58:03.187574+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1xqIdQIk354Xun07cy8dlU1yl0nZFIW_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17569473918534653414', time=2024-09-14T13:58:03.734306+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.224+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7-Khgnh-zOn43hLJg8C3pc4e5NILSuN_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2479511706942296656', time=2024-09-14T13:58:03.886233+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qunLunofWLy2Spd204fl-v7PCnFN2U-_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4526058062839584513', time=2024-09-14T13:58:03.886891+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3H57iciPU-wWWeW52ZkItohwBLJPYTN_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.769205383290547822', time=2024-09-14T13:58:04.561069+0000, chain.objs.size()=1 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hrUBBk4-IilfPCZAkYaI-ZD7X4r_TxR_0 2024-09-14T12:16:15.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17211433458129124103', time=2024-09-14T13:58:05.440110+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nGQ22BCxCMbR8ln296BbUAereGkU40I_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13881643527059597497', time=2024-09-14T13:58:06.099732+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BhrA5sjRK2BKkVvqRFcU_0SMGbb51R5_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8020707682360211154', time=2024-09-14T13:58:06.595899+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.225+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HDlcE4EhywAXOWHpwweU58wqWKHXc8R_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2216600658964474341', time=2024-09-14T13:58:06.596703+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3upHN6Jljik6s8YrSFeWj27X7Ot_pRA_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13931692803250213079', time=2024-09-14T13:58:06.684065+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.195sIAjJ3tIQ13LdTJXH5GALCQ6WUGw_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18281091723513980488', time=2024-09-14T13:58:06.747875+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hFOB8L_r4plaUBnJ9k6H6Q-nwrfIePJ_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16024977240896941847', time=2024-09-14T13:58:06.766112+0000, chain.objs.size()=1 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M8zuoJMTNt8LpHWMJoBs69YBd2zEhlL_0 2024-09-14T12:16:15.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14878706529624044125', time=2024-09-14T13:58:06.893245+0000, chain.objs.size()=1 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aRFtCJsv1UtNx4JWBj-gEZOeRIDzi3b_0 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7520106001378680463', time=2024-09-14T13:58:07.171828+0000, chain.objs.size()=1 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uy6KdkAbWYxtT_h9aKpL-iFsyq5pV02_0 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14186227858573158123', time=2024-09-14T13:58:07.461434+0000, chain.objs.size()=1 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RD3svYnAlENG0mtJzJKW-lN0ZpS2eJU_0 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.21939066494235062', time=2024-09-14T13:58:07.505232+0000, chain.objs.size()=1 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3aY18E_i3IwfjuXzlBnai9XiwKqJhbN_0 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.226+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7156839321592897901', time=2024-09-14T13:58:07.964536+0000, chain.objs.size()=1 2024-09-14T12:16:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YwZBvy_NaItFVNfjHv-7ph8MUay9kR-_0 2024-09-14T12:16:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6747801658969244313', time=2024-09-14T13:58:08.334290+0000, chain.objs.size()=1 2024-09-14T12:16:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NgGN_8TpZ9N9umHltpDq2b57kXU8MhO_0 2024-09-14T12:16:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.227+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13774078409810393631', time=2024-09-14T13:58:08.847009+0000, chain.objs.size()=1 2024-09-14T12:16:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.227+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OJzlWZTU6BTr5375Z6WJeYKE9K20orw_0 2024-09-14T12:16:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.228+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3853560060277222558', time=2024-09-14T13:58:08.906528+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.228+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Gmo2BWBRkUzpTmGsbWDSlRxhitoJ7Ap_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.228+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1533659769723604022', time=2024-09-14T13:58:09.371350+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.228+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JYGLhugFeKcoECITHKhKGrFRBV-c2o4_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8408971452105482020', time=2024-09-14T13:58:09.660122+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wIhEW3v0MpE8I3dvMUgIB5rRQh70Fxs_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10092098889762407305', time=2024-09-14T13:58:10.112421+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4t-Xyruj8mQW7-NkxWzaIq-5bD3WQJW_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16645576501223455630', time=2024-09-14T13:58:10.725828+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4XsR_5MSVu-7l6SpRfP-Q7kv-scTc9E_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6999599733554691415', time=2024-09-14T13:58:11.048524+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hoLGU9zB_Ev-Y3rl7WqQaFLhTIqVc3Y_0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6582874710803973125', time=2024-09-14T13:58:11.073231+0000, chain.objs.size()=1 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Typ5QWIAdgVx-MOhhxJ-aPtvHRuaRf__0 2024-09-14T12:16:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2508045438088032830', time=2024-09-14T13:58:11.331580+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Im6YRUmgUljnL7g1DqGpUYY3q5Zg_m6_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.212364518057297777', time=2024-09-14T13:58:11.803549+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.M0niQwGBv8mOUxkEquzPfYBeMX14kRf_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6467380841491784640', time=2024-09-14T13:58:12.103163+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.229+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AZDO0VEoZC051ne3T997jrMBzQLOvIu_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16256859121399982127', time=2024-09-14T13:58:12.276259+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._ATgyQLmAGdiZIf1lE1-4ID0MIkiPgU_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9808524577392038563', time=2024-09-14T13:58:12.364954+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oc1Yjn2TVyniTmEhtahbmtIj-GCONVU_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10370851586870371167', time=2024-09-14T13:58:12.479956+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2dSx7Nb_KCVQiC7PVdh3ltcOnKoPN4g_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14174914231328439596', time=2024-09-14T13:58:12.564020+0000, chain.objs.size()=1 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.230+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zhRAO8AI5tu20NtaocZuko3MYpl3bEY_0 2024-09-14T12:16:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2010408009964458330', time=2024-09-14T13:58:12.600833+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.V58A0RRd4dF__2VjBtL9XiaNnxnlo6Y_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16718134500616004931', time=2024-09-14T13:58:49.129986+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lTHUqzx4HbDfv-t-tHg9rfXSTsOAKwN_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12715474057260470859', time=2024-09-14T13:58:49.179068+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PZDIeFrvY7kHTWe0PLk-r8V8kbqHwAY_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11997377550506621026', time=2024-09-14T13:58:49.563340+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.WG6jZHe-J1-kzSDEWv4JMNst4F7crY2_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7254411827173609336', time=2024-09-14T13:58:49.899384+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2A5psGPsjuxJf22AdAyoiILbFv2D8Ux_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3478069356937112596', time=2024-09-14T13:58:50.657757+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nFZWNPnTyVcaWZ4d2nGUlcY1ukB7dHB_0 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13352085035868034683', time=2024-09-14T13:58:51.172117+0000, chain.objs.size()=1 2024-09-14T12:16:15.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nMxCBY3EOR6ZrX2ZMx09sFjugGAvOKb_0 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.209869186955774113', time=2024-09-14T13:58:51.258066+0000, chain.objs.size()=1 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.231+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iQ6MsEOLgt03TG0xAjFxC3M6TH1IV7n_0 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4112339796275821802', time=2024-09-14T13:58:51.317856+0000, chain.objs.size()=1 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.194uH14aBP9uonCj-GEb6uhi44TnNNb_0 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3937596954254352360', time=2024-09-14T13:58:52.098176+0000, chain.objs.size()=1 2024-09-14T12:16:15.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tyHXOyrwDGFhS59mN7iJev5brWvrPfO_0 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12196014771069902390', time=2024-09-14T13:58:52.212875+0000, chain.objs.size()=1 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.232+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tXWix2Hs0A7ibCIUSrBuoKd-2DjH5vX_0 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15035031437089254809', time=2024-09-14T13:58:52.385191+0000, chain.objs.size()=1 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PVtzfSoSst-5wu-WE1gqA_S1OvTKNao_0 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18182960354562847174', time=2024-09-14T13:58:52.621407+0000, chain.objs.size()=1 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GlexftdZey-EWDiJT_E3CgOGa-k60A1_0 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2082714337336402396', time=2024-09-14T13:58:53.373547+0000, chain.objs.size()=1 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.233+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DH7EjjO1-BAGoiNuWe_LulGfFifuPQq_0 2024-09-14T12:16:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.235+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/46067 2024-09-14T12:16:15.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T12:16:15.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9407325860509942394', time=2024-09-14T13:58:53.481287+0000, chain.objs.size()=1 2024-09-14T12:16:15.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-13Idw09xtZL66Anczk_YScroRH_asL_0 2024-09-14T12:16:15.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3302364488400160061', time=2024-09-14T13:58:53.495399+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.kEJCG2pXCslMLqCcP7fyZbnyRwA7y20_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16047212318853635235', time=2024-09-14T13:58:53.671490+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.h7nH3d_ps5lpfsvKjvYh-Kr3gtzv8PD_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16177721799099167946', time=2024-09-14T13:58:53.869105+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zKILUh7ylOoF3E9yj_pdrzzWJbbxXsm_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10829272426879081097', time=2024-09-14T13:58:54.046107+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ej6HbH4rxNl7R92K1SBSKlo6PhhMkKm_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1185283503742256239', time=2024-09-14T13:58:54.209228+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yw_Bzvh43q3yo5Jafz31tq1XZ0eq0bG_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4671333870018410370', time=2024-09-14T13:58:55.151803+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.na19E0ZOuLLdqrqFxlrkF-QGzt7FWxh_0 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1446945698601574616', time=2024-09-14T13:58:55.421769+0000, chain.objs.size()=1 2024-09-14T12:16:15.236 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3H0e9zRPt6ysR0-Q6KcgbMaKcR491Yj_0 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12793010581183507132', time=2024-09-14T13:58:56.506849+0000, chain.objs.size()=1 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RGsqybFWLI7CtWc8E_7m-cMKSaQwX1G_0 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1407988515656446534', time=2024-09-14T13:58:56.916194+0000, chain.objs.size()=1 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hJDQApyE11ryPc17UxjC3BFmepR3uW7_0 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3395269341615960804', time=2024-09-14T13:58:56.952507+0000, chain.objs.size()=1 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.F-ntBI7a07xKLuahGRo1s4vhv8RVOMr_0 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1637778917550669777', time=2024-09-14T13:58:58.086283+0000, chain.objs.size()=1 2024-09-14T12:16:15.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.237+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MVUlVeUr4VwPou1eg5D2orbgL_p7p-X_0 2024-09-14T12:16:15.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3441609162963857894', time=2024-09-14T13:58:58.322112+0000, chain.objs.size()=1 2024-09-14T12:16:15.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-d24mQ0Bqu_uxlJ0LlYh6jGXVKLWgOe_0 2024-09-14T12:16:15.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14098280123603328848', time=2024-09-14T13:58:58.961879+0000, chain.objs.size()=1 2024-09-14T12:16:15.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BOIF_00gD7Bu0ogV9W4K7bfXnZJyUuj_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7436241201645352722', time=2024-09-14T13:58:59.167495+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AXoGvRjbLSRHeE8agGU9_CzlJaJ1IR7_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12420257803481111238', time=2024-09-14T14:00:27.391390+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.461__shadow_.GNZ-4VN8g6sFfsmQA6Pjwrjwk-qNl09_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11813994611929563467', time=2024-09-14T14:00:31.161162+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.465__shadow_.SLkeyJS8VJMbQJrzth3KONrU2P_Hby6_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11849527702039684956', time=2024-09-14T14:00:51.189430+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.496__shadow_.LbrsrIsRNPtumDP0jAbWo2X-8egyGen_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~pnYqGaBnpL9h_AV4ClWD6w2Mkxv5V2p', time=2024-09-14T14:03:04.105203+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.531__multipart_mymultipart2.2~pnYqGaBnpL9h_AV4ClWD6w2Mkxv5V2p.1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12480597002040434835', time=2024-09-14T14:04:30.196506+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:V1.82SVD5Bu2I9MbXVwc7CRjdsGUgw5_.F3GqEyrorZc_QjxWG39wfjFKOZ4bp_k_0 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7731150111602363536', time=2024-09-14T14:04:35.897092+0000, chain.objs.size()=1 2024-09-14T12:16:15.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow_.o9xqpMca5sfDeFnutYq-dSK88IKx7Yr_0 2024-09-14T12:16:15.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2140566988071055099', time=2024-09-14T14:04:45.775575+0000, chain.objs.size()=1 2024-09-14T12:16:15.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.576__shadow:Z0z3puBmSk.CNQJuFy90J9g5FwA0WHb_.NByjowOgqya1w3hx4RGxLGbXw1aKKOi_0 2024-09-14T12:16:15.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4938574603182317984', time=2024-09-14T14:05:02.175969+0000, chain.objs.size()=1 2024-09-14T12:16:15.240 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.239+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:TjN4IuDUoHead2hotWhbTS1kbExK7fm_.uABIF9nmDGlJs1TQRvthniTbrpx5OU8_0 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8681769688807058542', time=2024-09-14T14:05:24.252761+0000, chain.objs.size()=1 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:d3W1wlGCZCeqOfut7Pfj62FdVVeSijf_.Kobz0Fe-gbotKlgun7E_R55ROizJlRh_0 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17694385640346559344', time=2024-09-14T14:06:38.292261+0000, chain.objs.size()=12 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.1 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.1_1 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.2 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.2_1 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.3 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.241+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.3_1 2024-09-14T12:16:15.241 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.243+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.4 2024-09-14T12:16:15.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.243+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.4_1 2024-09-14T12:16:15.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.243+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.5 2024-09-14T12:16:15.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.243+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.5_1 2024-09-14T12:16:15.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.243+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__multipart_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.6 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.244+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.614__shadow_multipart_enc.2~ZadYOEpFx32LvLA16FJQSQCO_r0IDoG.6_1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.244+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.724463821974893194', time=2024-09-14T14:07:47.360840+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.244+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.617__shadow_._duKBqxU5RpKSFlV6trjBFt6G5SZh5z_0 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12117816638764770906', time=2024-09-14T14:08:49.541613+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.619__shadow_.md-6kVWsli7cxnEYO2_QmcGjZTfKsiR_0 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.209777570291448227', time=2024-09-14T14:09:28.087345+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.633__shadow_.GrABTKyA-PbUHjZf_vOVgInf9OwVzso_0 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6154418127155359360', time=2024-09-14T14:09:40.890574+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.646__shadow_.sEp_ssvAwok-ANqsTRoEt_xx7vFyEri_0 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17170432507592760091', time=2024-09-14T14:10:12.224700+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.666__shadow_.k9mAqwW6yMLLxFxl8cIN7Xt6EH0Wy7o_0 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12794273137502401663', time=2024-09-14T14:10:32.178074+0000, chain.objs.size()=1 2024-09-14T12:16:15.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.700__shadow:iaDVaYxmFgTkunowah6YsQT42Dzp.Au_.2dB4qHd8FjahST0koT-irx980Q-B8bl_0 2024-09-14T12:16:15.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14051350568565998004', time=2024-09-14T14:12:22.824185+0000, chain.objs.size()=1 2024-09-14T12:16:15.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.245+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.755__shadow_.sPancmbTrKrD51CgVmGhpF9WQTWrAdn_0 2024-09-14T12:16:15.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.246+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9422761449516911630', time=2024-09-14T14:15:43.735647+0000, chain.objs.size()=1 2024-09-14T12:16:15.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.246+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.782__shadow_.YUDAB4V9hX4OIvtXoWiUbxi7QssUA6C_0 2024-09-14T12:16:15.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.247+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.249+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:16:15.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.250+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.251+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52915' 2024-09-14T12:16:15.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11419271006201232641', time=2024-09-14T13:53:08.880274+0000, chain.objs.size()=3 2024-09-14T12:16:15.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.PM3De2qHk7dwLVAouz8qGKTB8yFoNJA_0 2024-09-14T12:16:15.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.PM3De2qHk7dwLVAouz8qGKTB8yFoNJA_1 2024-09-14T12:16:15.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.158__shadow_.PM3De2qHk7dwLVAouz8qGKTB8yFoNJA_2 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_szTo9ytvQwN-rbpcd7OSJ7LQ1zctg3F', time=2024-09-14T13:53:19.392100+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.N17wncT13WQ-Y9ZUBPeJSqdG4wrp_e7_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12471650216650136076', time=2024-09-14T13:53:43.924962+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.177__shadow_.obiMmPLefflu7HyDeH1BV4wwU5fHgDg_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18365666044512010323', time=2024-09-14T13:55:35.909584+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236__shadow_.VAGZWfzJOSBP5RUiKDk0_4JRe9-Ezxv_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9160277389054176110', time=2024-09-14T13:55:36.886497+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237__shadow_.Cxy0VW8ysKe77z-qhRWr8oHkVudxgip_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15034178295289240175', time=2024-09-14T13:55:41.415559+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.243__shadow_.AWxjM67WfV00gVGWj2GVQ1ArQcvkbdI_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4714103269997933900', time=2024-09-14T13:55:45.893442+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.249__shadow_.zI_n0jajskYTG2D8N-tAT99bqt4KDcR_0 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11891856383386225208', time=2024-09-14T13:56:29.927008+0000, chain.objs.size()=1 2024-09-14T12:16:15.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yEBVB-urMXlb_rMCuDzTXlXp4b7G0a-_0 2024-09-14T12:16:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12775277849596820696', time=2024-09-14T13:56:30.084103+0000, chain.objs.size()=1 2024-09-14T12:16:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vDMn2H4w5Wi5JbSpPwvc7CvjgHpMpqn_0 2024-09-14T12:16:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8055542385995479354', time=2024-09-14T13:56:31.808770+0000, chain.objs.size()=1 2024-09-14T12:16:15.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.252+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HZ0UG-GL2VPeDlDx_hwSLatgoHOeDtv_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.254+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12976432194096222768', time=2024-09-14T13:56:32.773890+0000, chain.objs.size()=1 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.254+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.O-z_uzu00rg5sLlTywJOIVUYzIUeUpL_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11913826743257061386', time=2024-09-14T13:56:33.068365+0000, chain.objs.size()=1 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FLwWsNz_dR-xWTAYL3ZFxJn_6-xGzYV_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4753909705619756233', time=2024-09-14T13:56:33.068940+0000, chain.objs.size()=1 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FmDxlD9N6Yb4Ckv_e4uWx2UxpgpGVx2_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.312866439743633643', time=2024-09-14T13:56:33.632041+0000, chain.objs.size()=1 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wjpwVK_OEYpNdEnaaqc87pELPCOZtO5_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17283032237789265576', time=2024-09-14T13:56:34.208839+0000, chain.objs.size()=1 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.aeYyhv0gOnFlt4RVkVGZUKBVMYgligR_0 2024-09-14T12:16:15.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.51518576673138135', time=2024-09-14T13:56:34.309104+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dgXJrV1OwGKpPvtMAWzgWgQFETf0XI7_0 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1941512514612223582', time=2024-09-14T13:56:34.348288+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.THhrYQXIQ_syO9Yb8vE_BW97z0vgYjo_0 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12773221489062928374', time=2024-09-14T13:56:34.773468+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rjDFYM4gsI6eAQ92dEa33Nv0eplvHVo_0 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10316257924840880705', time=2024-09-14T13:56:35.044002+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.C_dwY2lfboipQk5z7CO4_s67Lk2iYZt_0 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17356886483487832878', time=2024-09-14T13:56:35.417896+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ricuopeAQ6Idb5wsGrcwFe-sI_bDdvy_0 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5778955472318682837', time=2024-09-14T13:56:35.437592+0000, chain.objs.size()=1 2024-09-14T12:16:15.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.255+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.11C1VRT2a1TwU2kFtFACqA-dubEPp_D_0 2024-09-14T12:16:15.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17111907352058713655', time=2024-09-14T13:56:35.780948+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sutU3V2GVosRtttFGU93XQjbUZf7-Y__0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15718713138823927885', time=2024-09-14T13:56:36.755067+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.phRZAuvyq1gu-XfRLRMPXKu7nlIxtAN_0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9955456908437880418', time=2024-09-14T13:56:36.906186+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.a4ROG6q43muwqJI45dV_dTPW7_hXMqR_0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5432191523907542854', time=2024-09-14T13:56:37.313156+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Hx3IwVf11zieGRkGLA5Hb-JAqdMdMoE_0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17244288563634192466', time=2024-09-14T13:56:38.235465+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wu5YoC_a5ZI2W0808KIcyRLXLQW_drH_0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.975440922169594343', time=2024-09-14T13:56:38.585415+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gO0CPLhaeJTlaZCRfiYtfhaU9Zc-HBb_0 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8842134225014635562', time=2024-09-14T13:56:38.848060+0000, chain.objs.size()=1 2024-09-14T12:16:15.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QnlZWCjpmawYW-ltpnZAXBjcY_AjwaL_0 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4178942723224304240', time=2024-09-14T13:56:39.029435+0000, chain.objs.size()=1 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nWjIoFG_wcWwSx32_T2mqs8cJvPIach_0 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.822451819500766516', time=2024-09-14T13:56:39.683099+0000, chain.objs.size()=1 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pR2wli_XYvnVI9ECGSL-RnEVx-IKZWN_0 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4975568244858133310', time=2024-09-14T13:56:39.733884+0000, chain.objs.size()=1 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8qqNiHuO7qcficmqWFNjL3S3PaDrF9L_0 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9815898825510537700', time=2024-09-14T13:56:39.888421+0000, chain.objs.size()=1 2024-09-14T12:16:15.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.257+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.J2pyi7doVgvJ8Mq5o5cyMcLJELG-y1z_0 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11672736479596006540', time=2024-09-14T13:56:40.252262+0000, chain.objs.size()=1 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.C5cOEHlP2zHD0vKug6jXIGgIas_0KLZ_0 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16116952310169060839', time=2024-09-14T13:56:42.333092+0000, chain.objs.size()=1 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.265__shadow_.blC4MxPXC9b6ZorKhtaO91WpQvkxtZZ_0 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7309969534369008711', time=2024-09-14T13:56:51.007226+0000, chain.objs.size()=1 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.278__shadow_.BtHy1wkWahNnKRb6H3rJnecQvCIkXyw_0 2024-09-14T12:16:15.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13603431098115599374', time=2024-09-14T13:56:55.169148+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.284__shadow_.t8PHnRVmlnk_z1tXceuTRMIJM-0y9UU_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16164551900380264466', time=2024-09-14T13:57:04.075094+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.Z6sKZh09V3TDPQFVE3a9jWmEVwC1a89_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13072626704471171851', time=2024-09-14T13:57:05.572292+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.295__shadow_.oy0MetbVVwFrzLp1q8NoDaW0PeeZ4hU_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16295703008663694482', time=2024-09-14T13:57:13.702086+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.306__shadow_.-8VaxTfQUsIAUMTXiJPmbgbpKn7lZAG_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16209982708408861221', time=2024-09-14T13:58:02.289819+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9AcmXejwKNbSl4wKzWYfDM27s7QN2vP_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16207197338043639024', time=2024-09-14T13:58:02.340190+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IQBtBejz88bind92nWa_Cq-2Mqc2crv_0 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3795198209267624054', time=2024-09-14T13:58:02.865494+0000, chain.objs.size()=1 2024-09-14T12:16:15.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xoYCCehU0dSWNlKCPdEGqzDCQfnZEM4_0 2024-09-14T12:16:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13909344854817193658', time=2024-09-14T13:58:03.034667+0000, chain.objs.size()=1 2024-09-14T12:16:15.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.259+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QAO7CpYPNepz1qgR0PWrSf_1T24e9Ve_0 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.261+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10775688152340080996', time=2024-09-14T13:58:03.185117+0000, chain.objs.size()=1 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.261+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HQDwQYFMilH2NSaoC9w8CVDMgupyPbj_0 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8229419712319323976', time=2024-09-14T13:58:04.123719+0000, chain.objs.size()=1 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0QPMLdSHi_mY_vXvQiyyDtDxc1DcmCU_0 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5634186481689316758', time=2024-09-14T13:58:04.413362+0000, chain.objs.size()=1 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.dl51cAHEWS36XjgZOOpI4z4TCddtsGQ_0 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18201748123057153392', time=2024-09-14T13:58:04.479994+0000, chain.objs.size()=1 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.L-OAJlEfh5efRDnKv-o7cdxsF1aaXpt_0 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4499604920327868213', time=2024-09-14T13:58:04.571596+0000, chain.objs.size()=1 2024-09-14T12:16:15.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.XlEWt6UP__zKnIAAnfDfeEqAJjfJ6wJ_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3365160094615296697', time=2024-09-14T13:58:05.286229+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xvud560wczEQX71l1xkpeXicWDaB8nn_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9576722064210740257', time=2024-09-14T13:58:05.660454+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gOJgnqeHHLPjJaaBeMrdbMyquV6cXZM_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4892642673775479614', time=2024-09-14T13:58:05.778920+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9zkmFZRcmiuR3Od3hoepAbK_WQLId-h_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15347033323215449770', time=2024-09-14T13:58:05.818673+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qgp_jth5E3yZLetKBLvAFQFDTFtxpK0_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2631146606562897724', time=2024-09-14T13:58:05.926818+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ox1nMzDcR47OWDXXHw8DeWfcQYqy1Td_0 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1470615416383479137', time=2024-09-14T13:58:06.137303+0000, chain.objs.size()=1 2024-09-14T12:16:15.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RG2mUUYJsETovOpxPuKD9CQ_PQZWjP-_0 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14887384355615107805', time=2024-09-14T13:58:07.009318+0000, chain.objs.size()=1 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.262+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Wh-LjHHy8oZP6zHFNaTQ3KcYXWJKM7v_0 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10062450337443923476', time=2024-09-14T13:58:07.009963+0000, chain.objs.size()=1 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rreNoxuRLpaHiZtCRg9LrcBwBdKHxVo_0 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.263+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16302052323535923991', time=2024-09-14T13:58:07.939698+0000, chain.objs.size()=1 2024-09-14T12:16:15.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.263+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FQhe_zaHoHUvT-kiar8eCFRgi3iHiCC_0 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13227379358134625903', time=2024-09-14T13:58:08.231572+0000, chain.objs.size()=1 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qcbCrOA-z2f9AIhpxudQqGm2fgAZx2c_0 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5677369110148524713', time=2024-09-14T13:58:08.844629+0000, chain.objs.size()=1 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.X1GufDU8TwUlnfSI3tpIPuBCXibzaSE_0 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2943514390258792990', time=2024-09-14T13:58:10.033548+0000, chain.objs.size()=1 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ry_xaXdwVlZfwCI9huAUfjG-NcFMj5D_0 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7748200586590082360', time=2024-09-14T13:58:10.064482+0000, chain.objs.size()=1 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.E0qaCNLrbfbyjqT2_VLq3Jc2NfPTWEY_0 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7033294342084397409', time=2024-09-14T13:58:10.241822+0000, chain.objs.size()=1 2024-09-14T12:16:15.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.264+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_._Mpv4wdoBRG7GycDD0kAo6B0eYFKoDI_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7878614483737969300', time=2024-09-14T13:58:10.678955+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.aUVsoZBnkAzNg5QiIjDhWc8HIMBmtqI_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10437772945186058057', time=2024-09-14T13:58:11.288907+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bxDWj8GD1kfhuo9-Mx0qSOsGkBPEi6U_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14075500538316741886', time=2024-09-14T13:58:11.435304+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bz2rVN44Lx_RUqbS2iycYxaJ0IK0GvY_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3107318191392077048', time=2024-09-14T13:58:11.843066+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JzfFQ8RlVLMF71mBdcIzxfsaBTrK8P1_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11723212013151554898', time=2024-09-14T13:58:12.198147+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bFNF8Jc-CFbPYBBW3T3CqmzneiXigJ6_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.680728420456531262', time=2024-09-14T13:58:12.217789+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.265+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rulgV2wm-KPLfPnHXBJXl8l3xazzRZ2_0 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.266+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8588707479643047871', time=2024-09-14T13:58:49.295894+0000, chain.objs.size()=1 2024-09-14T12:16:15.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.266+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iOxW9vlPb8BG4bzoZ3qlyQA5o7bvviu_0 2024-09-14T12:16:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.266+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5264715606521916615', time=2024-09-14T13:58:49.487317+0000, chain.objs.size()=1 2024-09-14T12:16:15.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.266+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.obFyS4S24wnUdKhonR8ApzVjekwhvit_0 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6459904977946850449', time=2024-09-14T13:58:49.752765+0000, chain.objs.size()=1 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-kc6MtVVkibw3bdlNLAK_t6hc1yGR-x_0 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6245639524700946225', time=2024-09-14T13:58:49.847659+0000, chain.objs.size()=1 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Wzxh40WOZxI-S21a5Hm0KJrryqL5l_j_0 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.148561878012184074', time=2024-09-14T13:58:49.991861+0000, chain.objs.size()=1 2024-09-14T12:16:15.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.EZFa1ioifCgx2nAjYgBxbpXoWKABD_9_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2155733471648741646', time=2024-09-14T13:58:50.034530+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.DWkHoSOGvvKi1UfEho0Vx_jrK3ApkW4_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16473083333431690276', time=2024-09-14T13:58:50.879965+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CtTi1jiCpEutJfMXA8AKOjZ_tbCSvIS_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7173259369905099074', time=2024-09-14T13:58:51.010448+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ytGTYjbfogrcNnsJjg5ZNyVDX0Auo2G_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2546736762624563159', time=2024-09-14T13:58:51.286688+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ArW3wed6_9ru24mcMtkrFeGq1Xt9Azp_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6663021691180317939', time=2024-09-14T13:58:51.330635+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.K48MBiMYeCDUTkE86xNT1q9S4w8b1Xc_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9592937780002322127', time=2024-09-14T13:58:51.431483+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.arr7VNga6bFMziRkEYzTwBv9NPiBWPa_0 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11596145957540089880', time=2024-09-14T13:58:51.474768+0000, chain.objs.size()=1 2024-09-14T12:16:15.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.D6UHbYoCUdBVdq_LTZEsrW80lkyybtO_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17678632717345117139', time=2024-09-14T13:58:51.968163+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.267+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.c669mC3-t2pg5p83OauJ3M45XfDjw_W_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.268+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2121253711183362998', time=2024-09-14T13:58:52.154565+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.268+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.so3lYxxReTnN8hJROjCFlHokkVRZdob_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3090438575835399810', time=2024-09-14T13:58:52.193618+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YrAdBwwr9iQhscsHwxRZ4Ga1kjohS77_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3535902059540057382', time=2024-09-14T13:58:52.317487+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.dB3osqMArUfBEK6KL598cFNfkYDTxt-_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3039090362520715424', time=2024-09-14T13:58:53.938596+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gpTUuaKxpvy0n_4x7q-5EJ0cBPyYuCM_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10050205072962632259', time=2024-09-14T13:58:54.131273+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LsXiZv1rKU4lmiJNpFqCinqtFi9kgPW_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5246242846279092767', time=2024-09-14T13:58:54.363032+0000, chain.objs.size()=1 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qwnDNMCcqKpBFShtnrG5Kv9439Kc776_0 2024-09-14T12:16:15.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18040957393909640380', time=2024-09-14T13:58:54.779623+0000, chain.objs.size()=1 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6ZnFIYHACW_FtYYV3-jiKGdR1Hhu0_Z_0 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7534336821156444945', time=2024-09-14T13:58:56.380535+0000, chain.objs.size()=1 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ytAAZV69NFUmcjMKEKMI3NV58rUy4Ov_0 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17546231982843020105', time=2024-09-14T13:58:56.721866+0000, chain.objs.size()=1 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jDq3EWLOe7VbGc3s0kXRPoIb6cLdgUj_0 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.830378024628230684', time=2024-09-14T13:58:56.786524+0000, chain.objs.size()=1 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uBhvuiSJbzOes-GkD9KN1lDZAPezM_h_0 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3488982352939803996', time=2024-09-14T13:58:56.835725+0000, chain.objs.size()=1 2024-09-14T12:16:15.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.269+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aIebU3yK8j0iZUKLPveosRysPJ8lIeA_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.270+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4361463747462013466', time=2024-09-14T13:58:58.528379+0000, chain.objs.size()=1 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.270+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-cIiNhRjmwHnQS37woT8e8k8y4DGYDA_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4664005501099589125', time=2024-09-14T13:58:58.621825+0000, chain.objs.size()=1 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.A2upkoVxTAXTcdIaDRQ2kmYmkqTza2p_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11672352897360075780', time=2024-09-14T13:58:58.681995+0000, chain.objs.size()=1 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LIzYBqRVMeIuz0hCoFlBZt8eDl7t6wE_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2544256610056241299', time=2024-09-14T13:58:59.015189+0000, chain.objs.size()=1 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lU0_w6ZrrSvn8OiHlV23i14jAjr8u0M_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16927231109251258705', time=2024-09-14T13:58:59.016739+0000, chain.objs.size()=1 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.iq1hJ_kv-rQsFz3EZ7QUnYfuF_6zcDA_0 2024-09-14T12:16:15.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12362100521217181867', time=2024-09-14T13:58:59.219144+0000, chain.objs.size()=1 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.NWGs1rFu5nGvb14lnU7FmFG4O9qDye__0 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8798439110604788716', time=2024-09-14T13:58:59.256854+0000, chain.objs.size()=1 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vpQQuzPY_K6DHTMsmu2wd3Axx7jy9dt_0 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9431989518811578847', time=2024-09-14T13:58:59.521873+0000, chain.objs.size()=1 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.271+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tZ5e48WsewB1rCKRbwIGSoMuqDGpmOn_0 2024-09-14T12:16:15.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.274+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/52915 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13508610728183116314', time=2024-09-14T14:00:56.325337+0000, chain.objs.size()=1 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1771472793073146580', time=2024-09-14T14:01:13.558426+0000, chain.objs.size()=1 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.518__multipart_mymultipart.2~RK2AZLRZEfTHEZAFnw0Uxu9QJGhGSMa.1 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14193268451693758297', time=2024-09-14T14:02:54.605770+0000, chain.objs.size()=4 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.527__multipart_mymultipart.2~Zd2SAUhbAwK9_QOk-4TLk6tr31-bnlh.1 2024-09-14T12:16:15.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.527__multipart_mymultipart.2~Zd2SAUhbAwK9_QOk-4TLk6tr31-bnlh.2 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.527__multipart_mymultipart.2~Zd2SAUhbAwK9_QOk-4TLk6tr31-bnlh.3 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.527__multipart_mymultipart.2~Zd2SAUhbAwK9_QOk-4TLk6tr31-bnlh.4 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.275+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9117553127386674187', time=2024-09-14T14:03:46.887667+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.551__shadow_.4qkg9K0EAaE1qhnSHhmRhPHPhEx8CK7_0 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4821961664941502616', time=2024-09-14T14:04:23.919073+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:CG41pgRQAvokZGrl0VJK7ptPd7v0fmv_.dvXk3Dipkm2h1EOfGv46J_7pybB4dMv_0 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13059383043406708727', time=2024-09-14T14:04:30.766347+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:XXYnVtX-I113K9cmEvmUHoGchjB-vFt_.ua8HBUZZu64pzVgil8BwPAcvM-hkK1Q_0 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7706512203978659006', time=2024-09-14T14:04:36.401931+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:psAQBFYadHSvm-lZO2kLVyppNGY1KUE_.7IyFtMlvjOux0u3NNE9YIRPIaK5IO2N_0 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10538578083198872064', time=2024-09-14T14:05:23.912739+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:d3W1wlGCZCeqOfut7Pfj62FdVVeSijf_.Kobz0Fe-gbotKlgun7E_R55ROizJlRh_0 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7880449898687737911', time=2024-09-14T14:05:23.958034+0000, chain.objs.size()=1 2024-09-14T12:16:15.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.276+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.580__shadow:iGIKlkv6AYoaA8da8Zwg3EqLgkYivgR_.PBjCwhyD1FakUnozwxFHD5YEiNZumDB_0 2024-09-14T12:16:15.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.277+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11234920850600080282', time=2024-09-14T14:11:13.295244+0000, chain.objs.size()=1 2024-09-14T12:16:15.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.277+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.734__shadow_.qJcH41wEVWcEv3yiuQQb_guubl1ptIg_0 2024-09-14T12:16:15.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12021540778925161730', time=2024-09-14T14:14:31.073861+0000, chain.objs.size()=10 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_0 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_1 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_2 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_3 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_4 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_5 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_6 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_7 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_8 2024-09-14T12:16:15.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.278+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.779__shadow_.guAnf0UP2x8tMcDAxOiKCL7GCmjhSgx_9 2024-09-14T12:16:15.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.282+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.284+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:16:15.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.286+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.286+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/144889' 2024-09-14T12:16:15.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_lVpwZSamRXlfucb45fcRpJ6xYbTzkuY', time=2024-09-14T13:53:24.049988+0000, chain.objs.size()=3 2024-09-14T12:16:15.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.fOM2qinPKshzncYiZoIwx8E7WZb73Sf_0 2024-09-14T12:16:15.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.fOM2qinPKshzncYiZoIwx8E7WZb73Sf_1 2024-09-14T12:16:15.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.fOM2qinPKshzncYiZoIwx8E7WZb73Sf_2 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14155325481672638467', time=2024-09-14T13:55:33.799018+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.233__shadow_.bOwtkaYYIyeTvPxZGum-NuQdWNEVhVx_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9564125760715366236', time=2024-09-14T13:55:39.706907+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.241__shadow_.ocCGMClLBK6W9WSkLInuw-IN1eIGRaM_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4369377288779289487', time=2024-09-14T13:55:41.416772+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.243__shadow_.PkkjW1Hey_6exiyYOal_36WUKF96dzA_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4533066153540828532', time=2024-09-14T13:55:43.086963+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.245__shadow_.8gHnjfhO1muRIIeDzrX81gMd3dECLFV_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8936023992805764278', time=2024-09-14T13:55:44.515370+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.247__shadow_.n2knw62rH6YVK1tZgtwI9Ca5WDcPfcF_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12936944859861729417', time=2024-09-14T13:55:52.694742+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.259__shadow_.uuUEovkxLUSuXEeLJuj47XDQczmMhfQ_0 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15191378717214184847', time=2024-09-14T13:56:29.625461+0000, chain.objs.size()=1 2024-09-14T12:16:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8eeNJUBLsLBlcTq9PrpCVWfC9aAhIPv_0 2024-09-14T12:16:15.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8760380289376714089', time=2024-09-14T13:56:30.093770+0000, chain.objs.size()=1 2024-09-14T12:16:15.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.39rEXp51L67Phidy_Y7vRGspCLCePKe_0 2024-09-14T12:16:15.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8212467300792290944', time=2024-09-14T13:56:30.221648+0000, chain.objs.size()=1 2024-09-14T12:16:15.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.287+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9pe8Iw8SfWNWNScrKfnhHs_DdQddpos_0 2024-09-14T12:16:15.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15238194347352467235', time=2024-09-14T13:56:30.332317+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FnjO-XIkC82ntLtBgtl4-eJeT6wmmYU_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4466628992152313164', time=2024-09-14T13:56:30.456468+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tO4_qTIncPT4jKsjRM3Hz13rbIdMTob_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4128370517788363634', time=2024-09-14T13:56:33.032152+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wogDaiu4LjDSDOmarodKhsEP_vJC3H6_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10274124522153066714', time=2024-09-14T13:56:33.153028+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.i3hQnBIL8a989MkbPDyr-kF13Su8IKi_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2712088954534570113', time=2024-09-14T13:56:33.371408+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ot_WaQ8F4Ga7hqQJY1oTdz68kmmA0qy_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10974446923576502613', time=2024-09-14T13:56:33.488464+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LjblAyOiABpArVszYWqqeYoBPJqtLIt_0 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7470150407747843359', time=2024-09-14T13:56:33.534772+0000, chain.objs.size()=1 2024-09-14T12:16:15.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.289+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mt5sZ4ToG6_9FF8Uy6-gTfDBgDyfDO6_0 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16012316327702922062', time=2024-09-14T13:56:33.573883+0000, chain.objs.size()=1 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4gUW7gHxcFHCiDKz6oLMDouzqpr2WSe_0 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8972465159925005400', time=2024-09-14T13:56:33.633498+0000, chain.objs.size()=1 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.aDpD8CM4QvzkI95m4noAKipgRk-4pCA_0 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6032453306397766187', time=2024-09-14T13:56:34.210373+0000, chain.objs.size()=1 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.N9Skm1lj3oZuDPzRNzgyBx0czlIfdYC_0 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13109082813898564947', time=2024-09-14T13:56:34.289869+0000, chain.objs.size()=1 2024-09-14T12:16:15.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.290+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0CQiPJg1HevXt3zU_U9E5sqQh1HaH1p_0 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3743735579276287475', time=2024-09-14T13:56:34.786523+0000, chain.objs.size()=1 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pvkFr70x1WMI3z_1qqr9XXWEP8q7VG1_0 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1790019472429063141', time=2024-09-14T13:56:35.457780+0000, chain.objs.size()=1 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ebgze4HQCpACQvgfKoU1WE3dka9DGzE_0 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11401116149040485001', time=2024-09-14T13:56:35.869126+0000, chain.objs.size()=1 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ezt_sA3D6zSHlSjJtTOvGLKmBEbZG1Q_0 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3521526109534161901', time=2024-09-14T13:56:36.152976+0000, chain.objs.size()=1 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.I8GPfQ0Ib4Qa4xm9Sg_CuUjH27jDypb_0 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7387069125702343539', time=2024-09-14T13:56:36.254536+0000, chain.objs.size()=1 2024-09-14T12:16:15.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DU_NovIat8mGB2eJ2GkPVjfyy6vQPg8_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4154926328001753764', time=2024-09-14T13:56:36.906371+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7ADJlWv10HFxgJhlPSs2e6RzuI6_WUk_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9559179276891638024', time=2024-09-14T13:56:37.330911+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wlngAUvPKQwYgiRI93DWOnA-ipawtyQ_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4662551211645233042', time=2024-09-14T13:56:38.119456+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0nUylZ2LE9HV5m9VECkUBzpgXrTWwZs_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.412217850947193447', time=2024-09-14T13:56:38.450482+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.291+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KFC418vsFW3Ae32GCzJe2wNNYyuvQY1_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12616644518732030009', time=2024-09-14T13:56:38.605851+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nsH5H7rFvezFTRYXcjIpTSg_W2hy95t_0 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.292+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11664149413416604805', time=2024-09-14T13:56:38.894261+0000, chain.objs.size()=1 2024-09-14T12:16:15.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.292+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.MYR5SpsFeWKUoHFDORhAhwxa2a3ITrr_0 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15753209031312709469', time=2024-09-14T13:56:38.981430+0000, chain.objs.size()=1 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IOXj7uU2gtPIiVoqQuM5scpOicF1q0z_0 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8303381945078170383', time=2024-09-14T13:56:39.055200+0000, chain.objs.size()=1 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kvNSjMZEiy_lQYCTonTQXqw2kVnGMLY_0 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14735408800145130994', time=2024-09-14T13:56:40.094487+0000, chain.objs.size()=1 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.293+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cqE2h3YuhujQPsA5ZPQGLo-50-8Qvuf_0 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1862736816355225042', time=2024-09-14T13:56:40.176898+0000, chain.objs.size()=1 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WkkTs8kABqgnA42-GNa0ilqkGvdYVOE_0 2024-09-14T12:16:15.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14655056228812901419', time=2024-09-14T13:56:40.257758+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TOB5K3iyJERp6dx2BH9ElKxn4Dq6wVA_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2345409235098612549', time=2024-09-14T13:56:41.003741+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.263__shadow_.gkeW4m9N1IF1fVz3e5r_6LF8fyVl_Ub_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10019588816137467605', time=2024-09-14T13:56:52.377601+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.280__shadow_.A1vUhvWVdwCmS1B-K6gnY_Id4Da2u9A_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7747684958846280730', time=2024-09-14T13:56:54.445491+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.283__shadow_.EkMQB0xe_-RIxicwyrsSsYWrdU71AhW_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13666891888301102272', time=2024-09-14T13:56:54.451313+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.283__shadow_.jmf9saSvxDH9bYV0MfP6N0Dtq9APibV_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7280994305047624820', time=2024-09-14T13:56:59.443786+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.290__shadow_.ah-aN6ruIv15Ix7XklaG82v0xuFClsU_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11827098857264617831', time=2024-09-14T13:57:04.099573+0000, chain.objs.size()=1 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.294+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.BDVbVpuwMiDKhXMFFIfVWKPBPgHYBPT_0 2024-09-14T12:16:15.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2733933876756429302', time=2024-09-14T13:58:02.351861+0000, chain.objs.size()=1 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.J0OUBEw1o6e_xCJz4p7OT8vPiKRKsnA_0 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16107188010011245910', time=2024-09-14T13:58:02.771612+0000, chain.objs.size()=1 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.96kyjtFp4GBKzV7xBEX--RL6PY8_tmd_0 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10376431911895354106', time=2024-09-14T13:58:04.245394+0000, chain.objs.size()=1 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.K0jx69VObCpOneHBAevi7jvoPxDQ--T_0 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.33065116016885398', time=2024-09-14T13:58:04.584431+0000, chain.objs.size()=1 2024-09-14T12:16:15.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.295+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GYgPyPQr9lwyFffoy85-JVRempQuVFU_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15217834922061547125', time=2024-09-14T13:58:05.432815+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.28_tssoQPnzf_-LtoQfd4usSCYTX8PS_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10650482768431229128', time=2024-09-14T13:58:05.986785+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AkC2mUO_2iHzmcyFifwJblFhhiN2HCC_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13173907732879388370', time=2024-09-14T13:58:06.154134+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.P5oBWw409znntNC9RSB3NQw0QTBhgYM_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14398828694022822185', time=2024-09-14T13:58:06.585552+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qvj7K93se2tALib8XQep6eMgoyEiyDr_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6314114286059413313', time=2024-09-14T13:58:06.714370+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yCDODTsQXERezhAQ8iKeHwDHUer4a0o_0 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8494658418858300621', time=2024-09-14T13:58:06.951398+0000, chain.objs.size()=1 2024-09-14T12:16:15.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.syr8vNbQBmIvSfM_ySpra9GDFNCGppO_0 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10070745249071697279', time=2024-09-14T13:58:07.298288+0000, chain.objs.size()=1 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Nrvup8V5dDRmf50f3P090PFMuL0EqQn_0 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9686244559402939962', time=2024-09-14T13:58:08.082807+0000, chain.objs.size()=1 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.296+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UREb59LjdNv1UuNiqyWohC7KhTNPQ9W_0 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10015937842027102015', time=2024-09-14T13:58:08.808261+0000, chain.objs.size()=1 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3IAfS8rjWQZ-SFyjvH3FpL-1rWMG__V_0 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.297+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8259825990845178390', time=2024-09-14T13:58:09.235243+0000, chain.objs.size()=1 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.297+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YKSJyahyAkiX_kJf1CGGOHQiWUKuM9e_0 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8683483215926115779', time=2024-09-14T13:58:09.312074+0000, chain.objs.size()=1 2024-09-14T12:16:15.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.1dkcG9ncBAcwsyJ3wCGB7B-GaoFZOjt_0 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10117011857834133887', time=2024-09-14T13:58:09.411693+0000, chain.objs.size()=1 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.e3fvp3XV68dfMnHsryGjZH4BE5kXfrq_0 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.556125056087204761', time=2024-09-14T13:58:10.565217+0000, chain.objs.size()=1 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZUFM8kaj6NI3THnedTvl_hH6_x--U-8_0 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6497019291968120751', time=2024-09-14T13:58:10.821672+0000, chain.objs.size()=1 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i2-Gmjat1ksJdqAKR2JbaIrfAgTZRyg_0 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1184218369287506451', time=2024-09-14T13:58:10.923002+0000, chain.objs.size()=1 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.H4lFr11n3VV8qFveEbxmCkbK3zyr7k7_0 2024-09-14T12:16:15.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18000580889260015608', time=2024-09-14T13:58:11.175676+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6hhfheHvCUAW-r-yzCOHnFP7gVKy8J__0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4728628329550282983', time=2024-09-14T13:58:11.467348+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.298+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.73QhtBSxQ6mQ4kMVPxcrFCFEWYSTqNk_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16488873086065884625', time=2024-09-14T13:58:11.483975+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DDRmDB5QporoaagugtSJp2EczUOegVa_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12147379112822580330', time=2024-09-14T13:58:11.852115+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JbQa6Yl8HfhQR_nKGfjVYEoNaa2PMkt_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9042065804231036740', time=2024-09-14T13:58:12.068182+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.m9H5PiO6KP6AefNdiBjBUq-HbADah80_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12006497991373567983', time=2024-09-14T13:58:12.396325+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.299+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.l3OTbuhJhwCAL8dl57h5crBou2vSC0n_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11563991231390311996', time=2024-09-14T13:58:12.483006+0000, chain.objs.size()=1 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9vvLtTl4-90SdTmFQwxdjuFnDou7UXX_0 2024-09-14T12:16:15.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8515337306316625817', time=2024-09-14T13:58:12.513123+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9Svlk7RhUc41QFRqbDK0vkSZSiA4Llq_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10096509531420569798', time=2024-09-14T13:58:12.594613+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EDDLQ-Wey10e3maOP-gPFjPC32TgxZy_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8963828679760180135', time=2024-09-14T13:58:49.136324+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xwum1JZ2cAIbU0ql9yTCACsTS8Buym0_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15723519453145588334', time=2024-09-14T13:58:49.458652+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.99fEIPnZ94yiY9DH9yEClGchzGZEWzX_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.941140366322034445', time=2024-09-14T13:58:49.632309+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.300+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rYBtckE_ce9CLJOmwm739QqoqrYlnKn_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9910296833643909726', time=2024-09-14T13:58:49.668664+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5T2YIU2W2g3rp-WC8DcTEkVVeJkG9Cr_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14369637993095969280', time=2024-09-14T13:58:50.035335+0000, chain.objs.size()=1 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yk8yzfId7CP5osNbK-9MdiF4NRLw97d_0 2024-09-14T12:16:15.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3580336146035835570', time=2024-09-14T13:58:50.884042+0000, chain.objs.size()=1 2024-09-14T12:16:15.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.V5XMEhosgaKr3YEE3i5ax0Zi_IaUYAP_0 2024-09-14T12:16:15.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7978248323463622205', time=2024-09-14T13:58:51.504808+0000, chain.objs.size()=1 2024-09-14T12:16:15.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KkqZqNgcJPcB0cyX_s5CS3VTbIW9HkH_0 2024-09-14T12:16:15.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6383638986159407955', time=2024-09-14T13:58:52.610134+0000, chain.objs.size()=1 2024-09-14T12:16:15.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.301+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Hk3HolMHCwA7lDuVUfInQrbmAkle_ge_0 2024-09-14T12:16:15.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6186355455391761889', time=2024-09-14T13:58:53.353853+0000, chain.objs.size()=1 2024-09-14T12:16:15.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.86q8DWdhvHoaPxrYRV0pOyiYcsLwMUn_0 2024-09-14T12:16:15.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2761241406618439782', time=2024-09-14T13:58:53.481802+0000, chain.objs.size()=1 2024-09-14T12:16:15.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BKQp9TdJwsFeqvv8GccsdG2hgbvaQ6z_0 2024-09-14T12:16:15.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9233548489594699463', time=2024-09-14T13:58:53.716627+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.riBbxxMVyN3VH8jCBZ8nZINDHB1iFOd_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15478281595156875771', time=2024-09-14T13:58:53.799774+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.z-0HK1SSrfvGPOwiycaRvT0iicEzyqj_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12944859047576658597', time=2024-09-14T13:58:55.068951+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aHah3tjF4B0oN1-pQuT-fkKTR2ByOae_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10736535701473745724', time=2024-09-14T13:58:55.318019+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZzdJkwahkJSgn63vTcJ1pu_4l_8YUtp_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4556141849074894658', time=2024-09-14T13:58:55.728963+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.302+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8XFDyGwyxAmrYQEf98SUrSyy0Jy91Fs_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7701785299928766397', time=2024-09-14T13:58:55.773918+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._FCda2U1Nbqp-nkkBTjDjNeASBQ6rR7_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17286364245804847529', time=2024-09-14T13:58:56.559877+0000, chain.objs.size()=1 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CMQP4OcEAm_zgQSnluHPoYKsYDsgk4w_0 2024-09-14T12:16:15.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13630764479588063068', time=2024-09-14T13:58:56.577142+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.303+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mLoFGWARyJHkdrd0HFiKeWSdws48HJs_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.304+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16295277779951478693', time=2024-09-14T13:58:56.719910+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.304+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5aFAvubZMUl9PoqDQlNgspuyAe2hQml_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4900336521501412829', time=2024-09-14T13:58:57.028965+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.j4V2A0Sdfmfl14ELlOr2TZWyzRm0km2_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11432708794864162412', time=2024-09-14T13:58:57.130277+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KpbdWTwqYVYW7IBEhVIrQXkg1y65uCV_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10581323772625877215', time=2024-09-14T13:58:57.222689+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jD0BcvS7J2Sac3j3-bBjwtj7R18HMc-_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3103679168121732403', time=2024-09-14T13:58:57.309204+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AtBPf2q1WxTKIsA7aLPaHedlnlctnUi_0 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18066968978115679473', time=2024-09-14T13:58:57.707005+0000, chain.objs.size()=1 2024-09-14T12:16:15.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.305+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pKBLMqDZ9gABO84dTjXADBsYGSo9yiU_0 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6085371503606228384', time=2024-09-14T13:58:57.854660+0000, chain.objs.size()=1 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rzpxNVt1IMwqkTOsB6YoChEj6Iy49j4_0 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6275829975136256427', time=2024-09-14T13:58:59.323984+0000, chain.objs.size()=1 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.sVaMr0Z9rw5eISffaGhCg9lMxxFGt5T_0 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10545027050682122585', time=2024-09-14T13:59:26.888946+0000, chain.objs.size()=1 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.372__shadow_.f3atxJxoNa3nFqXkUNvCXwXbowSQiUu_0 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11346446143369890389', time=2024-09-14T14:00:23.769771+0000, chain.objs.size()=1 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.457__shadow_.knp14V68EV9JgirIQengZxDQVYB1O2z_0 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9966496460937268014', time=2024-09-14T14:00:41.378347+0000, chain.objs.size()=1 2024-09-14T12:16:15.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.307+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.484__shadow_.EGfDFaGoKNn6dIg58K_CphSDMlYo4Bb_0 2024-09-14T12:16:15.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.310+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/144889 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6674431657442875305', time=2024-09-14T14:00:52.465702+0000, chain.objs.size()=1 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.498__shadow_.PN3L_GE_ca6HV2FKw-Vxg1ZFS8Yq_jt_0 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7346215770724613764', time=2024-09-14T14:00:53.509377+0000, chain.objs.size()=1 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.499__shadow_.AkHBRq-275Si8igApgNHlnuF0ilA-vJ_0 2024-09-14T12:16:15.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.273398055053137564', time=2024-09-14T14:00:53.751015+0000, chain.objs.size()=1 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.500__shadow_.saCeywKA6vD9zdZi0YhnQCoFx_KY9PP_0 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4052058122811132716', time=2024-09-14T14:01:04.211449+0000, chain.objs.size()=6 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17514209035911040113', time=2024-09-14T14:01:15.175983+0000, chain.objs.size()=1 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.517__shadow_.4JbrUvNmvTQyERfkUQtwwBiOQUZKe1s_0 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3614455528007661317', time=2024-09-14T14:03:59.779941+0000, chain.objs.size()=1 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.557__shadow_.uRbYlH_O7lbQ2a8xUuiBl7--t75cv-K_0 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11262629348861689010', time=2024-09-14T14:04:23.228723+0000, chain.objs.size()=1 2024-09-14T12:16:15.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.312+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:nFB3ZGYoWIu7zAZrO2EvB4JjTBolxLg_.Pork0z-W4zufgMoS6MVR-1kacGmyStM_0 2024-09-14T12:16:15.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6518691359731017517', time=2024-09-14T14:04:28.005462+0000, chain.objs.size()=1 2024-09-14T12:16:15.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:uEisKBscxHVoF7Vm5TEkQcNisBvYmnO_.QqLq5jCshpCb3W6R8E-3ny5t4aU0JQa_0 2024-09-14T12:16:15.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14603834198329834407', time=2024-09-14T14:09:26.842317+0000, chain.objs.size()=1 2024-09-14T12:16:15.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.631__shadow_.NXYPTijh0c2CFYoacm5TuJVP38XRqbn_0 2024-09-14T12:16:15.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9458825313691546564', time=2024-09-14T14:10:13.411172+0000, chain.objs.size()=1 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.668__shadow_.8iIIlgCUW0lgSiGbohQFoTKOI7LbcsZ_0 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6763968053117922132', time=2024-09-14T14:10:19.520596+0000, chain.objs.size()=1 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.679__shadow_.dWZSrxd7Z3195Am9FeEY_3SvO4jp6Ds_0 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6883069753256375437', time=2024-09-14T14:11:27.746393+0000, chain.objs.size()=1 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.740__shadow_.j7Cy4ocLQfHQQ_ief2XdQLMTM7rYnHY_0 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9277795131513420740', time=2024-09-14T14:13:23.844680+0000, chain.objs.size()=1 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.765__shadow_.Fu9TD9EhQyNPaJXodgFAaLslu23ADJQ_0 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9271612436906338595', time=2024-09-14T14:13:55.434837+0000, chain.objs.size()=1 2024-09-14T12:16:15.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.314+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.775__shadow_.sP-cZOOtB3c94R6haW4s0BIOsR3LzIG_0 2024-09-14T12:16:15.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.316+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.319+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:16:15.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.320+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.320+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45358' 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17184827226752614792', time=2024-09-14T13:55:36.894235+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237__shadow_.n1lwI-yDZKrtB3hV1EzNF8yNKm4yJxQ_0 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8814297868871056120', time=2024-09-14T13:55:39.713149+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.241__shadow_.4LLxQI0S8_eSaVygh5ug4Kz8BJE9MXW_0 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16453226607931827930', time=2024-09-14T13:55:54.127331+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.261__shadow_.gEOlaN9ZLJs157K6Gm8OAkAnYDm49Zy_0 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18389205634503965309', time=2024-09-14T13:56:29.895745+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.pv--KcrGgNMe_ey0i_nOZJ3PqP5FB8c_0 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17580383792071686152', time=2024-09-14T13:56:30.164522+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lrgUHolRyun8ECnDUgC-q5y9hFzwg-8_0 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13881676671581589099', time=2024-09-14T13:56:30.527589+0000, chain.objs.size()=1 2024-09-14T12:16:15.320 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lw9cmdpsjYsNz7Yx8zubU54I9NeUPhx_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4724483198405644857', time=2024-09-14T13:56:31.479987+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EdUhMEepPPYnUi2DnBduxF4Wx1Ikoxz_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13530372935130027302', time=2024-09-14T13:56:31.617033+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZUjz6wudVwHL-rQp8PPKR-Ttegz3z09_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13484251914013301376', time=2024-09-14T13:56:31.808556+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BUUKKkGOqBIPI3mXMoSdnRPJ-P8RPI1_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5801687260687670572', time=2024-09-14T13:56:32.624771+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.r5-9Qzv8vqWs_z2Ugq5QB795MoAlGWg_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3747010120179730342', time=2024-09-14T13:56:32.763234+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mgET3lrrL3AwcEbaJh4A8Ym8oXLgzmi_0 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.196160065905591892', time=2024-09-14T13:56:33.431377+0000, chain.objs.size()=1 2024-09-14T12:16:15.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.322+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jnw3TkMmLm_Cb5SQBv3K3785xjMn8NS_0 2024-09-14T12:16:15.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1933944098092765997', time=2024-09-14T13:56:34.020176+0000, chain.objs.size()=1 2024-09-14T12:16:15.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.NNkXKRSiwy8EsePffY6JnChQxrB57ey_0 2024-09-14T12:16:15.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3558414957482871733', time=2024-09-14T13:56:34.289906+0000, chain.objs.size()=1 2024-09-14T12:16:15.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.owCetHAMciortHODG6362t_4OyrdEkq_0 2024-09-14T12:16:15.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2327554658631223799', time=2024-09-14T13:56:34.410110+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ofrkyrdft9gRxafBXM1EmMxbJzxl0ao_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11630880473836724271', time=2024-09-14T13:56:34.410689+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BVpODctxFelS-SILHRRvuBoN4OIRtSj_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2182395896669621414', time=2024-09-14T13:56:34.457322+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.e5WBVrNnKmZpNZ63L720tBtAxeq1v-e_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16108426022547479910', time=2024-09-14T13:56:34.529951+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8n1_EF7uYgjlDtsHudAyVV86QyWGlLM_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15695410426721957417', time=2024-09-14T13:56:34.569390+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EDGdtbBQ5l5WtMGraPPlQeKgymQ_c4d_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3621371898964540900', time=2024-09-14T13:56:34.795300+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.QhWWO-BJDuZnXwMY5cKTFIU4dBPJrBo_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5815445381255705700', time=2024-09-14T13:56:35.725833+0000, chain.objs.size()=1 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.AByHk8YdsIDsXfCl1uq3Kseg8dNUazW_0 2024-09-14T12:16:15.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7789425980988824826', time=2024-09-14T13:56:35.908261+0000, chain.objs.size()=1 2024-09-14T12:16:15.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ictPN16kmjHd9MXobgiucTyTlza9PbH_0 2024-09-14T12:16:15.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16269520790514144562', time=2024-09-14T13:56:36.334474+0000, chain.objs.size()=1 2024-09-14T12:16:15.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.324+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PhKn-cWKuwCUMw-0ZZVWFgwGcoAWLG6_0 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5026898685459068668', time=2024-09-14T13:56:36.412987+0000, chain.objs.size()=1 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.L8yWnHhk6nFCs3tgZFr3Fnp1Ou4IiYc_0 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18024291821870630911', time=2024-09-14T13:56:37.044497+0000, chain.objs.size()=1 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LGA9bw0FnyVqGiHVbjd_IPHSIh5lFW8_0 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8690057565223331511', time=2024-09-14T13:56:37.186737+0000, chain.objs.size()=1 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.qO1zJ8NFu0IctUuyzfWInhQvnJi9Lda_0 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9630494395364426374', time=2024-09-14T13:56:37.464322+0000, chain.objs.size()=1 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vmCpq0Z1Fe1qK6zdQPR_1hu2CczhDFA_0 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13432078691154536656', time=2024-09-14T13:56:37.618116+0000, chain.objs.size()=1 2024-09-14T12:16:15.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HrEWAu-Mrf86xA-jhGzs1FT0bDoH5ug_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1919008069231192239', time=2024-09-14T13:56:37.635360+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.R2yS8kx20kvIOYoHnWNY_X-wUGeOsI1_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17308529033924196968', time=2024-09-14T13:56:38.252747+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.g0R61sb71HJLoJxmiEX0XixX8oLCnay_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13116248436643039234', time=2024-09-14T13:56:38.355096+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8BOJ8YgvUgRAeMOa46THnXS7EIhMdM__0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14605699558025936456', time=2024-09-14T13:56:38.388519+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ssV5h6zQNSthISBUH-s2oxKzwBJpaNS_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8911386055117053406', time=2024-09-14T13:56:38.536304+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.326+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.A8wdKCLINWCCKmSv8PiH4L9VVt21gj-_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14488511124023690724', time=2024-09-14T13:56:38.844125+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2J8_U2HIjfEAMMmv2iDe3hoE55g3Jdw_0 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.327+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6368825177991132592', time=2024-09-14T13:56:39.032242+0000, chain.objs.size()=1 2024-09-14T12:16:15.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.327+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2vCsyF9i0LqueR0cEQ2vTj7OFkVoOlm_0 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17779659805972250055', time=2024-09-14T13:56:39.128487+0000, chain.objs.size()=1 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gv99VH1vcKLBynjaoYviVITbR8CbwPq_0 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17076854241184857190', time=2024-09-14T13:56:40.188334+0000, chain.objs.size()=1 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2xKXVMqP25CjVbBGuzmw4GsEJu0x-v2_0 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17397395044382797173', time=2024-09-14T13:56:40.320847+0000, chain.objs.size()=1 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.76UYbdi-9AieSopgGnmAZf3O3jY_AuQ_0 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5163716145488111544', time=2024-09-14T13:56:41.002567+0000, chain.objs.size()=1 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.263__shadow_.g6vOHntCk8vAmL2L2liOPHWyk3_ET2Y_0 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2549272088774523495', time=2024-09-14T13:56:53.748522+0000, chain.objs.size()=1 2024-09-14T12:16:15.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.282__shadow_.Jvetxm2NiXNtdAR6fkAonM1nkjffrHg_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11526189360738956078', time=2024-09-14T13:56:54.453233+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.283__shadow_.HaM3q2rnvuPCRF2xPbRt3W_9sWoInpY_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16810580213939936562', time=2024-09-14T13:57:02.241515+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.Mf0oOp3n5-2Q5d7KLrdsqVp4JHAJ26M_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5301581184155717739', time=2024-09-14T13:57:10.716792+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.302__shadow_.lH-JlCebOI2lmiTa6SQIASQjsFl5L0m_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10817986994167810007', time=2024-09-14T13:58:02.622583+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.73ux7XEIswvfbKzWJOvWN5BXVwz_Cvu_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.403963338097958286', time=2024-09-14T13:58:02.731212+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.328+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AksbZmXChq1kEwHBZAbEfjaWDXN-IA0_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6153141285663434667', time=2024-09-14T13:58:02.734396+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ViVkQT9_FUlYJH6dT7ooMhzNaAU6ZJ5_0 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.329+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2203312048568012668', time=2024-09-14T13:58:02.835038+0000, chain.objs.size()=1 2024-09-14T12:16:15.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.329+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.b53V2zApAJlWzFILr8npLdTRpalZcT-_0 2024-09-14T12:16:15.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.363299416282704900', time=2024-09-14T13:58:03.777807+0000, chain.objs.size()=1 2024-09-14T12:16:15.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.7OGt1P5erwf8h-kCCfOJ6le45Enic_7_0 2024-09-14T12:16:15.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.330+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6438992665779269159', time=2024-09-14T13:58:03.886686+0000, chain.objs.size()=1 2024-09-14T12:16:15.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.330+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.henH2PFbTUnNI44WCZEvxTJ-TPp_8T-_0 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3770606842273736940', time=2024-09-14T13:58:04.067247+0000, chain.objs.size()=1 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8ulPfUDWlxn2pUf50ZNdP7Ch2LFmbOH_0 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16806931007222426985', time=2024-09-14T13:58:04.389995+0000, chain.objs.size()=1 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ADMbmtChahDpZbmQgDb8dvxdyrCVeyo_0 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12345267450585339757', time=2024-09-14T13:58:04.450970+0000, chain.objs.size()=1 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.lXxvVO4ESCAWZ447pCYlAKuaojVfzQl_0 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14479600639981032671', time=2024-09-14T13:58:04.692546+0000, chain.objs.size()=1 2024-09-14T12:16:15.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CZhfcxR2zj464canzbi3X3UW_2cJiFx_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9587416043084714740', time=2024-09-14T13:58:05.661072+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UxwTTb1qK88o73m4pyBAtHvwXTP9LEp_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6446191518945753168', time=2024-09-14T13:58:06.992202+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.59nj4q6Lw5fY2Kk2n7C7vmA78Z_bm2V_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9182246428212233693', time=2024-09-14T13:58:07.454293+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.AoOF5YHKeZQsJXJrARX6nLyydj2Hj9A_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1230374534249162528', time=2024-09-14T13:58:07.455009+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.QKYUM6r76MPAW9OZ9i8D3Jevl2JVcpS_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15993716224978236220', time=2024-09-14T13:58:08.464609+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SEJWFjPPyBbSKKaykoBiFkwQjcoT35r_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9035457356921628274', time=2024-09-14T13:58:08.465356+0000, chain.objs.size()=1 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.331+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.WTNSdC2rmGBox-2pZ9A8KsczN9_0TxW_0 2024-09-14T12:16:15.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8115269310700614509', time=2024-09-14T13:58:08.577799+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Nu3m3r7o-eqOrHS2o0PjY1NjArci2pu_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.332+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11214985741333700242', time=2024-09-14T13:58:08.871989+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.332+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.GH4vqJVMxXMduf3IvoHUpr0MmpHbmEv_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.974046575895382849', time=2024-09-14T13:58:09.297704+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LNzYJs6x64id0mez_NXbJjrAzwBFjqN_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1157628965724530042', time=2024-09-14T13:58:09.415921+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YbSNRIZ-Omej7FybSPDrrsS92pQlkr8_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16291889992759130518', time=2024-09-14T13:58:09.499926+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kGQ3eYAVGgyuv_SNKre6DE5u82QzsnH_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7483985118919517926', time=2024-09-14T13:58:09.673141+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BIpQbB0ts5f2NnoAQLYr2uM30eLFIEu_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17028859931800356739', time=2024-09-14T13:58:10.859887+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.EVBMLl220-xq4wwlVGxH5fIIOle3BBe_0 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7920322457996025373', time=2024-09-14T13:58:10.966282+0000, chain.objs.size()=1 2024-09-14T12:16:15.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Ydf3KSIxGmIEygpig6zWW7gaN0KTTuo_0 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10738359457643571804', time=2024-09-14T13:58:11.224235+0000, chain.objs.size()=1 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.LK8hRL_rAaUO0iDOtYLBJB7lXkL87bQ_0 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6983261107722182543', time=2024-09-14T13:58:11.435849+0000, chain.objs.size()=1 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ITe4d_GihM_vNk9YmNY9O2edNxCBZ7C_0 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16303372999807095320', time=2024-09-14T13:58:11.962202+0000, chain.objs.size()=1 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.333+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.wYc89TkyR-vD3oa4l9aFyuoj9GclNwG_0 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7773634186081682868', time=2024-09-14T13:58:11.963221+0000, chain.objs.size()=1 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Dy8CygoKzb0EJfjwIM_eO3FfrmSwQdx_0 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.334+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13105861395713827941', time=2024-09-14T13:58:12.333176+0000, chain.objs.size()=1 2024-09-14T12:16:15.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.334+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6tyocwi763F2mF7bL7z16cqMrVKme42_0 2024-09-14T12:16:15.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14216317597679723984', time=2024-09-14T13:58:12.385735+0000, chain.objs.size()=1 2024-09-14T12:16:15.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UBREKdhRcAEF-J9TWWKfN0Sceean6yO_0 2024-09-14T12:16:15.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8612118913250452370', time=2024-09-14T13:58:49.164355+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zWGl7i4xYgl3Fl1AJrqUbRSweV8NM3v_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16717795285739416345', time=2024-09-14T13:58:49.569886+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7f4EX34bJcQapmlys9LVq9pXfXKpSw-_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8545029727774346724', time=2024-09-14T13:58:49.968860+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fsiawgBeB0zebpikBod5z4my0u4HWPd_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16697184325867919992', time=2024-09-14T13:58:50.531968+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4sK2bD3dN77E3S9gapDY3COHwXv8IlS_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3815025314293721365', time=2024-09-14T13:58:50.534101+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.335+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9l5vosHCPn3m_g1NIaL97by5t69Zf00_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.318629486992160540', time=2024-09-14T13:58:50.536199+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.GP20X5yyMLrFiVwHZnoH5aFMnkJ5iJT_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16485843856286705207', time=2024-09-14T13:58:50.809438+0000, chain.objs.size()=1 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Cyh0t3OZULD0rZ110NtUGncjEqveJgJ_0 2024-09-14T12:16:15.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12169501045422889701', time=2024-09-14T13:58:51.289394+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.3-nXlB4hse8LAceDaVlufrA0ydaHeM-_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1237166582109800229', time=2024-09-14T13:58:51.507280+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.oQnSKMrVJfpSjqs2JUBHRaX-XV5OhxP_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9704367530476961458', time=2024-09-14T13:58:51.997724+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.-YRg5B_hbEMnTSHpDqu0JCFrZbd0pj3_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6349100586046659689', time=2024-09-14T13:58:52.006292+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.n0owfXb6XM_WWCTLmdJXzcR5uc_yaBM_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4008297412999932179', time=2024-09-14T13:58:52.068843+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.336+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CbxEq-P_Z7ut5vkN9JNBchzcwmdWE8W_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5684228866550961857', time=2024-09-14T13:58:52.511632+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.q1NdUOdcqFIoh3EHlAaK3AiUOw7e1Ak_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15589319766103897370', time=2024-09-14T13:58:52.648283+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.337+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._tbrI0i6gZOdJtMyDAEZEl8SKAyU_kh_0 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.337+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3897211769407913368', time=2024-09-14T13:58:52.882436+0000, chain.objs.size()=1 2024-09-14T12:16:15.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.D-vp4PTxRwKG9_gcDMhB7nOBfj7evZn_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2483560185534046611', time=2024-09-14T13:58:53.711126+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.txGDXW_uS-9gOJvLP_r373YV_Y-vRpu_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18239871307021304882', time=2024-09-14T13:58:53.819683+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HHLH023SQykyGmdr-rcyDF0Fg3jEeyB_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14375190162242496130', time=2024-09-14T13:58:53.935095+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Z2Xgrnl2890zD2aaMjlYHNdR-q2Q3Z5_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3997341737573254663', time=2024-09-14T13:58:54.196788+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.twVbVpEngvKfTG36ZkOGz5WTpiQzSBM_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10356830554264376608', time=2024-09-14T13:58:54.748778+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BC_6KG32aHTFjrOR2Z9mdzO-Opqx297_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1975887743345535196', time=2024-09-14T13:58:54.898809+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.338+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yZA6aY6bcYk6hYRvWRWxyxPGvFc0NCi_0 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12060285625615482178', time=2024-09-14T13:58:54.900153+0000, chain.objs.size()=1 2024-09-14T12:16:15.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0JPDyiXU2jEDt9hZ3vOYklVPysAQuPX_0 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4609247385632891569', time=2024-09-14T13:58:54.938441+0000, chain.objs.size()=1 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.JK_1HDxBYqQOSsjs2PNbQShtPf2CVde_0 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1261471088140659250', time=2024-09-14T13:58:55.610988+0000, chain.objs.size()=1 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OcLgeLQqqsfx6pTOxEmm8RDmKm0A4VB_0 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15911908949724046327', time=2024-09-14T13:58:55.752141+0000, chain.objs.size()=1 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.NNFrvh-xcaLvzy5-D-buZLgs0fLE-Ch_0 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5318030760599147662', time=2024-09-14T13:58:56.980666+0000, chain.objs.size()=1 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eZFjppmU0V2t9M0DiIcL2oVO1UGNJ4X_0 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5423405536908663376', time=2024-09-14T13:58:57.326630+0000, chain.objs.size()=1 2024-09-14T12:16:15.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.339+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.E2G9bOObsQDKscka5AXr8Jfu7NjfmAM_0 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.341+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/45358 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10749576032900317902', time=2024-09-14T13:58:57.953620+0000, chain.objs.size()=1 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ixoXehGGTfoeXVGD4uBGb_ySI0sNbZO_0 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11193648196158885451', time=2024-09-14T13:58:58.033171+0000, chain.objs.size()=1 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lK4uFHpasb32JqSiBWiauq0fGRGnA-N_0 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17166866456387808386', time=2024-09-14T13:58:58.584087+0000, chain.objs.size()=1 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.klnes4eXoJA8vCm3LxA6MaYjxGGBHvp_0 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3286427172419821464', time=2024-09-14T13:58:59.299374+0000, chain.objs.size()=1 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.H-CV-n2yhn1sadBolNyHLkJj9ArBth3_0 2024-09-14T12:16:15.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12711949678301809619', time=2024-09-14T13:58:59.401944+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.07d8DZ-CZS3ZrL01blfCosYux4o-2DL_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5711958676607066157', time=2024-09-14T13:58:59.402639+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.J4dR7tUIvBzTMXfIA8LvsbSJ4HUGDho_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6145818169530738266', time=2024-09-14T13:58:59.694779+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.pgBPs5rxTCEFLlWK69yn__fNbd5OyGj_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11373368965705715931', time=2024-09-14T13:58:59.775557+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.BxmcXzsG9uLAlL89To4LSKcYzJCdS2r_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15573482283124617837', time=2024-09-14T14:00:24.675293+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.458__shadow_.UMDt5wr05ErW9XnAQxUJqyk242_CUs8_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13903511373848809267', time=2024-09-14T14:00:29.263115+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.463__shadow_.oFG_eK2tNu3UKI0sSCEusSc0qRfn_4D_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11994967234653030726', time=2024-09-14T14:00:41.380008+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.484__shadow_.Mzu8FuQQPCfdPmkz3UyjR0XSMsRn7LP_0 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd', time=2024-09-14T14:02:12.013045+0000, chain.objs.size()=1 2024-09-14T12:16:15.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.343+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.2 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.344+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd', time=2024-09-14T14:02:12.016887+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.344+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.3 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18285923803546059225', time=2024-09-14T14:03:57.979491+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.556__shadow_.e5ORcM9jpZecBmvdUgBRQ6bv77HFBLQ_0 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6181449353166551889', time=2024-09-14T14:04:26.201780+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:cLa03PoRFI8hDFLMYsekFud2mSMCR4R_.NLDOLnPRy_5tY-n_r6_KFyZy54g1zsg_0 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.126933009368399856', time=2024-09-14T14:04:37.606787+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:7rfK4xXg42ASZ9o1ekaezBMdsi1u8uq_.Ps0mYrfE903d2l8n_fi57Fri6j5ewEP_0 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17606398597528421551', time=2024-09-14T14:05:01.055313+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:WRv-ZefrDcV6meC8NsIv1Yu3-9rJjNZ_.Jr9IHoDSlQ1Vq1lzWp9Xj8i413QQmHO_0 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13281952082034699615', time=2024-09-14T14:05:07.343259+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:jybJ.fltuPkEFAfRQQq8SFLBoIhFxH4_.fp1qQWx_X6mI1V9JeyifFm0OkAHlVSS_0 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13088722085074869866', time=2024-09-14T14:05:21.813996+0000, chain.objs.size()=1 2024-09-14T12:16:15.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:JmLoWsxQEAxYmc0FlCMFb1G6PZgXVFR_.5NYzIzcqFG52-tXydFeMc-4aFiM23rf_0 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.481886890995152384', time=2024-09-14T14:05:30.456997+0000, chain.objs.size()=1 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:alytGsNi0yxa.wB5HKx9Opa67.6n4MX_.9S6-8tIDO_eGGz5_56my-vjNkHxayDG_0 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8418455643041693088', time=2024-09-14T14:09:31.622826+0000, chain.objs.size()=1 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.638__shadow_.ozUYKOsb7Vn0JFpK9gpJSuQZnRKlRX-_0 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13217722836729562944', time=2024-09-14T14:09:31.878077+0000, chain.objs.size()=1 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.639__shadow_.HlJ7DkdN6QaS1WwHNHyql1QoWYZeUeS_0 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15429091654157598081', time=2024-09-14T14:10:53.078228+0000, chain.objs.size()=1 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.345+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.716__shadow:A8QCBL1kEKyd5nFR-uibkiOlAPSppH3_.q0QxwwTRavbK9fBr-SRp0L544_5UDWG_0 2024-09-14T12:16:15.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.347+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.349+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:16:15.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.350+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.351+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49364' 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7937301565101172842', time=2024-09-14T13:53:19.148935+0000, chain.objs.size()=3 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-STANDARD.2~N4AeCCz8KfAXEByEkTBnjyvp5sM7HJ2.1 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-STANDARD.2~N4AeCCz8KfAXEByEkTBnjyvp5sM7HJ2.2 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__multipart_foo-STANDARD.2~N4AeCCz8KfAXEByEkTBnjyvp5sM7HJ2.3 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_MJrn-oxWkbFIZk7JPh1bNpprqfxHWgT', time=2024-09-14T13:53:25.873849+0000, chain.objs.size()=1 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.163__shadow_.dQp7yi79pv4_O1JTyuCi2sMMRUmv6OZ_0 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13962963575263476685', time=2024-09-14T13:53:30.709459+0000, chain.objs.size()=1 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.171__shadow_.86FUYKwjGsQMLddaR7I7iCSmkPaIYiw_0 2024-09-14T12:16:15.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.456349824931726336', time=2024-09-14T13:55:32.370648+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.231__shadow_.gcM3jBODV-1D20K-lei4qgitVBXmqta_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16640162455011081640', time=2024-09-14T13:56:30.539324+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ZATpYTdg9r2u5LT3nctz-tGzo1ko54H_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16987287082565821138', time=2024-09-14T13:56:30.673229+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GhwwezbBBbLKKk-Dp6BfwoxoXGclt0N_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8515834338854004920', time=2024-09-14T13:56:31.701778+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gut17RfbU7Um_UkT26mupY3Nqag5LBJ_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11677232110732096961', time=2024-09-14T13:56:32.035041+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.SL5P0f4YMCiF9gnYLXN18W15D6Ba_4L_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17874009141007854836', time=2024-09-14T13:56:32.621096+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.EPbcthlX2S111k5kGhg7dsGS4q0LY80_0 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3925763771487503666', time=2024-09-14T13:56:33.593386+0000, chain.objs.size()=1 2024-09-14T12:16:15.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.352+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.muvbsqB6uiWzEzBfapNYeTQtxW9sYRL_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.301963079575474854', time=2024-09-14T13:56:34.614026+0000, chain.objs.size()=1 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3wKoGfsk4A4FoTpupA-qpqod1Z_e-UC_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3172827581044835126', time=2024-09-14T13:56:35.058274+0000, chain.objs.size()=1 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.4Rt5uldyoC6Eco97KRzY9916ZLJpTxV_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3082454046743132615', time=2024-09-14T13:56:35.069734+0000, chain.objs.size()=1 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._P38ciD1FvbcqekEwOHBmxo9mjFrjQi_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9034421557323066466', time=2024-09-14T13:56:35.414281+0000, chain.objs.size()=1 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KTeyAKGbsF54OUPYklNT-XRmJ_CRa8t_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7862257720116617584', time=2024-09-14T13:56:35.541246+0000, chain.objs.size()=1 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vgGEoMFGl54ItCytXlPKYQahL7y3Tci_0 2024-09-14T12:16:15.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13928938408431524954', time=2024-09-14T13:56:35.765197+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.aOoTrlWlEzYgLCiN4DmlD5FPBRzy1hT_0 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.120622424666840202', time=2024-09-14T13:56:35.982464+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HJdnUD2fdcNDEExazCBPjDbZCOneicm_0 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.135939018526208255', time=2024-09-14T13:56:35.983113+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.PuqcRzFk9ycsoKgNr911T1vfmFEsAhP_0 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6072451835935126176', time=2024-09-14T13:56:36.098446+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ad19gOCDDHi2yIqFjuWPCe7cBjG4n19_0 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6276517600486356539', time=2024-09-14T13:56:36.422071+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Gve8GqLtNtyqX_VfBSZJlf-PiAaPutd_0 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10846371169086981549', time=2024-09-14T13:56:36.765811+0000, chain.objs.size()=1 2024-09-14T12:16:15.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.354+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wLSxnBY7p2R9NFz7taP9VtUvTBrv1r1_0 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.355+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.593078685534579791', time=2024-09-14T13:56:36.973973+0000, chain.objs.size()=1 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.355+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ykC-akNbPgExJ-t15wu6sqMeyTEXxD-_0 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8531344495519203675', time=2024-09-14T13:56:37.081024+0000, chain.objs.size()=1 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GxkFPDrU-_xC3K5UOGfnbxcpIuOoI7W_0 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4536946998247200501', time=2024-09-14T13:56:37.162693+0000, chain.objs.size()=1 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ojUZkAqyLCL9KF5ntcanCNBxrhEC0Js_0 2024-09-14T12:16:15.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2955813872684037904', time=2024-09-14T13:56:37.344823+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eH1oClILFYCTniSoYRo4PKABtCShViL_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4560958224436177412', time=2024-09-14T13:56:37.411115+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.6KU3y_7Tp7BvQdkl5y9jUMbXJejR5l8_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12244771142465204839', time=2024-09-14T13:56:38.127860+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vVnFAcZcquBGbG65CQPatqUF8Q2MvP8_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14370517547004055361', time=2024-09-14T13:56:38.630498+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vMzkbAjOj5NULVSTNO6Dsi-vluBBg1P_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9296136198438464816', time=2024-09-14T13:56:38.988991+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GQg8_FJvQV4zTwlxVtXz-HEre92kfJ4_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16463439873124365657', time=2024-09-14T13:56:38.989993+0000, chain.objs.size()=1 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cHKI5a25WGKsg3ybBDn5FRO9kntI4Lt_0 2024-09-14T12:16:15.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6601364039012808674', time=2024-09-14T13:56:39.128268+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.P3DgofPreyYvaNdm09jzqxiKv5Kdxni_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16289251498539907609', time=2024-09-14T13:56:39.759950+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.356+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.CSQYwyKWrQcIbGbJ8erJ9P6KftTesyY_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.357+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2890351423096181500', time=2024-09-14T13:56:39.949304+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.357+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lvalxqBGOOEds4SZFAdFrggfRQRPiTD_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.357+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1684951971221881738', time=2024-09-14T13:56:40.212672+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.357+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0RQqsmfVMXxxmA4_rYUpycBYFNgRos2_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10584043800994815981', time=2024-09-14T13:56:40.311545+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rNCWGVMrEwj1y_6WX5O1RSY9Wh_Ejlo_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2243262323770193747', time=2024-09-14T13:56:42.338108+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.265__shadow_.x7tRzLjld0DtumSo2_rpNhj49e_5PAZ_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.264755181779446912', time=2024-09-14T13:56:42.985419+0000, chain.objs.size()=1 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.266__shadow_.vWL4Y8gfaeIEW60mQrplRJTt8jnWm2v_0 2024-09-14T12:16:15.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11740623534505450700', time=2024-09-14T13:57:04.178697+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.otcCDKPKCUXuKGDJgp7_z9kGKTdK3YL_0 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3232730020961993971', time=2024-09-14T13:57:23.402948+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.319__shadow:xmm1qWKUW.Y8guFdIaI4Uv2cixoZB5a_.TXvF7LZ_6QM7yFJx7Psqwy3AGjo-Ppm_0 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4962403452895307064', time=2024-09-14T13:58:02.230028+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.x2cvDjCiKUtDmo3HmZ3R9qAWRZ7-RYJ_0 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11659671138379158724', time=2024-09-14T13:58:02.230730+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4o9Y9u-7oWIuU0g8_Tl3H4sZpmXpONG_0 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16357759193965305099', time=2024-09-14T13:58:02.287716+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cBW6YBrAP60tu0k3k7csYH8vGhq9cyK_0 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11534833464530389493', time=2024-09-14T13:58:02.433890+0000, chain.objs.size()=1 2024-09-14T12:16:15.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.358+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.G7QW70mRP5WNdTX3qgU--ZwZpTVs-me_0 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2694797774811059525', time=2024-09-14T13:58:03.138002+0000, chain.objs.size()=1 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vvKdHA-XT2fCRq1YQzLTe0lNuU8R5Jh_0 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.359+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12646760826714200386', time=2024-09-14T13:58:04.066664+0000, chain.objs.size()=1 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.359+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9ekmWO5XpE46xqrzVNHkHZkmz4VzIsz_0 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7192462542297048606', time=2024-09-14T13:58:04.151915+0000, chain.objs.size()=1 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IE3r73GKxrPGAfyxn8ie7Vzzcwsrz3Y_0 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18233352251565752994', time=2024-09-14T13:58:04.229476+0000, chain.objs.size()=1 2024-09-14T12:16:15.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.v3OiGssSg6dQ18ElqLF_z0UqzopRUnd_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6212798511093867254', time=2024-09-14T13:58:04.392122+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Eb-hlyCGLwr-hVENy_ZD3N36TwkP0oX_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.588211218990019714', time=2024-09-14T13:58:05.205042+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.sQ-fA8g8xkD0BNRypQ4Z8QIW0aigxsl_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1439814878249441647', time=2024-09-14T13:58:05.580125+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ffnlLaicoLJRcUbBHwGo42NIqJii5Zn_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4998195656115103433', time=2024-09-14T13:58:05.606522+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ct3cS7-NnZA6N64emMa705QmxGV9OaN_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10427177257407834190', time=2024-09-14T13:58:05.954791+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.360+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bjlJ4Qgz0DODoitBZe_eLMIzdumoJog_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11483626430043002586', time=2024-09-14T13:58:06.003905+0000, chain.objs.size()=1 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.pZ7Hm18t2LnkWXlRMlSAkYOpLyVv2mN_0 2024-09-14T12:16:15.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5667915125953702349', time=2024-09-14T13:58:06.129289+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.uf8LpQNTuN4ccQWdfwAcjXFndv9j1U0_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4673807882882937103', time=2024-09-14T13:58:06.177320+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MIFsq8MlBYpJ84YCHuyro51zEaIpOBs_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13105482127806307258', time=2024-09-14T13:58:06.697440+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.361+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xnzQY6WWL9V_v6gyZQUGlc_y8rpqAPn_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6100827605537541482', time=2024-09-14T13:58:07.454905+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.I8LynAG528798BfcaeciXk2qMJcw6Sl_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.315807046474101851', time=2024-09-14T13:58:07.560130+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.f8i-eQrTH6xpZkS_712OFqpIb8N0UK-_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2205037374054575493', time=2024-09-14T13:58:07.938977+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.NodgZP9dvqX-61QwyTHjULmo1CbVtv5_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18214975452380671451', time=2024-09-14T13:58:08.179901+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.362+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YDNIpohBxXmdNKKSVVebK2Vvho54PlT_0 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14792273718783861388', time=2024-09-14T13:58:08.230887+0000, chain.objs.size()=1 2024-09-14T12:16:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.KgVcVuuDJOCredctGD6AC8AsLd0-6Cl_0 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12878822626952710265', time=2024-09-14T13:58:08.272265+0000, chain.objs.size()=1 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.f-u16QDZ8T_qYEZiKE9n9_MPnogzaZe_0 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6314723611395479786', time=2024-09-14T13:58:09.791382+0000, chain.objs.size()=1 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fBJze-3wg4SRRYR-bD6ZVFG3yJ7fKlq_0 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11476226598751606860', time=2024-09-14T13:58:09.910247+0000, chain.objs.size()=1 2024-09-14T12:16:15.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.363+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.9Ue9VY0tZ3Pv9KtE7VeL5frpLlnYbS-_0 2024-09-14T12:16:15.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15378831435439985668', time=2024-09-14T13:58:10.240243+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.IUHXnwH6cB-E8ZYK_Uj6olKNPAGuTUB_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2327509670644233902', time=2024-09-14T13:58:10.552874+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ZGm2e9_i_qHZvgnzb0VA3P1LghXoC6g_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4895054217999329030', time=2024-09-14T13:58:10.554388+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JvobPucitJgZDqFQ2gQe8h2rCepECZF_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11933898972574882735', time=2024-09-14T13:58:10.649642+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.q5a48JbR59dJGOC2wV7o1qKd_VljbfF_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12805914054553693267', time=2024-09-14T13:58:10.689896+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nTuoPkVFVK00QpJtEeEJ_euyax_Wu4z_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1729836749342763742', time=2024-09-14T13:58:10.690600+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.364+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fvtIHjOb8ZyD4Vb7mOfcUIBqkRMj3e6_0 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8965685906872049867', time=2024-09-14T13:58:10.911272+0000, chain.objs.size()=1 2024-09-14T12:16:15.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.kpi1g6cezRKAvwNMEXYhm0q4QQqZAyZ_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7610866233939471037', time=2024-09-14T13:58:11.005902+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3Mahrao9bdGYiyFKJRd8kPPa3ose08l_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12698285775021182572', time=2024-09-14T13:58:11.298701+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.OsWIfQrV_lS7n0mOokae2zTnSTNn1-n_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12487958659363778033', time=2024-09-14T13:58:11.803578+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MEbFGj1LRQLBj-DkzpUjPRnppJc-6ls_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11920309825932508265', time=2024-09-14T13:58:12.202416+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DyRjvpr3QI3OfW0BJBfrd8wkPC_9U32_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11432569346922246857', time=2024-09-14T13:58:12.276135+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.365+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YcZF0P0dc20iNDD_as-QbBj_wvkp-kR_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3202053713581662078', time=2024-09-14T13:58:12.563951+0000, chain.objs.size()=1 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.a5ye0mUPXUty9OINXSYafFeMYB-b5Ph_0 2024-09-14T12:16:15.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11575699524120799216', time=2024-09-14T13:58:12.600916+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Iu3pKUeU8dHzyNKXvIBm8yMmmRplM66_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15641092578913164816', time=2024-09-14T13:58:49.057470+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9TDIbK1Xq8Pct5Karr30r7NHxbOgSAx_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6843094073123852174', time=2024-09-14T13:58:49.330319+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QBcHVxSdI3lkRY7vjYS_Jno9hzLbrgV_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9231727190165391615', time=2024-09-14T13:58:49.601392+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.366+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rCgVJhEIUfLxb5jr1Zej_6QAUV-KdJI_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8285955464236102177', time=2024-09-14T13:58:50.014253+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ud6skCA0j3Em3aCfmDTC8hi5Z0ZJGlP_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17759262921830928266', time=2024-09-14T13:58:51.317856+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FqjwbDIzd55Worm39Wm19Xbyva69wBL_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16634116639935373262', time=2024-09-14T13:58:51.436271+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.6qV2sLDXo6JD136VNydd080qdP_5to4_0 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2723558780224737595', time=2024-09-14T13:58:51.965751+0000, chain.objs.size()=1 2024-09-14T12:16:15.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.r15m1prskyeFltQe12ShOJGrcfZSa4M_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12281140744131832930', time=2024-09-14T13:58:51.966524+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.OU6vLrhOzv36dF1sdxLeckLARgAFRON_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7402138518637049503', time=2024-09-14T13:58:51.967220+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.367+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0SkRS1r3e-axgqrU8Xfge0Oc9x3Y6zj_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14798988244025646242', time=2024-09-14T13:58:52.056976+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FhDTmeB1dbmSwukJBL90ZWBY8YiKIXF_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1013213301197229212', time=2024-09-14T13:58:52.609788+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.r-fFq2vvOfoU4_IIGl6TMX1RbZLd6GV_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10300480520334291106', time=2024-09-14T13:58:53.565580+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.r7Ho4o4mNVQ8czvYxpJDU0UxShfzk0I_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7064611029804846608', time=2024-09-14T13:58:53.869032+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fvcIhQ9-Z4jxB-AOw7349V-rxyI2isC_0 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13247709150066795066', time=2024-09-14T13:58:54.077472+0000, chain.objs.size()=1 2024-09-14T12:16:15.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.368+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hIvw6tZ3W3sShSGiufYENji7LUDAfMO_0 2024-09-14T12:16:15.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15024232211365562443', time=2024-09-14T13:58:54.177073+0000, chain.objs.size()=1 2024-09-14T12:16:15.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.G4Iau2RAFX4yfEcvf6VTE3uQO_UrFu0_0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17862569431864040226', time=2024-09-14T13:58:54.246424+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rjwL9cufneibitqS3vm0xzRrwwmbYi__0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1146634905874738798', time=2024-09-14T13:58:54.856204+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ODSdDoPhGvQb0fiU3P1V4rdgAY5j50K_0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11970481919821531370', time=2024-09-14T13:58:55.151771+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.369+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ysKF-ew8_bi_HzhU1fHvrNh8GnQ2fRQ_0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13577171202727163991', time=2024-09-14T13:58:55.772512+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.fm_TJN0vqtjmDHZY1n_kumChL4etI0U_0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11703516202008153101', time=2024-09-14T13:58:56.506779+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mfbP2uv3Dp_jKdPzjDarIdcNnfvyavr_0 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15111716940942707206', time=2024-09-14T13:58:56.990527+0000, chain.objs.size()=1 2024-09-14T12:16:15.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.M1Pq6kFfKTrc88scSoAi-IbQ9BtUWQV_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11196704965483874141', time=2024-09-14T13:58:57.098663+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.370+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hACkuYMX4m7q-TnLdpy_yL5x60S9_iE_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.372+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/49364 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14828493942466479252', time=2024-09-14T13:58:57.702800+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.cw2rd6COsgJ5ywQEF9E0O2HMvq8qhdA_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13792113829438446770', time=2024-09-14T13:58:58.030556+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.27O-ePkAQTCGZ_eaY5dSXmFE58iAwEI_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3497586294177765405', time=2024-09-14T13:58:58.288754+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hQO5jKFe20IjDMLBVzfyRPPiB2fAI8R_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.978424633529171973', time=2024-09-14T13:58:58.706811+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.prbZRh6seYPGXUAGM3sGq4TuPU3yK8N_0 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16594196640194595383', time=2024-09-14T13:58:59.145615+0000, chain.objs.size()=1 2024-09-14T12:16:15.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5ZgbKJCYie_0AZemWSH_rl7DNdZRb6u_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9514030570965082320', time=2024-09-14T13:58:59.255040+0000, chain.objs.size()=1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hSmX2IoiuDi-CstK4bt-xwGI0pfkb_n_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7031314544236655443', time=2024-09-14T13:59:09.585987+0000, chain.objs.size()=1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.340__shadow_.A2VOqlU1TKJ_FGfuNo57ZOtttFDIAwa_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6398626780519401278', time=2024-09-14T13:59:30.943375+0000, chain.objs.size()=1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.377__shadow_.kyV4lmwRFavrHie6u7YwprHLXK6-Oeb_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11571052666002791729', time=2024-09-14T14:01:15.172290+0000, chain.objs.size()=1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.517__shadow_.TUEd_baHNo0_Pu-vFWhrCl00uRKOXGj_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2743706646656030863', time=2024-09-14T14:01:36.001506+0000, chain.objs.size()=1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.520__shadow:vljfsdIzK3dVis0wYvqIKk4XgyUa7TG_.BtPp9D_HFf4CGDHbLWrJQ8Vcpkv5j3D_0 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3214871447996262188', time=2024-09-14T14:02:24.577536+0000, chain.objs.size()=6 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.1 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.374+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.mwsnzYRMutAGQkjpkP9XchzESS1vJLuF.2 2024-09-14T12:16:15.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.3fOwktnbMFHU0EIo-fVQ2eNwGF-C-e1U.3 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.4 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.376+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.5 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~CH9V1Ti3h7lFogkCknAuBFDDdwVKWHd.6 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9995393184084591584', time=2024-09-14T14:04:31.629589+0000, chain.objs.size()=1 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.570__shadow:p6cP3qlwBEwCLhg7lnZxsdO1FAYcHQa_.iXMFQrUb1wonKI3aWOqfvQKwT6VM82t_0 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13942344725475299204', time=2024-09-14T14:04:52.685696+0000, chain.objs.size()=1 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:gSv2CRGNTHgwHXT7d7Hyuhdf7yB3JTA_.NH75hmtTJ14TVDS9zd-OJ15SY9wvSkc_0 2024-09-14T12:16:15.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5175263259719599302', time=2024-09-14T14:04:55.891237+0000, chain.objs.size()=1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:WF2.A.JWC.vNNVkaVmm1cnoHwjhjFvI_.mNl8-hj0SOAxkoljFJC29T5fjYe0fah_0 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9193204493806932204', time=2024-09-14T14:05:01.868297+0000, chain.objs.size()=1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:br8C4lz9WCCROLniS8AT8Nh8tHhAiOg_.eXvPUB1K2e9UoDZqZf6SxMRS_bKuEVP_0 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15312929332379370674', time=2024-09-14T14:05:19.670591+0000, chain.objs.size()=7 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.1_1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.2 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.377+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.2_1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.379+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.3 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__shadow_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.3_1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.578__multipart_testobj.2~OnDA6a6NvOHdn10miLByEhRderaEJbH.4 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13183720162817355935', time=2024-09-14T14:05:30.151014+0000, chain.objs.size()=1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.587__shadow:rDj44XA.ayC0x5YrYUVmnJ.UUaBecZp_.k9N3c4de134Qy69h6SSDbe8kNWF88Jj_0 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7344333905340029957', time=2024-09-14T14:05:40.966381+0000, chain.objs.size()=1 2024-09-14T12:16:15.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.605__shadow_.OTNMzc2yn9JuATdw3JjrnIfi1uSkG2U_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13867954760018708810', time=2024-09-14T14:09:42.426614+0000, chain.objs.size()=1 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.647__shadow_.3tApxZbExL50OcMZ3CmD0qCNhCFPnuq_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16560211238628531853', time=2024-09-14T14:10:25.381785+0000, chain.objs.size()=1 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.690__shadow:61WADhNTY87e9YmaWtgoRyXAn.fDZX0_.5ZCaEznqBauwBzFb7KAevqm8LfdGMo0_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9288085519889727056', time=2024-09-14T14:11:43.787819+0000, chain.objs.size()=1 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.747__shadow_.f1kiv8Pdt0QjBGQsD88I5m5w4nEycwg_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4457028786799129677', time=2024-09-14T14:12:20.964685+0000, chain.objs.size()=1 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.753__shadow_.eokSc59MmKuPaCK5Lb0pdQzmAVu7kkd_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17914096332248917383', time=2024-09-14T14:13:51.942159+0000, chain.objs.size()=1 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.380+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.774__shadow_.h_sYKdKM_I4yhttZRT7_usZ798emAnT_0 2024-09-14T12:16:15.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.383+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.385+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:16:15.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.386+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.386+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53607' 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8157837726112724963', time=2024-09-14T13:54:01.791838+0000, chain.objs.size()=1 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.199__shadow_.wvw3FfMrQoW-giZTk0pPtNfW2lIkouR_0 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16771780756313079518', time=2024-09-14T13:55:33.798727+0000, chain.objs.size()=1 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.233__shadow_.oxTzNMqFZVRXQ8il9MW0UFQDdyHR_jj_0 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11757490645166990119', time=2024-09-14T13:55:42.397057+0000, chain.objs.size()=1 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.244__shadow_.rs_F_ODTj82mJ96aRCKoahfN2_MROg-_0 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9985711298551678242', time=2024-09-14T13:55:43.770538+0000, chain.objs.size()=1 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.246__shadow_.yCK1HrUrvaZ86Mr_O40PRTQtAjGpDse_0 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14785787545855245836', time=2024-09-14T13:56:29.974774+0000, chain.objs.size()=1 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GdahfTEbOYdcCEY2BzJi7jw_K1Axka2_0 2024-09-14T12:16:15.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8296588864269797983', time=2024-09-14T13:56:29.997069+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D69wiZ2S5Og6pwmHS3OBMETaRUXjjKD_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9372196798987564678', time=2024-09-14T13:56:30.095688+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.f7qs8Ub5jjsZzX-JS7uZRzKQmndcn8D_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14665441074996649746', time=2024-09-14T13:56:30.276358+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.kYjE8RoKsPsw86LniamK0Cvl_5z3uJN_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6364270494887585577', time=2024-09-14T13:56:30.313719+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.D0rZ4sWtv-BbY-Tj3W2-NMn4ECLqLgv_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7462872700512208837', time=2024-09-14T13:56:30.377847+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gY_q_TR7CV5Psu84mqP3DkeQwoPJuWI_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16189175812743516795', time=2024-09-14T13:56:30.587686+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ttaUJJ_OrQrXwO9nRWgDCkbGJpeKA4U_0 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10475467715694821959', time=2024-09-14T13:56:31.339083+0000, chain.objs.size()=1 2024-09-14T12:16:15.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.387+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.f4OulgyHOKg6D0CIW-4g_qVjP8wsN1D_0 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15759230120068185199', time=2024-09-14T13:56:32.038855+0000, chain.objs.size()=1 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.jdo20VGUh2m0UJHaZM4vWEmT1TpymEi_0 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14348285031015402402', time=2024-09-14T13:56:32.101950+0000, chain.objs.size()=1 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.5b5Hsh_uYlQCEaDWifciceC3LbN-cjp_0 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2037653676780919239', time=2024-09-14T13:56:32.123810+0000, chain.objs.size()=1 2024-09-14T12:16:15.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Tlygzs8_6ZzoYol9M63e-LoeSET6zUJ_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14505115644772305050', time=2024-09-14T13:56:32.764534+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.GGDyrjhgM1uwsYKeM8vKjI7WL9MOX8g_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7858985315976125452', time=2024-09-14T13:56:33.118491+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nRM4AlVCm_C4bm8EXdG3y5XEU5OfjY-_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5322801482248283283', time=2024-09-14T13:56:33.188863+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ExP0nJOSQUww-nLKnlSLMHQInniUee6_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4208961642060931067', time=2024-09-14T13:56:33.189462+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VGe9Fv7rsflIhMSmBFimha_mtnJcWS3_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12547134305670091305', time=2024-09-14T13:56:33.207125+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.rVQEkWrxDXvnm7qCvYaneLCqGn6ooMJ_0 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.867453964963906329', time=2024-09-14T13:56:33.226138+0000, chain.objs.size()=1 2024-09-14T12:16:15.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.eDTii6sHIzbzWSivNZGhEs9_qA1jK_J_0 2024-09-14T12:16:15.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15848085277059495942', time=2024-09-14T13:56:33.260639+0000, chain.objs.size()=1 2024-09-14T12:16:15.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._ewYaM4cdUZPcK6GP5eupYGXGG9FJC8_0 2024-09-14T12:16:15.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17479007002323269457', time=2024-09-14T13:56:33.559045+0000, chain.objs.size()=1 2024-09-14T12:16:15.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.389+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wknBxXNgmGN5PjS2Ke27f5cqxJXF4Pn_0 2024-09-14T12:16:15.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4295410941409591938', time=2024-09-14T13:56:34.649529+0000, chain.objs.size()=1 2024-09-14T12:16:15.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.lfc5U_IY_8TU-NlnggiZbMhAo_utTYo_0 2024-09-14T12:16:15.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10841520313458442233', time=2024-09-14T13:56:34.948824+0000, chain.objs.size()=1 2024-09-14T12:16:15.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ShhaIA4WBgqmrz8ft_o5rd7AV6MWNl6_0 2024-09-14T12:16:15.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17013229386259745998', time=2024-09-14T13:56:35.434074+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.391+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.bGxfYS-4SWnz72YrvLqm6WwrVp9TSb6_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10051048402833077136', time=2024-09-14T13:56:35.471886+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Teqhwq7dLiDAXw9Uq6vcleAv4gM2HH5_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5720728119262455723', time=2024-09-14T13:56:36.359507+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.P7WXk2xGmFuPJvzz6j8Mp_QBSsa3j7p_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8478355976260907540', time=2024-09-14T13:56:36.440363+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Rah6mCm1ga9pZJR79_zDCyHpmCUkYVF_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.575357273422781118', time=2024-09-14T13:56:36.768091+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.fwbpvpbRRXYpKorI_H2SqqO_GtK-Q5L_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4008008483993967847', time=2024-09-14T13:56:37.060997+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.JRLU8bOqGiOBGjxxXUHAEIeN-nJ04mO_0 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7685779506601482989', time=2024-09-14T13:56:37.493611+0000, chain.objs.size()=1 2024-09-14T12:16:15.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.L39wT2Tcq7hW9uzshxa0zQ0_vNdRhiM_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.232002630158528370', time=2024-09-14T13:56:37.774048+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.yObHpgUR3V0NH6lxME9cKz55VPKQ5Zs_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11844883605607260027', time=2024-09-14T13:56:38.078681+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DWgoaQZP4mICyE6BwBzVIWTvXX_SIML_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4741502386459263924', time=2024-09-14T13:56:38.217501+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.392+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XwPQdDJramg3w4Ryyp9BKM7H_mCdcEA_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.393+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1903913453903665790', time=2024-09-14T13:56:38.316659+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.393+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.cm_ZGX6N-rfA3F_iOd-uBlnx0_5iqgn_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.393+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2109306335079926029', time=2024-09-14T13:56:38.564112+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.393+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0QNwIPNtErOx-INhB5WR4mSzZYLEavh_0 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.394+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15223345045296704688', time=2024-09-14T13:56:39.193704+0000, chain.objs.size()=1 2024-09-14T12:16:15.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.394+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.mIyaw2EpHEpOCMuWv-12-227UTJ9xwY_0 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8950847357351055491', time=2024-09-14T13:56:39.621538+0000, chain.objs.size()=1 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7Y8OXHC4ROZTGJvxbDM0p5uQG1n1UK5_0 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8804261639320862807', time=2024-09-14T13:56:40.069192+0000, chain.objs.size()=1 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_._th2Q4oGFnPwZhLUk7RGk8N5rhcXUXJ_0 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15115148008859185143', time=2024-09-14T13:56:40.162439+0000, chain.objs.size()=1 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wwxFM9D3dDp-Tc2DdJjpb4xT1RrCZnx_0 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11852005747910062423', time=2024-09-14T13:56:40.342789+0000, chain.objs.size()=1 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.xc--Kw1b2p4tJ35r0TeSH66P5LvO5VA_0 2024-09-14T12:16:15.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2293728077608679143', time=2024-09-14T13:56:51.694443+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.279__shadow_.SZI4HB1cW2aWNeOef0hrXCHVcRr0G0h_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12669904013892503396', time=2024-09-14T13:56:53.749927+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.282__shadow_.03b9MfaTDgidsDMO1XziPg048GlLvq4_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14190435643043529330', time=2024-09-14T13:57:02.107335+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.uFYRChmRtPzWXz10kO2ZNL-j3bm5I8a_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12445632026732686749', time=2024-09-14T13:57:02.136160+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.mba-Xt3GJF06OCo030uAtCHOemFTnZL_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14567478493138637679', time=2024-09-14T13:57:04.063630+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.SIAA1f5FB0fae7YGI58D_-fCboVpfHq_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7475219939052527565', time=2024-09-14T13:57:04.094850+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.395+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.A0KhkcZXOrAvmfzQLe70AF4K19eYIAH_0 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6956764143316205519', time=2024-09-14T13:57:05.576156+0000, chain.objs.size()=1 2024-09-14T12:16:15.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.295__shadow_.Tl12cdW7ah1zzhkOv-7MmngUkDKYIgH_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13404372220133355560', time=2024-09-14T13:57:09.296619+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.300__shadow_.SSC1nJBE7QnHtRmE-KjabtSqX8HlLyx_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12770402634870626195', time=2024-09-14T13:57:24.624399+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.321__shadow_.-DCSERHjFVo7Az0d5Ot3nHb5cjG2353_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14153296540424513243', time=2024-09-14T13:58:02.467586+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Re5DSS3Dd8bulbOyOLRPVUmUnFoKCo__0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6526423280492498775', time=2024-09-14T13:58:02.727163+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.396+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.a6tBx5EX8FJel4B8BX4qVPS023kmsyJ_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3075159986291565304', time=2024-09-14T13:58:04.048579+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TnUBryMwYh3j03v3emxBkMqqehJr6u2_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9208843236356772046', time=2024-09-14T13:58:05.737973+0000, chain.objs.size()=1 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Xk1kXaEvF9pml_i8aQa24d5h0_ivtyg_0 2024-09-14T12:16:15.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16558902717209924504', time=2024-09-14T13:58:05.856255+0000, chain.objs.size()=1 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xjAHvYfUdGhpkIC_DDEOqWHX0MDaPnh_0 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6172549887948734985', time=2024-09-14T13:58:06.560524+0000, chain.objs.size()=1 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oSA0vVfTFwbY1qlc35NiO_j9xgcxFLv_0 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17538147006564547482', time=2024-09-14T13:58:07.129143+0000, chain.objs.size()=1 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.W24j4SrbKrSzQIiGZpIV_gwDExEix8G_0 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6707512390083054919', time=2024-09-14T13:58:07.337871+0000, chain.objs.size()=1 2024-09-14T12:16:15.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.397+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RfzYFgU0xAzI0ytN85HC66RH9Nuivic_0 2024-09-14T12:16:15.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5266998674383664853', time=2024-09-14T13:58:08.057628+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.k49RCXsP51KfnX4irB7n8jg5G5MtD2R_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.398+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11127087291499250511', time=2024-09-14T13:58:08.179022+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.398+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.VsBUV2RiuAzIdbzDBPvyRztlX-DKylf_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4955965547186873140', time=2024-09-14T13:58:08.301927+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.c9odohCv3YNxDOggWmK0GgVd_eLz5Pv_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18118474190893498589', time=2024-09-14T13:58:08.720033+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.SPU_VGSPwjQtntR3KD-nbSXbXVu84FP_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6292966734544693144', time=2024-09-14T13:58:09.557835+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Th5QTHmL9BUE1938BqFsZbxwp2xAmEY_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16224433333447992065', time=2024-09-14T13:58:10.078644+0000, chain.objs.size()=1 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RyxbA2zKLNY8fLOgvlJUwVrPsaFAry1_0 2024-09-14T12:16:15.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17740746618868919390', time=2024-09-14T13:58:10.823799+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.d9ZGnHtibvzBpW8PtDaPDWMZHbgFtlD_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5344899045013468816', time=2024-09-14T13:58:11.070795+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rZfZ640nRYCLFHxIwJ_KL3J5H8Dlj-2_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14179269604914943681', time=2024-09-14T13:58:11.904807+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Tdv_H1KfsIz9Q7EbPuRdyjubuZjMMKx_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2236625531602306134', time=2024-09-14T13:58:12.128243+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qJDOLHBfPDi9ugr3eQXawzJz5wpw4Zx_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14998605497895725910', time=2024-09-14T13:58:12.159158+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.399+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.-BG1HFH04DqINZ8xUmXiOIHx4XgVLO7_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10166429326506423733', time=2024-09-14T13:58:12.322584+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rIgHvZ3M1kBOEYNBxRIdedi8KWKiwV8_0 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.400+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7122758414239188102', time=2024-09-14T13:58:12.395729+0000, chain.objs.size()=1 2024-09-14T12:16:15.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.400+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4HYHbq1AL9dV6YH_4SaAKtIX9Wr6WFp_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4755746232974776304', time=2024-09-14T13:58:49.124296+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.7FHP2UPTO-Jd3aGKl9fTjiRd0UlhNOj_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13175090260446401403', time=2024-09-14T13:58:49.139142+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.q93A7bWnjLyeNJ630IdOGJ94iZWiPIA_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7717352754053568451', time=2024-09-14T13:58:49.154979+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.0TJUnb7Uu0RFMsk-3QCfP3qxaxCbqda_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5613311458719601360', time=2024-09-14T13:58:50.032339+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jccdRCfXWfs_-2hDnDxUrVLJ45sCwGA_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3627996607147396288', time=2024-09-14T13:58:50.511978+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.wUKJUEs1rwzFcGuXGcd8AQ0o-OoOKoP_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16051253107246246191', time=2024-09-14T13:58:50.698432+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.rRFglqV5oSTFULj3go3ud7Fg8ejkQ7-_0 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17109990851786823864', time=2024-09-14T13:58:50.803424+0000, chain.objs.size()=1 2024-09-14T12:16:15.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.hmoS2qLHdSTmBiaQhSLMCtCFc0Adcho_0 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10927061634583004309', time=2024-09-14T13:58:51.060175+0000, chain.objs.size()=1 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.IRUHdsLJlitlpI3Kdtq5oJkzuCc5FyW_0 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5041203729294990189', time=2024-09-14T13:58:51.125800+0000, chain.objs.size()=1 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._hqkI2Hld3eDlztDs9C5wx1-MiCWrUY_0 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3133880920851926744', time=2024-09-14T13:58:51.200865+0000, chain.objs.size()=1 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.NfKKMyuPO86T10EJ7sXAuIDYVwWqLDz_0 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11745653579719322401', time=2024-09-14T13:58:53.598262+0000, chain.objs.size()=1 2024-09-14T12:16:15.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.401+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.QASw_S-UEug2LpWD6QA6M1VJmH_atM2_0 2024-09-14T12:16:15.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14896763935361735078', time=2024-09-14T13:58:53.871355+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.73CRBuK4beG43LIV2HOtzZXh7VCJVDP_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6448454673035783931', time=2024-09-14T13:58:54.190845+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.mvRgbzX-ONAbTh3K5DPZBBAR4X2d6dT_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8791259724529911152', time=2024-09-14T13:58:54.337273+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Rqdqejau4b8lSfDjeH3p7bAe5ysNdnM_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2168083652264680984', time=2024-09-14T13:58:54.744408+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.a4eLUOq7UBJDLnuXGvbLiTYvxa8seF0_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3077334833015468254', time=2024-09-14T13:58:54.757516+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HC-foVgJEOT6NC0F74o-MMuDZOy28iJ_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13255173432141786228', time=2024-09-14T13:58:54.935800+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.HAYT02CVdk36coHVRbSVP5tU_weaO6X_0 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17963944364024565076', time=2024-09-14T13:58:55.148822+0000, chain.objs.size()=1 2024-09-14T12:16:15.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d3BHR1xXUYbOKrfUdm5jfiud-y6D6DO_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6685760826148372193', time=2024-09-14T13:58:56.518650+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.403+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ycZuXrzD-Aov6qmOR-WPaP_v-6IkGwN_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3191694725450868324', time=2024-09-14T13:58:56.678776+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._JGCSZ1xdeTOagpqVaxmHeff9yfoxaI_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10374574869468506526', time=2024-09-14T13:58:57.391601+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.S6GkVVHnZnFCjPGc1mhVTnylHwdPx5Q_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14509495310883933471', time=2024-09-14T13:58:57.703246+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.uuBHQZTZVRtqqBMw_ph6gSeAb8V5LNr_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12523636306319409570', time=2024-09-14T13:58:58.118028+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.404+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.FTrp_C5vF7apwIF7FqxLdFrrs8RaaMN_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13374446842121477313', time=2024-09-14T13:58:58.177913+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YPN4M7VYJyui2rUk4vbYJajl77G-32A_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.405+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7879620194707667319', time=2024-09-14T13:58:58.587097+0000, chain.objs.size()=1 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.405+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Yrh2GHr7apAvu-tp5LBzpwTxUik2muA_0 2024-09-14T12:16:15.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10203988104401484151', time=2024-09-14T13:58:58.662449+0000, chain.objs.size()=1 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.D24JQGgxsfZX-Bv5zsnXCzcD8ln0CjP_0 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8982998430602562822', time=2024-09-14T13:58:58.696866+0000, chain.objs.size()=1 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4dWScUq1Mk8k9WsukGTSg3dvPVvvH9N_0 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8176177347769964170', time=2024-09-14T13:58:59.105119+0000, chain.objs.size()=1 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.406+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.tzWcN7qXdZFbILFunSyvH5M2WFZ1aEm_0 2024-09-14T12:16:15.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.408+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/53607 2024-09-14T12:16:15.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T12:16:15.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12744544442326943986', time=2024-09-14T13:58:59.399220+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.d6pH1iFSdE_Vn4Zna-EKUN7tFRO6h93_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17506469214495409074', time=2024-09-14T13:58:59.469205+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YySa4I6Vi4yKKoMFxytyfnlYm3pLa9s_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7120174346271446025', time=2024-09-14T13:58:59.504188+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.UY6T6_63bfgJHhSWAYP6dqtfVPU2JNu_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7138892780566109879', time=2024-09-14T13:58:59.602186+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aZP3ki2ESoHgjx48eIk5atRAz3jwlMS_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1597490243522089058', time=2024-09-14T13:59:06.078987+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.334__shadow_.c1TAjyAw43NwDN34Qzx7vVcKz9kc_-J_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6614219648892898345', time=2024-09-14T14:00:26.484975+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.460__shadow_.sW9iqP4LPJDP5XklcHqPXulx_bWQsI0_0 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10634611997047427642', time=2024-09-14T14:00:44.957907+0000, chain.objs.size()=1 2024-09-14T12:16:15.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.486__shadow_.Xs20y0c0CReRgL3ClpR80PnQ-xpcsga_0 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5014525876630856069', time=2024-09-14T14:00:46.415062+0000, chain.objs.size()=1 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.488__shadow_.sVz0bf9WFmc9gKIXL5WUZqnyz3vJzDP_0 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9407559946649338012', time=2024-09-14T14:00:56.324664+0000, chain.objs.size()=1 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.503__shadow:wE8cpHYnceVR6-j8QHDQp9V.3N0m4zr_.cZNSid0iG1iUDYtKicRoz184zY57yVX_0 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3811838365638772268', time=2024-09-14T14:01:15.405560+0000, chain.objs.size()=1 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.518__multipart_mymultipart.2~wY0jeGb9VuL5KZcYwoG8W79B2D398dC.1 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3821686641654284503', time=2024-09-14T14:02:42.198267+0000, chain.objs.size()=2 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~Q611T5tMjZv4s3AQZE_sZ02IcVag3Ic.1 2024-09-14T12:16:15.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.410+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~Q611T5tMjZv4s3AQZE_sZ02IcVag3Ic.2 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.412+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6632350780468641241', time=2024-09-14T14:03:50.042212+0000, chain.objs.size()=1 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.412+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.552__shadow_.OkQUtkQU9Qny7lyDvkwzWpZ6ePkOpTA_0 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.412+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9105996338665645664', time=2024-09-14T14:03:56.731889+0000, chain.objs.size()=1 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.412+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.555__shadow_.56_vIjnxUvTsYtteDutuXWklOpobqvi_0 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12033260172085507313', time=2024-09-14T14:03:57.801694+0000, chain.objs.size()=1 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.556__shadow_.KX-ATbVFYdaTAN6ZcmW2Mt7Ezqsru_S_0 2024-09-14T12:16:15.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12393241494008065247', time=2024-09-14T14:04:30.520445+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:Luo5XhMHnyrQbx-DmxMBEI3OutUCphu_.FEgypqvxyGiHRhpXbZafaAOyTy9qvg1_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9944130827838018138', time=2024-09-14T14:04:31.998329+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.570__shadow:qD7lcX3WagOgWifUFD-hqs1ozkqBjvP_.ON8iN_X1E7LgZGdF27StUJBcxo0UjmD_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15041833612562045664', time=2024-09-14T14:04:38.927868+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.574__shadow:fW4lFqeFqefJCIqX3iLSxBdqvadjtrI_.c4ttbz_eJfxf0OKQC5SRZ7T_o8jMNTT_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.433993715996985515', time=2024-09-14T14:05:28.041177+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.585__shadow:8jyxcVjmRwt.Y.VYArOkFy9m9zWbC3d_.iYyUQxouGUZoZoxCa7NuZeh6T6zVH0Z_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16025550574125416040', time=2024-09-14T14:05:38.793855+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.602__shadow_.SiDRcF9dWlyt69U0gk_3xWxCsktVOWT_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10575094597519007144', time=2024-09-14T14:09:30.167433+0000, chain.objs.size()=1 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.636__shadow_.4gR5ZLWhnhZFNlY5XYPqVnjl3AI0cz3_0 2024-09-14T12:16:15.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7800859264811284060', time=2024-09-14T14:09:32.709078+0000, chain.objs.size()=1 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.640__shadow_.Y0PBFPptQgwB-JlZ3tFiHhPZA_1VLRI_0 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8407471251238941250', time=2024-09-14T14:09:34.971919+0000, chain.objs.size()=1 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.413+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.642__shadow_.24LD1ynf2C1mhLX-NyZLQhc5_Og9ax1_0 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.414+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8989301827620106285', time=2024-09-14T14:10:12.221065+0000, chain.objs.size()=1 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.414+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.666__shadow_.0IXBwrXnwZV1Lx_XY79mekEnOw9PnoP_0 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.414+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8591198522186166894', time=2024-09-14T14:11:43.089054+0000, chain.objs.size()=1 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.414+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.746__shadow_.vxUkhw1aHCDvdjLYjrM4S-DbJYXCQow_0 2024-09-14T12:16:15.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.415+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.418+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:16:15.416 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.419+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.419+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53168' 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1355915374908793426', time=2024-09-14T13:53:43.312513+0000, chain.objs.size()=1 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.176__shadow_.XP0X2y7GXNMThLIBTbncCCASCWbKuAe_0 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14445394241290851364', time=2024-09-14T13:53:45.106496+0000, chain.objs.size()=1 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.179__shadow_.AqmCqtDJJnlgRCTm44dC42wlDAOTkiw_0 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9000780123052077205', time=2024-09-14T13:55:36.903748+0000, chain.objs.size()=1 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237__shadow_.R5et_N_evVP_GTlBC1L2_eZGsn3qgrA_0 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5540769168292865754', time=2024-09-14T13:55:47.950165+0000, chain.objs.size()=1 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.252__shadow_.g_yBzUO25TGoJysoQvH-eEJz9dTjhGE_0 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6730430313053823235', time=2024-09-14T13:56:31.577711+0000, chain.objs.size()=1 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OCETUVJZPkxZi4rWOUxte8ZjxIPOCLR_0 2024-09-14T12:16:15.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9944180323428458882', time=2024-09-14T13:56:31.648098+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XtGgWXznpeLKJ3PUDmjHQs335ltqsW7_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8382003124235057408', time=2024-09-14T13:56:31.847514+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.iyJt_QvHEPn3VAGjNj4xDw4xjYaU-uH_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9066153754168697982', time=2024-09-14T13:56:33.450021+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8Bv6hJ1FR_qEwaoxk7FknQTZJdW1Pbr_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7909991277848597516', time=2024-09-14T13:56:33.599623+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.ait3_Z4-pUUAkWjo6fqnbrbiHWIrE61_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7425042731964942673', time=2024-09-14T13:56:34.349505+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RyU0XDhZF-KJbb2wvs3nGJy9WLt39uB_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8123112134827990046', time=2024-09-14T13:56:34.532824+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.inng8KYBc1938TCNyxanKz3yxuw4lIW_0 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13384276688288118708', time=2024-09-14T13:56:34.869458+0000, chain.objs.size()=1 2024-09-14T12:16:15.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.420+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.7kUx7mGW6xgXyRPs5vxtRyoMImlT3mD_0 2024-09-14T12:16:15.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9885708123108082973', time=2024-09-14T13:56:34.884294+0000, chain.objs.size()=1 2024-09-14T12:16:15.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IkFTTZE-UEbSAseIRc_VqNWfV9fXAYn_0 2024-09-14T12:16:15.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.421+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15771628213566731420', time=2024-09-14T13:56:34.980413+0000, chain.objs.size()=1 2024-09-14T12:16:15.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.421+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Po3gtdZrVUAjC_h5oBqXDn7NiDxRrhq_0 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.921398201381354643', time=2024-09-14T13:56:35.671402+0000, chain.objs.size()=1 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.9HDl1Amnh0JSDQjMAN83xP1Gizz9BS4_0 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15457051154419670708', time=2024-09-14T13:56:35.871128+0000, chain.objs.size()=1 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ezp05YyOt-MmF_Ud7lIhxyZkfg1EEcN_0 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14766288935383458929', time=2024-09-14T13:56:36.432413+0000, chain.objs.size()=1 2024-09-14T12:16:15.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.TdtvqLlgPiYkFY0BOo3y7R52uzNZMVh_0 2024-09-14T12:16:15.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17111529694776515916', time=2024-09-14T13:56:36.801803+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.MWuS-3Hg98lxm9VoaO6Mg1C7izzKwSg_0 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11897565960020956052', time=2024-09-14T13:56:36.968139+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sIcxDYXBRDMVhWDnXkkByE95jz3zQa1_0 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14239856433899019967', time=2024-09-14T13:56:37.046175+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-zVRb3mjqmvYJ3SgAHEm9Ks7hqFMafx_0 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7541887501469661203', time=2024-09-14T13:56:37.755896+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.3r9DLtPBfD3CF-XEyRj8poXyZSYng0__0 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.557171584598029757', time=2024-09-14T13:56:38.085883+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Jxl7Va28yMBk1F_UFZ_2ZUwsMjRNCEZ_0 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7359098509977926184', time=2024-09-14T13:56:38.086571+0000, chain.objs.size()=1 2024-09-14T12:16:15.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2TniesBU4J_IrRFzTNg_ArGaD-8JNXh_0 2024-09-14T12:16:15.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14737294793025585467', time=2024-09-14T13:56:38.429999+0000, chain.objs.size()=1 2024-09-14T12:16:15.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.0SzMeo-wSbUhNdNpww_goWOSZHBpujP_0 2024-09-14T12:16:15.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13071378630895315546', time=2024-09-14T13:56:39.483144+0000, chain.objs.size()=1 2024-09-14T12:16:15.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.423+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.dEUhNn7izolmYdcGcBtBhagQpXIcfI5_0 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14238485613492271088', time=2024-09-14T13:56:40.280352+0000, chain.objs.size()=1 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.zp2cEmr4nnZVl0pT9M3igZr2y2VNOXZ_0 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5948335387228544695', time=2024-09-14T13:56:41.688520+0000, chain.objs.size()=1 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.264__shadow_.WX9QmKjtq7Zhjq86LN1uPKdebnPVR_3_0 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15962485168838350396', time=2024-09-14T13:57:02.182300+0000, chain.objs.size()=1 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.292__shadow_.v8GB4EDZWps0EPJUwFNDgpA8zudiXnj_0 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1797788136923278423', time=2024-09-14T13:57:04.198365+0000, chain.objs.size()=1 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.1XbP0wiS8ik9HExtYG-xBWRiTXBQ5WA_0 2024-09-14T12:16:15.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4270818565090491914', time=2024-09-14T13:57:07.077447+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.297__shadow_.y6hK0u54yM8jdQ5YMkzqO7aZOehXRKN_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11338419718691285617', time=2024-09-14T13:58:02.497001+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.00XzhpdISavh0fcbZ0Fh3LMGqvaDRn2_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15283560713187453560', time=2024-09-14T13:58:02.643517+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MWoVDHvR0s9Fc8P7mQG4kYkrhtw1uUF_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8958296284797807703', time=2024-09-14T13:58:02.966029+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6mULTJNh-2JWVRnw1Q_zZoGJLjg8Ir-_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6954752710639290410', time=2024-09-14T13:58:03.238001+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.W0I4Po9rWwVnvrcvud93s6DDyWQqNXD_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4127938487942213194', time=2024-09-14T13:58:03.729570+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.G5wDVZm8Kc1UJLU5hJCSW43gA-gFCnL_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11655470264565262077', time=2024-09-14T13:58:03.854897+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.425+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.UYzFJgqdsxfx-WOFXKxTDgOka2CXQt3_0 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8130556911156366609', time=2024-09-14T13:58:04.279265+0000, chain.objs.size()=1 2024-09-14T12:16:15.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.19VclPLchW7PG368-nBzxxqA7UOYa45_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16241868260409341920', time=2024-09-14T13:58:04.381765+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fcRY4cKABwMqpbO0xrARcznjeMxYS1x_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9805897250175154448', time=2024-09-14T13:58:04.716516+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.O9oxgh98khN-5CzGHLUWtQVKC67h6l8_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1480703261107060305', time=2024-09-14T13:58:05.170968+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rleAnLelUQgAgCw3YCotVDZ-9UOTNCO_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18284445277401590584', time=2024-09-14T13:58:05.203505+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.BpmzvxQzVt3RvFCusPhx5Ao3W8bCGjM_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14868222367986845907', time=2024-09-14T13:58:05.337470+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Be2vvC1HKFK9DQXAbvlA1CO1SN7KLm1_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2639207223743715162', time=2024-09-14T13:58:05.525376+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.swVhtLLWa8Wjpt1k0zNYU4CWD_A4_cG_0 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15465674955741821461', time=2024-09-14T13:58:05.739855+0000, chain.objs.size()=1 2024-09-14T12:16:15.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DTZm6T5EAlUOJdJ7LUGHXGP0B9oFa_e_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4350069601835293351', time=2024-09-14T13:58:05.762437+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.vzIzh3Yz4o00N_fJFG1LR6LAdlAquN__0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1132993450416346960', time=2024-09-14T13:58:05.986777+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.N3ULDBab6MS8NVdCZnoQxZAtfCJA3lh_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14454084280116991255', time=2024-09-14T13:58:05.987619+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.427+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FkkhfU_yT8qWH74iaMFlyxllb12ukqi_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7520531378268444315', time=2024-09-14T13:58:06.067222+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Q9dAgAzvY9jP_lzbcCdyRYWq40Oj3a1_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4315487858720902186', time=2024-09-14T13:58:06.106383+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.b9xLXh7BH78MQhKxXBAvrq-J21Ysbf7_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14710257983513198332', time=2024-09-14T13:58:06.576497+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.qmApTERYi5y1adYcKEnsKdo5uAV5zB4_0 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.298875764204042692', time=2024-09-14T13:58:06.832534+0000, chain.objs.size()=1 2024-09-14T12:16:15.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.nGWAJrMQv89gT0opG1fldsxlauEm1S3_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1023878417665115375', time=2024-09-14T13:58:07.367477+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Cdtcs3HhKrFNNvcOr3yUbmY21jjVGVF_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8448038488288799670', time=2024-09-14T13:58:07.430863+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0XwAwwFaI0U6Z0QJRHBCev-62mCu5JJ_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.891928776370690062', time=2024-09-14T13:58:07.553179+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ubO7ZuLQ6Lv9gczrKMqgakIQ2-h6Gdi_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10737416322689556946', time=2024-09-14T13:58:07.962691+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.MrqiBaAtxr6fz6_XE8iTmJG-Kp7DFlF_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12953050370225064233', time=2024-09-14T13:58:08.199441+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.CksCYsRjt9SXor1T_c3dSzytc6Ce5Nt_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12287627484000568074', time=2024-09-14T13:58:08.664747+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Jxn0WdawxGrcXiU92w7vLoeiy4OG3Ar_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8992788170050743989', time=2024-09-14T13:58:08.693815+0000, chain.objs.size()=1 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.429+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.eJs4sedKVrccZcr97n-Kg22uF-pBcs3_0 2024-09-14T12:16:15.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6621464046248989578', time=2024-09-14T13:58:08.767487+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.euDcQcKgo6nbnJx5mVyKSm0dT7ebLVD_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7699471516368055706', time=2024-09-14T13:58:09.799387+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.FVyahNNWuudJ8UHKnZrUI61XZNe1Zl0_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13074024785248671112', time=2024-09-14T13:58:10.178252+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.tJNo3s84v-G6t5SjhIaGng2ykidAnUR_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4372711659045369740', time=2024-09-14T13:58:10.672962+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.YcAJ1yh-HbyIBk-fjojPjziCOiuZ_s7_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7566811314418692241', time=2024-09-14T13:58:10.743973+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.4kyzRYQ_4LtjCWHwPWArPh02rwHunKJ_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7269487965407238173', time=2024-09-14T13:58:10.853875+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.gJ1Z1rcKv05230ayKNQFODCYmf5wcSr_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9769419244833159370', time=2024-09-14T13:58:10.978939+0000, chain.objs.size()=1 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.DE9ZuizUeI2r0WBapqG_j1mpnwGNiSX_0 2024-09-14T12:16:15.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17537620177458383004', time=2024-09-14T13:58:11.082618+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.z2VdTyvRG3DLytt_WUIZfNDCORjWT9T_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14648971196083937161', time=2024-09-14T13:58:11.423785+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.yZcs0mD3mZj0m9lWOspOJ2dsaN6p6Xa_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11992679906150400542', time=2024-09-14T13:58:11.544412+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.RzS7bDNeSk5PLYRd3qeqAOR-ycYV6fb_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1797583104317528248', time=2024-09-14T13:58:11.958476+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.431+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Z7pzWje4aXK3u-GM3l4LtSnnspNrq4P_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4382673267249805403', time=2024-09-14T13:58:12.068171+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rHcNiIzsS0JcDqIjlnyk2VPNKHwJr2w_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15759876530589574529', time=2024-09-14T13:58:49.055446+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZfdcnG6_V3YLf5tZxwIujUCoLeCnG5a_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12104368078239568887', time=2024-09-14T13:58:49.592208+0000, chain.objs.size()=1 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.VACvgoyHp7jYCXOyeXj8w530kB7Yo8s_0 2024-09-14T12:16:15.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1540339973613149030', time=2024-09-14T13:58:51.243098+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aJOfsN1Y_DgvVOempNZSosQuNHY9Rmv_0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16683048736997760601', time=2024-09-14T13:58:51.941968+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.XEitgXDmke8sYkfx-GvLazXy3z5lyw__0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18245331700588455518', time=2024-09-14T13:58:52.055345+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R1FxFYWspRbEZtChkVTM572rQlaSm3S_0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18422791654673248552', time=2024-09-14T13:58:52.182766+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.oSDbP2lwBJ-GjS6NE_4XM1csh5I6r8S_0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1390626159177921714', time=2024-09-14T13:58:52.235477+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.433+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.5fAQsnCJXn8ECE-NaZV1iZtohApcRm__0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9970189418681489754', time=2024-09-14T13:58:52.770084+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.4QCHdpfV4ADa_yyS2g1Lo8LHaxNsYd3_0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6473714346465695969', time=2024-09-14T13:58:52.899185+0000, chain.objs.size()=1 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Dm0fcQiY35FaSS8LQcEdn0R5663aARz_0 2024-09-14T12:16:15.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6707836838746511871', time=2024-09-14T13:58:53.516439+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.434+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZuvHH-QBC8SJgmQ0WikRd5lOfgpWf5u_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7080374297315954108', time=2024-09-14T13:58:53.606353+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.gmoNm8WwIhVS-gyd5T1Z4azO7_7fa25_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10068215023235296012', time=2024-09-14T13:58:53.823483+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.yTVRk14fHwz394-HAIk_VSn4tFCe0o2_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5736401739367152738', time=2024-09-14T13:58:53.958182+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qGzQx-oo5_ALiNnj261re8d-8lCxUpN_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17911311236763753170', time=2024-09-14T13:58:53.986432+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.W5uhsoH9IMv1kIjijgX-RDFymRkbaQT_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6030745352042384485', time=2024-09-14T13:58:54.245772+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ZhkW0JJusQeWtvRdYKUuP48uaDnxuic_0 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13282238242912580030', time=2024-09-14T13:58:54.992068+0000, chain.objs.size()=1 2024-09-14T12:16:15.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.AZ44DeUiAoXmqflWaWKo4ahqkrQjQV6_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15589759157581600694', time=2024-09-14T13:58:55.185236+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.2U5UkHqlG5gYSWwGxT5nZ1gJg3RXULN_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8183883245120939168', time=2024-09-14T13:58:55.211702+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.435+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.eDz2A6uRq5a1YIlT5P-ziNwxG33t_9w_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3581983714825979365', time=2024-09-14T13:58:55.355666+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.TtGwclW7r0U_pOmdcWz34AT3-URb3RH_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7231883606815062830', time=2024-09-14T13:58:55.537304+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qLBWMVrYkfWjs6dxOEmO486463TInn5_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9982863693623311299', time=2024-09-14T13:58:55.751838+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.CK8crau3XN9lhupsCZURwdIimzYOXw1_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10591929414068717543', time=2024-09-14T13:58:55.752654+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.xhWXuOAbjk1WigEaboLUYkH-zsDsUs2_0 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10801927788209242777', time=2024-09-14T13:58:56.417946+0000, chain.objs.size()=1 2024-09-14T12:16:15.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.33D3o2sSV6p1W8NF60m8JWNuuMf6SNc_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3298276169380006050', time=2024-09-14T13:58:56.419482+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._VzhrRbADccq7Gyu7SHqxIETWJx2HqB_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6771329884388802023', time=2024-09-14T13:58:56.559096+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.kKyenmSxPsqSsfpXTiLgbS5c2jKuVgG_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11890839932766744930', time=2024-09-14T13:58:56.629352+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9TVNS008dOMzx7V9989Y5wldCVBeC0L_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13055252858865223481', time=2024-09-14T13:58:56.719212+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.LD2mEUhfSu017jtMl4v2NPWqygKwj7g_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15636525453191993119', time=2024-09-14T13:58:57.130377+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bV8oPyoZas3voHc74T56QBQOQhNBEqj_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10706528095669522107', time=2024-09-14T13:58:57.309964+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.437+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.K_QARRmbkqSEU21-m8X41rlGNCj213U_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.439+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8438577760942538080', time=2024-09-14T13:58:58.184379+0000, chain.objs.size()=1 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.439+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.nFTeIme9TAenZAMB-ghZajvh7LsUfhb_0 2024-09-14T12:16:15.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.440+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/53168 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6083031819042554060', time=2024-09-14T13:58:58.456591+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.A7qRgEpuxrHTACdWsVSc-TiqAaR2XvC_0 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.278695002360810370', time=2024-09-14T13:58:59.108376+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.KjpAFT5D-rF-HFGJGAVax9Oi21U930Y_0 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14379880694077216278', time=2024-09-14T13:58:59.257986+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jl22TbNQwmBUJFiumsobYkJNUQe2JkU_0 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17545573076016477962', time=2024-09-14T13:58:59.341407+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.251P52_Z7v4NoC6WXRYQkUK9YDWV0-V_0 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13783932761104704209', time=2024-09-14T13:59:39.594518+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.390__shadow_.MRym4AvztYqsJFubpBya6-UdO7-f0z3_0 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3171266921598024241', time=2024-09-14T14:00:26.490072+0000, chain.objs.size()=1 2024-09-14T12:16:15.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.460__shadow_.wplLjhFdW_1J1Z6ANocktLp4fs2PvIb_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3615662751829900656', time=2024-09-14T14:00:30.809077+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.465__shadow_.RYwhtoXzQI0mDDyj8-a96bTuAEmShot_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13303555163493027403', time=2024-09-14T14:00:40.577471+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.7PGK8ZSeNqIcK_oXrzpmtXStlivJt5K_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0', time=2024-09-14T14:01:50.535631+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.522__multipart_mymultipart.2~uZMYQTxmZ0ccCnV-6rl_KABGKa4I4V0.2 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1964935858257157225', time=2024-09-14T14:04:00.832151+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.557__shadow_.jjuWHMz2wDirvGRPu9hHj2uSg_gKazM_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6227517936617216461', time=2024-09-14T14:04:31.852399+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.570__shadow:e5Exry0EbZph1gqIk7FQCCKpfN5RWsU_.XQbr8W_lok6gUCMuWpAAiKOQ-xhnqmz_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14467728982596068029', time=2024-09-14T14:04:31.900981+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.442+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.570__shadow:0Ni1RbFfcjJDrSr1a6Bl-T-zajDQ.wF_.4gqKK3CK5n7zxjCfZOy6Fw-2oON8-A3_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.444+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2100277989769905977', time=2024-09-14T14:04:59.984950+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.444+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:3.OPPkVVxPotfkOOE509PH-nMXWcNLl_._oNY8qPKayIyx_zfvyn8qML15EaGIRU_0 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.444+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16395350424887211253', time=2024-09-14T14:05:02.423509+0000, chain.objs.size()=1 2024-09-14T12:16:15.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.444+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:tKAux0VqtXwZactFjCiWt7xAS2TEU5d_.ut0m1C5b_595PVb1AATYWq2O7DmOHzN_0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10546960033019989151', time=2024-09-14T14:05:21.977974+0000, chain.objs.size()=1 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.579__shadow:XOQhGOhJdnPPUrVxPZkQVlGcuTnUITf_.4MCA_-pAj0nCdVKTukvRYhTjVoUogRm_0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11179744792890203967', time=2024-09-14T14:05:25.900342+0000, chain.objs.size()=1 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.583__shadow:05vR6090wNGWTA-IQ-jeFNzySMwlcDi_.7tCG0EI90T7xUGostAzpXYN8DF8DeQG_0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4264877539446921736', time=2024-09-14T14:09:24.740964+0000, chain.objs.size()=1 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.628__shadow_.lXGSP_kXiIvFp7yIqlT2nXYNpWl3UnJ_0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13650741458670792055', time=2024-09-14T14:09:39.414360+0000, chain.objs.size()=2 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.645__shadow_.lMsiqXReCEuZVB8o6g_8BpKcq1k2TbX_0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.445+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.645__shadow_.lMsiqXReCEuZVB8o6g_8BpKcq1k2TbX_1 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.447+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.449+0000 7f15f1926800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.450+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.451+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:16:15.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/77460' 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_u9nrT3OXBf1sQfpa4foylWrz8sVrk77', time=2024-09-14T13:53:21.557976+0000, chain.objs.size()=3 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.UN8jyyJk9HHYVLSCiSiS7g9pyElFUmX_0 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.UN8jyyJk9HHYVLSCiSiS7g9pyElFUmX_1 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.UN8jyyJk9HHYVLSCiSiS7g9pyElFUmX_2 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='_YWdYvkP14ucSO4AWvPxMAjs1yIFXZc_', time=2024-09-14T13:53:23.724919+0000, chain.objs.size()=3 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.DCdS3WcoBTncZhjod4C-o4jT9BEb0G2_0 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.DCdS3WcoBTncZhjod4C-o4jT9BEb0G2_1 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.161__shadow_.DCdS3WcoBTncZhjod4C-o4jT9BEb0G2_2 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9608552023866994145', time=2024-09-14T13:53:27.540435+0000, chain.objs.size()=2 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.164__multipart_foo.2~eSgyyqkhUXGfhHIYQx_VFywOiVCwqc5.1 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.164__multipart_foo.2~eSgyyqkhUXGfhHIYQx_VFywOiVCwqc5.2 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13263916069696521448', time=2024-09-14T13:55:35.194904+0000, chain.objs.size()=1 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.235__shadow_.-E5FRwLvHz5oCAlpbbMPfHGoPP9uWlV_0 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14346772022456143134', time=2024-09-14T13:55:35.917211+0000, chain.objs.size()=1 2024-09-14T12:16:15.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.236__shadow_.im9_Emn63q-VB73iUovBVVmADEa12Fs_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2332952171237626948', time=2024-09-14T13:55:36.890463+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.237__shadow_.aoAzPKcILUeSv3EpVcVLC7-rCcuzibJ_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1062030893535445785', time=2024-09-14T13:55:48.674302+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.452+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.253__shadow_.0l4bgMbi3IbfgSsAm5PJGLRGgQo3p8M_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.41287407769323747', time=2024-09-14T13:55:49.384565+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.254__shadow_.nOwfqR4SuDzRjqxEusX1IrS5UXMNPO9_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15313255700908232608', time=2024-09-14T13:55:50.744762+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.256__shadow_.V2Y8q2A1YCsRbKMe2visO3lgtabjb7m_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2072087832926661173', time=2024-09-14T13:55:52.044053+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.258__shadow_.7acX7KzbmgNTBkSNZJjdidOMiBQGs0q_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9328502998847995068', time=2024-09-14T13:56:29.590159+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.tkuU94hXDlaocf0x0-d9oMpbQy83eDE_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11069650124119774689', time=2024-09-14T13:56:29.626753+0000, chain.objs.size()=1 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.BbHK1OEXY23VZ3-MIcQ2S6p10LeVUU2_0 2024-09-14T12:16:15.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11047615040732785544', time=2024-09-14T13:56:29.735480+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.wMULxPmtETaW4RJifrFTAq5G7lzHO8S_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15982526660982187956', time=2024-09-14T13:56:29.773500+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.XIRi4CYT5M7BtQT0o9FoH5M76l7BEGj_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5584526300368311593', time=2024-09-14T13:56:29.993441+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.R00RdpwpAnrxpG-FVcmnvUfgDrKy0Yh_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2918573715136204996', time=2024-09-14T13:56:30.365256+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.2EwqYnX1IOeXcDk70sDbqVdhxMLYVpG_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10754660326123116030', time=2024-09-14T13:56:31.527175+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.RuXdjD82ECLAH-OZ2_YoMpGKD8W26Vg_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15565370007820403484', time=2024-09-14T13:56:32.722723+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.455+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.vB3VHCjZBHJMVONq9JPNK2XZiH2bU64_0 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2074348779386226252', time=2024-09-14T13:56:32.907659+0000, chain.objs.size()=1 2024-09-14T12:16:15.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.DhlO1PJzvlkojpx-hs0D7vnmcZGnX68_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1364008866026562194', time=2024-09-14T13:56:33.045230+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.WavpS6BOG076mnyKazh_cxeUJXZRV4b_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8759786185523858480', time=2024-09-14T13:56:33.077445+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.e9ZlwXGcToKryojmYTTdcw8sJ172hX__0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3016494755745454231', time=2024-09-14T13:56:33.231978+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.H7uAUcp4UJShkFItbh5xUHNSye-g4yX_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11169796718233623110', time=2024-09-14T13:56:34.127689+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Asd76mDOj4JEg0_pyIbi3r7IoM4l8on_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7120250359197480413', time=2024-09-14T13:56:34.145775+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.OP9yv_GhxH5YlRzI25xhBkG1gI209VX_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4913554410412956306', time=2024-09-14T13:56:34.431449+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nHDGC-YgePLPirwTVopY5d74CLMQy8I_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12764311516125378135', time=2024-09-14T13:56:35.048116+0000, chain.objs.size()=1 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.YraahauMEm73F_nHpmMkOEzkfU8hMEf_0 2024-09-14T12:16:15.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18444078158057296439', time=2024-09-14T13:56:35.457683+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.nygV1w9z2SGd9jwKtrANdjtBrpJTKGN_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1296591523153717265', time=2024-09-14T13:56:35.575602+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.HOie19-IByDeqdtklV8N7TVSpa7JJbW_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4975942582104613905', time=2024-09-14T13:56:35.672363+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.457+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8jttWQzNIRxHt2M7SFin9QqO-gaTKvx_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.458+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2337245789153587306', time=2024-09-14T13:56:35.865311+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.458+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.sxBs4LjJjL7heIXMJb22R984OQXUDVl_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1056344110470506277', time=2024-09-14T13:56:35.972230+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.IRPrVbDJtjmTzddGJbUlHXpBXuY3LcW_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11061401645746812458', time=2024-09-14T13:56:36.042456+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.KBA0kGcPiiv67UrH_z2kZrG2oyN04Ul_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7632025373366635594', time=2024-09-14T13:56:36.102618+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.veapL0N6-KRnakJ8P5C0dvifBHkAL3a_0 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6860619600981813646', time=2024-09-14T13:56:36.772664+0000, chain.objs.size()=1 2024-09-14T12:16:15.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.LrrKDFE6LxAfwf83KmVsr27QcyPSvl2_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16688202757412783992', time=2024-09-14T13:56:36.790374+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.8o2U0I9bozb4kEX4RkaDXU-VmYMR0uU_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18402413552570888701', time=2024-09-14T13:56:37.634467+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.oEx4Ql5lwHL4nkSDOKnEqe5G2I2vrJT_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11707942733022167341', time=2024-09-14T13:56:37.637535+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.FBVNtR-HzTdjieQNx0dAJozwKQQHgRn_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4680606061857384925', time=2024-09-14T13:56:38.049517+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.34LRgAQw4qBcytmAOI74iymj6ktGzjm_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18302244356014772455', time=2024-09-14T13:56:38.085020+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.Ia1i2cQiAxeypuegByLuQE4zq9Bhtm__0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16863183521009441304', time=2024-09-14T13:56:38.086800+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.459+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.draP-YC-0Zkr-no4BO5PagpL0dRewez_0 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.460+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17545098656658885755', time=2024-09-14T13:56:38.980481+0000, chain.objs.size()=1 2024-09-14T12:16:15.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.460+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.axu_qfTdbhz-EZVynnhyUx_Akw3c4wN_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11221409810696698681', time=2024-09-14T13:56:39.032257+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.-AHYvi3RSJQWxiK8hfsLHw_BKg_-cVy_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15278482536045945576', time=2024-09-14T13:56:39.166812+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.VOnbEy0fJ13w7tGuTEKQ1XYkGnRGPKs_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2050467541399686237', time=2024-09-14T13:56:40.128655+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.R93evDEV8QyN_ft89ELwrOlBrB6r2ej_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9723632726977011342', time=2024-09-14T13:56:40.174943+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.262__shadow_.gOxMI-1yRKxQWeqH0N9OWgHFIX8OIgP_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8625510934383727805', time=2024-09-14T13:56:46.281869+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.271__shadow_.r7U1Mfeh9z5GcURpDRQNL9LI2kWwVIc_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16699241749414553355', time=2024-09-14T13:56:53.050985+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.281__shadow_.NBqO_ivAF2UFbt-OJnt8HWxwL_R4yKY_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18244387957891829267', time=2024-09-14T13:57:04.060923+0000, chain.objs.size()=1 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.461+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.8ZmNkYtgd5CEKOYLtleIZrEHJutGAwt_0 2024-09-14T12:16:15.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12946804478974651204', time=2024-09-14T13:57:04.114812+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.JHepZvBDXma4lPDiPy3sfqk6neBkXkY_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15372082028348325929', time=2024-09-14T13:57:04.176215+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.293__shadow_.R8CF_Lqcf9FgcpOD1zNlrP7TNc4NrTT_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13190207166828629992', time=2024-09-14T13:57:11.404574+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.303__shadow_.XapbnQrnadN5_m3N8Og9RcX2955OhBW_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15619676862574360372', time=2024-09-14T13:57:14.890421+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.462+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.307__shadow:Zd-Mi53rM9miOYjSlvVGr3Ctd.kcnX6_.TjkGtTCidZkh3gHwqUtpczDDbY3MV1h_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1424620627490881004', time=2024-09-14T13:58:02.216942+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.mMW97vlpUAAqdCQ5L6q65Y3WlYI9Z7__0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.463+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2005507710285472336', time=2024-09-14T13:58:02.860312+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.463+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.2MtuBiqAnyjbtaYpFYIAJNdjiMjuF0c_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.826855758810015196', time=2024-09-14T13:58:03.219462+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.0P4UIkOjvZL9hEJRGa_QyR3YQpf-JTD_0 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15454568970315920310', time=2024-09-14T13:58:03.241638+0000, chain.objs.size()=1 2024-09-14T12:16:15.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JIlsHpRbzUn1v25igU2cU02hTLzs3JV_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15831884379021039772', time=2024-09-14T13:58:03.249755+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.z6XXEQAgeXcCTk0WV8RPESa4xKPN0wH_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2526547945507131634', time=2024-09-14T13:58:03.769860+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.TLhGam2fY0_C_8kdu0jZr6Jtma0heuR_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11648557254446591439', time=2024-09-14T13:58:03.776699+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rOZR1g0haq9DPBYPEb2kRehSA-delwz_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14700689917651794443', time=2024-09-14T13:58:04.152241+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.Y2oCEp4SQj9cstf0m-cynGZ0M7AF1Iu_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6155741358952069759', time=2024-09-14T13:58:04.327479+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.zurYLZTbhdbWdtfSfUA_zHzaq0Bspa3_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13428883111695250146', time=2024-09-14T13:58:05.165943+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.oQ5-vr4mjcE_YKQNejcW4eKhNm_GORI_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10160162636714140205', time=2024-09-14T13:58:05.411370+0000, chain.objs.size()=1 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.464+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xc9V__fLuEUgJ--4KV_DYiy1h4MlckG_0 2024-09-14T12:16:15.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15687144542857823621', time=2024-09-14T13:58:05.569448+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.xXHxotkGkRYn5tl394CjZO2Gl3GQbCr_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9108085798624020075', time=2024-09-14T13:58:05.916426+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.cSQhcWSaxgIPpybHAKyk9QOwl60fiM1_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11546981530993694283', time=2024-09-14T13:58:06.576881+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.3Vc3aXZ0LT5-t8yfgsXSbDHNYKnnjdk_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9960585485267519859', time=2024-09-14T13:58:06.943165+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.amtGLDfoWH79hCbApTY_keZYqFr7vRc_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10388717519320172187', time=2024-09-14T13:58:07.039758+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.465+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.i6yKAiywRbbJlviy6B7Htyf5qEwe5Yj_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12090176630735109707', time=2024-09-14T13:58:07.083114+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.fYpEYgl0O9eQNXpYT8CGL4ET68T_zOa_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10701553116662283038', time=2024-09-14T13:58:07.222206+0000, chain.objs.size()=1 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.g94h-vYl7idjX07-T9hYwoDot9xHnzs_0 2024-09-14T12:16:15.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15123973716026443309', time=2024-09-14T13:58:09.757279+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.8l_rTb3Swa47TrjO00nJZPhsHmITBHO_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5504509404831907254', time=2024-09-14T13:58:10.147876+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.JG6tlQPsLGzAleqxWDPrzb-oqaMYVmA_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4627193318917068199', time=2024-09-14T13:58:10.548406+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.466+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.HwtzfLoIq9Jd-aTW9rLxy8PvAIyIJrk_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10797770787829600920', time=2024-09-14T13:58:10.549025+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.6IuiwbWfzhlG8dvRYZrCNK6TnH5gT0H_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17933519116627209313', time=2024-09-14T13:58:10.787280+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.bsD9GJUC3T_iNdW9uhwfvX6rPt_U9Bk_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6402378962031132658', time=2024-09-14T13:58:10.962606+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.467+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.geU1Xwq-IcizlXq3g-WpAu0WBGuVhrx_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1942728607611333811', time=2024-09-14T13:58:11.054554+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.hn1c7l6udyXhjn3ZVo2VUVs3W4W4FB0_0 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8565542027180031351', time=2024-09-14T13:58:11.070455+0000, chain.objs.size()=1 2024-09-14T12:16:15.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.ErpaQcIUc3oKlJODS4bQ7VH89MffPcg_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11023466748179895455', time=2024-09-14T13:58:11.348644+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.323__shadow_.rBi7VS81tX09yfC1x75d0UNzPT_vgPR_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2240216150212440159', time=2024-09-14T13:58:50.718268+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.b6yF7THE0Z6sZMD4brr1Hj35WEKq0qZ_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2864947044643261769', time=2024-09-14T13:58:50.809441+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.bQZWjrMFwSetCIDX4LqgA5RHVQ99WlP_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3505104869359226119', time=2024-09-14T13:58:51.135925+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.qqMWXySKrPVbJYGbFs0LwdjvZjQPbUH_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9150540480264639196', time=2024-09-14T13:58:51.178535+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.T122o0m6c_mwVYLY5GX-LEu9F5KqzZX_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14563878629539053489', time=2024-09-14T13:58:51.396193+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.x2sTlRQ7G9duyaqJEXKanTU6gq8XZIB_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3205778666935149871', time=2024-09-14T13:58:51.930012+0000, chain.objs.size()=1 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.468+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ldzgjmZ8DE5V74sw2gh39iTFcy5B-_y_0 2024-09-14T12:16:15.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.469+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12107912935762549935', time=2024-09-14T13:58:52.108591+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.469+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.zYANW8pL_LbNmR_lBtIpWxmlb-o0-9y_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.469+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5242609919762534189', time=2024-09-14T13:58:52.350410+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.469+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.MdGdlPS4WdboK6axpwNvCcj2Lt-aybr_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4471677585327580620', time=2024-09-14T13:58:52.398160+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.YQWOzt8659mZGmWT5ULQkLbd6WaFDsm_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12229368262037635246', time=2024-09-14T13:58:53.365595+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.h8qo9oyovsHeemzK3PUKzzAeXEnHTSv_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12485850505413943451', time=2024-09-14T13:58:53.641383+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.lyj7Hzn1G_PcCcU7hvgxIG9wKKsNNM-_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10120635562983764089', time=2024-09-14T13:58:53.765287+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.q7BVMRbJGfSFcA_yLbaC18MtDENFPJq_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1092985594284519592', time=2024-09-14T13:58:53.872128+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8i7bPLJv5k84_oIVfMMz1DWpR54HcX8_0 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2993215202288368915', time=2024-09-14T13:58:54.196546+0000, chain.objs.size()=1 2024-09-14T12:16:15.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.aJh4-lJhVgmRVrLrQvefb-x0RF0Um9O_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2316524312466278214', time=2024-09-14T13:58:54.748765+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.x922Or3yOPzm_QZS98CaUukn-Rwy96t_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1800691364260878519', time=2024-09-14T13:58:55.055608+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.vYrzkxWC4CKQpHylNXr6TEg_KN4ax3x_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8455466664438674543', time=2024-09-14T13:58:55.058971+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.Y2AGIMJPQee4fp6THCZJ_yspwlkOx4f_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9879668726911245418', time=2024-09-14T13:58:55.752132+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.8MemeMUaapXdZry-uygmcXbkbwFqsOw_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1650454289865222805', time=2024-09-14T13:58:56.409075+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.471+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.9d2XgSHx29Yb4utjXZdJU3T-HLb1q_m_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.473+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9090346611650988727', time=2024-09-14T13:58:56.670789+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.473+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.PAegeRrAgUjWtaOJbB_aj7VH4fQffoS_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.473+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1711757076172875632', time=2024-09-14T13:58:57.374044+0000, chain.objs.size()=1 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.473+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.L497GyFji5m02I3e1BD3boUmBn8wvBn_0 2024-09-14T12:16:15.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.474+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 0/77460 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.18032315660958690271', time=2024-09-14T13:58:57.732938+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.jf8gML66M5Bt_ReM7iM2DcIhTCDe6DE_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.2745199823048589870', time=2024-09-14T13:58:57.839847+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_._1_oXDmwDI0tQ1XAKMHN340hqFzc1A5_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12536035595975708112', time=2024-09-14T13:58:58.059502+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.ctl9-ScrNbRMuTrrjz2rydAkxvg9gQw_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.3468581959782742005', time=2024-09-14T13:58:58.166843+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.RWWwLwyn4nrtOpVYSaUyawrbmY9dq95_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.17247133842819568810', time=2024-09-14T13:58:59.341410+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.W1-xAPiC28zJFt5asVCHAsJ1fOoVcrZ_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.13603177725274635363', time=2024-09-14T13:58:59.755479+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.324__shadow_.R2ZHgHXtQy7bN1P6MSf1Qkw4sh2Mxqg_0 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.11432185225663685588', time=2024-09-14T13:59:05.458754+0000, chain.objs.size()=1 2024-09-14T12:16:15.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.333__shadow_.k_1mgFgNBh_RcxswHnvZhBhwbIHTbpS_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6141912336509078383', time=2024-09-14T13:59:16.762898+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.353__shadow_.f6ZPwJ-qA2iTLUglxpzx_b36C8-eWcl_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.14350433478516236623', time=2024-09-14T13:59:32.414875+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.379__shadow_.e55u_lq9s1gvs63CyE3_DLFIzTLpdh9_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4876235166865940767', time=2024-09-14T13:59:33.927187+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.381__shadow_.SfZmympCxW9MbboG6YOJUekQlj4sGyj_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7104616648241201950', time=2024-09-14T14:00:24.675290+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.458__shadow_.beR6SVzh4dYIwqGMgPyssZpbKjgSwXo_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7822139360053980195', time=2024-09-14T14:00:25.590033+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.477+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.459__shadow_.E5bpk9L5c5E8vh0ehjbHEvjyw4DvL7m_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.478+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1725075442335597267', time=2024-09-14T14:00:29.263195+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.478+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.463__shadow_.v9WSySPE_9z-c46J503zGlcHNCj_9-v_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.7111961168510930208', time=2024-09-14T14:00:40.595673+0000, chain.objs.size()=1 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.483__shadow_.cDxGrWWCdP1nd2pmKbKQkI6RsvBD-NM_0 2024-09-14T12:16:15.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.15040693176003894625', time=2024-09-14T14:00:53.747533+0000, chain.objs.size()=1 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.500__shadow_.saCeywKA6vD9zdZi0YhnQCoFx_KY9PP_0 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12648163750105221162', time=2024-09-14T14:01:03.703234+0000, chain.objs.size()=6 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.1 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.2 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.3 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.4 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.5 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.507__multipart_srcmultipart.2~wkCJhPLZeEEbxgNR2BpmzpqNAJDC-0M.6 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.1752597745865429536', time=2024-09-14T14:02:29.757745+0000, chain.objs.size()=1 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~bVBAXIsBr-3Mb_659LuYloXiW7wzSfS.1 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10193000665295589506', time=2024-09-14T14:02:36.384800+0000, chain.objs.size()=3 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.479+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~vJiS67ijBwnGSvv3cROrXcEp85qJFJW.1 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.480+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~vJiS67ijBwnGSvv3cROrXcEp85qJFJW.2 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.523__multipart_mymultipart.2~vJiS67ijBwnGSvv3cROrXcEp85qJFJW.3 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.481+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6375423252873353068', time=2024-09-14T14:02:43.826848+0000, chain.objs.size()=2 2024-09-14T12:16:15.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.481+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~ORnM5VGThulRxLFeLWgxsTE1svTAjwS.1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~ORnM5VGThulRxLFeLWgxsTE1svTAjwS.2 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.582995092861895563', time=2024-09-14T14:02:48.974213+0000, chain.objs.size()=4 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~PNAOR-0R4nsLf4v6SQJ4k32MsACA4LI.1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__shadow_mymultipart.2~PNAOR-0R4nsLf4v6SQJ4k32MsACA4LI.1_1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__multipart_mymultipart.2~PNAOR-0R4nsLf4v6SQJ4k32MsACA4LI.2 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.525__shadow_mymultipart.2~PNAOR-0R4nsLf4v6SQJ4k32MsACA4LI.2_1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1', time=2024-09-14T14:03:09.610004+0000, chain.objs.size()=2 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__multipart_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.3 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.535__shadow_mymultipart.2~19Ij1l4zBurSyOkYOxHNj6PFnt_9Pl1.3_1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16015971100741605815', time=2024-09-14T14:04:10.668135+0000, chain.objs.size()=1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.562__shadow_.B8akng5ABGMfH0evMQJ6LaEABN2pS3c_0 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.4248844595271394243', time=2024-09-14T14:04:28.938414+0000, chain.objs.size()=1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.482+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.569__shadow:Ac3DY9fYi645KGhxhYrmnt8nKFNZEFw_.WvduJ-VSZ1mjQWOYtowbPLzOGAECAsy_0 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12134369320999950265', time=2024-09-14T14:05:04.509166+0000, chain.objs.size()=1 2024-09-14T12:16:15.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.577__shadow:9Mw-9vpg3yCZFKsUVopQS79glOoWUhk_.IiSEyCmjQyD2XX8IXr5klk93w44xFyJ_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12817844787528619486', time=2024-09-14T14:08:48.831799+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.618__shadow_.iNQxZJG0mnUIQjlK6dOydsq4E8HNE1U_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16660518895276372080', time=2024-09-14T14:09:26.231780+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.630__shadow_.gLPONW9vbe4MNb36DFuN-bmYFB8HgOv_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.12451201663647898301', time=2024-09-14T14:09:29.511315+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.635__shadow_.RXepbAxhxsNAU2sUIu087QbwuDNTUsx_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.8156293415586879573', time=2024-09-14T14:09:47.116407+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.650__shadow_.cOJBNucG7S-QXhZviAMXcSVZb9-tnPs_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5448788171919496482', time=2024-09-14T14:10:15.134865+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.671__shadow_.CmOwuPIAgUkoaBEuaV1JBu6IZkaofHP_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.10856084240621490163', time=2024-09-14T14:10:15.391066+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.672__shadow_.pl2KbzfjPipHvLcFxzFdewsMgbFQAzQ_0 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.6467218198397476232', time=2024-09-14T14:10:19.512509+0000, chain.objs.size()=1 2024-09-14T12:16:15.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.679__shadow_.eVGmPb4vuUc0R0iCHYQ1IcAkMXSKVVA_0 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9508052792998742694', time=2024-09-14T14:10:34.408734+0000, chain.objs.size()=1 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.703__shadow:go6L8BCcMllBI3nVPpfpQeBcSrZfZt3_.bm8VGDusyc4pnz9XpzPM9Oc5vJQI3rS_0 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.9959883888279489335', time=2024-09-14T14:10:35.048162+0000, chain.objs.size()=1 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.704__shadow:KR04Ba4BwZUhndhMZh.nnYM.yqqDbD7_.3FfCwnwfDhd2mhCd3eBsazBZdO6Sux1_0 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.16888872967262527679', time=2024-09-14T14:11:03.786514+0000, chain.objs.size()=1 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.484+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.718__shadow_.wUhl_F7NIwDjw0rtTdQz7VVHQ-mhjCw_0 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.486+0000 7f15f1926800 20 garbage collection: RGWGC::process iterating over entry tag='38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.5969644677739882559', time=2024-09-14T14:11:04.477268+0000, chain.objs.size()=1 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.486+0000 7f15f1926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:38a4cafb-e998-4940-b6f4-48d3d00371d5.4579.719__shadow_.GRdN8aXdVgWM_s278ttwiA4tsWbgcOT_0 2024-09-14T12:16:15.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.487+0000 7f15f1926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:16:15.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.490+0000 7f14a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.492+0000 7f15f1926800 20 remove_watcher() i=0 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.492+0000 7f15f1926800 2 removed watcher, disabling cache 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.493+0000 7f15f1926800 20 remove_watcher() i=1 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.494+0000 7f15f1926800 20 remove_watcher() i=2 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.495+0000 7f15f1926800 20 remove_watcher() i=3 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.496+0000 7f15f1926800 20 remove_watcher() i=4 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.497+0000 7f15f1926800 20 remove_watcher() i=5 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.498+0000 7f15f1926800 20 remove_watcher() i=6 2024-09-14T12:16:15.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T12:16:15.499+0000 7f15f1926800 20 remove_watcher() i=7 2024-09-14T12:16:15.521 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T12:16:15.530 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T12:16:15.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T12:16:15.554 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:16:15.879 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:15.890 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:16:15.892 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2033,"stamp":"2024-09-14T12:16:15.254145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":626082067,"num_objects":4911,"num_object_clones":0,"num_object_copies":9822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4911,"num_whiteouts":0,"num_read":308460,"num_read_kb":2439320,"num_write":161765,"num_write_kb":2394034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13942,"ondisk_log_size":13942,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2707184,"kb_used_data":1282096,"kb_used_omap":12,"kb_used_meta":1424947,"kb_avail":752267536,"statfs":{"total":773094113280,"available":770321956864,"internally_reserved":0,"allocated":1312866304,"data_stored":1267975418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1459146291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005414"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213341+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:12:33.213341+0000","last_peered":"2024-09-14T12:12:33.213341+0000","last_clean":"2024-09-14T12:12:33.213341+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:12:33.213341+0000","last_undegraded":"2024-09-14T12:12:33.213341+0000","last_fullsized":"2024-09-14T12:12:33.213341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311879+0000","last_change":"2024-09-14T11:51:07.025774+0000","last_active":"2024-09-14T12:13:38.311879+0000","last_peered":"2024-09-14T12:13:38.311879+0000","last_clean":"2024-09-14T12:13:38.311879+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:13:38.311879+0000","last_undegraded":"2024-09-14T12:13:38.311879+0000","last_fullsized":"2024-09-14T12:13:38.311879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.449121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201523+0000","last_change":"2024-09-14T11:35:00.449276+0000","last_active":"2024-09-14T12:12:33.201523+0000","last_peered":"2024-09-14T12:12:33.201523+0000","last_clean":"2024-09-14T12:12:33.201523+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:12:33.201523+0000","last_undegraded":"2024-09-14T12:12:33.201523+0000","last_fullsized":"2024-09-14T12:12:33.201523+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:28.070565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":2,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313986+0000","last_change":"2024-09-14T11:31:47.462526+0000","last_active":"2024-09-14T12:13:58.313986+0000","last_peered":"2024-09-14T12:13:58.313986+0000","last_clean":"2024-09-14T12:13:58.313986+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:13:58.313986+0000","last_undegraded":"2024-09-14T12:13:58.313986+0000","last_fullsized":"2024-09-14T12:13:58.313986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:37.396723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.448111+0000","last_change":"2024-09-14T11:51:07.028080+0000","last_active":"2024-09-14T12:12:53.448111+0000","last_peered":"2024-09-14T12:12:53.448111+0000","last_clean":"2024-09-14T12:12:53.448111+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:12:53.448111+0000","last_undegraded":"2024-09-14T12:12:53.448111+0000","last_fullsized":"2024-09-14T12:12:53.448111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.359237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447637+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:12:35.447637+0000","last_peered":"2024-09-14T12:12:35.447637+0000","last_clean":"2024-09-14T12:12:35.447637+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:12:35.447637+0000","last_undegraded":"2024-09-14T12:12:35.447637+0000","last_fullsized":"2024-09-14T12:12:35.447637+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:50.280918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.309024+0000","last_change":"2024-09-14T11:35:00.438757+0000","last_active":"2024-09-14T12:13:13.309024+0000","last_peered":"2024-09-14T12:13:13.309024+0000","last_clean":"2024-09-14T12:13:13.309024+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:13:13.309024+0000","last_undegraded":"2024-09-14T12:13:13.309024+0000","last_fullsized":"2024-09-14T12:13:13.309024+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:50.182947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:50.442209+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:11:50.442209+0000","last_peered":"2024-09-14T12:11:50.442209+0000","last_clean":"2024-09-14T12:11:50.442209+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:11:50.442209+0000","last_undegraded":"2024-09-14T12:11:50.442209+0000","last_fullsized":"2024-09-14T12:11:50.442209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:01.804143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215760+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:13:13.215760+0000","last_peered":"2024-09-14T12:13:13.215760+0000","last_clean":"2024-09-14T12:13:13.215760+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:13:13.215760+0000","last_undegraded":"2024-09-14T12:13:13.215760+0000","last_fullsized":"2024-09-14T12:13:13.215760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328354+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:12:33.328354+0000","last_peered":"2024-09-14T12:12:33.328354+0000","last_clean":"2024-09-14T12:12:33.328354+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:12:33.328354+0000","last_undegraded":"2024-09-14T12:12:33.328354+0000","last_fullsized":"2024-09-14T12:12:33.328354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.966334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205890+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:11:48.205890+0000","last_peered":"2024-09-14T12:11:48.205890+0000","last_clean":"2024-09-14T12:11:48.205890+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:11:48.205890+0000","last_undegraded":"2024-09-14T12:11:48.205890+0000","last_fullsized":"2024-09-14T12:11:48.205890+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:51.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.321996+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:11:23.321996+0000","last_peered":"2024-09-14T12:11:23.321996+0000","last_clean":"2024-09-14T12:11:23.321996+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:11:23.321996+0000","last_undegraded":"2024-09-14T12:11:23.321996+0000","last_fullsized":"2024-09-14T12:11:23.321996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":10,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205846+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:11:48.205846+0000","last_peered":"2024-09-14T12:11:48.205846+0000","last_clean":"2024-09-14T12:11:48.205846+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:11:48.205846+0000","last_undegraded":"2024-09-14T12:11:48.205846+0000","last_fullsized":"2024-09-14T12:11:48.205846+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211503+0000","last_change":"2024-09-14T11:51:07.022651+0000","last_active":"2024-09-14T12:14:03.211503+0000","last_peered":"2024-09-14T12:14:03.211503+0000","last_clean":"2024-09-14T12:14:03.211503+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:14:03.211503+0000","last_undegraded":"2024-09-14T12:14:03.211503+0000","last_fullsized":"2024-09-14T12:14:03.211503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:59.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455134+0000","last_change":"2024-09-14T11:35:03.472494+0000","last_active":"2024-09-14T12:13:43.455134+0000","last_peered":"2024-09-14T12:13:43.455134+0000","last_clean":"2024-09-14T12:13:43.455134+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:13:43.455134+0000","last_undegraded":"2024-09-14T12:13:43.455134+0000","last_fullsized":"2024-09-14T12:13:43.455134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:49.051891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.317809+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:11:23.317809+0000","last_peered":"2024-09-14T12:11:23.317809+0000","last_clean":"2024-09-14T12:11:23.317809+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:11:23.317809+0000","last_undegraded":"2024-09-14T12:11:23.317809+0000","last_fullsized":"2024-09-14T12:11:23.317809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.439584+0000","last_change":"2024-09-14T11:31:47.462449+0000","last_active":"2024-09-14T12:11:48.439584+0000","last_peered":"2024-09-14T12:11:48.439584+0000","last_clean":"2024-09-14T12:11:48.439584+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:11:48.439584+0000","last_undegraded":"2024-09-14T12:11:48.439584+0000","last_fullsized":"2024-09-14T12:11:48.439584+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:14.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445264+0000","last_change":"2024-09-14T11:35:03.473587+0000","last_active":"2024-09-14T12:12:33.445264+0000","last_peered":"2024-09-14T12:12:33.445264+0000","last_clean":"2024-09-14T12:12:33.445264+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:12:33.445264+0000","last_undegraded":"2024-09-14T12:12:33.445264+0000","last_fullsized":"2024-09-14T12:12:33.445264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.755910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'13","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211025+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:12:33.211025+0000","last_peered":"2024-09-14T12:12:33.211025+0000","last_clean":"2024-09-14T12:12:33.211025+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:12:33.211025+0000","last_undegraded":"2024-09-14T12:12:33.211025+0000","last_fullsized":"2024-09-14T12:12:33.211025+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":17412,"num_write":23,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.203551+0000","last_change":"2024-09-14T11:31:47.457527+0000","last_active":"2024-09-14T12:12:53.203551+0000","last_peered":"2024-09-14T12:12:53.203551+0000","last_clean":"2024-09-14T12:12:53.203551+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:12:53.203551+0000","last_undegraded":"2024-09-14T12:12:53.203551+0000","last_fullsized":"2024-09-14T12:12:53.203551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:10.893316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.198600+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:12:08.198600+0000","last_peered":"2024-09-14T12:12:08.198600+0000","last_clean":"2024-09-14T12:12:08.198600+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:12:08.198600+0000","last_undegraded":"2024-09-14T12:12:08.198600+0000","last_fullsized":"2024-09-14T12:12:08.198600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:27.310781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331145+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:12:28.331145+0000","last_peered":"2024-09-14T12:12:28.331145+0000","last_clean":"2024-09-14T12:12:28.331145+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:12:28.331145+0000","last_undegraded":"2024-09-14T12:12:28.331145+0000","last_fullsized":"2024-09-14T12:12:28.331145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6146,"num_write":4,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.302497+0000","last_change":"2024-09-14T11:51:07.028060+0000","last_active":"2024-09-14T12:12:08.302497+0000","last_peered":"2024-09-14T12:12:08.302497+0000","last_clean":"2024-09-14T12:12:08.302497+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:12:08.302497+0000","last_undegraded":"2024-09-14T12:12:08.302497+0000","last_fullsized":"2024-09-14T12:12:08.302497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.552311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.453694+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:12:08.453694+0000","last_peered":"2024-09-14T12:12:08.453694+0000","last_clean":"2024-09-14T12:12:08.453694+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:12:08.453694+0000","last_undegraded":"2024-09-14T12:12:08.453694+0000","last_fullsized":"2024-09-14T12:12:08.453694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:12.592203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219471+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:13:43.219471+0000","last_peered":"2024-09-14T12:13:43.219471+0000","last_clean":"2024-09-14T12:13:43.219471+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:13:43.219471+0000","last_undegraded":"2024-09-14T12:13:43.219471+0000","last_fullsized":"2024-09-14T12:13:43.219471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":13,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312475+0000","last_change":"2024-09-14T11:35:00.443367+0000","last_active":"2024-09-14T12:13:43.312475+0000","last_peered":"2024-09-14T12:13:43.312475+0000","last_clean":"2024-09-14T12:13:43.312475+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:13:43.312475+0000","last_undegraded":"2024-09-14T12:13:43.312475+0000","last_fullsized":"2024-09-14T12:13:43.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:39.932103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.307053+0000","last_change":"2024-09-14T11:31:47.459863+0000","last_active":"2024-09-14T12:12:53.307053+0000","last_peered":"2024-09-14T12:12:53.307053+0000","last_clean":"2024-09-14T12:12:53.307053+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:12:53.307053+0000","last_undegraded":"2024-09-14T12:12:53.307053+0000","last_fullsized":"2024-09-14T12:12:53.307053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.115513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.328248+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:12:08.328248+0000","last_peered":"2024-09-14T12:12:08.328248+0000","last_clean":"2024-09-14T12:12:08.328248+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:12:08.328248+0000","last_undegraded":"2024-09-14T12:12:08.328248+0000","last_fullsized":"2024-09-14T12:12:08.328248+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:28.383593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338233+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:13:43.338233+0000","last_peered":"2024-09-14T12:13:43.338233+0000","last_clean":"2024-09-14T12:13:43.338233+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:13:43.338233+0000","last_undegraded":"2024-09-14T12:13:43.338233+0000","last_fullsized":"2024-09-14T12:13:43.338233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200369+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:12:23.200369+0000","last_peered":"2024-09-14T12:12:23.200369+0000","last_clean":"2024-09-14T12:12:23.200369+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:12:23.200369+0000","last_undegraded":"2024-09-14T12:12:23.200369+0000","last_fullsized":"2024-09-14T12:12:23.200369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.326665+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:12:23.326665+0000","last_peered":"2024-09-14T12:12:23.326665+0000","last_clean":"2024-09-14T12:12:23.326665+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:12:23.326665+0000","last_undegraded":"2024-09-14T12:12:23.326665+0000","last_fullsized":"2024-09-14T12:12:23.326665+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200345+0000","last_change":"2024-09-14T11:35:03.476474+0000","last_active":"2024-09-14T12:12:23.200345+0000","last_peered":"2024-09-14T12:12:23.200345+0000","last_clean":"2024-09-14T12:12:23.200345+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:12:23.200345+0000","last_undegraded":"2024-09-14T12:12:23.200345+0000","last_fullsized":"2024-09-14T12:12:23.200345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:43.941080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209824+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:12:23.209824+0000","last_peered":"2024-09-14T12:12:23.209824+0000","last_clean":"2024-09-14T12:12:23.209824+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:12:23.209824+0000","last_undegraded":"2024-09-14T12:12:23.209824+0000","last_fullsized":"2024-09-14T12:12:23.209824+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:15.445086+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:12:15.445086+0000","last_peered":"2024-09-14T12:12:15.445086+0000","last_clean":"2024-09-14T12:12:15.445086+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:12:15.445086+0000","last_undegraded":"2024-09-14T12:12:15.445086+0000","last_fullsized":"2024-09-14T12:12:15.445086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:16.454913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209866+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:12:23.209866+0000","last_peered":"2024-09-14T12:12:23.209866+0000","last_clean":"2024-09-14T12:12:23.209866+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:12:23.209866+0000","last_undegraded":"2024-09-14T12:12:23.209866+0000","last_fullsized":"2024-09-14T12:12:23.209866+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7286,"num_write":3,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'10","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443925+0000","last_change":"2024-09-14T11:35:00.447506+0000","last_active":"2024-09-14T12:12:23.443925+0000","last_peered":"2024-09-14T12:12:23.443925+0000","last_clean":"2024-09-14T12:12:23.443925+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:12:23.443925+0000","last_undegraded":"2024-09-14T12:12:23.443925+0000","last_fullsized":"2024-09-14T12:12:23.443925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:00.533644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443907+0000","last_change":"2024-09-14T11:35:03.480075+0000","last_active":"2024-09-14T12:12:23.443907+0000","last_peered":"2024-09-14T12:12:23.443907+0000","last_clean":"2024-09-14T12:12:23.443907+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:12:23.443907+0000","last_undegraded":"2024-09-14T12:12:23.443907+0000","last_fullsized":"2024-09-14T12:12:23.443907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:33.496292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330297+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:12:23.330297+0000","last_peered":"2024-09-14T12:12:23.330297+0000","last_clean":"2024-09-14T12:12:23.330297+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:12:23.330297+0000","last_undegraded":"2024-09-14T12:12:23.330297+0000","last_fullsized":"2024-09-14T12:12:23.330297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.306990+0000","last_change":"2024-09-14T11:51:07.027822+0000","last_active":"2024-09-14T12:12:53.306990+0000","last_peered":"2024-09-14T12:12:53.306990+0000","last_clean":"2024-09-14T12:12:53.306990+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:12:53.306990+0000","last_undegraded":"2024-09-14T12:12:53.306990+0000","last_fullsized":"2024-09-14T12:12:53.306990+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:23.309895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216361+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:13:18.216361+0000","last_peered":"2024-09-14T12:13:18.216361+0000","last_clean":"2024-09-14T12:13:18.216361+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:13:18.216361+0000","last_undegraded":"2024-09-14T12:13:18.216361+0000","last_fullsized":"2024-09-14T12:13:18.216361+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.309609+0000","last_change":"2024-09-14T11:35:00.448968+0000","last_active":"2024-09-14T12:13:18.309609+0000","last_peered":"2024-09-14T12:13:18.309609+0000","last_clean":"2024-09-14T12:13:18.309609+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:13:18.309609+0000","last_undegraded":"2024-09-14T12:13:18.309609+0000","last_fullsized":"2024-09-14T12:13:18.309609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.693742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.329763+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:12:18.329763+0000","last_peered":"2024-09-14T12:12:18.329763+0000","last_clean":"2024-09-14T12:12:18.329763+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:12:18.329763+0000","last_undegraded":"2024-09-14T12:12:18.329763+0000","last_fullsized":"2024-09-14T12:12:18.329763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:10.558327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.447497+0000","last_change":"2024-09-14T11:51:07.027403+0000","last_active":"2024-09-14T12:12:48.447497+0000","last_peered":"2024-09-14T12:12:48.447497+0000","last_clean":"2024-09-14T12:12:48.447497+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:12:48.447497+0000","last_undegraded":"2024-09-14T12:12:48.447497+0000","last_fullsized":"2024-09-14T12:12:48.447497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:41.431415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207455+0000","last_change":"2024-09-14T11:35:03.477782+0000","last_active":"2024-09-14T12:13:28.207455+0000","last_peered":"2024-09-14T12:13:28.207455+0000","last_clean":"2024-09-14T12:13:28.207455+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:13:28.207455+0000","last_undegraded":"2024-09-14T12:13:28.207455+0000","last_fullsized":"2024-09-14T12:13:28.207455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:40.078111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.443370+0000","last_change":"2024-09-14T11:31:47.459051+0000","last_active":"2024-09-14T12:12:18.443370+0000","last_peered":"2024-09-14T12:12:18.443370+0000","last_clean":"2024-09-14T12:12:18.443370+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:12:18.443370+0000","last_undegraded":"2024-09-14T12:12:18.443370+0000","last_fullsized":"2024-09-14T12:12:18.443370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:51.494106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207443+0000","last_change":"2024-09-14T11:35:00.446767+0000","last_active":"2024-09-14T12:13:28.207443+0000","last_peered":"2024-09-14T12:13:28.207443+0000","last_clean":"2024-09-14T12:13:28.207443+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:13:28.207443+0000","last_undegraded":"2024-09-14T12:13:28.207443+0000","last_fullsized":"2024-09-14T12:13:28.207443+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:07.682575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.303508+0000","last_change":"2024-09-14T11:31:47.461172+0000","last_active":"2024-09-14T12:12:18.303508+0000","last_peered":"2024-09-14T12:12:18.303508+0000","last_clean":"2024-09-14T12:12:18.303508+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:12:18.303508+0000","last_undegraded":"2024-09-14T12:12:18.303508+0000","last_fullsized":"2024-09-14T12:12:18.303508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:24.137730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341112+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:14:03.341112+0000","last_peered":"2024-09-14T12:14:03.341112+0000","last_clean":"2024-09-14T12:14:03.341112+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:14:03.341112+0000","last_undegraded":"2024-09-14T12:14:03.341112+0000","last_fullsized":"2024-09-14T12:14:03.341112+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9588,"num_write":4,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:00.457511+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:14:00.457511+0000","last_peered":"2024-09-14T12:14:00.457511+0000","last_clean":"2024-09-14T12:14:00.457511+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:14:00.457511+0000","last_undegraded":"2024-09-14T12:14:00.457511+0000","last_fullsized":"2024-09-14T12:14:00.457511+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:20.445608+0000","last_change":"2024-09-14T11:31:47.455100+0000","last_active":"2024-09-14T12:12:20.445608+0000","last_peered":"2024-09-14T12:12:20.445608+0000","last_clean":"2024-09-14T12:12:20.445608+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:12:20.445608+0000","last_undegraded":"2024-09-14T12:12:20.445608+0000","last_fullsized":"2024-09-14T12:12:20.445608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:09.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211406+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:14:03.211406+0000","last_peered":"2024-09-14T12:14:03.211406+0000","last_clean":"2024-09-14T12:14:03.211406+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:14:03.211406+0000","last_undegraded":"2024-09-14T12:14:03.211406+0000","last_fullsized":"2024-09-14T12:14:03.211406+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464147+0000","last_change":"2024-09-14T11:31:47.454175+0000","last_active":"2024-09-14T12:13:03.464147+0000","last_peered":"2024-09-14T12:13:03.464147+0000","last_clean":"2024-09-14T12:13:03.464147+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:13:03.464147+0000","last_undegraded":"2024-09-14T12:13:03.464147+0000","last_fullsized":"2024-09-14T12:13:03.464147+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.297114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.206264+0000","last_change":"2024-09-14T11:35:03.477505+0000","last_active":"2024-09-14T12:13:18.206264+0000","last_peered":"2024-09-14T12:13:18.206264+0000","last_clean":"2024-09-14T12:13:18.206264+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:13:18.206264+0000","last_undegraded":"2024-09-14T12:13:18.206264+0000","last_fullsized":"2024-09-14T12:13:18.206264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:56.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:55.442720+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:11:55.442720+0000","last_peered":"2024-09-14T12:11:55.442720+0000","last_clean":"2024-09-14T12:11:55.442720+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:11:55.442720+0000","last_undegraded":"2024-09-14T12:11:55.442720+0000","last_fullsized":"2024-09-14T12:11:55.442720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.452072+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:11:58.452072+0000","last_peered":"2024-09-14T12:11:58.452072+0000","last_clean":"2024-09-14T12:11:58.452072+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:11:58.452072+0000","last_undegraded":"2024-09-14T12:11:58.452072+0000","last_fullsized":"2024-09-14T12:11:58.452072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.334737+0000","last_change":"2024-09-14T11:35:00.437763+0000","last_active":"2024-09-14T12:13:18.334737+0000","last_peered":"2024-09-14T12:13:18.334737+0000","last_clean":"2024-09-14T12:13:18.334737+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:13:18.334737+0000","last_undegraded":"2024-09-14T12:13:18.334737+0000","last_fullsized":"2024-09-14T12:13:18.334737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:10.195413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448816+0000","last_change":"2024-09-14T11:31:47.455016+0000","last_active":"2024-09-14T12:12:58.448816+0000","last_peered":"2024-09-14T12:12:58.448816+0000","last_clean":"2024-09-14T12:12:58.448816+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:12:58.448816+0000","last_undegraded":"2024-09-14T12:12:58.448816+0000","last_fullsized":"2024-09-14T12:12:58.448816+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:05.916872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:40.448133+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:12:40.448133+0000","last_peered":"2024-09-14T12:12:40.448133+0000","last_clean":"2024-09-14T12:12:40.448133+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:12:40.448133+0000","last_undegraded":"2024-09-14T12:12:40.448133+0000","last_fullsized":"2024-09-14T12:12:40.448133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:19.901941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'10","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457537+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:12:33.457537+0000","last_peered":"2024-09-14T12:12:33.457537+0000","last_clean":"2024-09-14T12:12:33.457537+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:12:33.457537+0000","last_undegraded":"2024-09-14T12:12:33.457537+0000","last_fullsized":"2024-09-14T12:12:33.457537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:41.032154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12294,"num_write":15,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450330+0000","last_change":"2024-09-14T11:31:47.456677+0000","last_active":"2024-09-14T12:13:00.450330+0000","last_peered":"2024-09-14T12:13:00.450330+0000","last_clean":"2024-09-14T12:13:00.450330+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:13:00.450330+0000","last_undegraded":"2024-09-14T12:13:00.450330+0000","last_fullsized":"2024-09-14T12:13:00.450330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.544493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447594+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:12:35.447594+0000","last_peered":"2024-09-14T12:12:35.447594+0000","last_clean":"2024-09-14T12:12:35.447594+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:12:35.447594+0000","last_undegraded":"2024-09-14T12:12:35.447594+0000","last_fullsized":"2024-09-14T12:12:35.447594+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:39.273428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:43.305948+0000","last_change":"2024-09-14T11:35:00.449492+0000","last_active":"2024-09-14T12:12:43.305948+0000","last_peered":"2024-09-14T12:12:43.305948+0000","last_clean":"2024-09-14T12:12:43.305948+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:12:43.305948+0000","last_undegraded":"2024-09-14T12:12:43.305948+0000","last_fullsized":"2024-09-14T12:12:43.305948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:07.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448902+0000","last_change":"2024-09-14T11:31:47.458093+0000","last_active":"2024-09-14T12:12:58.448902+0000","last_peered":"2024-09-14T12:12:58.448902+0000","last_clean":"2024-09-14T12:12:58.448902+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:12:58.448902+0000","last_undegraded":"2024-09-14T12:12:58.448902+0000","last_fullsized":"2024-09-14T12:12:58.448902+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:32.003627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473241+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:14:03.473241+0000","last_peered":"2024-09-14T12:14:03.473241+0000","last_clean":"2024-09-14T12:14:03.473241+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:14:03.473241+0000","last_undegraded":"2024-09-14T12:14:03.473241+0000","last_fullsized":"2024-09-14T12:14:03.473241+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468672+0000","last_change":"2024-09-14T11:31:47.461691+0000","last_active":"2024-09-14T12:13:33.468672+0000","last_peered":"2024-09-14T12:13:33.468672+0000","last_clean":"2024-09-14T12:13:33.468672+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:13:33.468672+0000","last_undegraded":"2024-09-14T12:13:33.468672+0000","last_fullsized":"2024-09-14T12:13:33.468672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:28.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207399+0000","last_change":"2024-09-14T11:31:47.462125+0000","last_active":"2024-09-14T12:13:28.207399+0000","last_peered":"2024-09-14T12:13:28.207399+0000","last_clean":"2024-09-14T12:13:28.207399+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:13:28.207399+0000","last_undegraded":"2024-09-14T12:13:28.207399+0000","last_fullsized":"2024-09-14T12:13:28.207399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:55.114065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.306468+0000","last_change":"2024-09-14T11:51:07.031655+0000","last_active":"2024-09-14T12:12:48.306468+0000","last_peered":"2024-09-14T12:12:48.306468+0000","last_clean":"2024-09-14T12:12:48.306468+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:12:48.306468+0000","last_undegraded":"2024-09-14T12:12:48.306468+0000","last_fullsized":"2024-09-14T12:12:48.306468+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:23.951366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201466+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:12:33.201466+0000","last_peered":"2024-09-14T12:12:33.201466+0000","last_clean":"2024-09-14T12:12:33.201466+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:12:33.201466+0000","last_undegraded":"2024-09-14T12:12:33.201466+0000","last_fullsized":"2024-09-14T12:12:33.201466+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:50.359964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.464857+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:13:08.464857+0000","last_peered":"2024-09-14T12:13:08.464857+0000","last_clean":"2024-09-14T12:13:08.464857+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:13:08.464857+0000","last_undegraded":"2024-09-14T12:13:08.464857+0000","last_fullsized":"2024-09-14T12:13:08.464857+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221763+0000","last_change":"2024-09-14T11:31:47.454368+0000","last_active":"2024-09-14T12:13:28.221763+0000","last_peered":"2024-09-14T12:13:28.221763+0000","last_clean":"2024-09-14T12:13:28.221763+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:13:28.221763+0000","last_undegraded":"2024-09-14T12:13:28.221763+0000","last_fullsized":"2024-09-14T12:13:28.221763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:49.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457485+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:12:33.457485+0000","last_peered":"2024-09-14T12:12:33.457485+0000","last_clean":"2024-09-14T12:12:33.457485+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:12:33.457485+0000","last_undegraded":"2024-09-14T12:12:33.457485+0000","last_fullsized":"2024-09-14T12:12:33.457485+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:14.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.335995+0000","last_change":"2024-09-14T11:31:47.458566+0000","last_active":"2024-09-14T12:13:28.335995+0000","last_peered":"2024-09-14T12:13:28.335995+0000","last_clean":"2024-09-14T12:13:28.335995+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:13:28.335995+0000","last_undegraded":"2024-09-14T12:13:28.335995+0000","last_fullsized":"2024-09-14T12:13:28.335995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:16.885698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445234+0000","last_change":"2024-09-14T11:35:03.475098+0000","last_active":"2024-09-14T12:12:33.445234+0000","last_peered":"2024-09-14T12:12:33.445234+0000","last_clean":"2024-09-14T12:12:33.445234+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:12:33.445234+0000","last_undegraded":"2024-09-14T12:12:33.445234+0000","last_fullsized":"2024-09-14T12:12:33.445234+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:47.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'5","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201494+0000","last_change":"2024-09-14T11:35:00.441606+0000","last_active":"2024-09-14T12:12:33.201494+0000","last_peered":"2024-09-14T12:12:33.201494+0000","last_clean":"2024-09-14T12:12:33.201494+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:12:33.201494+0000","last_undegraded":"2024-09-14T12:12:33.201494+0000","last_fullsized":"2024-09-14T12:12:33.201494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.099191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453081+0000","last_change":"2024-09-14T11:31:47.457442+0000","last_active":"2024-09-14T12:13:28.453081+0000","last_peered":"2024-09-14T12:13:28.453081+0000","last_clean":"2024-09-14T12:13:28.453081+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:13:28.453081+0000","last_undegraded":"2024-09-14T12:13:28.453081+0000","last_fullsized":"2024-09-14T12:13:28.453081+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.421189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328235+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:12:33.328235+0000","last_peered":"2024-09-14T12:12:33.328235+0000","last_clean":"2024-09-14T12:12:33.328235+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:12:33.328235+0000","last_undegraded":"2024-09-14T12:12:33.328235+0000","last_fullsized":"2024-09-14T12:12:33.328235+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.691369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445253+0000","last_change":"2024-09-14T11:35:00.438555+0000","last_active":"2024-09-14T12:12:33.445253+0000","last_peered":"2024-09-14T12:12:33.445253+0000","last_clean":"2024-09-14T12:12:33.445253+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:12:33.445253+0000","last_undegraded":"2024-09-14T12:12:33.445253+0000","last_fullsized":"2024-09-14T12:12:33.445253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:40.844681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471478+0000","last_change":"2024-09-14T11:31:47.457290+0000","last_active":"2024-09-14T12:13:53.471478+0000","last_peered":"2024-09-14T12:13:53.471478+0000","last_clean":"2024-09-14T12:13:53.471478+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:13:53.471478+0000","last_undegraded":"2024-09-14T12:13:53.471478+0000","last_fullsized":"2024-09-14T12:13:53.471478+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:56.244895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'308","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.108039+0000","last_change":"2024-09-14T11:17:21.587746+0000","last_active":"2024-09-14T12:15:43.108039+0000","last_peered":"2024-09-14T12:15:43.108039+0000","last_clean":"2024-09-14T12:15:43.108039+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:15:43.108039+0000","last_undegraded":"2024-09-14T12:15:43.108039+0000","last_fullsized":"2024-09-14T12:15:43.108039+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:26.043334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430926,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":565,"num_read_kb":9737,"num_write":1184,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'480","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869433+0000","last_change":"2024-09-14T11:17:23.596289+0000","last_active":"2024-09-14T12:13:31.869433+0000","last_peered":"2024-09-14T12:13:31.869433+0000","last_clean":"2024-09-14T12:13:31.869433+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:13:31.869433+0000","last_undegraded":"2024-09-14T12:13:31.869433+0000","last_fullsized":"2024-09-14T12:13:31.869433+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.016139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'264","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.841386+0000","last_change":"2024-09-14T11:17:21.584104+0000","last_active":"2024-09-14T12:14:17.841386+0000","last_peered":"2024-09-14T12:14:17.841386+0000","last_clean":"2024-09-14T12:14:17.841386+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:14:17.841386+0000","last_undegraded":"2024-09-14T12:14:17.841386+0000","last_fullsized":"2024-09-14T12:14:17.841386+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:46.479650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699282,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":471,"num_read_kb":22750,"num_write":944,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'451","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.480890+0000","last_change":"2024-09-14T11:17:23.592564+0000","last_active":"2024-09-14T12:14:53.480890+0000","last_peered":"2024-09-14T12:14:53.480890+0000","last_clean":"2024-09-14T12:14:53.480890+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:14:53.480890+0000","last_undegraded":"2024-09-14T12:14:53.480890+0000","last_fullsized":"2024-09-14T12:14:53.480890+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:08.504401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'298","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455236+0000","last_change":"2024-09-14T11:17:21.580337+0000","last_active":"2024-09-14T12:13:40.455236+0000","last_peered":"2024-09-14T12:13:40.455236+0000","last_clean":"2024-09-14T12:13:40.455236+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:13:40.455236+0000","last_undegraded":"2024-09-14T12:13:40.455236+0000","last_fullsized":"2024-09-14T12:13:40.455236+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:44.574988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5644441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":645,"num_read_kb":8093,"num_write":1094,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'828","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.348237+0000","last_change":"2024-09-14T11:17:23.599492+0000","last_active":"2024-09-14T12:14:53.348237+0000","last_peered":"2024-09-14T12:14:53.348237+0000","last_clean":"2024-09-14T12:14:53.348237+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:14:53.348237+0000","last_undegraded":"2024-09-14T12:14:53.348237+0000","last_fullsized":"2024-09-14T12:14:53.348237+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:31.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223314+0000","last_change":"2024-09-14T11:17:21.587518+0000","last_active":"2024-09-14T12:13:38.223314+0000","last_peered":"2024-09-14T12:13:38.223314+0000","last_clean":"2024-09-14T12:13:38.223314+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:13:38.223314+0000","last_undegraded":"2024-09-14T12:13:38.223314+0000","last_fullsized":"2024-09-14T12:13:38.223314+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.780145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11836321,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":624,"num_read_kb":69334,"num_write":1171,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'478","reported_seq":2201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:55.464747+0000","last_change":"2024-09-14T11:17:23.604953+0000","last_active":"2024-09-14T12:14:55.464747+0000","last_peered":"2024-09-14T12:14:55.464747+0000","last_clean":"2024-09-14T12:14:55.464747+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:14:55.464747+0000","last_undegraded":"2024-09-14T12:14:55.464747+0000","last_fullsized":"2024-09-14T12:14:55.464747+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.132184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'288","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.776642+0000","last_change":"2024-09-14T11:17:21.585772+0000","last_active":"2024-09-14T12:13:33.776642+0000","last_peered":"2024-09-14T12:13:33.776642+0000","last_clean":"2024-09-14T12:13:33.776642+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:13:33.776642+0000","last_undegraded":"2024-09-14T12:13:33.776642+0000","last_fullsized":"2024-09-14T12:13:33.776642+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:30.264733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353450,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":577,"num_read_kb":8504,"num_write":1053,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'928","reported_seq":2495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.884819+0000","last_change":"2024-09-14T11:17:23.598765+0000","last_active":"2024-09-14T12:13:38.884819+0000","last_peered":"2024-09-14T12:13:38.884819+0000","last_clean":"2024-09-14T12:13:38.884819+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:13:38.884819+0000","last_undegraded":"2024-09-14T12:13:38.884819+0000","last_fullsized":"2024-09-14T12:13:38.884819+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:07.244374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'276","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:29.940360+0000","last_change":"2024-09-14T11:17:21.586031+0000","last_active":"2024-09-14T12:12:29.940360+0000","last_peered":"2024-09-14T12:12:29.940360+0000","last_clean":"2024-09-14T12:12:29.940360+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:12:29.940360+0000","last_undegraded":"2024-09-14T12:12:29.940360+0000","last_fullsized":"2024-09-14T12:12:29.940360+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:35.597137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1550973,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":530,"num_read_kb":13219,"num_write":1002,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'322","reported_seq":1677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.773491+0000","last_change":"2024-09-14T11:17:23.598233+0000","last_active":"2024-09-14T12:14:33.773491+0000","last_peered":"2024-09-14T12:14:33.773491+0000","last_clean":"2024-09-14T12:14:33.773491+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:14:33.773491+0000","last_undegraded":"2024-09-14T12:14:33.773491+0000","last_fullsized":"2024-09-14T12:14:33.773491+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:42.186568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'269","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.884175+0000","last_change":"2024-09-14T11:17:21.583061+0000","last_active":"2024-09-14T12:12:25.884175+0000","last_peered":"2024-09-14T12:12:25.884175+0000","last_clean":"2024-09-14T12:12:25.884175+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:12:25.884175+0000","last_undegraded":"2024-09-14T12:12:25.884175+0000","last_fullsized":"2024-09-14T12:12:25.884175+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:35.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089099,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":445,"num_read_kb":13115,"num_write":950,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'406","reported_seq":1944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.589436+0000","last_change":"2024-09-14T11:17:23.595095+0000","last_active":"2024-09-14T12:14:01.589436+0000","last_peered":"2024-09-14T12:14:01.589436+0000","last_clean":"2024-09-14T12:14:01.589436+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:14:01.589436+0000","last_undegraded":"2024-09-14T12:14:01.589436+0000","last_fullsized":"2024-09-14T12:14:01.589436+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:51.571958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'283","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.611116+0000","last_change":"2024-09-14T11:17:55.703681+0000","last_active":"2024-09-14T12:14:02.611116+0000","last_peered":"2024-09-14T12:14:02.611116+0000","last_clean":"2024-09-14T12:14:02.611116+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:14:02.611116+0000","last_undegraded":"2024-09-14T12:14:02.611116+0000","last_fullsized":"2024-09-14T12:14:02.611116+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:43.991223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100038,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":520,"num_read_kb":3515,"num_write":1040,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'928","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.115259+0000","last_change":"2024-09-14T11:17:23.602237+0000","last_active":"2024-09-14T12:15:48.115259+0000","last_peered":"2024-09-14T12:15:48.115259+0000","last_clean":"2024-09-14T12:15:48.115259+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:15:48.115259+0000","last_undegraded":"2024-09-14T12:15:48.115259+0000","last_fullsized":"2024-09-14T12:15:48.115259+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:07.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'883","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606712+0000","last_change":"2024-09-14T11:17:23.599033+0000","last_active":"2024-09-14T12:14:34.606712+0000","last_peered":"2024-09-14T12:14:34.606712+0000","last_clean":"2024-09-14T12:14:34.606712+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:14:34.606712+0000","last_undegraded":"2024-09-14T12:14:34.606712+0000","last_fullsized":"2024-09-14T12:14:34.606712+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:02.965131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'310","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464273+0000","last_change":"2024-09-14T11:17:21.590951+0000","last_active":"2024-09-14T12:13:03.464273+0000","last_peered":"2024-09-14T12:13:03.464273+0000","last_clean":"2024-09-14T12:13:03.464273+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:13:03.464273+0000","last_undegraded":"2024-09-14T12:13:03.464273+0000","last_fullsized":"2024-09-14T12:13:03.464273+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:04.497926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4275713,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":605,"num_read_kb":33506,"num_write":1154,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'723","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.112494+0000","last_change":"2024-09-14T11:17:55.874871+0000","last_active":"2024-09-14T12:15:48.112494+0000","last_peered":"2024-09-14T12:15:48.112494+0000","last_clean":"2024-09-14T12:15:48.112494+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:15:48.112494+0000","last_undegraded":"2024-09-14T12:15:48.112494+0000","last_fullsized":"2024-09-14T12:15:48.112494+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:09.467887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'412","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448912+0000","last_change":"2024-09-14T11:17:21.591292+0000","last_active":"2024-09-14T12:12:58.448912+0000","last_peered":"2024-09-14T12:12:58.448912+0000","last_clean":"2024-09-14T12:12:58.448912+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:12:58.448912+0000","last_undegraded":"2024-09-14T12:12:58.448912+0000","last_fullsized":"2024-09-14T12:12:58.448912+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.290528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714049,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":871,"num_read_kb":10641,"num_write":1158,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'766","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.137705+0000","last_change":"2024-09-14T11:17:23.599028+0000","last_active":"2024-09-14T12:15:48.137705+0000","last_peered":"2024-09-14T12:15:48.137705+0000","last_clean":"2024-09-14T12:15:48.137705+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:15:48.137705+0000","last_undegraded":"2024-09-14T12:15:48.137705+0000","last_fullsized":"2024-09-14T12:15:48.137705+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'319","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.585271+0000","last_change":"2024-09-14T11:17:21.590804+0000","last_active":"2024-09-14T12:13:32.585271+0000","last_peered":"2024-09-14T12:13:32.585271+0000","last_clean":"2024-09-14T12:13:32.585271+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:13:32.585271+0000","last_undegraded":"2024-09-14T12:13:32.585271+0000","last_fullsized":"2024-09-14T12:13:32.585271+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:31.068330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5357337,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":598,"num_read_kb":6370,"num_write":1006,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.113932+0000","last_change":"2024-09-14T11:17:23.602214+0000","last_active":"2024-09-14T12:15:48.113932+0000","last_peered":"2024-09-14T12:15:48.113932+0000","last_clean":"2024-09-14T12:15:48.113932+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:15:48.113932+0000","last_undegraded":"2024-09-14T12:15:48.113932+0000","last_fullsized":"2024-09-14T12:15:48.113932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:16.076422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'268","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.331946+0000","last_change":"2024-09-14T11:17:21.580921+0000","last_active":"2024-09-14T12:12:58.331946+0000","last_peered":"2024-09-14T12:12:58.331946+0000","last_clean":"2024-09-14T12:12:58.331946+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:12:58.331946+0000","last_undegraded":"2024-09-14T12:12:58.331946+0000","last_fullsized":"2024-09-14T12:12:58.331946+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440903,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":619,"num_read_kb":17017,"num_write":902,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'903","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.117762+0000","last_change":"2024-09-14T11:17:23.599615+0000","last_active":"2024-09-14T12:15:48.117762+0000","last_peered":"2024-09-14T12:15:48.117762+0000","last_clean":"2024-09-14T12:15:48.117762+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:15:48.117762+0000","last_undegraded":"2024-09-14T12:15:48.117762+0000","last_fullsized":"2024-09-14T12:15:48.117762+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:54.414087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'241","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213854+0000","last_change":"2024-09-14T11:17:21.586068+0000","last_active":"2024-09-14T12:12:58.213854+0000","last_peered":"2024-09-14T12:12:58.213854+0000","last_clean":"2024-09-14T12:12:58.213854+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:12:58.213854+0000","last_undegraded":"2024-09-14T12:12:58.213854+0000","last_fullsized":"2024-09-14T12:12:58.213854+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.111859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8739959,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19406,"num_write":803,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1142","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503777+0000","last_change":"2024-09-14T11:17:23.592841+0000","last_active":"2024-09-14T12:15:18.503777+0000","last_peered":"2024-09-14T12:15:18.503777+0000","last_clean":"2024-09-14T12:15:18.503777+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:15:18.503777+0000","last_undegraded":"2024-09-14T12:15:18.503777+0000","last_fullsized":"2024-09-14T12:15:18.503777+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:33.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'291","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453969+0000","last_change":"2024-09-14T11:17:21.581385+0000","last_active":"2024-09-14T12:13:30.453969+0000","last_peered":"2024-09-14T12:13:30.453969+0000","last_clean":"2024-09-14T12:13:30.453969+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:13:30.453969+0000","last_undegraded":"2024-09-14T12:13:30.453969+0000","last_fullsized":"2024-09-14T12:13:30.453969+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:13.497850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217581,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":658,"num_read_kb":10760,"num_write":949,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'124","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.745040+0000","last_change":"2024-09-14T11:17:31.654831+0000","last_active":"2024-09-14T12:14:34.745040+0000","last_peered":"2024-09-14T12:14:34.745040+0000","last_clean":"2024-09-14T12:14:34.745040+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:14:34.745040+0000","last_undegraded":"2024-09-14T12:14:34.745040+0000","last_fullsized":"2024-09-14T12:14:34.745040+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:31.244666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'519","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.588328+0000","last_change":"2024-09-14T11:17:23.599731+0000","last_active":"2024-09-14T12:14:01.588328+0000","last_peered":"2024-09-14T12:14:01.588328+0000","last_clean":"2024-09-14T12:14:01.588328+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:14:01.588328+0000","last_undegraded":"2024-09-14T12:14:01.588328+0000","last_fullsized":"2024-09-14T12:14:01.588328+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:06.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'232","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.467113+0000","last_change":"2024-09-14T11:17:21.582288+0000","last_active":"2024-09-14T12:13:23.467113+0000","last_peered":"2024-09-14T12:13:23.467113+0000","last_clean":"2024-09-14T12:13:23.467113+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:13:23.467113+0000","last_undegraded":"2024-09-14T12:13:23.467113+0000","last_fullsized":"2024-09-14T12:13:23.467113+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:12.066003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5249689,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":400,"num_read_kb":3402,"num_write":817,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217819+0000","last_change":"2024-09-14T11:17:25.615823+0000","last_active":"2024-09-14T12:13:03.217819+0000","last_peered":"2024-09-14T12:13:03.217819+0000","last_clean":"2024-09-14T12:13:03.217819+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:13:03.217819+0000","last_undegraded":"2024-09-14T12:13:03.217819+0000","last_fullsized":"2024-09-14T12:13:03.217819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:11.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:30.469572+0000","last_change":"2024-09-14T11:17:27.635100+0000","last_active":"2024-09-14T12:15:30.469572+0000","last_peered":"2024-09-14T12:15:30.469572+0000","last_clean":"2024-09-14T12:15:30.469572+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:15:30.469572+0000","last_undegraded":"2024-09-14T12:15:30.469572+0000","last_fullsized":"2024-09-14T12:15:30.469572+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:40.414857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":1083,"num_write":448,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.465023+0000","last_change":"2024-09-14T11:17:29.648345+0000","last_active":"2024-09-14T12:13:08.465023+0000","last_peered":"2024-09-14T12:13:08.465023+0000","last_clean":"2024-09-14T12:13:08.465023+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:13:08.465023+0000","last_undegraded":"2024-09-14T12:13:08.465023+0000","last_fullsized":"2024-09-14T12:13:08.465023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:26.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'125","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.666407+0000","last_change":"2024-09-14T11:17:31.655931+0000","last_active":"2024-09-14T12:14:32.666407+0000","last_peered":"2024-09-14T12:14:32.666407+0000","last_clean":"2024-09-14T12:14:32.666407+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:14:32.666407+0000","last_undegraded":"2024-09-14T12:14:32.666407+0000","last_fullsized":"2024-09-14T12:14:32.666407+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.187962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'403","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605468+0000","last_change":"2024-09-14T11:17:23.593797+0000","last_active":"2024-09-14T12:14:34.605468+0000","last_peered":"2024-09-14T12:14:34.605468+0000","last_clean":"2024-09-14T12:14:34.605468+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:14:34.605468+0000","last_undegraded":"2024-09-14T12:14:34.605468+0000","last_fullsized":"2024-09-14T12:14:34.605468+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:55.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'306","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.125338+0000","last_change":"2024-09-14T11:17:21.586646+0000","last_active":"2024-09-14T12:15:43.125338+0000","last_peered":"2024-09-14T12:15:43.125338+0000","last_clean":"2024-09-14T12:15:43.125338+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:15:43.125338+0000","last_undegraded":"2024-09-14T12:15:43.125338+0000","last_fullsized":"2024-09-14T12:15:43.125338+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:04.270874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2640321,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":500,"num_read_kb":9431,"num_write":1065,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219417+0000","last_change":"2024-09-14T11:17:25.616433+0000","last_active":"2024-09-14T12:13:43.219417+0000","last_peered":"2024-09-14T12:13:43.219417+0000","last_clean":"2024-09-14T12:13:43.219417+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:13:43.219417+0000","last_undegraded":"2024-09-14T12:13:43.219417+0000","last_fullsized":"2024-09-14T12:13:43.219417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:30.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332635+0000","last_change":"2024-09-14T11:17:27.625733+0000","last_active":"2024-09-14T12:13:03.332635+0000","last_peered":"2024-09-14T12:13:03.332635+0000","last_clean":"2024-09-14T12:13:03.332635+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:13:03.332635+0000","last_undegraded":"2024-09-14T12:13:03.332635+0000","last_fullsized":"2024-09-14T12:13:03.332635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.964076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.333430+0000","last_change":"2024-09-14T11:17:29.644069+0000","last_active":"2024-09-14T12:13:08.333430+0000","last_peered":"2024-09-14T12:13:08.333430+0000","last_clean":"2024-09-14T12:13:08.333430+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:13:08.333430+0000","last_undegraded":"2024-09-14T12:13:08.333430+0000","last_fullsized":"2024-09-14T12:13:08.333430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:57.125690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'115","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447544+0000","last_change":"2024-09-14T11:17:31.656073+0000","last_active":"2024-09-14T12:12:35.447544+0000","last_peered":"2024-09-14T12:12:35.447544+0000","last_clean":"2024-09-14T12:12:35.447544+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:12:35.447544+0000","last_undegraded":"2024-09-14T12:12:35.447544+0000","last_fullsized":"2024-09-14T12:12:35.447544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.047265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'515","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.577498+0000","last_change":"2024-09-14T11:17:23.603416+0000","last_active":"2024-09-14T12:13:55.577498+0000","last_peered":"2024-09-14T12:13:55.577498+0000","last_clean":"2024-09-14T12:13:55.577498+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:13:55.577498+0000","last_undegraded":"2024-09-14T12:13:55.577498+0000","last_fullsized":"2024-09-14T12:13:55.577498+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:40.391533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'377","reported_seq":1092,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.441992+0000","last_change":"2024-09-14T11:17:21.581059+0000","last_active":"2024-09-14T12:14:01.441992+0000","last_peered":"2024-09-14T12:14:01.441992+0000","last_clean":"2024-09-14T12:14:01.441992+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:14:01.441992+0000","last_undegraded":"2024-09-14T12:14:01.441992+0000","last_fullsized":"2024-09-14T12:14:01.441992+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:45.085082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20627141,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":959,"num_read_kb":13380,"num_write":1346,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.214581+0000","last_change":"2024-09-14T11:17:25.616302+0000","last_active":"2024-09-14T12:13:03.214581+0000","last_peered":"2024-09-14T12:13:03.214581+0000","last_clean":"2024-09-14T12:13:03.214581+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:13:03.214581+0000","last_undegraded":"2024-09-14T12:13:03.214581+0000","last_fullsized":"2024-09-14T12:13:03.214581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:14.747448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311910+0000","last_change":"2024-09-14T11:17:27.629551+0000","last_active":"2024-09-14T12:13:38.311910+0000","last_peered":"2024-09-14T12:13:38.311910+0000","last_clean":"2024-09-14T12:13:38.311910+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:13:38.311910+0000","last_undegraded":"2024-09-14T12:13:38.311910+0000","last_fullsized":"2024-09-14T12:13:38.311910+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'760","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.258497+0000","last_change":"2024-09-14T11:17:29.644411+0000","last_active":"2024-09-14T12:15:49.258497+0000","last_peered":"2024-09-14T12:15:49.258497+0000","last_clean":"2024-09-14T12:15:49.258497+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:15:49.258497+0000","last_undegraded":"2024-09-14T12:15:49.258497+0000","last_fullsized":"2024-09-14T12:15:49.258497+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:09.032379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.802436+0000","last_change":"2024-09-14T11:17:31.653029+0000","last_active":"2024-09-14T12:14:34.802436+0000","last_peered":"2024-09-14T12:14:34.802436+0000","last_clean":"2024-09-14T12:14:34.802436+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:14:34.802436+0000","last_undegraded":"2024-09-14T12:14:34.802436+0000","last_fullsized":"2024-09-14T12:14:34.802436+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.378206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1034","reported_seq":2653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208892+0000","last_change":"2024-09-14T11:17:23.595010+0000","last_active":"2024-09-14T12:14:31.208892+0000","last_peered":"2024-09-14T12:14:31.208892+0000","last_clean":"2024-09-14T12:14:31.208892+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:14:31.208892+0000","last_undegraded":"2024-09-14T12:14:31.208892+0000","last_fullsized":"2024-09-14T12:14:31.208892+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'281","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.939272+0000","last_change":"2024-09-14T11:17:21.584036+0000","last_active":"2024-09-14T12:13:51.939272+0000","last_peered":"2024-09-14T12:13:51.939272+0000","last_clean":"2024-09-14T12:13:51.939272+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:13:51.939272+0000","last_undegraded":"2024-09-14T12:13:51.939272+0000","last_fullsized":"2024-09-14T12:13:51.939272+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:15.378108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5585677,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":661,"num_read_kb":31887,"num_write":1040,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217853+0000","last_change":"2024-09-14T11:17:25.618783+0000","last_active":"2024-09-14T12:13:03.217853+0000","last_peered":"2024-09-14T12:13:03.217853+0000","last_clean":"2024-09-14T12:13:03.217853+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:13:03.217853+0000","last_undegraded":"2024-09-14T12:13:03.217853+0000","last_fullsized":"2024-09-14T12:13:03.217853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:17.470265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'266","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.147383+0000","last_change":"2024-09-14T11:17:27.633216+0000","last_active":"2024-09-14T12:15:48.147383+0000","last_peered":"2024-09-14T12:15:48.147383+0000","last_clean":"2024-09-14T12:15:48.147383+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:15:48.147383+0000","last_undegraded":"2024-09-14T12:15:48.147383+0000","last_fullsized":"2024-09-14T12:15:48.147383+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.992449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":965,"num_write":372,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'797","reported_seq":2950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.519993+0000","last_change":"2024-09-14T11:17:29.645452+0000","last_active":"2024-09-14T12:15:52.519993+0000","last_peered":"2024-09-14T12:15:52.519993+0000","last_clean":"2024-09-14T12:15:52.519993+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:15:52.519993+0000","last_undegraded":"2024-09-14T12:15:52.519993+0000","last_fullsized":"2024-09-14T12:15:52.519993+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:20.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'781","reported_seq":2531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.772745+0000","last_change":"2024-09-14T11:17:23.592552+0000","last_active":"2024-09-14T12:14:33.772745+0000","last_peered":"2024-09-14T12:14:33.772745+0000","last_clean":"2024-09-14T12:14:33.772745+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:14:33.772745+0000","last_undegraded":"2024-09-14T12:14:33.772745+0000","last_fullsized":"2024-09-14T12:14:33.772745+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.626824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'321","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470266+0000","last_change":"2024-09-14T11:17:21.585562+0000","last_active":"2024-09-14T12:13:43.470266+0000","last_peered":"2024-09-14T12:13:43.470266+0000","last_clean":"2024-09-14T12:13:43.470266+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:13:43.470266+0000","last_undegraded":"2024-09-14T12:13:43.470266+0000","last_fullsized":"2024-09-14T12:13:43.470266+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:32.839861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10701649,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":609,"num_read_kb":56115,"num_write":1049,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470857+0000","last_change":"2024-09-14T11:17:25.612123+0000","last_active":"2024-09-14T12:13:48.470857+0000","last_peered":"2024-09-14T12:13:48.470857+0000","last_clean":"2024-09-14T12:13:48.470857+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:13:48.470857+0000","last_undegraded":"2024-09-14T12:13:48.470857+0000","last_fullsized":"2024-09-14T12:13:48.470857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.389407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'349","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.228278+0000","last_change":"2024-09-14T11:17:27.632368+0000","last_active":"2024-09-14T12:15:49.228278+0000","last_peered":"2024-09-14T12:15:49.228278+0000","last_clean":"2024-09-14T12:15:49.228278+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:15:49.228278+0000","last_undegraded":"2024-09-14T12:15:49.228278+0000","last_fullsized":"2024-09-14T12:15:49.228278+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.760176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65135,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1087,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.209730+0000","last_change":"2024-09-14T11:17:29.646397+0000","last_active":"2024-09-14T12:13:48.209730+0000","last_peered":"2024-09-14T12:13:48.209730+0000","last_clean":"2024-09-14T12:13:48.209730+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:13:48.209730+0000","last_undegraded":"2024-09-14T12:13:48.209730+0000","last_fullsized":"2024-09-14T12:13:48.209730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.686669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'546","reported_seq":1351,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.248613+0000","last_change":"2024-09-14T11:17:31.656988+0000","last_active":"2024-09-14T12:15:49.248613+0000","last_peered":"2024-09-14T12:15:49.248613+0000","last_clean":"2024-09-14T12:15:49.248613+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:15:49.248613+0000","last_undegraded":"2024-09-14T12:15:49.248613+0000","last_fullsized":"2024-09-14T12:15:49.248613+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:43.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'387","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338146+0000","last_change":"2024-09-14T11:17:23.594471+0000","last_active":"2024-09-14T12:13:43.338146+0000","last_peered":"2024-09-14T12:13:43.338146+0000","last_clean":"2024-09-14T12:13:43.338146+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:13:43.338146+0000","last_undegraded":"2024-09-14T12:13:43.338146+0000","last_fullsized":"2024-09-14T12:13:43.338146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:33.360740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'321","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.127362+0000","last_change":"2024-09-14T11:17:21.582857+0000","last_active":"2024-09-14T12:13:57.127362+0000","last_peered":"2024-09-14T12:13:57.127362+0000","last_clean":"2024-09-14T12:13:57.127362+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:13:57.127362+0000","last_undegraded":"2024-09-14T12:13:57.127362+0000","last_fullsized":"2024-09-14T12:13:57.127362+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:31.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7483620,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":979,"num_read_kb":12713,"num_write":1195,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312912+0000","last_change":"2024-09-14T11:17:25.611404+0000","last_active":"2024-09-14T12:13:48.312912+0000","last_peered":"2024-09-14T12:13:48.312912+0000","last_clean":"2024-09-14T12:13:48.312912+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:13:48.312912+0000","last_undegraded":"2024-09-14T12:13:48.312912+0000","last_fullsized":"2024-09-14T12:13:48.312912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:08.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'247","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.205235+0000","last_change":"2024-09-14T11:17:27.631285+0000","last_active":"2024-09-14T12:15:49.205235+0000","last_peered":"2024-09-14T12:15:49.205235+0000","last_clean":"2024-09-14T12:15:49.205235+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:15:49.205235+0000","last_undegraded":"2024-09-14T12:15:49.205235+0000","last_fullsized":"2024-09-14T12:15:49.205235+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:15.793000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":858,"num_write":330,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.207057+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:11:58.207057+0000","last_peered":"2024-09-14T12:11:58.207057+0000","last_clean":"2024-09-14T12:11:58.207057+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:11:58.207057+0000","last_undegraded":"2024-09-14T12:11:58.207057+0000","last_fullsized":"2024-09-14T12:11:58.207057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2525","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.132063+0000","last_change":"2024-09-14T11:17:31.655728+0000","last_active":"2024-09-14T12:15:48.132063+0000","last_peered":"2024-09-14T12:15:48.132063+0000","last_clean":"2024-09-14T12:15:48.132063+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:15:48.132063+0000","last_undegraded":"2024-09-14T12:15:48.132063+0000","last_fullsized":"2024-09-14T12:15:48.132063+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:25.453442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1156","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344423+0000","last_change":"2024-09-14T11:17:23.605410+0000","last_active":"2024-09-14T12:13:53.344423+0000","last_peered":"2024-09-14T12:13:53.344423+0000","last_clean":"2024-09-14T12:13:53.344423+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:13:53.344423+0000","last_undegraded":"2024-09-14T12:13:53.344423+0000","last_fullsized":"2024-09-14T12:13:53.344423+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:20.036802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'307","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:19.299582+0000","last_change":"2024-09-14T11:17:21.589280+0000","last_active":"2024-09-14T12:14:19.299582+0000","last_peered":"2024-09-14T12:14:19.299582+0000","last_clean":"2024-09-14T12:14:19.299582+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:14:19.299582+0000","last_undegraded":"2024-09-14T12:14:19.299582+0000","last_fullsized":"2024-09-14T12:14:19.299582+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.602370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21050187,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":579,"num_read_kb":71361,"num_write":1042,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312428+0000","last_change":"2024-09-14T11:17:25.610821+0000","last_active":"2024-09-14T12:13:43.312428+0000","last_peered":"2024-09-14T12:13:43.312428+0000","last_clean":"2024-09-14T12:13:43.312428+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:13:43.312428+0000","last_undegraded":"2024-09-14T12:13:43.312428+0000","last_fullsized":"2024-09-14T12:13:43.312428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:02.190026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'303","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.230589+0000","last_change":"2024-09-14T11:17:27.635877+0000","last_active":"2024-09-14T12:15:49.230589+0000","last_peered":"2024-09-14T12:15:49.230589+0000","last_clean":"2024-09-14T12:15:49.230589+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:15:49.230589+0000","last_undegraded":"2024-09-14T12:15:49.230589+0000","last_fullsized":"2024-09-14T12:15:49.230589+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:09.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63434,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1010,"num_write":408,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.521807+0000","last_change":"2024-09-14T11:17:29.645441+0000","last_active":"2024-09-14T12:15:52.521807+0000","last_peered":"2024-09-14T12:15:52.521807+0000","last_clean":"2024-09-14T12:15:52.521807+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:15:52.521807+0000","last_undegraded":"2024-09-14T12:15:52.521807+0000","last_fullsized":"2024-09-14T12:15:52.521807+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.991498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.126444+0000","last_change":"2024-09-14T11:17:31.657084+0000","last_active":"2024-09-14T12:15:48.126444+0000","last_peered":"2024-09-14T12:15:48.126444+0000","last_clean":"2024-09-14T12:15:48.126444+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:15:48.126444+0000","last_undegraded":"2024-09-14T12:15:48.126444+0000","last_fullsized":"2024-09-14T12:15:48.126444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:26.090131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'579","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606091+0000","last_change":"2024-09-14T11:17:23.600240+0000","last_active":"2024-09-14T12:14:34.606091+0000","last_peered":"2024-09-14T12:14:34.606091+0000","last_clean":"2024-09-14T12:14:34.606091+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:14:34.606091+0000","last_undegraded":"2024-09-14T12:14:34.606091+0000","last_fullsized":"2024-09-14T12:14:34.606091+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:34.546153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:20.789966+0000","last_change":"2024-09-14T11:17:55.874169+0000","last_active":"2024-09-14T12:13:20.789966+0000","last_peered":"2024-09-14T12:13:20.789966+0000","last_clean":"2024-09-14T12:13:20.789966+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:13:20.789966+0000","last_undegraded":"2024-09-14T12:13:20.789966+0000","last_fullsized":"2024-09-14T12:13:20.789966+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.787464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17505113,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":715,"num_read_kb":58894,"num_write":1317,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313940+0000","last_change":"2024-09-14T11:17:25.606685+0000","last_active":"2024-09-14T12:13:58.313940+0000","last_peered":"2024-09-14T12:13:58.313940+0000","last_clean":"2024-09-14T12:13:58.313940+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:13:58.313940+0000","last_undegraded":"2024-09-14T12:13:58.313940+0000","last_fullsized":"2024-09-14T12:13:58.313940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:26.184797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'479","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.233091+0000","last_change":"2024-09-14T11:17:27.632963+0000","last_active":"2024-09-14T12:15:49.233091+0000","last_peered":"2024-09-14T12:15:49.233091+0000","last_clean":"2024-09-14T12:15:49.233091+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:15:49.233091+0000","last_undegraded":"2024-09-14T12:15:49.233091+0000","last_fullsized":"2024-09-14T12:15:49.233091+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:19.107003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112651,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":1798,"num_write":694,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.313426+0000","last_change":"2024-09-14T11:17:29.642604+0000","last_active":"2024-09-14T12:13:53.313426+0000","last_peered":"2024-09-14T12:13:53.313426+0000","last_clean":"2024-09-14T12:13:53.313426+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:13:53.313426+0000","last_undegraded":"2024-09-14T12:13:53.313426+0000","last_fullsized":"2024-09-14T12:13:53.313426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:39.976613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.210299+0000","last_change":"2024-09-14T11:17:31.660313+0000","last_active":"2024-09-14T12:13:53.210299+0000","last_peered":"2024-09-14T12:13:53.210299+0000","last_clean":"2024-09-14T12:13:53.210299+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:13:53.210299+0000","last_undegraded":"2024-09-14T12:13:53.210299+0000","last_fullsized":"2024-09-14T12:13:53.210299+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:47.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'491","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337413+0000","last_change":"2024-09-14T11:17:23.603415+0000","last_active":"2024-09-14T12:13:38.337413+0000","last_peered":"2024-09-14T12:13:38.337413+0000","last_clean":"2024-09-14T12:13:38.337413+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:13:38.337413+0000","last_undegraded":"2024-09-14T12:13:38.337413+0000","last_fullsized":"2024-09-14T12:13:38.337413+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.406649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'277","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.387199+0000","last_change":"2024-09-14T11:17:21.580769+0000","last_active":"2024-09-14T12:13:48.387199+0000","last_peered":"2024-09-14T12:13:48.387199+0000","last_clean":"2024-09-14T12:13:48.387199+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:13:48.387199+0000","last_undegraded":"2024-09-14T12:13:48.387199+0000","last_fullsized":"2024-09-14T12:13:48.387199+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:27.335044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899414,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":604,"num_read_kb":23428,"num_write":1046,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312463+0000","last_change":"2024-09-14T11:17:25.615155+0000","last_active":"2024-09-14T12:13:43.312463+0000","last_peered":"2024-09-14T12:13:43.312463+0000","last_clean":"2024-09-14T12:13:43.312463+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:13:43.312463+0000","last_undegraded":"2024-09-14T12:13:43.312463+0000","last_fullsized":"2024-09-14T12:13:43.312463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.760805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'283","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.209878+0000","last_change":"2024-09-14T11:17:27.634022+0000","last_active":"2024-09-14T12:15:49.209878+0000","last_peered":"2024-09-14T12:15:49.209878+0000","last_clean":"2024-09-14T12:15:49.209878+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:15:49.209878+0000","last_undegraded":"2024-09-14T12:15:49.209878+0000","last_fullsized":"2024-09-14T12:15:49.209878+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:42.665521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62230,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":1018,"num_write":456,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456437+0000","last_change":"2024-09-14T11:17:29.647566+0000","last_active":"2024-09-14T12:13:50.456437+0000","last_peered":"2024-09-14T12:13:50.456437+0000","last_clean":"2024-09-14T12:13:50.456437+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:13:50.456437+0000","last_undegraded":"2024-09-14T12:13:50.456437+0000","last_fullsized":"2024-09-14T12:13:50.456437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:15.794875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'110","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.479972+0000","last_change":"2024-09-14T11:17:31.655541+0000","last_active":"2024-09-14T12:15:38.479972+0000","last_peered":"2024-09-14T12:15:38.479972+0000","last_clean":"2024-09-14T12:15:38.479972+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:15:38.479972+0000","last_undegraded":"2024-09-14T12:15:38.479972+0000","last_fullsized":"2024-09-14T12:15:38.479972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:33.617603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'541","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755553+0000","last_change":"2024-09-14T11:17:23.599981+0000","last_active":"2024-09-14T12:14:02.755553+0000","last_peered":"2024-09-14T12:14:02.755553+0000","last_clean":"2024-09-14T12:14:02.755553+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:14:02.755553+0000","last_undegraded":"2024-09-14T12:14:02.755553+0000","last_fullsized":"2024-09-14T12:14:02.755553+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:03.188860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'340","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344436+0000","last_change":"2024-09-14T11:17:21.582543+0000","last_active":"2024-09-14T12:13:53.344436+0000","last_peered":"2024-09-14T12:13:53.344436+0000","last_clean":"2024-09-14T12:13:53.344436+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:13:53.344436+0000","last_undegraded":"2024-09-14T12:13:53.344436+0000","last_fullsized":"2024-09-14T12:13:53.344436+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:42.560672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10660161,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":695,"num_read_kb":21492,"num_write":1314,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209141+0000","last_change":"2024-09-14T11:17:25.605008+0000","last_active":"2024-09-14T12:13:43.209141+0000","last_peered":"2024-09-14T12:13:43.209141+0000","last_clean":"2024-09-14T12:13:43.209141+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:13:43.209141+0000","last_undegraded":"2024-09-14T12:13:43.209141+0000","last_fullsized":"2024-09-14T12:13:43.209141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:21.712998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'301","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.239456+0000","last_change":"2024-09-14T11:17:27.627740+0000","last_active":"2024-09-14T12:15:49.239456+0000","last_peered":"2024-09-14T12:15:49.239456+0000","last_clean":"2024-09-14T12:15:49.239456+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:15:49.239456+0000","last_undegraded":"2024-09-14T12:15:49.239456+0000","last_fullsized":"2024-09-14T12:15:49.239456+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:01.987766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59739,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":483,"num_read_kb":952,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.514434+0000","last_change":"2024-09-14T11:17:29.638832+0000","last_active":"2024-09-14T12:15:52.514434+0000","last_peered":"2024-09-14T12:15:52.514434+0000","last_clean":"2024-09-14T12:15:52.514434+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:15:52.514434+0000","last_undegraded":"2024-09-14T12:15:52.514434+0000","last_fullsized":"2024-09-14T12:15:52.514434+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":701,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:59.704823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'183","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.243227+0000","last_change":"2024-09-14T11:17:31.656014+0000","last_active":"2024-09-14T12:15:49.243227+0000","last_peered":"2024-09-14T12:15:49.243227+0000","last_clean":"2024-09-14T12:15:49.243227+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:15:49.243227+0000","last_undegraded":"2024-09-14T12:15:49.243227+0000","last_fullsized":"2024-09-14T12:15:49.243227+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:31.925155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'786","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337480+0000","last_change":"2024-09-14T11:17:23.594812+0000","last_active":"2024-09-14T12:13:38.337480+0000","last_peered":"2024-09-14T12:13:38.337480+0000","last_clean":"2024-09-14T12:13:38.337480+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:13:38.337480+0000","last_undegraded":"2024-09-14T12:13:38.337480+0000","last_fullsized":"2024-09-14T12:13:38.337480+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:20.279963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'266","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338103+0000","last_change":"2024-09-14T11:17:21.572083+0000","last_active":"2024-09-14T12:13:43.338103+0000","last_peered":"2024-09-14T12:13:43.338103+0000","last_clean":"2024-09-14T12:13:43.338103+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:13:43.338103+0000","last_undegraded":"2024-09-14T12:13:43.338103+0000","last_fullsized":"2024-09-14T12:13:43.338103+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:13.146982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6951881,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":413,"num_read_kb":54221,"num_write":900,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.187936+0000","last_change":"2024-09-14T11:17:25.619652+0000","last_active":"2024-09-14T12:15:49.187936+0000","last_peered":"2024-09-14T12:15:49.187936+0000","last_clean":"2024-09-14T12:15:49.187936+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:15:49.187936+0000","last_undegraded":"2024-09-14T12:15:49.187936+0000","last_fullsized":"2024-09-14T12:15:49.187936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:20.219288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219434+0000","last_change":"2024-09-14T11:17:27.632484+0000","last_active":"2024-09-14T12:13:43.219434+0000","last_peered":"2024-09-14T12:13:43.219434+0000","last_clean":"2024-09-14T12:13:43.219434+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:13:43.219434+0000","last_undegraded":"2024-09-14T12:13:43.219434+0000","last_fullsized":"2024-09-14T12:13:43.219434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'779","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.516405+0000","last_change":"2024-09-14T11:17:29.640978+0000","last_active":"2024-09-14T12:15:52.516405+0000","last_peered":"2024-09-14T12:15:52.516405+0000","last_clean":"2024-09-14T12:15:52.516405+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:15:52.516405+0000","last_undegraded":"2024-09-14T12:15:52.516405+0000","last_fullsized":"2024-09-14T12:15:52.516405+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":702,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.396632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.764408+0000","last_change":"2024-09-14T11:17:31.656199+0000","last_active":"2024-09-14T12:14:33.764408+0000","last_peered":"2024-09-14T12:14:33.764408+0000","last_clean":"2024-09-14T12:14:33.764408+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:14:33.764408+0000","last_undegraded":"2024-09-14T12:14:33.764408+0000","last_fullsized":"2024-09-14T12:14:33.764408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:30.802461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'446","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210300+0000","last_change":"2024-09-14T11:17:23.603828+0000","last_active":"2024-09-14T12:14:31.210300+0000","last_peered":"2024-09-14T12:14:31.210300+0000","last_clean":"2024-09-14T12:14:31.210300+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:14:31.210300+0000","last_undegraded":"2024-09-14T12:14:31.210300+0000","last_fullsized":"2024-09-14T12:14:31.210300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:37.153834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'272","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219327+0000","last_change":"2024-09-14T11:17:21.585341+0000","last_active":"2024-09-14T12:13:43.219327+0000","last_peered":"2024-09-14T12:13:43.219327+0000","last_clean":"2024-09-14T12:13:43.219327+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:13:43.219327+0000","last_undegraded":"2024-09-14T12:13:43.219327+0000","last_fullsized":"2024-09-14T12:13:43.219327+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:02.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5522412,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":470,"num_read_kb":11146,"num_write":1013,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338261+0000","last_change":"2024-09-14T11:17:25.616843+0000","last_active":"2024-09-14T12:13:43.338261+0000","last_peered":"2024-09-14T12:13:43.338261+0000","last_clean":"2024-09-14T12:13:43.338261+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:13:43.338261+0000","last_undegraded":"2024-09-14T12:13:43.338261+0000","last_fullsized":"2024-09-14T12:13:43.338261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:24.981755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'359","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.224639+0000","last_change":"2024-09-14T11:17:27.635744+0000","last_active":"2024-09-14T12:15:49.224639+0000","last_peered":"2024-09-14T12:15:49.224639+0000","last_clean":"2024-09-14T12:15:49.224639+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:15:49.224639+0000","last_undegraded":"2024-09-14T12:15:49.224639+0000","last_fullsized":"2024-09-14T12:15:49.224639+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:39.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59251,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":576,"num_read_kb":1082,"num_write":460,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.343756+0000","last_change":"2024-09-14T11:17:29.646394+0000","last_active":"2024-09-14T12:13:48.343756+0000","last_peered":"2024-09-14T12:13:48.343756+0000","last_clean":"2024-09-14T12:13:48.343756+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:13:48.343756+0000","last_undegraded":"2024-09-14T12:13:48.343756+0000","last_fullsized":"2024-09-14T12:13:48.343756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:23.198544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'153","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.201239+0000","last_change":"2024-09-14T11:17:31.657114+0000","last_active":"2024-09-14T12:14:31.201239+0000","last_peered":"2024-09-14T12:14:31.201239+0000","last_clean":"2024-09-14T12:14:31.201239+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:14:31.201239+0000","last_undegraded":"2024-09-14T12:14:31.201239+0000","last_fullsized":"2024-09-14T12:14:31.201239+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:58.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'834","reported_seq":2361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.529186+0000","last_change":"2024-09-14T11:17:23.599852+0000","last_active":"2024-09-14T12:13:48.529186+0000","last_peered":"2024-09-14T12:13:48.529186+0000","last_clean":"2024-09-14T12:13:48.529186+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:13:48.529186+0000","last_undegraded":"2024-09-14T12:13:48.529186+0000","last_fullsized":"2024-09-14T12:13:48.529186+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:20.678363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.465508+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T12:13:13.465508+0000","last_peered":"2024-09-14T12:13:13.465508+0000","last_clean":"2024-09-14T12:13:13.465508+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:13:13.465508+0000","last_undegraded":"2024-09-14T12:13:13.465508+0000","last_fullsized":"2024-09-14T12:13:13.465508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221784+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T12:13:28.221784+0000","last_peered":"2024-09-14T12:13:28.221784+0000","last_clean":"2024-09-14T12:13:28.221784+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:13:28.221784+0000","last_undegraded":"2024-09-14T12:13:28.221784+0000","last_fullsized":"2024-09-14T12:13:28.221784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'286","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:59.802403+0000","last_change":"2024-09-14T11:17:21.591302+0000","last_active":"2024-09-14T12:13:59.802403+0000","last_peered":"2024-09-14T12:13:59.802403+0000","last_clean":"2024-09-14T12:13:59.802403+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:13:59.802403+0000","last_undegraded":"2024-09-14T12:13:59.802403+0000","last_fullsized":"2024-09-14T12:13:59.802403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:29.565797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5920202,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":537,"num_read_kb":16920,"num_write":1021,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470216+0000","last_change":"2024-09-14T11:17:25.613638+0000","last_active":"2024-09-14T12:13:43.470216+0000","last_peered":"2024-09-14T12:13:43.470216+0000","last_clean":"2024-09-14T12:13:43.470216+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:13:43.470216+0000","last_undegraded":"2024-09-14T12:13:43.470216+0000","last_fullsized":"2024-09-14T12:13:43.470216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:59.751658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.237428+0000","last_change":"2024-09-14T11:17:27.633577+0000","last_active":"2024-09-14T12:15:49.237428+0000","last_peered":"2024-09-14T12:15:49.237428+0000","last_clean":"2024-09-14T12:15:49.237428+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:15:49.237428+0000","last_undegraded":"2024-09-14T12:15:49.237428+0000","last_fullsized":"2024-09-14T12:15:49.237428+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.125363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1448,"num_read_kb":3032,"num_write":1382,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456404+0000","last_change":"2024-09-14T11:17:29.646281+0000","last_active":"2024-09-14T12:13:50.456404+0000","last_peered":"2024-09-14T12:13:50.456404+0000","last_clean":"2024-09-14T12:13:50.456404+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:13:50.456404+0000","last_undegraded":"2024-09-14T12:13:50.456404+0000","last_fullsized":"2024-09-14T12:13:50.456404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:03.727278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'170","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.634305+0000","last_change":"2024-09-14T11:17:31.655031+0000","last_active":"2024-09-14T12:14:34.634305+0000","last_peered":"2024-09-14T12:14:34.634305+0000","last_clean":"2024-09-14T12:14:34.634305+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:14:34.634305+0000","last_undegraded":"2024-09-14T12:14:34.634305+0000","last_fullsized":"2024-09-14T12:14:34.634305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:19.605574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'459","reported_seq":2050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208300+0000","last_change":"2024-09-14T11:17:23.599920+0000","last_active":"2024-09-14T12:14:31.208300+0000","last_peered":"2024-09-14T12:14:31.208300+0000","last_clean":"2024-09-14T12:14:31.208300+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:14:31.208300+0000","last_undegraded":"2024-09-14T12:14:31.208300+0000","last_fullsized":"2024-09-14T12:14:31.208300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:33.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466357+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T12:13:18.466357+0000","last_peered":"2024-09-14T12:13:18.466357+0000","last_clean":"2024-09-14T12:13:18.466357+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:13:18.466357+0000","last_undegraded":"2024-09-14T12:13:18.466357+0000","last_fullsized":"2024-09-14T12:13:18.466357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'306","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.117145+0000","last_change":"2024-09-14T11:17:21.582410+0000","last_active":"2024-09-14T12:13:42.117145+0000","last_peered":"2024-09-14T12:13:42.117145+0000","last_clean":"2024-09-14T12:13:42.117145+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:13:42.117145+0000","last_undegraded":"2024-09-14T12:13:42.117145+0000","last_fullsized":"2024-09-14T12:13:42.117145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.881583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730149,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":574,"num_read_kb":9080,"num_write":1205,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.224869+0000","last_change":"2024-09-14T11:17:25.617276+0000","last_active":"2024-09-14T12:13:48.224869+0000","last_peered":"2024-09-14T12:13:48.224869+0000","last_clean":"2024-09-14T12:13:48.224869+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:13:48.224869+0000","last_undegraded":"2024-09-14T12:13:48.224869+0000","last_fullsized":"2024-09-14T12:13:48.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:50.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1285","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.254822+0000","last_change":"2024-09-14T11:17:27.631903+0000","last_active":"2024-09-14T12:15:49.254822+0000","last_peered":"2024-09-14T12:15:49.254822+0000","last_clean":"2024-09-14T12:15:49.254822+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:15:49.254822+0000","last_undegraded":"2024-09-14T12:15:49.254822+0000","last_fullsized":"2024-09-14T12:15:49.254822+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:33.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259105,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2005,"num_read_kb":3622,"num_write":1136,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471608+0000","last_change":"2024-09-14T11:17:29.645394+0000","last_active":"2024-09-14T12:13:53.471608+0000","last_peered":"2024-09-14T12:13:53.471608+0000","last_clean":"2024-09-14T12:13:53.471608+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:13:53.471608+0000","last_undegraded":"2024-09-14T12:13:53.471608+0000","last_fullsized":"2024-09-14T12:13:53.471608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:49.499047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211448+0000","last_change":"2024-09-14T11:17:31.658892+0000","last_active":"2024-09-14T12:14:03.211448+0000","last_peered":"2024-09-14T12:14:03.211448+0000","last_clean":"2024-09-14T12:14:03.211448+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:14:03.211448+0000","last_undegraded":"2024-09-14T12:14:03.211448+0000","last_fullsized":"2024-09-14T12:14:03.211448+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:34.868207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'656","reported_seq":2304,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606004+0000","last_change":"2024-09-14T11:17:23.597525+0000","last_active":"2024-09-14T12:14:34.606004+0000","last_peered":"2024-09-14T12:14:34.606004+0000","last_clean":"2024-09-14T12:14:34.606004+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:14:34.606004+0000","last_undegraded":"2024-09-14T12:14:34.606004+0000","last_fullsized":"2024-09-14T12:14:34.606004+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:35.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.310703+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T12:13:28.310703+0000","last_peered":"2024-09-14T12:13:28.310703+0000","last_clean":"2024-09-14T12:13:28.310703+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:13:28.310703+0000","last_undegraded":"2024-09-14T12:13:28.310703+0000","last_fullsized":"2024-09-14T12:13:28.310703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'302","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.739230+0000","last_change":"2024-09-14T11:17:21.573767+0000","last_active":"2024-09-14T12:15:43.739230+0000","last_peered":"2024-09-14T12:15:43.739230+0000","last_clean":"2024-09-14T12:15:43.739230+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:15:43.739230+0000","last_undegraded":"2024-09-14T12:15:43.739230+0000","last_fullsized":"2024-09-14T12:15:43.739230+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:55.914740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14553424,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":614,"num_read_kb":56413,"num_write":1078,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312976+0000","last_change":"2024-09-14T11:17:25.616518+0000","last_active":"2024-09-14T12:13:48.312976+0000","last_peered":"2024-09-14T12:13:48.312976+0000","last_clean":"2024-09-14T12:13:48.312976+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:13:48.312976+0000","last_undegraded":"2024-09-14T12:13:48.312976+0000","last_fullsized":"2024-09-14T12:13:48.312976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:31.140976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'258","reported_seq":1503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.376331+0000","last_change":"2024-09-14T11:17:27.633187+0000","last_active":"2024-09-14T12:15:49.376331+0000","last_peered":"2024-09-14T12:15:49.376331+0000","last_clean":"2024-09-14T12:15:49.376331+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:15:49.376331+0000","last_undegraded":"2024-09-14T12:15:49.376331+0000","last_fullsized":"2024-09-14T12:15:49.376331+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.161248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455781+0000","last_change":"2024-09-14T11:17:29.647473+0000","last_active":"2024-09-14T12:13:45.455781+0000","last_peered":"2024-09-14T12:13:45.455781+0000","last_clean":"2024-09-14T12:13:45.455781+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:13:45.455781+0000","last_undegraded":"2024-09-14T12:13:45.455781+0000","last_fullsized":"2024-09-14T12:13:45.455781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:28.646908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'797","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.930217+0000","last_change":"2024-09-14T11:17:23.593249+0000","last_active":"2024-09-14T12:13:46.930217+0000","last_peered":"2024-09-14T12:13:46.930217+0000","last_clean":"2024-09-14T12:13:46.930217+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:13:46.930217+0000","last_undegraded":"2024-09-14T12:13:46.930217+0000","last_fullsized":"2024-09-14T12:13:46.930217+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:29.005386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221722+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T12:13:28.221722+0000","last_peered":"2024-09-14T12:13:28.221722+0000","last_clean":"2024-09-14T12:13:28.221722+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:13:28.221722+0000","last_undegraded":"2024-09-14T12:13:28.221722+0000","last_fullsized":"2024-09-14T12:13:28.221722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'349","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.745606+0000","last_change":"2024-09-14T11:17:55.703523+0000","last_active":"2024-09-14T12:13:38.745606+0000","last_peered":"2024-09-14T12:13:38.745606+0000","last_clean":"2024-09-14T12:13:38.745606+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:13:38.745606+0000","last_undegraded":"2024-09-14T12:13:38.745606+0000","last_fullsized":"2024-09-14T12:13:38.745606+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.352121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16087121,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":660,"num_read_kb":100618,"num_write":1288,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.188503+0000","last_change":"2024-09-14T11:17:25.612572+0000","last_active":"2024-09-14T12:15:49.188503+0000","last_peered":"2024-09-14T12:15:49.188503+0000","last_clean":"2024-09-14T12:15:49.188503+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:15:49.188503+0000","last_undegraded":"2024-09-14T12:15:49.188503+0000","last_fullsized":"2024-09-14T12:15:49.188503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:50.762349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'141","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.389956+0000","last_change":"2024-09-14T11:17:27.629622+0000","last_active":"2024-09-14T12:15:49.389956+0000","last_peered":"2024-09-14T12:15:49.389956+0000","last_clean":"2024-09-14T12:15:49.389956+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:15:49.389956+0000","last_undegraded":"2024-09-14T12:15:49.389956+0000","last_fullsized":"2024-09-14T12:15:49.389956+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:36.891527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344480+0000","last_change":"2024-09-14T11:17:29.643346+0000","last_active":"2024-09-14T12:13:53.344480+0000","last_peered":"2024-09-14T12:13:53.344480+0000","last_clean":"2024-09-14T12:13:53.344480+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:13:53.344480+0000","last_undegraded":"2024-09-14T12:13:53.344480+0000","last_fullsized":"2024-09-14T12:13:53.344480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:54.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'152","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225431+0000","last_change":"2024-09-14T11:17:31.658341+0000","last_active":"2024-09-14T12:13:53.225431+0000","last_peered":"2024-09-14T12:13:53.225431+0000","last_clean":"2024-09-14T12:13:53.225431+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:13:53.225431+0000","last_undegraded":"2024-09-14T12:13:53.225431+0000","last_fullsized":"2024-09-14T12:13:53.225431+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:31.293556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'538","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771726+0000","last_change":"2024-09-14T11:17:23.595767+0000","last_active":"2024-09-14T12:14:33.771726+0000","last_peered":"2024-09-14T12:14:33.771726+0000","last_clean":"2024-09-14T12:14:33.771726+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:14:33.771726+0000","last_undegraded":"2024-09-14T12:14:33.771726+0000","last_fullsized":"2024-09-14T12:14:33.771726+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:17.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'299","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225524+0000","last_change":"2024-09-14T11:17:21.587230+0000","last_active":"2024-09-14T12:13:53.225524+0000","last_peered":"2024-09-14T12:13:53.225524+0000","last_clean":"2024-09-14T12:13:53.225524+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:13:53.225524+0000","last_undegraded":"2024-09-14T12:13:53.225524+0000","last_fullsized":"2024-09-14T12:13:53.225524+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:54.075546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280479,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":539,"num_read_kb":15898,"num_write":1106,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207418+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T12:13:28.207418+0000","last_peered":"2024-09-14T12:13:28.207418+0000","last_clean":"2024-09-14T12:13:28.207418+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:13:28.207418+0000","last_undegraded":"2024-09-14T12:13:28.207418+0000","last_fullsized":"2024-09-14T12:13:28.207418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455178+0000","last_change":"2024-09-14T11:17:25.613788+0000","last_active":"2024-09-14T12:13:40.455178+0000","last_peered":"2024-09-14T12:13:40.455178+0000","last_clean":"2024-09-14T12:13:40.455178+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:13:40.455178+0000","last_undegraded":"2024-09-14T12:13:40.455178+0000","last_fullsized":"2024-09-14T12:13:40.455178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:16.381616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'586","reported_seq":1248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.218406+0000","last_change":"2024-09-14T11:17:27.638848+0000","last_active":"2024-09-14T12:15:49.218406+0000","last_peered":"2024-09-14T12:15:49.218406+0000","last_clean":"2024-09-14T12:15:49.218406+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:15:49.218406+0000","last_undegraded":"2024-09-14T12:15:49.218406+0000","last_fullsized":"2024-09-14T12:15:49.218406+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.865878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104200,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1639,"num_read_kb":2569,"num_write":2206,"num_write_kb":2029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339077+0000","last_change":"2024-09-14T11:17:29.647531+0000","last_active":"2024-09-14T12:13:48.339077+0000","last_peered":"2024-09-14T12:13:48.339077+0000","last_clean":"2024-09-14T12:13:48.339077+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:13:48.339077+0000","last_undegraded":"2024-09-14T12:13:48.339077+0000","last_fullsized":"2024-09-14T12:13:48.339077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:29.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.737717+0000","last_change":"2024-09-14T11:17:31.650597+0000","last_active":"2024-09-14T12:14:31.737717+0000","last_peered":"2024-09-14T12:14:31.737717+0000","last_clean":"2024-09-14T12:14:31.737717+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:14:31.737717+0000","last_undegraded":"2024-09-14T12:14:31.737717+0000","last_fullsized":"2024-09-14T12:14:31.737717+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:24.077884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'812","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503663+0000","last_change":"2024-09-14T11:17:23.597119+0000","last_active":"2024-09-14T12:15:18.503663+0000","last_peered":"2024-09-14T12:15:18.503663+0000","last_clean":"2024-09-14T12:15:18.503663+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:15:18.503663+0000","last_undegraded":"2024-09-14T12:15:18.503663+0000","last_fullsized":"2024-09-14T12:15:18.503663+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:41.357900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.208536+0000","last_change":"2024-09-14T11:17:21.572174+0000","last_active":"2024-09-14T12:13:38.208536+0000","last_peered":"2024-09-14T12:13:38.208536+0000","last_clean":"2024-09-14T12:13:38.208536+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:13:38.208536+0000","last_undegraded":"2024-09-14T12:13:38.208536+0000","last_fullsized":"2024-09-14T12:13:38.208536+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:44.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6367698,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":735,"num_read_kb":26393,"num_write":1206,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468686+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T12:13:33.468686+0000","last_peered":"2024-09-14T12:13:33.468686+0000","last_clean":"2024-09-14T12:13:33.468686+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:13:33.468686+0000","last_undegraded":"2024-09-14T12:13:33.468686+0000","last_fullsized":"2024-09-14T12:13:33.468686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455177+0000","last_change":"2024-09-14T11:17:25.613944+0000","last_active":"2024-09-14T12:13:43.455177+0000","last_peered":"2024-09-14T12:13:43.455177+0000","last_clean":"2024-09-14T12:13:43.455177+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:13:43.455177+0000","last_undegraded":"2024-09-14T12:13:43.455177+0000","last_fullsized":"2024-09-14T12:13:43.455177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.612668+0000","last_change":"2024-09-14T11:17:27.630067+0000","last_active":"2024-09-14T12:14:34.612668+0000","last_peered":"2024-09-14T12:14:34.612668+0000","last_clean":"2024-09-14T12:14:34.612668+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:14:34.612668+0000","last_undegraded":"2024-09-14T12:14:34.612668+0000","last_fullsized":"2024-09-14T12:14:34.612668+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:12.127579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'807","reported_seq":6805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.257470+0000","last_change":"2024-09-14T11:17:29.642605+0000","last_active":"2024-09-14T12:15:49.257470+0000","last_peered":"2024-09-14T12:15:49.257470+0000","last_clean":"2024-09-14T12:15:49.257470+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:15:49.257470+0000","last_undegraded":"2024-09-14T12:15:49.257470+0000","last_fullsized":"2024-09-14T12:15:49.257470+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:10.588277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'138","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.221695+0000","last_change":"2024-09-14T11:17:31.658974+0000","last_active":"2024-09-14T12:14:03.221695+0000","last_peered":"2024-09-14T12:14:03.221695+0000","last_clean":"2024-09-14T12:14:03.221695+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:14:03.221695+0000","last_undegraded":"2024-09-14T12:14:03.221695+0000","last_fullsized":"2024-09-14T12:14:03.221695+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:06.184401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1159","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.578456+0000","last_change":"2024-09-14T11:17:23.594825+0000","last_active":"2024-09-14T12:13:55.578456+0000","last_peered":"2024-09-14T12:13:55.578456+0000","last_clean":"2024-09-14T12:13:55.578456+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:13:55.578456+0000","last_undegraded":"2024-09-14T12:13:55.578456+0000","last_fullsized":"2024-09-14T12:13:55.578456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":1100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:08.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'256","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219480+0000","last_change":"2024-09-14T11:17:21.588659+0000","last_active":"2024-09-14T12:13:43.219480+0000","last_peered":"2024-09-14T12:13:43.219480+0000","last_clean":"2024-09-14T12:13:43.219480+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:13:43.219480+0000","last_undegraded":"2024-09-14T12:13:43.219480+0000","last_fullsized":"2024-09-14T12:13:43.219480+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:03.346229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4470127,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":464,"num_read_kb":24953,"num_write":865,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.208010+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T12:13:33.208010+0000","last_peered":"2024-09-14T12:13:33.208010+0000","last_clean":"2024-09-14T12:13:33.208010+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:13:33.208010+0000","last_undegraded":"2024-09-14T12:13:33.208010+0000","last_fullsized":"2024-09-14T12:13:33.208010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338159+0000","last_change":"2024-09-14T11:17:25.612971+0000","last_active":"2024-09-14T12:13:43.338159+0000","last_peered":"2024-09-14T12:13:43.338159+0000","last_clean":"2024-09-14T12:13:43.338159+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:13:43.338159+0000","last_undegraded":"2024-09-14T12:13:43.338159+0000","last_fullsized":"2024-09-14T12:13:43.338159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:01.406616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'112","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338189+0000","last_change":"2024-09-14T11:17:27.630261+0000","last_active":"2024-09-14T12:13:43.338189+0000","last_peered":"2024-09-14T12:13:43.338189+0000","last_clean":"2024-09-14T12:13:43.338189+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:13:43.338189+0000","last_undegraded":"2024-09-14T12:13:43.338189+0000","last_fullsized":"2024-09-14T12:13:43.338189+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:38.765597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'798","reported_seq":2498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.518226+0000","last_change":"2024-09-14T11:17:29.646106+0000","last_active":"2024-09-14T12:15:52.518226+0000","last_peered":"2024-09-14T12:15:52.518226+0000","last_clean":"2024-09-14T12:15:52.518226+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:15:52.518226+0000","last_undegraded":"2024-09-14T12:15:52.518226+0000","last_fullsized":"2024-09-14T12:15:52.518226+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.541372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'195","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.076897+0000","last_change":"2024-09-14T11:17:31.656972+0000","last_active":"2024-09-14T12:14:33.076897+0000","last_peered":"2024-09-14T12:14:33.076897+0000","last_clean":"2024-09-14T12:14:33.076897+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:14:33.076897+0000","last_undegraded":"2024-09-14T12:14:33.076897+0000","last_fullsized":"2024-09-14T12:14:33.076897+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:57.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619317+0000","last_change":"2024-09-14T11:17:23.593644+0000","last_active":"2024-09-14T12:13:57.619317+0000","last_peered":"2024-09-14T12:13:57.619317+0000","last_clean":"2024-09-14T12:13:57.619317+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:13:57.619317+0000","last_undegraded":"2024-09-14T12:13:57.619317+0000","last_fullsized":"2024-09-14T12:13:57.619317+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:42.299861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'336","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455823+0000","last_change":"2024-09-14T11:17:21.581527+0000","last_active":"2024-09-14T12:13:45.455823+0000","last_peered":"2024-09-14T12:13:45.455823+0000","last_clean":"2024-09-14T12:13:45.455823+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:13:45.455823+0000","last_undegraded":"2024-09-14T12:13:45.455823+0000","last_fullsized":"2024-09-14T12:13:45.455823+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:36.511139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3691887,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":559,"num_read_kb":7690,"num_write":1039,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453887+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T12:13:33.453887+0000","last_peered":"2024-09-14T12:13:33.453887+0000","last_clean":"2024-09-14T12:13:33.453887+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:13:33.453887+0000","last_undegraded":"2024-09-14T12:13:33.453887+0000","last_fullsized":"2024-09-14T12:13:33.453887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219350+0000","last_change":"2024-09-14T11:17:25.617838+0000","last_active":"2024-09-14T12:13:43.219350+0000","last_peered":"2024-09-14T12:13:43.219350+0000","last_clean":"2024-09-14T12:13:43.219350+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:13:43.219350+0000","last_undegraded":"2024-09-14T12:13:43.219350+0000","last_fullsized":"2024-09-14T12:13:43.219350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.722602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'704","reported_seq":1413,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.214861+0000","last_change":"2024-09-14T11:17:27.628721+0000","last_active":"2024-09-14T12:15:49.214861+0000","last_peered":"2024-09-14T12:15:49.214861+0000","last_clean":"2024-09-14T12:15:49.214861+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:15:49.214861+0000","last_undegraded":"2024-09-14T12:15:49.214861+0000","last_fullsized":"2024-09-14T12:15:49.214861+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:43.091580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1237,"num_read_kb":2632,"num_write":1012,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219994+0000","last_change":"2024-09-14T11:17:29.643858+0000","last_active":"2024-09-14T12:13:48.219994+0000","last_peered":"2024-09-14T12:13:48.219994+0000","last_clean":"2024-09-14T12:13:48.219994+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:13:48.219994+0000","last_undegraded":"2024-09-14T12:13:48.219994+0000","last_fullsized":"2024-09-14T12:13:48.219994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.290912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'112","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.590948+0000","last_change":"2024-09-14T11:17:31.659136+0000","last_active":"2024-09-14T12:14:34.590948+0000","last_peered":"2024-09-14T12:14:34.590948+0000","last_clean":"2024-09-14T12:14:34.590948+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:14:34.590948+0000","last_undegraded":"2024-09-14T12:14:34.590948+0000","last_fullsized":"2024-09-14T12:14:34.590948+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:30.679212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'154","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.818840+0000","last_change":"2024-09-14T11:17:31.657903+0000","last_active":"2024-09-14T12:14:34.818840+0000","last_peered":"2024-09-14T12:14:34.818840+0000","last_clean":"2024-09-14T12:14:34.818840+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:14:34.818840+0000","last_undegraded":"2024-09-14T12:14:34.818840+0000","last_fullsized":"2024-09-14T12:14:34.818840+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:29.439862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'376","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.886093+0000","last_change":"2024-09-14T11:17:23.593275+0000","last_active":"2024-09-14T12:13:38.886093+0000","last_peered":"2024-09-14T12:13:38.886093+0000","last_clean":"2024-09-14T12:13:38.886093+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:13:38.886093+0000","last_undegraded":"2024-09-14T12:13:38.886093+0000","last_fullsized":"2024-09-14T12:13:38.886093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:51.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'293","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.336037+0000","last_change":"2024-09-14T11:17:21.585438+0000","last_active":"2024-09-14T12:13:28.336037+0000","last_peered":"2024-09-14T12:13:28.336037+0000","last_clean":"2024-09-14T12:13:28.336037+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:13:28.336037+0000","last_undegraded":"2024-09-14T12:13:28.336037+0000","last_fullsized":"2024-09-14T12:13:28.336037+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:54.991062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049101,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":641,"num_read_kb":30194,"num_write":1071,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.962929+0000","last_change":"2024-09-14T11:17:25.614818+0000","last_active":"2024-09-14T12:15:48.962929+0000","last_peered":"2024-09-14T12:15:48.962929+0000","last_clean":"2024-09-14T12:15:48.962929+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:15:48.962929+0000","last_undegraded":"2024-09-14T12:15:48.962929+0000","last_fullsized":"2024-09-14T12:15:48.962929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.190710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'294","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236190+0000","last_change":"2024-09-14T11:17:27.630446+0000","last_active":"2024-09-14T12:15:48.236190+0000","last_peered":"2024-09-14T12:15:48.236190+0000","last_clean":"2024-09-14T12:15:48.236190+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:15:48.236190+0000","last_undegraded":"2024-09-14T12:15:48.236190+0000","last_fullsized":"2024-09-14T12:15:48.236190+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:50.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66272,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1020,"num_write":404,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.218125+0000","last_change":"2024-09-14T11:17:29.645258+0000","last_active":"2024-09-14T12:13:33.218125+0000","last_peered":"2024-09-14T12:13:33.218125+0000","last_clean":"2024-09-14T12:13:33.218125+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:13:33.218125+0000","last_undegraded":"2024-09-14T12:13:33.218125+0000","last_fullsized":"2024-09-14T12:13:33.218125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:46.921971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'432","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605972+0000","last_change":"2024-09-14T11:17:23.600768+0000","last_active":"2024-09-14T12:14:34.605972+0000","last_peered":"2024-09-14T12:14:34.605972+0000","last_clean":"2024-09-14T12:14:34.605972+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:14:34.605972+0000","last_undegraded":"2024-09-14T12:14:34.605972+0000","last_fullsized":"2024-09-14T12:14:34.605972+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:12.282064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'317","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.463351+0000","last_change":"2024-09-14T11:17:21.581055+0000","last_active":"2024-09-14T12:12:58.463351+0000","last_peered":"2024-09-14T12:12:58.463351+0000","last_clean":"2024-09-14T12:12:58.463351+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:12:58.463351+0000","last_undegraded":"2024-09-14T12:12:58.463351+0000","last_fullsized":"2024-09-14T12:12:58.463351+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.405999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2349190,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":512,"num_read_kb":23221,"num_write":1133,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.217660+0000","last_change":"2024-09-14T11:17:25.615312+0000","last_active":"2024-09-14T12:13:28.217660+0000","last_peered":"2024-09-14T12:13:28.217660+0000","last_clean":"2024-09-14T12:13:28.217660+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:13:28.217660+0000","last_undegraded":"2024-09-14T12:13:28.217660+0000","last_fullsized":"2024-09-14T12:13:28.217660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:18.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.936226+0000","last_change":"2024-09-14T11:17:27.636113+0000","last_active":"2024-09-14T12:13:46.936226+0000","last_peered":"2024-09-14T12:13:46.936226+0000","last_clean":"2024-09-14T12:13:46.936226+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:13:46.936226+0000","last_undegraded":"2024-09-14T12:13:46.936226+0000","last_fullsized":"2024-09-14T12:13:46.936226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:28.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468624+0000","last_change":"2024-09-14T11:17:29.642497+0000","last_active":"2024-09-14T12:13:33.468624+0000","last_peered":"2024-09-14T12:13:33.468624+0000","last_clean":"2024-09-14T12:13:33.468624+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:13:33.468624+0000","last_undegraded":"2024-09-14T12:13:33.468624+0000","last_fullsized":"2024-09-14T12:13:33.468624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:18.572740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.825413+0000","last_change":"2024-09-14T11:17:31.655716+0000","last_active":"2024-09-14T12:14:33.825413+0000","last_peered":"2024-09-14T12:14:33.825413+0000","last_clean":"2024-09-14T12:14:33.825413+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:14:33.825413+0000","last_undegraded":"2024-09-14T12:14:33.825413+0000","last_fullsized":"2024-09-14T12:14:33.825413+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:00.360800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'491","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.116559+0000","last_change":"2024-09-14T11:17:23.601965+0000","last_active":"2024-09-14T12:15:48.116559+0000","last_peered":"2024-09-14T12:15:48.116559+0000","last_clean":"2024-09-14T12:15:48.116559+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:15:48.116559+0000","last_undegraded":"2024-09-14T12:15:48.116559+0000","last_fullsized":"2024-09-14T12:15:48.116559+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:59.504121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'290","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:22.843550+0000","last_change":"2024-09-14T11:17:21.589616+0000","last_active":"2024-09-14T12:13:22.843550+0000","last_peered":"2024-09-14T12:13:22.843550+0000","last_clean":"2024-09-14T12:13:22.843550+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:13:22.843550+0000","last_undegraded":"2024-09-14T12:13:22.843550+0000","last_fullsized":"2024-09-14T12:13:22.843550+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:27.751657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14192749,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":584,"num_read_kb":51938,"num_write":1037,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.467979+0000","last_change":"2024-09-14T11:17:25.617478+0000","last_active":"2024-09-14T12:13:28.467979+0000","last_peered":"2024-09-14T12:13:28.467979+0000","last_clean":"2024-09-14T12:13:28.467979+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:13:28.467979+0000","last_undegraded":"2024-09-14T12:13:28.467979+0000","last_fullsized":"2024-09-14T12:13:28.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:19.271955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236218+0000","last_change":"2024-09-14T11:17:27.636107+0000","last_active":"2024-09-14T12:15:48.236218+0000","last_peered":"2024-09-14T12:15:48.236218+0000","last_clean":"2024-09-14T12:15:48.236218+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:15:48.236218+0000","last_undegraded":"2024-09-14T12:15:48.236218+0000","last_fullsized":"2024-09-14T12:15:48.236218+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:04.296570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1069,"num_write":430,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453820+0000","last_change":"2024-09-14T11:17:29.643307+0000","last_active":"2024-09-14T12:13:33.453820+0000","last_peered":"2024-09-14T12:13:33.453820+0000","last_clean":"2024-09-14T12:13:33.453820+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:13:33.453820+0000","last_undegraded":"2024-09-14T12:13:33.453820+0000","last_fullsized":"2024-09-14T12:13:33.453820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:35.656780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.811510+0000","last_change":"2024-09-14T11:17:31.659547+0000","last_active":"2024-09-14T12:13:42.811510+0000","last_peered":"2024-09-14T12:13:42.811510+0000","last_clean":"2024-09-14T12:13:42.811510+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:13:42.811510+0000","last_undegraded":"2024-09-14T12:13:42.811510+0000","last_fullsized":"2024-09-14T12:13:42.811510+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:01.530736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'927","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208965+0000","last_change":"2024-09-14T11:17:23.598429+0000","last_active":"2024-09-14T12:14:31.208965+0000","last_peered":"2024-09-14T12:14:31.208965+0000","last_clean":"2024-09-14T12:14:31.208965+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:14:31.208965+0000","last_undegraded":"2024-09-14T12:14:31.208965+0000","last_fullsized":"2024-09-14T12:14:31.208965+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.669362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'282","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.849222+0000","last_change":"2024-09-14T11:17:21.587300+0000","last_active":"2024-09-14T12:14:28.849222+0000","last_peered":"2024-09-14T12:14:28.849222+0000","last_clean":"2024-09-14T12:14:28.849222+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:14:28.849222+0000","last_undegraded":"2024-09-14T12:14:28.849222+0000","last_fullsized":"2024-09-14T12:14:28.849222+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:29.886995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7128357,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":600,"num_read_kb":18788,"num_write":1048,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453138+0000","last_change":"2024-09-14T11:17:25.614842+0000","last_active":"2024-09-14T12:13:28.453138+0000","last_peered":"2024-09-14T12:13:28.453138+0000","last_clean":"2024-09-14T12:13:28.453138+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:13:28.453138+0000","last_undegraded":"2024-09-14T12:13:28.453138+0000","last_fullsized":"2024-09-14T12:13:28.453138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:42.011559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'298","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.488988+0000","last_change":"2024-09-14T11:17:27.628464+0000","last_active":"2024-09-14T12:15:48.488988+0000","last_peered":"2024-09-14T12:15:48.488988+0000","last_clean":"2024-09-14T12:15:48.488988+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:15:48.488988+0000","last_undegraded":"2024-09-14T12:15:48.488988+0000","last_fullsized":"2024-09-14T12:15:48.488988+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.155512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":1097,"num_write":412,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453988+0000","last_change":"2024-09-14T11:17:29.647028+0000","last_active":"2024-09-14T12:13:30.453988+0000","last_peered":"2024-09-14T12:13:30.453988+0000","last_clean":"2024-09-14T12:13:30.453988+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:13:30.453988+0000","last_undegraded":"2024-09-14T12:13:30.453988+0000","last_fullsized":"2024-09-14T12:13:30.453988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:25.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'446","reported_seq":2072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208631+0000","last_change":"2024-09-14T11:17:23.593931+0000","last_active":"2024-09-14T12:14:31.208631+0000","last_peered":"2024-09-14T12:14:31.208631+0000","last_clean":"2024-09-14T12:14:31.208631+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:14:31.208631+0000","last_undegraded":"2024-09-14T12:14:31.208631+0000","last_fullsized":"2024-09-14T12:14:31.208631+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:31.575674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'271","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213772+0000","last_change":"2024-09-14T11:17:21.580778+0000","last_active":"2024-09-14T12:12:58.213772+0000","last_peered":"2024-09-14T12:12:58.213772+0000","last_clean":"2024-09-14T12:12:58.213772+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:12:58.213772+0000","last_undegraded":"2024-09-14T12:12:58.213772+0000","last_fullsized":"2024-09-14T12:12:58.213772+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.109271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11405599,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":713,"num_read_kb":38674,"num_write":1003,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454040+0000","last_change":"2024-09-14T11:17:25.616189+0000","last_active":"2024-09-14T12:13:30.454040+0000","last_peered":"2024-09-14T12:13:30.454040+0000","last_clean":"2024-09-14T12:13:30.454040+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:13:30.454040+0000","last_undegraded":"2024-09-14T12:13:30.454040+0000","last_fullsized":"2024-09-14T12:13:30.454040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:01.244165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'482","reported_seq":1102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.211205+0000","last_change":"2024-09-14T11:17:27.633619+0000","last_active":"2024-09-14T12:15:49.211205+0000","last_peered":"2024-09-14T12:15:49.211205+0000","last_clean":"2024-09-14T12:15:49.211205+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:15:49.211205+0000","last_undegraded":"2024-09-14T12:15:49.211205+0000","last_fullsized":"2024-09-14T12:15:49.211205+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:36.703508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":852,"num_read_kb":1825,"num_write":744,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213328+0000","last_change":"2024-09-14T11:17:29.645579+0000","last_active":"2024-09-14T12:12:33.213328+0000","last_peered":"2024-09-14T12:12:33.213328+0000","last_clean":"2024-09-14T12:12:33.213328+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:12:33.213328+0000","last_undegraded":"2024-09-14T12:12:33.213328+0000","last_fullsized":"2024-09-14T12:12:33.213328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:26.891079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'838","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208276+0000","last_change":"2024-09-14T11:17:23.595214+0000","last_active":"2024-09-14T12:14:31.208276+0000","last_peered":"2024-09-14T12:14:31.208276+0000","last_clean":"2024-09-14T12:14:31.208276+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:14:31.208276+0000","last_undegraded":"2024-09-14T12:14:31.208276+0000","last_fullsized":"2024-09-14T12:14:31.208276+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:09.844778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'324","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.453765+0000","last_change":"2024-09-14T11:17:21.579786+0000","last_active":"2024-09-14T12:13:32.453765+0000","last_peered":"2024-09-14T12:13:32.453765+0000","last_clean":"2024-09-14T12:13:32.453765+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:13:32.453765+0000","last_undegraded":"2024-09-14T12:13:32.453765+0000","last_fullsized":"2024-09-14T12:13:32.453765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733331,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":565,"num_read_kb":5748,"num_write":1181,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455241+0000","last_change":"2024-09-14T11:17:25.616062+0000","last_active":"2024-09-14T12:13:43.455241+0000","last_peered":"2024-09-14T12:13:43.455241+0000","last_clean":"2024-09-14T12:13:43.455241+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:13:43.455241+0000","last_undegraded":"2024-09-14T12:13:43.455241+0000","last_fullsized":"2024-09-14T12:13:43.455241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.590638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'308","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.481804+0000","last_change":"2024-09-14T11:17:27.631864+0000","last_active":"2024-09-14T12:14:58.481804+0000","last_peered":"2024-09-14T12:14:58.481804+0000","last_clean":"2024-09-14T12:14:58.481804+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:14:58.481804+0000","last_undegraded":"2024-09-14T12:14:58.481804+0000","last_fullsized":"2024-09-14T12:14:58.481804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.144668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":978,"num_write":424,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201536+0000","last_change":"2024-09-14T11:17:29.640091+0000","last_active":"2024-09-14T12:12:33.201536+0000","last_peered":"2024-09-14T12:12:33.201536+0000","last_clean":"2024-09-14T12:12:33.201536+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:12:33.201536+0000","last_undegraded":"2024-09-14T12:12:33.201536+0000","last_fullsized":"2024-09-14T12:12:33.201536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:15.297752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'201","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.078225+0000","last_change":"2024-09-14T11:17:31.654553+0000","last_active":"2024-09-14T12:14:32.078225+0000","last_peered":"2024-09-14T12:14:32.078225+0000","last_clean":"2024-09-14T12:14:32.078225+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:14:32.078225+0000","last_undegraded":"2024-09-14T12:14:32.078225+0000","last_fullsized":"2024-09-14T12:14:32.078225+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:30.957381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'415","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208752+0000","last_change":"2024-09-14T11:17:23.597737+0000","last_active":"2024-09-14T12:14:31.208752+0000","last_peered":"2024-09-14T12:14:31.208752+0000","last_clean":"2024-09-14T12:14:31.208752+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:14:31.208752+0000","last_undegraded":"2024-09-14T12:14:31.208752+0000","last_fullsized":"2024-09-14T12:14:31.208752+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.853930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'308","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:24.386036+0000","last_change":"2024-09-14T11:17:21.572704+0000","last_active":"2024-09-14T12:12:24.386036+0000","last_peered":"2024-09-14T12:12:24.386036+0000","last_clean":"2024-09-14T12:12:24.386036+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:12:24.386036+0000","last_undegraded":"2024-09-14T12:12:24.386036+0000","last_fullsized":"2024-09-14T12:12:24.386036+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:48.097453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13018890,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":718,"num_read_kb":55641,"num_write":1232,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.327534+0000","last_change":"2024-09-14T11:17:25.615822+0000","last_active":"2024-09-14T12:12:28.327534+0000","last_peered":"2024-09-14T12:12:28.327534+0000","last_clean":"2024-09-14T12:12:28.327534+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:12:28.327534+0000","last_undegraded":"2024-09-14T12:12:28.327534+0000","last_fullsized":"2024-09-14T12:12:28.327534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:36.413046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236297+0000","last_change":"2024-09-14T11:17:27.632371+0000","last_active":"2024-09-14T12:15:48.236297+0000","last_peered":"2024-09-14T12:15:48.236297+0000","last_clean":"2024-09-14T12:15:48.236297+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:15:48.236297+0000","last_undegraded":"2024-09-14T12:15:48.236297+0000","last_fullsized":"2024-09-14T12:15:48.236297+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:48.220034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64399,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1008,"num_write":400,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209176+0000","last_change":"2024-09-14T11:17:29.643082+0000","last_active":"2024-09-14T12:13:43.209176+0000","last_peered":"2024-09-14T12:13:43.209176+0000","last_clean":"2024-09-14T12:13:43.209176+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:13:43.209176+0000","last_undegraded":"2024-09-14T12:13:43.209176+0000","last_fullsized":"2024-09-14T12:13:43.209176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:03.359386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'100","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.251218+0000","last_change":"2024-09-14T11:17:31.657761+0000","last_active":"2024-09-14T12:15:49.251218+0000","last_peered":"2024-09-14T12:15:49.251218+0000","last_clean":"2024-09-14T12:15:49.251218+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:15:49.251218+0000","last_undegraded":"2024-09-14T12:15:49.251218+0000","last_fullsized":"2024-09-14T12:15:49.251218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.568137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'483","reported_seq":2020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869633+0000","last_change":"2024-09-14T11:17:23.594002+0000","last_active":"2024-09-14T12:13:31.869633+0000","last_peered":"2024-09-14T12:13:31.869633+0000","last_clean":"2024-09-14T12:13:31.869633+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:13:31.869633+0000","last_undegraded":"2024-09-14T12:13:31.869633+0000","last_fullsized":"2024-09-14T12:13:31.869633+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:29.422949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'375","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.446252+0000","last_change":"2024-09-14T11:17:21.582882+0000","last_active":"2024-09-14T12:12:25.446252+0000","last_peered":"2024-09-14T12:12:25.446252+0000","last_clean":"2024-09-14T12:12:25.446252+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:12:25.446252+0000","last_undegraded":"2024-09-14T12:12:25.446252+0000","last_fullsized":"2024-09-14T12:12:25.446252+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:26.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250648,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1125,"num_read_kb":773,"num_write":1245,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.200982+0000","last_change":"2024-09-14T11:17:25.606521+0000","last_active":"2024-09-14T12:12:28.200982+0000","last_peered":"2024-09-14T12:12:28.200982+0000","last_clean":"2024-09-14T12:12:28.200982+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:12:28.200982+0000","last_undegraded":"2024-09-14T12:12:28.200982+0000","last_fullsized":"2024-09-14T12:12:28.200982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.190615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.336647+0000","last_change":"2024-09-14T11:17:27.625718+0000","last_active":"2024-09-14T12:13:33.336647+0000","last_peered":"2024-09-14T12:13:33.336647+0000","last_clean":"2024-09-14T12:13:33.336647+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:13:33.336647+0000","last_undegraded":"2024-09-14T12:13:33.336647+0000","last_fullsized":"2024-09-14T12:13:33.336647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:13.564944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'778","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.483250+0000","last_change":"2024-09-14T11:17:29.641638+0000","last_active":"2024-09-14T12:15:52.483250+0000","last_peered":"2024-09-14T12:15:52.483250+0000","last_clean":"2024-09-14T12:15:52.483250+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:15:52.483250+0000","last_undegraded":"2024-09-14T12:15:52.483250+0000","last_fullsized":"2024-09-14T12:15:52.483250+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:54.865127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'126","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.517595+0000","last_change":"2024-09-14T11:17:31.654896+0000","last_active":"2024-09-14T12:13:48.517595+0000","last_peered":"2024-09-14T12:13:48.517595+0000","last_clean":"2024-09-14T12:13:48.517595+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:13:48.517595+0000","last_undegraded":"2024-09-14T12:13:48.517595+0000","last_fullsized":"2024-09-14T12:13:48.517595+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:18.947558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'482","reported_seq":2002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606832+0000","last_change":"2024-09-14T11:17:23.603409+0000","last_active":"2024-09-14T12:14:34.606832+0000","last_peered":"2024-09-14T12:14:34.606832+0000","last_clean":"2024-09-14T12:14:34.606832+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:14:34.606832+0000","last_undegraded":"2024-09-14T12:14:34.606832+0000","last_fullsized":"2024-09-14T12:14:34.606832+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:58.876757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'299","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330319+0000","last_change":"2024-09-14T11:17:21.584853+0000","last_active":"2024-09-14T12:12:23.330319+0000","last_peered":"2024-09-14T12:12:23.330319+0000","last_clean":"2024-09-14T12:12:23.330319+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:12:23.330319+0000","last_undegraded":"2024-09-14T12:12:23.330319+0000","last_fullsized":"2024-09-14T12:12:23.330319+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:42.636525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14722428,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":599,"num_read_kb":45610,"num_write":977,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.456732+0000","last_change":"2024-09-14T11:17:25.618200+0000","last_active":"2024-09-14T12:12:28.456732+0000","last_peered":"2024-09-14T12:12:28.456732+0000","last_clean":"2024-09-14T12:12:28.456732+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:12:28.456732+0000","last_undegraded":"2024-09-14T12:12:28.456732+0000","last_fullsized":"2024-09-14T12:12:28.456732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:36.032390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'312","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.241335+0000","last_change":"2024-09-14T11:17:27.632003+0000","last_active":"2024-09-14T12:15:43.241335+0000","last_peered":"2024-09-14T12:15:43.241335+0000","last_clean":"2024-09-14T12:15:43.241335+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:15:43.241335+0000","last_undegraded":"2024-09-14T12:15:43.241335+0000","last_fullsized":"2024-09-14T12:15:43.241335+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50001,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":888,"num_write":376,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:05.450810+0000","last_change":"2024-09-14T11:17:29.642860+0000","last_active":"2024-09-14T12:13:05.450810+0000","last_peered":"2024-09-14T12:13:05.450810+0000","last_clean":"2024-09-14T12:13:05.450810+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:13:05.450810+0000","last_undegraded":"2024-09-14T12:13:05.450810+0000","last_fullsized":"2024-09-14T12:13:05.450810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:49.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'163","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.740671+0000","last_change":"2024-09-14T11:17:31.659537+0000","last_active":"2024-09-14T12:14:31.740671+0000","last_peered":"2024-09-14T12:14:31.740671+0000","last_clean":"2024-09-14T12:14:31.740671+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:14:31.740671+0000","last_undegraded":"2024-09-14T12:14:31.740671+0000","last_fullsized":"2024-09-14T12:14:31.740671+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:58.564304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'823","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.532267+0000","last_change":"2024-09-14T11:17:23.603348+0000","last_active":"2024-09-14T12:13:48.532267+0000","last_peered":"2024-09-14T12:13:48.532267+0000","last_clean":"2024-09-14T12:13:48.532267+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:13:48.532267+0000","last_undegraded":"2024-09-14T12:13:48.532267+0000","last_fullsized":"2024-09-14T12:13:48.532267+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.172017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'333","reported_seq":1190,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.301913+0000","last_change":"2024-09-14T11:17:21.586488+0000","last_active":"2024-09-14T12:14:02.301913+0000","last_peered":"2024-09-14T12:14:02.301913+0000","last_clean":"2024-09-14T12:14:02.301913+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:14:02.301913+0000","last_undegraded":"2024-09-14T12:14:02.301913+0000","last_fullsized":"2024-09-14T12:14:02.301913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:17.459649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3993460,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1259,"num_read_kb":37456,"num_write":1235,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331124+0000","last_change":"2024-09-14T11:17:25.617051+0000","last_active":"2024-09-14T12:12:28.331124+0000","last_peered":"2024-09-14T12:12:28.331124+0000","last_clean":"2024-09-14T12:12:28.331124+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:12:28.331124+0000","last_undegraded":"2024-09-14T12:12:28.331124+0000","last_fullsized":"2024-09-14T12:12:28.331124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:24.207846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.736743+0000","last_change":"2024-09-14T11:17:27.635755+0000","last_active":"2024-09-14T12:15:43.736743+0000","last_peered":"2024-09-14T12:15:43.736743+0000","last_clean":"2024-09-14T12:15:43.736743+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:15:43.736743+0000","last_undegraded":"2024-09-14T12:15:43.736743+0000","last_fullsized":"2024-09-14T12:15:43.736743+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":933,"num_write":370,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.450854+0000","last_change":"2024-09-14T11:17:29.642662+0000","last_active":"2024-09-14T12:13:13.450854+0000","last_peered":"2024-09-14T12:13:13.450854+0000","last_clean":"2024-09-14T12:13:13.450854+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:13:13.450854+0000","last_undegraded":"2024-09-14T12:13:13.450854+0000","last_fullsized":"2024-09-14T12:13:13.450854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:37.438168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'101","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:52.066499+0000","last_change":"2024-09-14T11:17:31.653130+0000","last_active":"2024-09-14T12:13:52.066499+0000","last_peered":"2024-09-14T12:13:52.066499+0000","last_clean":"2024-09-14T12:13:52.066499+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:13:52.066499+0000","last_undegraded":"2024-09-14T12:13:52.066499+0000","last_fullsized":"2024-09-14T12:13:52.066499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:01.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'466","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.118951+0000","last_change":"2024-09-14T11:17:23.598902+0000","last_active":"2024-09-14T12:15:48.118951+0000","last_peered":"2024-09-14T12:15:48.118951+0000","last_clean":"2024-09-14T12:15:48.118951+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:15:48.118951+0000","last_undegraded":"2024-09-14T12:15:48.118951+0000","last_fullsized":"2024-09-14T12:15:48.118951+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:31.355611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'302","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218830+0000","last_change":"2024-09-14T11:17:21.589014+0000","last_active":"2024-09-14T12:13:38.218830+0000","last_peered":"2024-09-14T12:13:38.218830+0000","last_clean":"2024-09-14T12:13:38.218830+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:13:38.218830+0000","last_undegraded":"2024-09-14T12:13:38.218830+0000","last_fullsized":"2024-09-14T12:13:38.218830+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:25.221696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054523,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":529,"num_read_kb":9738,"num_write":1104,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332528+0000","last_change":"2024-09-14T11:17:25.610612+0000","last_active":"2024-09-14T12:13:03.332528+0000","last_peered":"2024-09-14T12:13:03.332528+0000","last_clean":"2024-09-14T12:13:03.332528+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:13:03.332528+0000","last_undegraded":"2024-09-14T12:13:03.332528+0000","last_fullsized":"2024-09-14T12:13:03.332528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:48.115678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'251","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.229206+0000","last_change":"2024-09-14T11:17:27.631891+0000","last_active":"2024-09-14T12:14:58.229206+0000","last_peered":"2024-09-14T12:14:58.229206+0000","last_clean":"2024-09-14T12:14:58.229206+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:14:58.229206+0000","last_undegraded":"2024-09-14T12:14:58.229206+0000","last_fullsized":"2024-09-14T12:14:58.229206+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:44.534516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":945,"num_write":360,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328284+0000","last_change":"2024-09-14T11:17:29.643072+0000","last_active":"2024-09-14T12:12:33.328284+0000","last_peered":"2024-09-14T12:12:33.328284+0000","last_clean":"2024-09-14T12:12:33.328284+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:12:33.328284+0000","last_undegraded":"2024-09-14T12:12:33.328284+0000","last_fullsized":"2024-09-14T12:12:33.328284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:34.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'185","reported_seq":1645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.716019+0000","last_change":"2024-09-14T11:17:31.657886+0000","last_active":"2024-09-14T12:14:31.716019+0000","last_peered":"2024-09-14T12:14:31.716019+0000","last_clean":"2024-09-14T12:14:31.716019+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:14:31.716019+0000","last_undegraded":"2024-09-14T12:14:31.716019+0000","last_fullsized":"2024-09-14T12:14:31.716019+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:25.875385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'587","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619382+0000","last_change":"2024-09-14T11:17:23.593981+0000","last_active":"2024-09-14T12:13:57.619382+0000","last_peered":"2024-09-14T12:13:57.619382+0000","last_clean":"2024-09-14T12:13:57.619382+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:13:57.619382+0000","last_undegraded":"2024-09-14T12:13:57.619382+0000","last_fullsized":"2024-09-14T12:13:57.619382+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:57.500739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'285","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.894234+0000","last_change":"2024-09-14T11:17:55.706003+0000","last_active":"2024-09-14T12:14:28.894234+0000","last_peered":"2024-09-14T12:14:28.894234+0000","last_clean":"2024-09-14T12:14:28.894234+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:14:28.894234+0000","last_undegraded":"2024-09-14T12:14:28.894234+0000","last_fullsized":"2024-09-14T12:14:28.894234+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.137533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6358364,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1129,"num_read_kb":9181,"num_write":1079,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205682+0000","last_change":"2024-09-14T11:17:25.611418+0000","last_active":"2024-09-14T12:13:13.205682+0000","last_peered":"2024-09-14T12:13:13.205682+0000","last_clean":"2024-09-14T12:13:13.205682+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:13:13.205682+0000","last_undegraded":"2024-09-14T12:13:13.205682+0000","last_fullsized":"2024-09-14T12:13:13.205682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.637349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'323","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.348967+0000","last_change":"2024-09-14T11:17:27.631558+0000","last_active":"2024-09-14T12:14:58.348967+0000","last_peered":"2024-09-14T12:14:58.348967+0000","last_clean":"2024-09-14T12:14:58.348967+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:14:58.348967+0000","last_undegraded":"2024-09-14T12:14:58.348967+0000","last_fullsized":"2024-09-14T12:14:58.348967+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:57.236491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1084,"num_write":436,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446967+0000","last_change":"2024-09-14T11:17:29.643690+0000","last_active":"2024-09-14T12:12:30.446967+0000","last_peered":"2024-09-14T12:12:30.446967+0000","last_clean":"2024-09-14T12:12:30.446967+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:12:30.446967+0000","last_undegraded":"2024-09-14T12:12:30.446967+0000","last_fullsized":"2024-09-14T12:12:30.446967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:41.882853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'98","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.149653+0000","last_change":"2024-09-14T11:17:31.656443+0000","last_active":"2024-09-14T12:15:48.149653+0000","last_peered":"2024-09-14T12:15:48.149653+0000","last_clean":"2024-09-14T12:15:48.149653+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:15:48.149653+0000","last_undegraded":"2024-09-14T12:15:48.149653+0000","last_fullsized":"2024-09-14T12:15:48.149653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:42.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'539","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.591433+0000","last_change":"2024-09-14T11:17:23.600867+0000","last_active":"2024-09-14T12:14:01.591433+0000","last_peered":"2024-09-14T12:14:01.591433+0000","last_clean":"2024-09-14T12:14:01.591433+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:14:01.591433+0000","last_undegraded":"2024-09-14T12:14:01.591433+0000","last_fullsized":"2024-09-14T12:14:01.591433+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:37.601941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.454382+0000","last_change":"2024-09-14T11:17:21.582606+0000","last_active":"2024-09-14T12:13:38.454382+0000","last_peered":"2024-09-14T12:13:38.454382+0000","last_clean":"2024-09-14T12:13:38.454382+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:13:38.454382+0000","last_undegraded":"2024-09-14T12:13:38.454382+0000","last_fullsized":"2024-09-14T12:13:38.454382+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.655925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437957,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":598,"num_read_kb":34320,"num_write":1205,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'835","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.500767+0000","last_change":"2024-09-14T11:17:23.593094+0000","last_active":"2024-09-14T12:15:18.500767+0000","last_peered":"2024-09-14T12:15:18.500767+0000","last_clean":"2024-09-14T12:15:18.500767+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:15:18.500767+0000","last_undegraded":"2024-09-14T12:15:18.500767+0000","last_fullsized":"2024-09-14T12:15:18.500767+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:00.728519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'370","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671665+0000","last_change":"2024-09-14T11:17:21.587023+0000","last_active":"2024-09-14T12:14:17.671665+0000","last_peered":"2024-09-14T12:14:17.671665+0000","last_clean":"2024-09-14T12:14:17.671665+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:14:17.671665+0000","last_undegraded":"2024-09-14T12:14:17.671665+0000","last_fullsized":"2024-09-14T12:14:17.671665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:28.536485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23470781,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":689,"num_read_kb":108288,"num_write":1311,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'490","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.751737+0000","last_change":"2024-09-14T11:17:23.594077+0000","last_active":"2024-09-14T12:14:02.751737+0000","last_peered":"2024-09-14T12:14:02.751737+0000","last_clean":"2024-09-14T12:14:02.751737+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:14:02.751737+0000","last_undegraded":"2024-09-14T12:14:02.751737+0000","last_fullsized":"2024-09-14T12:14:02.751737+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:09.993223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'276","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223288+0000","last_change":"2024-09-14T11:17:21.586835+0000","last_active":"2024-09-14T12:13:38.223288+0000","last_peered":"2024-09-14T12:13:38.223288+0000","last_clean":"2024-09-14T12:13:38.223288+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:13:38.223288+0000","last_undegraded":"2024-09-14T12:13:38.223288+0000","last_fullsized":"2024-09-14T12:13:38.223288+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:19.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8420620,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":518,"num_read_kb":31259,"num_write":1040,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1198","reported_seq":2729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210733+0000","last_change":"2024-09-14T11:17:23.592819+0000","last_active":"2024-09-14T12:14:31.210733+0000","last_peered":"2024-09-14T12:14:31.210733+0000","last_clean":"2024-09-14T12:14:31.210733+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:14:31.210733+0000","last_undegraded":"2024-09-14T12:14:31.210733+0000","last_fullsized":"2024-09-14T12:14:31.210733+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:27.543641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'310","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455745+0000","last_change":"2024-09-14T11:17:21.585188+0000","last_active":"2024-09-14T12:13:45.455745+0000","last_peered":"2024-09-14T12:13:45.455745+0000","last_clean":"2024-09-14T12:13:45.455745+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:13:45.455745+0000","last_undegraded":"2024-09-14T12:13:45.455745+0000","last_fullsized":"2024-09-14T12:13:45.455745+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:07.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290954,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":15201,"num_write":1236,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'918","reported_seq":2573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.502687+0000","last_change":"2024-09-14T11:17:23.601191+0000","last_active":"2024-09-14T12:15:18.502687+0000","last_peered":"2024-09-14T12:15:18.502687+0000","last_clean":"2024-09-14T12:15:18.502687+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:15:18.502687+0000","last_undegraded":"2024-09-14T12:15:18.502687+0000","last_fullsized":"2024-09-14T12:15:18.502687+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:39.840105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'250","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.613284+0000","last_change":"2024-09-14T11:17:21.584208+0000","last_active":"2024-09-14T12:13:51.613284+0000","last_peered":"2024-09-14T12:13:51.613284+0000","last_clean":"2024-09-14T12:13:51.613284+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:13:51.613284+0000","last_undegraded":"2024-09-14T12:13:51.613284+0000","last_fullsized":"2024-09-14T12:13:51.613284+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5737636,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":491,"num_read_kb":7710,"num_write":891,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'501","reported_seq":2112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.120303+0000","last_change":"2024-09-14T11:17:23.594912+0000","last_active":"2024-09-14T12:15:48.120303+0000","last_peered":"2024-09-14T12:15:48.120303+0000","last_clean":"2024-09-14T12:15:48.120303+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:15:48.120303+0000","last_undegraded":"2024-09-14T12:15:48.120303+0000","last_fullsized":"2024-09-14T12:15:48.120303+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:05.056139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'342","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209162+0000","last_change":"2024-09-14T11:17:21.579512+0000","last_active":"2024-09-14T12:13:43.209162+0000","last_peered":"2024-09-14T12:13:43.209162+0000","last_clean":"2024-09-14T12:13:43.209162+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:13:43.209162+0000","last_undegraded":"2024-09-14T12:13:43.209162+0000","last_fullsized":"2024-09-14T12:13:43.209162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:50.912297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12577240,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":612,"num_read_kb":78819,"num_write":1193,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'832","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.122782+0000","last_change":"2024-09-14T11:17:23.602134+0000","last_active":"2024-09-14T12:15:48.122782+0000","last_peered":"2024-09-14T12:15:48.122782+0000","last_clean":"2024-09-14T12:15:48.122782+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:15:48.122782+0000","last_undegraded":"2024-09-14T12:15:48.122782+0000","last_fullsized":"2024-09-14T12:15:48.122782+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:55.121466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'379","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.864741+0000","last_change":"2024-09-14T11:17:21.587871+0000","last_active":"2024-09-14T12:15:38.864741+0000","last_peered":"2024-09-14T12:15:38.864741+0000","last_clean":"2024-09-14T12:15:38.864741+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:15:38.864741+0000","last_undegraded":"2024-09-14T12:15:38.864741+0000","last_fullsized":"2024-09-14T12:15:38.864741+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:00.375845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3958235,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":797,"num_read_kb":42745,"num_write":1534,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771846+0000","last_change":"2024-09-14T11:17:23.596351+0000","last_active":"2024-09-14T12:14:33.771846+0000","last_peered":"2024-09-14T12:14:33.771846+0000","last_clean":"2024-09-14T12:14:33.771846+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:14:33.771846+0000","last_undegraded":"2024-09-14T12:14:33.771846+0000","last_fullsized":"2024-09-14T12:14:33.771846+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'294","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:47.252551+0000","last_change":"2024-09-14T11:17:21.583193+0000","last_active":"2024-09-14T12:15:47.252551+0000","last_peered":"2024-09-14T12:15:47.252551+0000","last_clean":"2024-09-14T12:15:47.252551+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:15:47.252551+0000","last_undegraded":"2024-09-14T12:15:47.252551+0000","last_fullsized":"2024-09-14T12:15:47.252551+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:06.631109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5913903,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":660,"num_read_kb":25683,"num_write":1142,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'724","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.121608+0000","last_change":"2024-09-14T11:17:23.604245+0000","last_active":"2024-09-14T12:15:48.121608+0000","last_peered":"2024-09-14T12:15:48.121608+0000","last_clean":"2024-09-14T12:15:48.121608+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:15:48.121608+0000","last_undegraded":"2024-09-14T12:15:48.121608+0000","last_fullsized":"2024-09-14T12:15:48.121608+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:40.467603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'255","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.226111+0000","last_change":"2024-09-14T11:17:21.580614+0000","last_active":"2024-09-14T12:13:58.226111+0000","last_peered":"2024-09-14T12:13:58.226111+0000","last_clean":"2024-09-14T12:13:58.226111+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:13:58.226111+0000","last_undegraded":"2024-09-14T12:13:58.226111+0000","last_fullsized":"2024-09-14T12:13:58.226111+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:49.477505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521661,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":473,"num_read_kb":13775,"num_write":915,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'542","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755084+0000","last_change":"2024-09-14T11:17:23.597056+0000","last_active":"2024-09-14T12:14:02.755084+0000","last_peered":"2024-09-14T12:14:02.755084+0000","last_clean":"2024-09-14T12:14:02.755084+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:14:02.755084+0000","last_undegraded":"2024-09-14T12:14:02.755084+0000","last_fullsized":"2024-09-14T12:14:02.755084+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:25.820590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'302","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.673579+0000","last_change":"2024-09-14T11:17:21.583089+0000","last_active":"2024-09-14T12:14:17.673579+0000","last_peered":"2024-09-14T12:14:17.673579+0000","last_clean":"2024-09-14T12:14:17.673579+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:14:17.673579+0000","last_undegraded":"2024-09-14T12:14:17.673579+0000","last_fullsized":"2024-09-14T12:14:17.673579+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140678,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":542,"num_read_kb":24861,"num_write":1084,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'886","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.506780+0000","last_change":"2024-09-14T11:17:23.590933+0000","last_active":"2024-09-14T12:15:18.506780+0000","last_peered":"2024-09-14T12:15:18.506780+0000","last_clean":"2024-09-14T12:15:18.506780+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:15:18.506780+0000","last_undegraded":"2024-09-14T12:15:18.506780+0000","last_fullsized":"2024-09-14T12:15:18.506780+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.559604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'314","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.066911+0000","last_change":"2024-09-14T11:17:21.589675+0000","last_active":"2024-09-14T12:14:31.066911+0000","last_peered":"2024-09-14T12:14:31.066911+0000","last_clean":"2024-09-14T12:14:31.066911+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:14:31.066911+0000","last_undegraded":"2024-09-14T12:14:31.066911+0000","last_fullsized":"2024-09-14T12:14:31.066911+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:06.262409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8888920,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":612,"num_read_kb":50704,"num_write":1163,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'681","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606396+0000","last_change":"2024-09-14T11:17:23.595898+0000","last_active":"2024-09-14T12:14:34.606396+0000","last_peered":"2024-09-14T12:14:34.606396+0000","last_clean":"2024-09-14T12:14:34.606396+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:14:34.606396+0000","last_undegraded":"2024-09-14T12:14:34.606396+0000","last_fullsized":"2024-09-14T12:14:34.606396+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:45.372928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'277","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455187+0000","last_change":"2024-09-14T11:17:21.589111+0000","last_active":"2024-09-14T12:13:40.455187+0000","last_peered":"2024-09-14T12:13:40.455187+0000","last_clean":"2024-09-14T12:13:40.455187+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:13:40.455187+0000","last_undegraded":"2024-09-14T12:13:40.455187+0000","last_fullsized":"2024-09-14T12:13:40.455187+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:16.334007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442947,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":562,"num_read_kb":2144,"num_write":981,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'754","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.576424+0000","last_change":"2024-09-14T11:17:55.700734+0000","last_active":"2024-09-14T12:13:55.576424+0000","last_peered":"2024-09-14T12:13:55.576424+0000","last_clean":"2024-09-14T12:13:55.576424+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:13:55.576424+0000","last_undegraded":"2024-09-14T12:13:55.576424+0000","last_fullsized":"2024-09-14T12:13:55.576424+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.642169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'261","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:40.731776+0000","last_change":"2024-09-14T11:17:21.582462+0000","last_active":"2024-09-14T12:15:40.731776+0000","last_peered":"2024-09-14T12:15:40.731776+0000","last_clean":"2024-09-14T12:15:40.731776+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:15:40.731776+0000","last_undegraded":"2024-09-14T12:15:40.731776+0000","last_fullsized":"2024-09-14T12:15:40.731776+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.146715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9504952,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":46679,"num_write":889,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'468","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.507172+0000","last_change":"2024-09-14T11:17:23.606550+0000","last_active":"2024-09-14T12:15:18.507172+0000","last_peered":"2024-09-14T12:15:18.507172+0000","last_clean":"2024-09-14T12:15:18.507172+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:15:18.507172+0000","last_undegraded":"2024-09-14T12:15:18.507172+0000","last_fullsized":"2024-09-14T12:15:18.507172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:25.294313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'278","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:23.213600+0000","last_change":"2024-09-14T11:17:55.703532+0000","last_active":"2024-09-14T12:14:23.213600+0000","last_peered":"2024-09-14T12:14:23.213600+0000","last_clean":"2024-09-14T12:14:23.213600+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:14:23.213600+0000","last_undegraded":"2024-09-14T12:14:23.213600+0000","last_fullsized":"2024-09-14T12:14:23.213600+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:23.137411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6360112,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":845,"num_read_kb":19019,"num_write":949,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'441","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.819923+0000","last_change":"2024-09-14T11:17:23.602231+0000","last_active":"2024-09-14T12:13:42.819923+0000","last_peered":"2024-09-14T12:13:42.819923+0000","last_clean":"2024-09-14T12:13:42.819923+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:13:42.819923+0000","last_undegraded":"2024-09-14T12:13:42.819923+0000","last_fullsized":"2024-09-14T12:13:42.819923+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:53.898892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'341","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.325603+0000","last_change":"2024-09-14T11:17:21.578753+0000","last_active":"2024-09-14T12:15:43.325603+0000","last_peered":"2024-09-14T12:15:43.325603+0000","last_clean":"2024-09-14T12:15:43.325603+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:15:43.325603+0000","last_undegraded":"2024-09-14T12:15:43.325603+0000","last_fullsized":"2024-09-14T12:15:43.325603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:48.907563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8442947,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":685,"num_read_kb":76781,"num_write":1218,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755681+0000","last_change":"2024-09-14T11:17:23.603778+0000","last_active":"2024-09-14T12:14:02.755681+0000","last_peered":"2024-09-14T12:14:02.755681+0000","last_clean":"2024-09-14T12:14:02.755681+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:14:02.755681+0000","last_undegraded":"2024-09-14T12:14:02.755681+0000","last_fullsized":"2024-09-14T12:14:02.755681+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:48.188661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'309","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.221072+0000","last_change":"2024-09-14T11:17:21.587433+0000","last_active":"2024-09-14T12:13:23.221072+0000","last_peered":"2024-09-14T12:13:23.221072+0000","last_clean":"2024-09-14T12:13:23.221072+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:13:23.221072+0000","last_undegraded":"2024-09-14T12:13:23.221072+0000","last_fullsized":"2024-09-14T12:13:23.221072+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:02.070789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5236306,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":506,"num_read_kb":6454,"num_write":1149,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'263","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.220982+0000","last_change":"2024-09-14T11:17:21.583452+0000","last_active":"2024-09-14T12:13:23.220982+0000","last_peered":"2024-09-14T12:13:23.220982+0000","last_clean":"2024-09-14T12:13:23.220982+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:13:23.220982+0000","last_undegraded":"2024-09-14T12:13:23.220982+0000","last_fullsized":"2024-09-14T12:13:23.220982+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:53.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116338,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":597,"num_read_kb":1699,"num_write":972,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'562","reported_seq":2258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.111067+0000","last_change":"2024-09-14T11:17:23.605011+0000","last_active":"2024-09-14T12:15:48.111067+0000","last_peered":"2024-09-14T12:15:48.111067+0000","last_clean":"2024-09-14T12:15:48.111067+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:15:48.111067+0000","last_undegraded":"2024-09-14T12:15:48.111067+0000","last_fullsized":"2024-09-14T12:15:48.111067+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:39.124367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'330","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671862+0000","last_change":"2024-09-14T11:17:21.571626+0000","last_active":"2024-09-14T12:14:17.671862+0000","last_peered":"2024-09-14T12:14:17.671862+0000","last_clean":"2024-09-14T12:14:17.671862+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:14:17.671862+0000","last_undegraded":"2024-09-14T12:14:17.671862+0000","last_fullsized":"2024-09-14T12:14:17.671862+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:58.165741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9786636,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":658,"num_read_kb":16752,"num_write":1197,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'915","reported_seq":2580,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605275+0000","last_change":"2024-09-14T11:17:23.597555+0000","last_active":"2024-09-14T12:14:34.605275+0000","last_peered":"2024-09-14T12:14:34.605275+0000","last_clean":"2024-09-14T12:14:34.605275+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:14:34.605275+0000","last_undegraded":"2024-09-14T12:14:34.605275+0000","last_fullsized":"2024-09-14T12:14:34.605275+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:39.353271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1791,"ondisk_log_size":1791,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2027907,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":17668,"num_read_kb":33740,"num_write":15057,"num_write_kb":12005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3350528,"data_stored":2810770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2142,"ondisk_log_size":2142,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":494933887,"num_objects":4404,"num_object_clones":0,"num_object_copies":8808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4404,"num_whiteouts":0,"num_read":40342,"num_read_kb":1801257,"num_write":69776,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1022427136,"data_stored":989867774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4397,"ondisk_log_size":4397,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":187942,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":143,"num_read_kb":186673,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510155,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421560,"kb_used_data":159912,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93950280,"statfs":{"total":96636764160,"available":96205086720,"internally_reserved":0,"allocated":163749888,"data_stored":157535924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374332,"kb_used_data":118252,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93997508,"statfs":{"total":96636764160,"available":96253448192,"internally_reserved":0,"allocated":121090048,"data_stored":116618273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510156,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296908,"kb_used_data":197756,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94074932,"statfs":{"total":96636764160,"available":96332730368,"internally_reserved":0,"allocated":202502144,"data_stored":196273581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510155,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248320,"kb_used_data":181040,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94123520,"statfs":{"total":96636764160,"available":96382484480,"internally_reserved":0,"allocated":185384960,"data_stored":179412959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510154,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433644,"kb_used_data":177564,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93938196,"statfs":{"total":96636764160,"available":96192712704,"internally_reserved":0,"allocated":181825536,"data_stored":175371481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510155,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221540,"kb_used_data":140436,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94150300,"statfs":{"total":96636764160,"available":96409907200,"internally_reserved":0,"allocated":143806464,"data_stored":139473832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510154,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309052,"kb_used_data":157164,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94062788,"statfs":{"total":96636764160,"available":96320294912,"internally_reserved":0,"allocated":160935936,"data_stored":156075796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575563,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401828,"kb_used_data":149972,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93970012,"statfs":{"total":96636764160,"available":96225292288,"internally_reserved":0,"allocated":153571328,"data_stored":147213572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":124071936,"data_stored":119267109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102313984,"data_stored":98986895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110706688,"data_stored":107837006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143204352,"data_stored":138319362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":155963525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158273536,"data_stored":153676881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":88297472,"data_stored":85327626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135106560,"data_stored":130489370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":386430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":141601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":486522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":256178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":533037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10194944,"data_stored":10191554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33595392,"data_stored":33594577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27557888,"data_stored":27553133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13672448,"data_stored":13671633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11075584,"data_stored":11073336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:16:15.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:16:16.245 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:16.256 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:16:16.257 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2033,"stamp":"2024-09-14T12:16:15.254145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":626082067,"num_objects":4911,"num_object_clones":0,"num_object_copies":9822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4911,"num_whiteouts":0,"num_read":308460,"num_read_kb":2439320,"num_write":161765,"num_write_kb":2394034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13942,"ondisk_log_size":13942,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2707184,"kb_used_data":1282096,"kb_used_omap":12,"kb_used_meta":1424947,"kb_avail":752267536,"statfs":{"total":773094113280,"available":770321956864,"internally_reserved":0,"allocated":1312866304,"data_stored":1267975418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1459146291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005414"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213341+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:12:33.213341+0000","last_peered":"2024-09-14T12:12:33.213341+0000","last_clean":"2024-09-14T12:12:33.213341+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:12:33.213341+0000","last_undegraded":"2024-09-14T12:12:33.213341+0000","last_fullsized":"2024-09-14T12:12:33.213341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311879+0000","last_change":"2024-09-14T11:51:07.025774+0000","last_active":"2024-09-14T12:13:38.311879+0000","last_peered":"2024-09-14T12:13:38.311879+0000","last_clean":"2024-09-14T12:13:38.311879+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:13:38.311879+0000","last_undegraded":"2024-09-14T12:13:38.311879+0000","last_fullsized":"2024-09-14T12:13:38.311879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.449121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201523+0000","last_change":"2024-09-14T11:35:00.449276+0000","last_active":"2024-09-14T12:12:33.201523+0000","last_peered":"2024-09-14T12:12:33.201523+0000","last_clean":"2024-09-14T12:12:33.201523+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:12:33.201523+0000","last_undegraded":"2024-09-14T12:12:33.201523+0000","last_fullsized":"2024-09-14T12:12:33.201523+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:28.070565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":2,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313986+0000","last_change":"2024-09-14T11:31:47.462526+0000","last_active":"2024-09-14T12:13:58.313986+0000","last_peered":"2024-09-14T12:13:58.313986+0000","last_clean":"2024-09-14T12:13:58.313986+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:13:58.313986+0000","last_undegraded":"2024-09-14T12:13:58.313986+0000","last_fullsized":"2024-09-14T12:13:58.313986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:37.396723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.448111+0000","last_change":"2024-09-14T11:51:07.028080+0000","last_active":"2024-09-14T12:12:53.448111+0000","last_peered":"2024-09-14T12:12:53.448111+0000","last_clean":"2024-09-14T12:12:53.448111+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:12:53.448111+0000","last_undegraded":"2024-09-14T12:12:53.448111+0000","last_fullsized":"2024-09-14T12:12:53.448111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.359237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447637+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:12:35.447637+0000","last_peered":"2024-09-14T12:12:35.447637+0000","last_clean":"2024-09-14T12:12:35.447637+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:12:35.447637+0000","last_undegraded":"2024-09-14T12:12:35.447637+0000","last_fullsized":"2024-09-14T12:12:35.447637+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:50.280918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.309024+0000","last_change":"2024-09-14T11:35:00.438757+0000","last_active":"2024-09-14T12:13:13.309024+0000","last_peered":"2024-09-14T12:13:13.309024+0000","last_clean":"2024-09-14T12:13:13.309024+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:13:13.309024+0000","last_undegraded":"2024-09-14T12:13:13.309024+0000","last_fullsized":"2024-09-14T12:13:13.309024+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:50.182947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:50.442209+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:11:50.442209+0000","last_peered":"2024-09-14T12:11:50.442209+0000","last_clean":"2024-09-14T12:11:50.442209+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:11:50.442209+0000","last_undegraded":"2024-09-14T12:11:50.442209+0000","last_fullsized":"2024-09-14T12:11:50.442209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:01.804143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215760+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:13:13.215760+0000","last_peered":"2024-09-14T12:13:13.215760+0000","last_clean":"2024-09-14T12:13:13.215760+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:13:13.215760+0000","last_undegraded":"2024-09-14T12:13:13.215760+0000","last_fullsized":"2024-09-14T12:13:13.215760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328354+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:12:33.328354+0000","last_peered":"2024-09-14T12:12:33.328354+0000","last_clean":"2024-09-14T12:12:33.328354+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:12:33.328354+0000","last_undegraded":"2024-09-14T12:12:33.328354+0000","last_fullsized":"2024-09-14T12:12:33.328354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.966334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205890+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:11:48.205890+0000","last_peered":"2024-09-14T12:11:48.205890+0000","last_clean":"2024-09-14T12:11:48.205890+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:11:48.205890+0000","last_undegraded":"2024-09-14T12:11:48.205890+0000","last_fullsized":"2024-09-14T12:11:48.205890+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:51.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.321996+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:11:23.321996+0000","last_peered":"2024-09-14T12:11:23.321996+0000","last_clean":"2024-09-14T12:11:23.321996+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:11:23.321996+0000","last_undegraded":"2024-09-14T12:11:23.321996+0000","last_fullsized":"2024-09-14T12:11:23.321996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":10,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205846+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:11:48.205846+0000","last_peered":"2024-09-14T12:11:48.205846+0000","last_clean":"2024-09-14T12:11:48.205846+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:11:48.205846+0000","last_undegraded":"2024-09-14T12:11:48.205846+0000","last_fullsized":"2024-09-14T12:11:48.205846+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211503+0000","last_change":"2024-09-14T11:51:07.022651+0000","last_active":"2024-09-14T12:14:03.211503+0000","last_peered":"2024-09-14T12:14:03.211503+0000","last_clean":"2024-09-14T12:14:03.211503+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:14:03.211503+0000","last_undegraded":"2024-09-14T12:14:03.211503+0000","last_fullsized":"2024-09-14T12:14:03.211503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:59.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455134+0000","last_change":"2024-09-14T11:35:03.472494+0000","last_active":"2024-09-14T12:13:43.455134+0000","last_peered":"2024-09-14T12:13:43.455134+0000","last_clean":"2024-09-14T12:13:43.455134+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:13:43.455134+0000","last_undegraded":"2024-09-14T12:13:43.455134+0000","last_fullsized":"2024-09-14T12:13:43.455134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:49.051891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.317809+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:11:23.317809+0000","last_peered":"2024-09-14T12:11:23.317809+0000","last_clean":"2024-09-14T12:11:23.317809+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:11:23.317809+0000","last_undegraded":"2024-09-14T12:11:23.317809+0000","last_fullsized":"2024-09-14T12:11:23.317809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.439584+0000","last_change":"2024-09-14T11:31:47.462449+0000","last_active":"2024-09-14T12:11:48.439584+0000","last_peered":"2024-09-14T12:11:48.439584+0000","last_clean":"2024-09-14T12:11:48.439584+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:11:48.439584+0000","last_undegraded":"2024-09-14T12:11:48.439584+0000","last_fullsized":"2024-09-14T12:11:48.439584+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:14.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445264+0000","last_change":"2024-09-14T11:35:03.473587+0000","last_active":"2024-09-14T12:12:33.445264+0000","last_peered":"2024-09-14T12:12:33.445264+0000","last_clean":"2024-09-14T12:12:33.445264+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:12:33.445264+0000","last_undegraded":"2024-09-14T12:12:33.445264+0000","last_fullsized":"2024-09-14T12:12:33.445264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.755910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'13","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211025+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:12:33.211025+0000","last_peered":"2024-09-14T12:12:33.211025+0000","last_clean":"2024-09-14T12:12:33.211025+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:12:33.211025+0000","last_undegraded":"2024-09-14T12:12:33.211025+0000","last_fullsized":"2024-09-14T12:12:33.211025+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":17412,"num_write":23,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.203551+0000","last_change":"2024-09-14T11:31:47.457527+0000","last_active":"2024-09-14T12:12:53.203551+0000","last_peered":"2024-09-14T12:12:53.203551+0000","last_clean":"2024-09-14T12:12:53.203551+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:12:53.203551+0000","last_undegraded":"2024-09-14T12:12:53.203551+0000","last_fullsized":"2024-09-14T12:12:53.203551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:10.893316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.198600+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:12:08.198600+0000","last_peered":"2024-09-14T12:12:08.198600+0000","last_clean":"2024-09-14T12:12:08.198600+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:12:08.198600+0000","last_undegraded":"2024-09-14T12:12:08.198600+0000","last_fullsized":"2024-09-14T12:12:08.198600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:27.310781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331145+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:12:28.331145+0000","last_peered":"2024-09-14T12:12:28.331145+0000","last_clean":"2024-09-14T12:12:28.331145+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:12:28.331145+0000","last_undegraded":"2024-09-14T12:12:28.331145+0000","last_fullsized":"2024-09-14T12:12:28.331145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6146,"num_write":4,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.302497+0000","last_change":"2024-09-14T11:51:07.028060+0000","last_active":"2024-09-14T12:12:08.302497+0000","last_peered":"2024-09-14T12:12:08.302497+0000","last_clean":"2024-09-14T12:12:08.302497+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:12:08.302497+0000","last_undegraded":"2024-09-14T12:12:08.302497+0000","last_fullsized":"2024-09-14T12:12:08.302497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.552311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.453694+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:12:08.453694+0000","last_peered":"2024-09-14T12:12:08.453694+0000","last_clean":"2024-09-14T12:12:08.453694+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:12:08.453694+0000","last_undegraded":"2024-09-14T12:12:08.453694+0000","last_fullsized":"2024-09-14T12:12:08.453694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:12.592203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219471+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:13:43.219471+0000","last_peered":"2024-09-14T12:13:43.219471+0000","last_clean":"2024-09-14T12:13:43.219471+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:13:43.219471+0000","last_undegraded":"2024-09-14T12:13:43.219471+0000","last_fullsized":"2024-09-14T12:13:43.219471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":13,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312475+0000","last_change":"2024-09-14T11:35:00.443367+0000","last_active":"2024-09-14T12:13:43.312475+0000","last_peered":"2024-09-14T12:13:43.312475+0000","last_clean":"2024-09-14T12:13:43.312475+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:13:43.312475+0000","last_undegraded":"2024-09-14T12:13:43.312475+0000","last_fullsized":"2024-09-14T12:13:43.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:39.932103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.307053+0000","last_change":"2024-09-14T11:31:47.459863+0000","last_active":"2024-09-14T12:12:53.307053+0000","last_peered":"2024-09-14T12:12:53.307053+0000","last_clean":"2024-09-14T12:12:53.307053+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:12:53.307053+0000","last_undegraded":"2024-09-14T12:12:53.307053+0000","last_fullsized":"2024-09-14T12:12:53.307053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.115513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.328248+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:12:08.328248+0000","last_peered":"2024-09-14T12:12:08.328248+0000","last_clean":"2024-09-14T12:12:08.328248+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:12:08.328248+0000","last_undegraded":"2024-09-14T12:12:08.328248+0000","last_fullsized":"2024-09-14T12:12:08.328248+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:28.383593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338233+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:13:43.338233+0000","last_peered":"2024-09-14T12:13:43.338233+0000","last_clean":"2024-09-14T12:13:43.338233+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:13:43.338233+0000","last_undegraded":"2024-09-14T12:13:43.338233+0000","last_fullsized":"2024-09-14T12:13:43.338233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200369+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:12:23.200369+0000","last_peered":"2024-09-14T12:12:23.200369+0000","last_clean":"2024-09-14T12:12:23.200369+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:12:23.200369+0000","last_undegraded":"2024-09-14T12:12:23.200369+0000","last_fullsized":"2024-09-14T12:12:23.200369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.326665+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:12:23.326665+0000","last_peered":"2024-09-14T12:12:23.326665+0000","last_clean":"2024-09-14T12:12:23.326665+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:12:23.326665+0000","last_undegraded":"2024-09-14T12:12:23.326665+0000","last_fullsized":"2024-09-14T12:12:23.326665+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200345+0000","last_change":"2024-09-14T11:35:03.476474+0000","last_active":"2024-09-14T12:12:23.200345+0000","last_peered":"2024-09-14T12:12:23.200345+0000","last_clean":"2024-09-14T12:12:23.200345+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:12:23.200345+0000","last_undegraded":"2024-09-14T12:12:23.200345+0000","last_fullsized":"2024-09-14T12:12:23.200345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:43.941080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209824+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:12:23.209824+0000","last_peered":"2024-09-14T12:12:23.209824+0000","last_clean":"2024-09-14T12:12:23.209824+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:12:23.209824+0000","last_undegraded":"2024-09-14T12:12:23.209824+0000","last_fullsized":"2024-09-14T12:12:23.209824+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:15.445086+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:12:15.445086+0000","last_peered":"2024-09-14T12:12:15.445086+0000","last_clean":"2024-09-14T12:12:15.445086+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:12:15.445086+0000","last_undegraded":"2024-09-14T12:12:15.445086+0000","last_fullsized":"2024-09-14T12:12:15.445086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:16.454913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209866+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:12:23.209866+0000","last_peered":"2024-09-14T12:12:23.209866+0000","last_clean":"2024-09-14T12:12:23.209866+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:12:23.209866+0000","last_undegraded":"2024-09-14T12:12:23.209866+0000","last_fullsized":"2024-09-14T12:12:23.209866+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7286,"num_write":3,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'10","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443925+0000","last_change":"2024-09-14T11:35:00.447506+0000","last_active":"2024-09-14T12:12:23.443925+0000","last_peered":"2024-09-14T12:12:23.443925+0000","last_clean":"2024-09-14T12:12:23.443925+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:12:23.443925+0000","last_undegraded":"2024-09-14T12:12:23.443925+0000","last_fullsized":"2024-09-14T12:12:23.443925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:00.533644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443907+0000","last_change":"2024-09-14T11:35:03.480075+0000","last_active":"2024-09-14T12:12:23.443907+0000","last_peered":"2024-09-14T12:12:23.443907+0000","last_clean":"2024-09-14T12:12:23.443907+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:12:23.443907+0000","last_undegraded":"2024-09-14T12:12:23.443907+0000","last_fullsized":"2024-09-14T12:12:23.443907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:33.496292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330297+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:12:23.330297+0000","last_peered":"2024-09-14T12:12:23.330297+0000","last_clean":"2024-09-14T12:12:23.330297+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:12:23.330297+0000","last_undegraded":"2024-09-14T12:12:23.330297+0000","last_fullsized":"2024-09-14T12:12:23.330297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.306990+0000","last_change":"2024-09-14T11:51:07.027822+0000","last_active":"2024-09-14T12:12:53.306990+0000","last_peered":"2024-09-14T12:12:53.306990+0000","last_clean":"2024-09-14T12:12:53.306990+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:12:53.306990+0000","last_undegraded":"2024-09-14T12:12:53.306990+0000","last_fullsized":"2024-09-14T12:12:53.306990+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:23.309895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216361+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:13:18.216361+0000","last_peered":"2024-09-14T12:13:18.216361+0000","last_clean":"2024-09-14T12:13:18.216361+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:13:18.216361+0000","last_undegraded":"2024-09-14T12:13:18.216361+0000","last_fullsized":"2024-09-14T12:13:18.216361+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.309609+0000","last_change":"2024-09-14T11:35:00.448968+0000","last_active":"2024-09-14T12:13:18.309609+0000","last_peered":"2024-09-14T12:13:18.309609+0000","last_clean":"2024-09-14T12:13:18.309609+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:13:18.309609+0000","last_undegraded":"2024-09-14T12:13:18.309609+0000","last_fullsized":"2024-09-14T12:13:18.309609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.693742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.329763+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:12:18.329763+0000","last_peered":"2024-09-14T12:12:18.329763+0000","last_clean":"2024-09-14T12:12:18.329763+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:12:18.329763+0000","last_undegraded":"2024-09-14T12:12:18.329763+0000","last_fullsized":"2024-09-14T12:12:18.329763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:10.558327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.447497+0000","last_change":"2024-09-14T11:51:07.027403+0000","last_active":"2024-09-14T12:12:48.447497+0000","last_peered":"2024-09-14T12:12:48.447497+0000","last_clean":"2024-09-14T12:12:48.447497+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:12:48.447497+0000","last_undegraded":"2024-09-14T12:12:48.447497+0000","last_fullsized":"2024-09-14T12:12:48.447497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:41.431415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207455+0000","last_change":"2024-09-14T11:35:03.477782+0000","last_active":"2024-09-14T12:13:28.207455+0000","last_peered":"2024-09-14T12:13:28.207455+0000","last_clean":"2024-09-14T12:13:28.207455+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:13:28.207455+0000","last_undegraded":"2024-09-14T12:13:28.207455+0000","last_fullsized":"2024-09-14T12:13:28.207455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:40.078111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.443370+0000","last_change":"2024-09-14T11:31:47.459051+0000","last_active":"2024-09-14T12:12:18.443370+0000","last_peered":"2024-09-14T12:12:18.443370+0000","last_clean":"2024-09-14T12:12:18.443370+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:12:18.443370+0000","last_undegraded":"2024-09-14T12:12:18.443370+0000","last_fullsized":"2024-09-14T12:12:18.443370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:51.494106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207443+0000","last_change":"2024-09-14T11:35:00.446767+0000","last_active":"2024-09-14T12:13:28.207443+0000","last_peered":"2024-09-14T12:13:28.207443+0000","last_clean":"2024-09-14T12:13:28.207443+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:13:28.207443+0000","last_undegraded":"2024-09-14T12:13:28.207443+0000","last_fullsized":"2024-09-14T12:13:28.207443+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:07.682575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.303508+0000","last_change":"2024-09-14T11:31:47.461172+0000","last_active":"2024-09-14T12:12:18.303508+0000","last_peered":"2024-09-14T12:12:18.303508+0000","last_clean":"2024-09-14T12:12:18.303508+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:12:18.303508+0000","last_undegraded":"2024-09-14T12:12:18.303508+0000","last_fullsized":"2024-09-14T12:12:18.303508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:24.137730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341112+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:14:03.341112+0000","last_peered":"2024-09-14T12:14:03.341112+0000","last_clean":"2024-09-14T12:14:03.341112+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:14:03.341112+0000","last_undegraded":"2024-09-14T12:14:03.341112+0000","last_fullsized":"2024-09-14T12:14:03.341112+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9588,"num_write":4,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:00.457511+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:14:00.457511+0000","last_peered":"2024-09-14T12:14:00.457511+0000","last_clean":"2024-09-14T12:14:00.457511+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:14:00.457511+0000","last_undegraded":"2024-09-14T12:14:00.457511+0000","last_fullsized":"2024-09-14T12:14:00.457511+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:20.445608+0000","last_change":"2024-09-14T11:31:47.455100+0000","last_active":"2024-09-14T12:12:20.445608+0000","last_peered":"2024-09-14T12:12:20.445608+0000","last_clean":"2024-09-14T12:12:20.445608+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:12:20.445608+0000","last_undegraded":"2024-09-14T12:12:20.445608+0000","last_fullsized":"2024-09-14T12:12:20.445608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:09.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211406+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:14:03.211406+0000","last_peered":"2024-09-14T12:14:03.211406+0000","last_clean":"2024-09-14T12:14:03.211406+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:14:03.211406+0000","last_undegraded":"2024-09-14T12:14:03.211406+0000","last_fullsized":"2024-09-14T12:14:03.211406+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464147+0000","last_change":"2024-09-14T11:31:47.454175+0000","last_active":"2024-09-14T12:13:03.464147+0000","last_peered":"2024-09-14T12:13:03.464147+0000","last_clean":"2024-09-14T12:13:03.464147+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:13:03.464147+0000","last_undegraded":"2024-09-14T12:13:03.464147+0000","last_fullsized":"2024-09-14T12:13:03.464147+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.297114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.206264+0000","last_change":"2024-09-14T11:35:03.477505+0000","last_active":"2024-09-14T12:13:18.206264+0000","last_peered":"2024-09-14T12:13:18.206264+0000","last_clean":"2024-09-14T12:13:18.206264+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:13:18.206264+0000","last_undegraded":"2024-09-14T12:13:18.206264+0000","last_fullsized":"2024-09-14T12:13:18.206264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:56.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:55.442720+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:11:55.442720+0000","last_peered":"2024-09-14T12:11:55.442720+0000","last_clean":"2024-09-14T12:11:55.442720+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:11:55.442720+0000","last_undegraded":"2024-09-14T12:11:55.442720+0000","last_fullsized":"2024-09-14T12:11:55.442720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.452072+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:11:58.452072+0000","last_peered":"2024-09-14T12:11:58.452072+0000","last_clean":"2024-09-14T12:11:58.452072+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:11:58.452072+0000","last_undegraded":"2024-09-14T12:11:58.452072+0000","last_fullsized":"2024-09-14T12:11:58.452072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.334737+0000","last_change":"2024-09-14T11:35:00.437763+0000","last_active":"2024-09-14T12:13:18.334737+0000","last_peered":"2024-09-14T12:13:18.334737+0000","last_clean":"2024-09-14T12:13:18.334737+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:13:18.334737+0000","last_undegraded":"2024-09-14T12:13:18.334737+0000","last_fullsized":"2024-09-14T12:13:18.334737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:10.195413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448816+0000","last_change":"2024-09-14T11:31:47.455016+0000","last_active":"2024-09-14T12:12:58.448816+0000","last_peered":"2024-09-14T12:12:58.448816+0000","last_clean":"2024-09-14T12:12:58.448816+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:12:58.448816+0000","last_undegraded":"2024-09-14T12:12:58.448816+0000","last_fullsized":"2024-09-14T12:12:58.448816+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:05.916872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:40.448133+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:12:40.448133+0000","last_peered":"2024-09-14T12:12:40.448133+0000","last_clean":"2024-09-14T12:12:40.448133+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:12:40.448133+0000","last_undegraded":"2024-09-14T12:12:40.448133+0000","last_fullsized":"2024-09-14T12:12:40.448133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:19.901941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'10","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457537+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:12:33.457537+0000","last_peered":"2024-09-14T12:12:33.457537+0000","last_clean":"2024-09-14T12:12:33.457537+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:12:33.457537+0000","last_undegraded":"2024-09-14T12:12:33.457537+0000","last_fullsized":"2024-09-14T12:12:33.457537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:41.032154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12294,"num_write":15,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450330+0000","last_change":"2024-09-14T11:31:47.456677+0000","last_active":"2024-09-14T12:13:00.450330+0000","last_peered":"2024-09-14T12:13:00.450330+0000","last_clean":"2024-09-14T12:13:00.450330+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:13:00.450330+0000","last_undegraded":"2024-09-14T12:13:00.450330+0000","last_fullsized":"2024-09-14T12:13:00.450330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.544493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447594+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:12:35.447594+0000","last_peered":"2024-09-14T12:12:35.447594+0000","last_clean":"2024-09-14T12:12:35.447594+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:12:35.447594+0000","last_undegraded":"2024-09-14T12:12:35.447594+0000","last_fullsized":"2024-09-14T12:12:35.447594+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:39.273428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:43.305948+0000","last_change":"2024-09-14T11:35:00.449492+0000","last_active":"2024-09-14T12:12:43.305948+0000","last_peered":"2024-09-14T12:12:43.305948+0000","last_clean":"2024-09-14T12:12:43.305948+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:12:43.305948+0000","last_undegraded":"2024-09-14T12:12:43.305948+0000","last_fullsized":"2024-09-14T12:12:43.305948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:07.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448902+0000","last_change":"2024-09-14T11:31:47.458093+0000","last_active":"2024-09-14T12:12:58.448902+0000","last_peered":"2024-09-14T12:12:58.448902+0000","last_clean":"2024-09-14T12:12:58.448902+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:12:58.448902+0000","last_undegraded":"2024-09-14T12:12:58.448902+0000","last_fullsized":"2024-09-14T12:12:58.448902+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:32.003627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473241+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:14:03.473241+0000","last_peered":"2024-09-14T12:14:03.473241+0000","last_clean":"2024-09-14T12:14:03.473241+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:14:03.473241+0000","last_undegraded":"2024-09-14T12:14:03.473241+0000","last_fullsized":"2024-09-14T12:14:03.473241+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468672+0000","last_change":"2024-09-14T11:31:47.461691+0000","last_active":"2024-09-14T12:13:33.468672+0000","last_peered":"2024-09-14T12:13:33.468672+0000","last_clean":"2024-09-14T12:13:33.468672+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:13:33.468672+0000","last_undegraded":"2024-09-14T12:13:33.468672+0000","last_fullsized":"2024-09-14T12:13:33.468672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:28.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207399+0000","last_change":"2024-09-14T11:31:47.462125+0000","last_active":"2024-09-14T12:13:28.207399+0000","last_peered":"2024-09-14T12:13:28.207399+0000","last_clean":"2024-09-14T12:13:28.207399+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:13:28.207399+0000","last_undegraded":"2024-09-14T12:13:28.207399+0000","last_fullsized":"2024-09-14T12:13:28.207399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:55.114065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.306468+0000","last_change":"2024-09-14T11:51:07.031655+0000","last_active":"2024-09-14T12:12:48.306468+0000","last_peered":"2024-09-14T12:12:48.306468+0000","last_clean":"2024-09-14T12:12:48.306468+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:12:48.306468+0000","last_undegraded":"2024-09-14T12:12:48.306468+0000","last_fullsized":"2024-09-14T12:12:48.306468+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:23.951366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201466+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:12:33.201466+0000","last_peered":"2024-09-14T12:12:33.201466+0000","last_clean":"2024-09-14T12:12:33.201466+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:12:33.201466+0000","last_undegraded":"2024-09-14T12:12:33.201466+0000","last_fullsized":"2024-09-14T12:12:33.201466+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:50.359964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.464857+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:13:08.464857+0000","last_peered":"2024-09-14T12:13:08.464857+0000","last_clean":"2024-09-14T12:13:08.464857+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:13:08.464857+0000","last_undegraded":"2024-09-14T12:13:08.464857+0000","last_fullsized":"2024-09-14T12:13:08.464857+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221763+0000","last_change":"2024-09-14T11:31:47.454368+0000","last_active":"2024-09-14T12:13:28.221763+0000","last_peered":"2024-09-14T12:13:28.221763+0000","last_clean":"2024-09-14T12:13:28.221763+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:13:28.221763+0000","last_undegraded":"2024-09-14T12:13:28.221763+0000","last_fullsized":"2024-09-14T12:13:28.221763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:49.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457485+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:12:33.457485+0000","last_peered":"2024-09-14T12:12:33.457485+0000","last_clean":"2024-09-14T12:12:33.457485+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:12:33.457485+0000","last_undegraded":"2024-09-14T12:12:33.457485+0000","last_fullsized":"2024-09-14T12:12:33.457485+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:14.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.335995+0000","last_change":"2024-09-14T11:31:47.458566+0000","last_active":"2024-09-14T12:13:28.335995+0000","last_peered":"2024-09-14T12:13:28.335995+0000","last_clean":"2024-09-14T12:13:28.335995+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:13:28.335995+0000","last_undegraded":"2024-09-14T12:13:28.335995+0000","last_fullsized":"2024-09-14T12:13:28.335995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:16.885698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445234+0000","last_change":"2024-09-14T11:35:03.475098+0000","last_active":"2024-09-14T12:12:33.445234+0000","last_peered":"2024-09-14T12:12:33.445234+0000","last_clean":"2024-09-14T12:12:33.445234+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:12:33.445234+0000","last_undegraded":"2024-09-14T12:12:33.445234+0000","last_fullsized":"2024-09-14T12:12:33.445234+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:47.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'5","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201494+0000","last_change":"2024-09-14T11:35:00.441606+0000","last_active":"2024-09-14T12:12:33.201494+0000","last_peered":"2024-09-14T12:12:33.201494+0000","last_clean":"2024-09-14T12:12:33.201494+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:12:33.201494+0000","last_undegraded":"2024-09-14T12:12:33.201494+0000","last_fullsized":"2024-09-14T12:12:33.201494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.099191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453081+0000","last_change":"2024-09-14T11:31:47.457442+0000","last_active":"2024-09-14T12:13:28.453081+0000","last_peered":"2024-09-14T12:13:28.453081+0000","last_clean":"2024-09-14T12:13:28.453081+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:13:28.453081+0000","last_undegraded":"2024-09-14T12:13:28.453081+0000","last_fullsized":"2024-09-14T12:13:28.453081+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.421189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328235+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:12:33.328235+0000","last_peered":"2024-09-14T12:12:33.328235+0000","last_clean":"2024-09-14T12:12:33.328235+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:12:33.328235+0000","last_undegraded":"2024-09-14T12:12:33.328235+0000","last_fullsized":"2024-09-14T12:12:33.328235+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.691369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445253+0000","last_change":"2024-09-14T11:35:00.438555+0000","last_active":"2024-09-14T12:12:33.445253+0000","last_peered":"2024-09-14T12:12:33.445253+0000","last_clean":"2024-09-14T12:12:33.445253+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:12:33.445253+0000","last_undegraded":"2024-09-14T12:12:33.445253+0000","last_fullsized":"2024-09-14T12:12:33.445253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:40.844681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471478+0000","last_change":"2024-09-14T11:31:47.457290+0000","last_active":"2024-09-14T12:13:53.471478+0000","last_peered":"2024-09-14T12:13:53.471478+0000","last_clean":"2024-09-14T12:13:53.471478+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:13:53.471478+0000","last_undegraded":"2024-09-14T12:13:53.471478+0000","last_fullsized":"2024-09-14T12:13:53.471478+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:56.244895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'308","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.108039+0000","last_change":"2024-09-14T11:17:21.587746+0000","last_active":"2024-09-14T12:15:43.108039+0000","last_peered":"2024-09-14T12:15:43.108039+0000","last_clean":"2024-09-14T12:15:43.108039+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:15:43.108039+0000","last_undegraded":"2024-09-14T12:15:43.108039+0000","last_fullsized":"2024-09-14T12:15:43.108039+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:26.043334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430926,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":565,"num_read_kb":9737,"num_write":1184,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'480","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869433+0000","last_change":"2024-09-14T11:17:23.596289+0000","last_active":"2024-09-14T12:13:31.869433+0000","last_peered":"2024-09-14T12:13:31.869433+0000","last_clean":"2024-09-14T12:13:31.869433+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:13:31.869433+0000","last_undegraded":"2024-09-14T12:13:31.869433+0000","last_fullsized":"2024-09-14T12:13:31.869433+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.016139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'264","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.841386+0000","last_change":"2024-09-14T11:17:21.584104+0000","last_active":"2024-09-14T12:14:17.841386+0000","last_peered":"2024-09-14T12:14:17.841386+0000","last_clean":"2024-09-14T12:14:17.841386+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:14:17.841386+0000","last_undegraded":"2024-09-14T12:14:17.841386+0000","last_fullsized":"2024-09-14T12:14:17.841386+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:46.479650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699282,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":471,"num_read_kb":22750,"num_write":944,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'451","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.480890+0000","last_change":"2024-09-14T11:17:23.592564+0000","last_active":"2024-09-14T12:14:53.480890+0000","last_peered":"2024-09-14T12:14:53.480890+0000","last_clean":"2024-09-14T12:14:53.480890+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:14:53.480890+0000","last_undegraded":"2024-09-14T12:14:53.480890+0000","last_fullsized":"2024-09-14T12:14:53.480890+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:08.504401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'298","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455236+0000","last_change":"2024-09-14T11:17:21.580337+0000","last_active":"2024-09-14T12:13:40.455236+0000","last_peered":"2024-09-14T12:13:40.455236+0000","last_clean":"2024-09-14T12:13:40.455236+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:13:40.455236+0000","last_undegraded":"2024-09-14T12:13:40.455236+0000","last_fullsized":"2024-09-14T12:13:40.455236+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:44.574988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5644441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":645,"num_read_kb":8093,"num_write":1094,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'828","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.348237+0000","last_change":"2024-09-14T11:17:23.599492+0000","last_active":"2024-09-14T12:14:53.348237+0000","last_peered":"2024-09-14T12:14:53.348237+0000","last_clean":"2024-09-14T12:14:53.348237+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:14:53.348237+0000","last_undegraded":"2024-09-14T12:14:53.348237+0000","last_fullsized":"2024-09-14T12:14:53.348237+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:31.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223314+0000","last_change":"2024-09-14T11:17:21.587518+0000","last_active":"2024-09-14T12:13:38.223314+0000","last_peered":"2024-09-14T12:13:38.223314+0000","last_clean":"2024-09-14T12:13:38.223314+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:13:38.223314+0000","last_undegraded":"2024-09-14T12:13:38.223314+0000","last_fullsized":"2024-09-14T12:13:38.223314+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.780145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11836321,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":624,"num_read_kb":69334,"num_write":1171,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'478","reported_seq":2201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:55.464747+0000","last_change":"2024-09-14T11:17:23.604953+0000","last_active":"2024-09-14T12:14:55.464747+0000","last_peered":"2024-09-14T12:14:55.464747+0000","last_clean":"2024-09-14T12:14:55.464747+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:14:55.464747+0000","last_undegraded":"2024-09-14T12:14:55.464747+0000","last_fullsized":"2024-09-14T12:14:55.464747+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.132184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'288","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.776642+0000","last_change":"2024-09-14T11:17:21.585772+0000","last_active":"2024-09-14T12:13:33.776642+0000","last_peered":"2024-09-14T12:13:33.776642+0000","last_clean":"2024-09-14T12:13:33.776642+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:13:33.776642+0000","last_undegraded":"2024-09-14T12:13:33.776642+0000","last_fullsized":"2024-09-14T12:13:33.776642+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:30.264733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353450,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":577,"num_read_kb":8504,"num_write":1053,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'928","reported_seq":2495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.884819+0000","last_change":"2024-09-14T11:17:23.598765+0000","last_active":"2024-09-14T12:13:38.884819+0000","last_peered":"2024-09-14T12:13:38.884819+0000","last_clean":"2024-09-14T12:13:38.884819+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:13:38.884819+0000","last_undegraded":"2024-09-14T12:13:38.884819+0000","last_fullsized":"2024-09-14T12:13:38.884819+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:07.244374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'276","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:29.940360+0000","last_change":"2024-09-14T11:17:21.586031+0000","last_active":"2024-09-14T12:12:29.940360+0000","last_peered":"2024-09-14T12:12:29.940360+0000","last_clean":"2024-09-14T12:12:29.940360+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:12:29.940360+0000","last_undegraded":"2024-09-14T12:12:29.940360+0000","last_fullsized":"2024-09-14T12:12:29.940360+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:35.597137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1550973,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":530,"num_read_kb":13219,"num_write":1002,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'322","reported_seq":1677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.773491+0000","last_change":"2024-09-14T11:17:23.598233+0000","last_active":"2024-09-14T12:14:33.773491+0000","last_peered":"2024-09-14T12:14:33.773491+0000","last_clean":"2024-09-14T12:14:33.773491+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:14:33.773491+0000","last_undegraded":"2024-09-14T12:14:33.773491+0000","last_fullsized":"2024-09-14T12:14:33.773491+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:42.186568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'269","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.884175+0000","last_change":"2024-09-14T11:17:21.583061+0000","last_active":"2024-09-14T12:12:25.884175+0000","last_peered":"2024-09-14T12:12:25.884175+0000","last_clean":"2024-09-14T12:12:25.884175+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:12:25.884175+0000","last_undegraded":"2024-09-14T12:12:25.884175+0000","last_fullsized":"2024-09-14T12:12:25.884175+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:35.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089099,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":445,"num_read_kb":13115,"num_write":950,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'406","reported_seq":1944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.589436+0000","last_change":"2024-09-14T11:17:23.595095+0000","last_active":"2024-09-14T12:14:01.589436+0000","last_peered":"2024-09-14T12:14:01.589436+0000","last_clean":"2024-09-14T12:14:01.589436+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:14:01.589436+0000","last_undegraded":"2024-09-14T12:14:01.589436+0000","last_fullsized":"2024-09-14T12:14:01.589436+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:51.571958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'283","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.611116+0000","last_change":"2024-09-14T11:17:55.703681+0000","last_active":"2024-09-14T12:14:02.611116+0000","last_peered":"2024-09-14T12:14:02.611116+0000","last_clean":"2024-09-14T12:14:02.611116+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:14:02.611116+0000","last_undegraded":"2024-09-14T12:14:02.611116+0000","last_fullsized":"2024-09-14T12:14:02.611116+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:43.991223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100038,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":520,"num_read_kb":3515,"num_write":1040,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'928","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.115259+0000","last_change":"2024-09-14T11:17:23.602237+0000","last_active":"2024-09-14T12:15:48.115259+0000","last_peered":"2024-09-14T12:15:48.115259+0000","last_clean":"2024-09-14T12:15:48.115259+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:15:48.115259+0000","last_undegraded":"2024-09-14T12:15:48.115259+0000","last_fullsized":"2024-09-14T12:15:48.115259+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:07.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'883","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606712+0000","last_change":"2024-09-14T11:17:23.599033+0000","last_active":"2024-09-14T12:14:34.606712+0000","last_peered":"2024-09-14T12:14:34.606712+0000","last_clean":"2024-09-14T12:14:34.606712+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:14:34.606712+0000","last_undegraded":"2024-09-14T12:14:34.606712+0000","last_fullsized":"2024-09-14T12:14:34.606712+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:02.965131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'310","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464273+0000","last_change":"2024-09-14T11:17:21.590951+0000","last_active":"2024-09-14T12:13:03.464273+0000","last_peered":"2024-09-14T12:13:03.464273+0000","last_clean":"2024-09-14T12:13:03.464273+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:13:03.464273+0000","last_undegraded":"2024-09-14T12:13:03.464273+0000","last_fullsized":"2024-09-14T12:13:03.464273+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:04.497926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4275713,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":605,"num_read_kb":33506,"num_write":1154,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'723","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.112494+0000","last_change":"2024-09-14T11:17:55.874871+0000","last_active":"2024-09-14T12:15:48.112494+0000","last_peered":"2024-09-14T12:15:48.112494+0000","last_clean":"2024-09-14T12:15:48.112494+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:15:48.112494+0000","last_undegraded":"2024-09-14T12:15:48.112494+0000","last_fullsized":"2024-09-14T12:15:48.112494+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:09.467887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'412","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448912+0000","last_change":"2024-09-14T11:17:21.591292+0000","last_active":"2024-09-14T12:12:58.448912+0000","last_peered":"2024-09-14T12:12:58.448912+0000","last_clean":"2024-09-14T12:12:58.448912+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:12:58.448912+0000","last_undegraded":"2024-09-14T12:12:58.448912+0000","last_fullsized":"2024-09-14T12:12:58.448912+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.290528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714049,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":871,"num_read_kb":10641,"num_write":1158,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'766","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.137705+0000","last_change":"2024-09-14T11:17:23.599028+0000","last_active":"2024-09-14T12:15:48.137705+0000","last_peered":"2024-09-14T12:15:48.137705+0000","last_clean":"2024-09-14T12:15:48.137705+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:15:48.137705+0000","last_undegraded":"2024-09-14T12:15:48.137705+0000","last_fullsized":"2024-09-14T12:15:48.137705+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'319","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.585271+0000","last_change":"2024-09-14T11:17:21.590804+0000","last_active":"2024-09-14T12:13:32.585271+0000","last_peered":"2024-09-14T12:13:32.585271+0000","last_clean":"2024-09-14T12:13:32.585271+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:13:32.585271+0000","last_undegraded":"2024-09-14T12:13:32.585271+0000","last_fullsized":"2024-09-14T12:13:32.585271+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:31.068330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5357337,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":598,"num_read_kb":6370,"num_write":1006,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.113932+0000","last_change":"2024-09-14T11:17:23.602214+0000","last_active":"2024-09-14T12:15:48.113932+0000","last_peered":"2024-09-14T12:15:48.113932+0000","last_clean":"2024-09-14T12:15:48.113932+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:15:48.113932+0000","last_undegraded":"2024-09-14T12:15:48.113932+0000","last_fullsized":"2024-09-14T12:15:48.113932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:16.076422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'268","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.331946+0000","last_change":"2024-09-14T11:17:21.580921+0000","last_active":"2024-09-14T12:12:58.331946+0000","last_peered":"2024-09-14T12:12:58.331946+0000","last_clean":"2024-09-14T12:12:58.331946+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:12:58.331946+0000","last_undegraded":"2024-09-14T12:12:58.331946+0000","last_fullsized":"2024-09-14T12:12:58.331946+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440903,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":619,"num_read_kb":17017,"num_write":902,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'903","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.117762+0000","last_change":"2024-09-14T11:17:23.599615+0000","last_active":"2024-09-14T12:15:48.117762+0000","last_peered":"2024-09-14T12:15:48.117762+0000","last_clean":"2024-09-14T12:15:48.117762+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:15:48.117762+0000","last_undegraded":"2024-09-14T12:15:48.117762+0000","last_fullsized":"2024-09-14T12:15:48.117762+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:54.414087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'241","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213854+0000","last_change":"2024-09-14T11:17:21.586068+0000","last_active":"2024-09-14T12:12:58.213854+0000","last_peered":"2024-09-14T12:12:58.213854+0000","last_clean":"2024-09-14T12:12:58.213854+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:12:58.213854+0000","last_undegraded":"2024-09-14T12:12:58.213854+0000","last_fullsized":"2024-09-14T12:12:58.213854+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.111859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8739959,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19406,"num_write":803,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1142","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503777+0000","last_change":"2024-09-14T11:17:23.592841+0000","last_active":"2024-09-14T12:15:18.503777+0000","last_peered":"2024-09-14T12:15:18.503777+0000","last_clean":"2024-09-14T12:15:18.503777+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:15:18.503777+0000","last_undegraded":"2024-09-14T12:15:18.503777+0000","last_fullsized":"2024-09-14T12:15:18.503777+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:33.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'291","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453969+0000","last_change":"2024-09-14T11:17:21.581385+0000","last_active":"2024-09-14T12:13:30.453969+0000","last_peered":"2024-09-14T12:13:30.453969+0000","last_clean":"2024-09-14T12:13:30.453969+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:13:30.453969+0000","last_undegraded":"2024-09-14T12:13:30.453969+0000","last_fullsized":"2024-09-14T12:13:30.453969+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:13.497850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217581,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":658,"num_read_kb":10760,"num_write":949,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'124","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.745040+0000","last_change":"2024-09-14T11:17:31.654831+0000","last_active":"2024-09-14T12:14:34.745040+0000","last_peered":"2024-09-14T12:14:34.745040+0000","last_clean":"2024-09-14T12:14:34.745040+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:14:34.745040+0000","last_undegraded":"2024-09-14T12:14:34.745040+0000","last_fullsized":"2024-09-14T12:14:34.745040+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:31.244666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'519","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.588328+0000","last_change":"2024-09-14T11:17:23.599731+0000","last_active":"2024-09-14T12:14:01.588328+0000","last_peered":"2024-09-14T12:14:01.588328+0000","last_clean":"2024-09-14T12:14:01.588328+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:14:01.588328+0000","last_undegraded":"2024-09-14T12:14:01.588328+0000","last_fullsized":"2024-09-14T12:14:01.588328+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:06.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'232","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.467113+0000","last_change":"2024-09-14T11:17:21.582288+0000","last_active":"2024-09-14T12:13:23.467113+0000","last_peered":"2024-09-14T12:13:23.467113+0000","last_clean":"2024-09-14T12:13:23.467113+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:13:23.467113+0000","last_undegraded":"2024-09-14T12:13:23.467113+0000","last_fullsized":"2024-09-14T12:13:23.467113+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:12.066003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5249689,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":400,"num_read_kb":3402,"num_write":817,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217819+0000","last_change":"2024-09-14T11:17:25.615823+0000","last_active":"2024-09-14T12:13:03.217819+0000","last_peered":"2024-09-14T12:13:03.217819+0000","last_clean":"2024-09-14T12:13:03.217819+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:13:03.217819+0000","last_undegraded":"2024-09-14T12:13:03.217819+0000","last_fullsized":"2024-09-14T12:13:03.217819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:11.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:30.469572+0000","last_change":"2024-09-14T11:17:27.635100+0000","last_active":"2024-09-14T12:15:30.469572+0000","last_peered":"2024-09-14T12:15:30.469572+0000","last_clean":"2024-09-14T12:15:30.469572+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:15:30.469572+0000","last_undegraded":"2024-09-14T12:15:30.469572+0000","last_fullsized":"2024-09-14T12:15:30.469572+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:40.414857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":1083,"num_write":448,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.465023+0000","last_change":"2024-09-14T11:17:29.648345+0000","last_active":"2024-09-14T12:13:08.465023+0000","last_peered":"2024-09-14T12:13:08.465023+0000","last_clean":"2024-09-14T12:13:08.465023+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:13:08.465023+0000","last_undegraded":"2024-09-14T12:13:08.465023+0000","last_fullsized":"2024-09-14T12:13:08.465023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:26.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'125","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.666407+0000","last_change":"2024-09-14T11:17:31.655931+0000","last_active":"2024-09-14T12:14:32.666407+0000","last_peered":"2024-09-14T12:14:32.666407+0000","last_clean":"2024-09-14T12:14:32.666407+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:14:32.666407+0000","last_undegraded":"2024-09-14T12:14:32.666407+0000","last_fullsized":"2024-09-14T12:14:32.666407+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.187962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'403","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605468+0000","last_change":"2024-09-14T11:17:23.593797+0000","last_active":"2024-09-14T12:14:34.605468+0000","last_peered":"2024-09-14T12:14:34.605468+0000","last_clean":"2024-09-14T12:14:34.605468+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:14:34.605468+0000","last_undegraded":"2024-09-14T12:14:34.605468+0000","last_fullsized":"2024-09-14T12:14:34.605468+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:55.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'306","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.125338+0000","last_change":"2024-09-14T11:17:21.586646+0000","last_active":"2024-09-14T12:15:43.125338+0000","last_peered":"2024-09-14T12:15:43.125338+0000","last_clean":"2024-09-14T12:15:43.125338+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:15:43.125338+0000","last_undegraded":"2024-09-14T12:15:43.125338+0000","last_fullsized":"2024-09-14T12:15:43.125338+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:04.270874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2640321,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":500,"num_read_kb":9431,"num_write":1065,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219417+0000","last_change":"2024-09-14T11:17:25.616433+0000","last_active":"2024-09-14T12:13:43.219417+0000","last_peered":"2024-09-14T12:13:43.219417+0000","last_clean":"2024-09-14T12:13:43.219417+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:13:43.219417+0000","last_undegraded":"2024-09-14T12:13:43.219417+0000","last_fullsized":"2024-09-14T12:13:43.219417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:30.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332635+0000","last_change":"2024-09-14T11:17:27.625733+0000","last_active":"2024-09-14T12:13:03.332635+0000","last_peered":"2024-09-14T12:13:03.332635+0000","last_clean":"2024-09-14T12:13:03.332635+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:13:03.332635+0000","last_undegraded":"2024-09-14T12:13:03.332635+0000","last_fullsized":"2024-09-14T12:13:03.332635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.964076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.333430+0000","last_change":"2024-09-14T11:17:29.644069+0000","last_active":"2024-09-14T12:13:08.333430+0000","last_peered":"2024-09-14T12:13:08.333430+0000","last_clean":"2024-09-14T12:13:08.333430+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:13:08.333430+0000","last_undegraded":"2024-09-14T12:13:08.333430+0000","last_fullsized":"2024-09-14T12:13:08.333430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:57.125690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'115","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447544+0000","last_change":"2024-09-14T11:17:31.656073+0000","last_active":"2024-09-14T12:12:35.447544+0000","last_peered":"2024-09-14T12:12:35.447544+0000","last_clean":"2024-09-14T12:12:35.447544+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:12:35.447544+0000","last_undegraded":"2024-09-14T12:12:35.447544+0000","last_fullsized":"2024-09-14T12:12:35.447544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.047265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'515","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.577498+0000","last_change":"2024-09-14T11:17:23.603416+0000","last_active":"2024-09-14T12:13:55.577498+0000","last_peered":"2024-09-14T12:13:55.577498+0000","last_clean":"2024-09-14T12:13:55.577498+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:13:55.577498+0000","last_undegraded":"2024-09-14T12:13:55.577498+0000","last_fullsized":"2024-09-14T12:13:55.577498+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:40.391533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'377","reported_seq":1092,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.441992+0000","last_change":"2024-09-14T11:17:21.581059+0000","last_active":"2024-09-14T12:14:01.441992+0000","last_peered":"2024-09-14T12:14:01.441992+0000","last_clean":"2024-09-14T12:14:01.441992+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:14:01.441992+0000","last_undegraded":"2024-09-14T12:14:01.441992+0000","last_fullsized":"2024-09-14T12:14:01.441992+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:45.085082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20627141,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":959,"num_read_kb":13380,"num_write":1346,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.214581+0000","last_change":"2024-09-14T11:17:25.616302+0000","last_active":"2024-09-14T12:13:03.214581+0000","last_peered":"2024-09-14T12:13:03.214581+0000","last_clean":"2024-09-14T12:13:03.214581+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:13:03.214581+0000","last_undegraded":"2024-09-14T12:13:03.214581+0000","last_fullsized":"2024-09-14T12:13:03.214581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:14.747448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311910+0000","last_change":"2024-09-14T11:17:27.629551+0000","last_active":"2024-09-14T12:13:38.311910+0000","last_peered":"2024-09-14T12:13:38.311910+0000","last_clean":"2024-09-14T12:13:38.311910+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:13:38.311910+0000","last_undegraded":"2024-09-14T12:13:38.311910+0000","last_fullsized":"2024-09-14T12:13:38.311910+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'760","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.258497+0000","last_change":"2024-09-14T11:17:29.644411+0000","last_active":"2024-09-14T12:15:49.258497+0000","last_peered":"2024-09-14T12:15:49.258497+0000","last_clean":"2024-09-14T12:15:49.258497+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:15:49.258497+0000","last_undegraded":"2024-09-14T12:15:49.258497+0000","last_fullsized":"2024-09-14T12:15:49.258497+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:09.032379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.802436+0000","last_change":"2024-09-14T11:17:31.653029+0000","last_active":"2024-09-14T12:14:34.802436+0000","last_peered":"2024-09-14T12:14:34.802436+0000","last_clean":"2024-09-14T12:14:34.802436+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:14:34.802436+0000","last_undegraded":"2024-09-14T12:14:34.802436+0000","last_fullsized":"2024-09-14T12:14:34.802436+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.378206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1034","reported_seq":2653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208892+0000","last_change":"2024-09-14T11:17:23.595010+0000","last_active":"2024-09-14T12:14:31.208892+0000","last_peered":"2024-09-14T12:14:31.208892+0000","last_clean":"2024-09-14T12:14:31.208892+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:14:31.208892+0000","last_undegraded":"2024-09-14T12:14:31.208892+0000","last_fullsized":"2024-09-14T12:14:31.208892+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'281","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.939272+0000","last_change":"2024-09-14T11:17:21.584036+0000","last_active":"2024-09-14T12:13:51.939272+0000","last_peered":"2024-09-14T12:13:51.939272+0000","last_clean":"2024-09-14T12:13:51.939272+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:13:51.939272+0000","last_undegraded":"2024-09-14T12:13:51.939272+0000","last_fullsized":"2024-09-14T12:13:51.939272+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:15.378108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5585677,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":661,"num_read_kb":31887,"num_write":1040,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217853+0000","last_change":"2024-09-14T11:17:25.618783+0000","last_active":"2024-09-14T12:13:03.217853+0000","last_peered":"2024-09-14T12:13:03.217853+0000","last_clean":"2024-09-14T12:13:03.217853+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:13:03.217853+0000","last_undegraded":"2024-09-14T12:13:03.217853+0000","last_fullsized":"2024-09-14T12:13:03.217853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:17.470265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'266","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.147383+0000","last_change":"2024-09-14T11:17:27.633216+0000","last_active":"2024-09-14T12:15:48.147383+0000","last_peered":"2024-09-14T12:15:48.147383+0000","last_clean":"2024-09-14T12:15:48.147383+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:15:48.147383+0000","last_undegraded":"2024-09-14T12:15:48.147383+0000","last_fullsized":"2024-09-14T12:15:48.147383+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.992449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":965,"num_write":372,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'797","reported_seq":2950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.519993+0000","last_change":"2024-09-14T11:17:29.645452+0000","last_active":"2024-09-14T12:15:52.519993+0000","last_peered":"2024-09-14T12:15:52.519993+0000","last_clean":"2024-09-14T12:15:52.519993+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:15:52.519993+0000","last_undegraded":"2024-09-14T12:15:52.519993+0000","last_fullsized":"2024-09-14T12:15:52.519993+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:20.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'781","reported_seq":2531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.772745+0000","last_change":"2024-09-14T11:17:23.592552+0000","last_active":"2024-09-14T12:14:33.772745+0000","last_peered":"2024-09-14T12:14:33.772745+0000","last_clean":"2024-09-14T12:14:33.772745+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:14:33.772745+0000","last_undegraded":"2024-09-14T12:14:33.772745+0000","last_fullsized":"2024-09-14T12:14:33.772745+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.626824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'321","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470266+0000","last_change":"2024-09-14T11:17:21.585562+0000","last_active":"2024-09-14T12:13:43.470266+0000","last_peered":"2024-09-14T12:13:43.470266+0000","last_clean":"2024-09-14T12:13:43.470266+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:13:43.470266+0000","last_undegraded":"2024-09-14T12:13:43.470266+0000","last_fullsized":"2024-09-14T12:13:43.470266+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:32.839861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10701649,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":609,"num_read_kb":56115,"num_write":1049,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470857+0000","last_change":"2024-09-14T11:17:25.612123+0000","last_active":"2024-09-14T12:13:48.470857+0000","last_peered":"2024-09-14T12:13:48.470857+0000","last_clean":"2024-09-14T12:13:48.470857+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:13:48.470857+0000","last_undegraded":"2024-09-14T12:13:48.470857+0000","last_fullsized":"2024-09-14T12:13:48.470857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.389407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'349","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.228278+0000","last_change":"2024-09-14T11:17:27.632368+0000","last_active":"2024-09-14T12:15:49.228278+0000","last_peered":"2024-09-14T12:15:49.228278+0000","last_clean":"2024-09-14T12:15:49.228278+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:15:49.228278+0000","last_undegraded":"2024-09-14T12:15:49.228278+0000","last_fullsized":"2024-09-14T12:15:49.228278+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.760176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65135,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1087,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.209730+0000","last_change":"2024-09-14T11:17:29.646397+0000","last_active":"2024-09-14T12:13:48.209730+0000","last_peered":"2024-09-14T12:13:48.209730+0000","last_clean":"2024-09-14T12:13:48.209730+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:13:48.209730+0000","last_undegraded":"2024-09-14T12:13:48.209730+0000","last_fullsized":"2024-09-14T12:13:48.209730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.686669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'546","reported_seq":1351,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.248613+0000","last_change":"2024-09-14T11:17:31.656988+0000","last_active":"2024-09-14T12:15:49.248613+0000","last_peered":"2024-09-14T12:15:49.248613+0000","last_clean":"2024-09-14T12:15:49.248613+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:15:49.248613+0000","last_undegraded":"2024-09-14T12:15:49.248613+0000","last_fullsized":"2024-09-14T12:15:49.248613+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:43.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'387","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338146+0000","last_change":"2024-09-14T11:17:23.594471+0000","last_active":"2024-09-14T12:13:43.338146+0000","last_peered":"2024-09-14T12:13:43.338146+0000","last_clean":"2024-09-14T12:13:43.338146+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:13:43.338146+0000","last_undegraded":"2024-09-14T12:13:43.338146+0000","last_fullsized":"2024-09-14T12:13:43.338146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:33.360740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'321","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.127362+0000","last_change":"2024-09-14T11:17:21.582857+0000","last_active":"2024-09-14T12:13:57.127362+0000","last_peered":"2024-09-14T12:13:57.127362+0000","last_clean":"2024-09-14T12:13:57.127362+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:13:57.127362+0000","last_undegraded":"2024-09-14T12:13:57.127362+0000","last_fullsized":"2024-09-14T12:13:57.127362+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:31.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7483620,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":979,"num_read_kb":12713,"num_write":1195,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312912+0000","last_change":"2024-09-14T11:17:25.611404+0000","last_active":"2024-09-14T12:13:48.312912+0000","last_peered":"2024-09-14T12:13:48.312912+0000","last_clean":"2024-09-14T12:13:48.312912+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:13:48.312912+0000","last_undegraded":"2024-09-14T12:13:48.312912+0000","last_fullsized":"2024-09-14T12:13:48.312912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:08.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'247","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.205235+0000","last_change":"2024-09-14T11:17:27.631285+0000","last_active":"2024-09-14T12:15:49.205235+0000","last_peered":"2024-09-14T12:15:49.205235+0000","last_clean":"2024-09-14T12:15:49.205235+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:15:49.205235+0000","last_undegraded":"2024-09-14T12:15:49.205235+0000","last_fullsized":"2024-09-14T12:15:49.205235+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:15.793000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":858,"num_write":330,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.207057+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:11:58.207057+0000","last_peered":"2024-09-14T12:11:58.207057+0000","last_clean":"2024-09-14T12:11:58.207057+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:11:58.207057+0000","last_undegraded":"2024-09-14T12:11:58.207057+0000","last_fullsized":"2024-09-14T12:11:58.207057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2525","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.132063+0000","last_change":"2024-09-14T11:17:31.655728+0000","last_active":"2024-09-14T12:15:48.132063+0000","last_peered":"2024-09-14T12:15:48.132063+0000","last_clean":"2024-09-14T12:15:48.132063+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:15:48.132063+0000","last_undegraded":"2024-09-14T12:15:48.132063+0000","last_fullsized":"2024-09-14T12:15:48.132063+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:25.453442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1156","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344423+0000","last_change":"2024-09-14T11:17:23.605410+0000","last_active":"2024-09-14T12:13:53.344423+0000","last_peered":"2024-09-14T12:13:53.344423+0000","last_clean":"2024-09-14T12:13:53.344423+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:13:53.344423+0000","last_undegraded":"2024-09-14T12:13:53.344423+0000","last_fullsized":"2024-09-14T12:13:53.344423+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:20.036802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'307","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:19.299582+0000","last_change":"2024-09-14T11:17:21.589280+0000","last_active":"2024-09-14T12:14:19.299582+0000","last_peered":"2024-09-14T12:14:19.299582+0000","last_clean":"2024-09-14T12:14:19.299582+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:14:19.299582+0000","last_undegraded":"2024-09-14T12:14:19.299582+0000","last_fullsized":"2024-09-14T12:14:19.299582+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.602370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21050187,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":579,"num_read_kb":71361,"num_write":1042,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312428+0000","last_change":"2024-09-14T11:17:25.610821+0000","last_active":"2024-09-14T12:13:43.312428+0000","last_peered":"2024-09-14T12:13:43.312428+0000","last_clean":"2024-09-14T12:13:43.312428+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:13:43.312428+0000","last_undegraded":"2024-09-14T12:13:43.312428+0000","last_fullsized":"2024-09-14T12:13:43.312428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:02.190026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'303","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.230589+0000","last_change":"2024-09-14T11:17:27.635877+0000","last_active":"2024-09-14T12:15:49.230589+0000","last_peered":"2024-09-14T12:15:49.230589+0000","last_clean":"2024-09-14T12:15:49.230589+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:15:49.230589+0000","last_undegraded":"2024-09-14T12:15:49.230589+0000","last_fullsized":"2024-09-14T12:15:49.230589+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:09.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63434,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1010,"num_write":408,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.521807+0000","last_change":"2024-09-14T11:17:29.645441+0000","last_active":"2024-09-14T12:15:52.521807+0000","last_peered":"2024-09-14T12:15:52.521807+0000","last_clean":"2024-09-14T12:15:52.521807+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:15:52.521807+0000","last_undegraded":"2024-09-14T12:15:52.521807+0000","last_fullsized":"2024-09-14T12:15:52.521807+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.991498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.126444+0000","last_change":"2024-09-14T11:17:31.657084+0000","last_active":"2024-09-14T12:15:48.126444+0000","last_peered":"2024-09-14T12:15:48.126444+0000","last_clean":"2024-09-14T12:15:48.126444+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:15:48.126444+0000","last_undegraded":"2024-09-14T12:15:48.126444+0000","last_fullsized":"2024-09-14T12:15:48.126444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:26.090131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'579","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606091+0000","last_change":"2024-09-14T11:17:23.600240+0000","last_active":"2024-09-14T12:14:34.606091+0000","last_peered":"2024-09-14T12:14:34.606091+0000","last_clean":"2024-09-14T12:14:34.606091+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:14:34.606091+0000","last_undegraded":"2024-09-14T12:14:34.606091+0000","last_fullsized":"2024-09-14T12:14:34.606091+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:34.546153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:20.789966+0000","last_change":"2024-09-14T11:17:55.874169+0000","last_active":"2024-09-14T12:13:20.789966+0000","last_peered":"2024-09-14T12:13:20.789966+0000","last_clean":"2024-09-14T12:13:20.789966+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:13:20.789966+0000","last_undegraded":"2024-09-14T12:13:20.789966+0000","last_fullsized":"2024-09-14T12:13:20.789966+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.787464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17505113,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":715,"num_read_kb":58894,"num_write":1317,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313940+0000","last_change":"2024-09-14T11:17:25.606685+0000","last_active":"2024-09-14T12:13:58.313940+0000","last_peered":"2024-09-14T12:13:58.313940+0000","last_clean":"2024-09-14T12:13:58.313940+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:13:58.313940+0000","last_undegraded":"2024-09-14T12:13:58.313940+0000","last_fullsized":"2024-09-14T12:13:58.313940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:26.184797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'479","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.233091+0000","last_change":"2024-09-14T11:17:27.632963+0000","last_active":"2024-09-14T12:15:49.233091+0000","last_peered":"2024-09-14T12:15:49.233091+0000","last_clean":"2024-09-14T12:15:49.233091+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:15:49.233091+0000","last_undegraded":"2024-09-14T12:15:49.233091+0000","last_fullsized":"2024-09-14T12:15:49.233091+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:19.107003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112651,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":1798,"num_write":694,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.313426+0000","last_change":"2024-09-14T11:17:29.642604+0000","last_active":"2024-09-14T12:13:53.313426+0000","last_peered":"2024-09-14T12:13:53.313426+0000","last_clean":"2024-09-14T12:13:53.313426+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:13:53.313426+0000","last_undegraded":"2024-09-14T12:13:53.313426+0000","last_fullsized":"2024-09-14T12:13:53.313426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:39.976613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.210299+0000","last_change":"2024-09-14T11:17:31.660313+0000","last_active":"2024-09-14T12:13:53.210299+0000","last_peered":"2024-09-14T12:13:53.210299+0000","last_clean":"2024-09-14T12:13:53.210299+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:13:53.210299+0000","last_undegraded":"2024-09-14T12:13:53.210299+0000","last_fullsized":"2024-09-14T12:13:53.210299+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:47.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'491","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337413+0000","last_change":"2024-09-14T11:17:23.603415+0000","last_active":"2024-09-14T12:13:38.337413+0000","last_peered":"2024-09-14T12:13:38.337413+0000","last_clean":"2024-09-14T12:13:38.337413+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:13:38.337413+0000","last_undegraded":"2024-09-14T12:13:38.337413+0000","last_fullsized":"2024-09-14T12:13:38.337413+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.406649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'277","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.387199+0000","last_change":"2024-09-14T11:17:21.580769+0000","last_active":"2024-09-14T12:13:48.387199+0000","last_peered":"2024-09-14T12:13:48.387199+0000","last_clean":"2024-09-14T12:13:48.387199+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:13:48.387199+0000","last_undegraded":"2024-09-14T12:13:48.387199+0000","last_fullsized":"2024-09-14T12:13:48.387199+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:27.335044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899414,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":604,"num_read_kb":23428,"num_write":1046,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312463+0000","last_change":"2024-09-14T11:17:25.615155+0000","last_active":"2024-09-14T12:13:43.312463+0000","last_peered":"2024-09-14T12:13:43.312463+0000","last_clean":"2024-09-14T12:13:43.312463+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:13:43.312463+0000","last_undegraded":"2024-09-14T12:13:43.312463+0000","last_fullsized":"2024-09-14T12:13:43.312463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.760805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'283","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.209878+0000","last_change":"2024-09-14T11:17:27.634022+0000","last_active":"2024-09-14T12:15:49.209878+0000","last_peered":"2024-09-14T12:15:49.209878+0000","last_clean":"2024-09-14T12:15:49.209878+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:15:49.209878+0000","last_undegraded":"2024-09-14T12:15:49.209878+0000","last_fullsized":"2024-09-14T12:15:49.209878+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:42.665521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62230,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":1018,"num_write":456,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456437+0000","last_change":"2024-09-14T11:17:29.647566+0000","last_active":"2024-09-14T12:13:50.456437+0000","last_peered":"2024-09-14T12:13:50.456437+0000","last_clean":"2024-09-14T12:13:50.456437+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:13:50.456437+0000","last_undegraded":"2024-09-14T12:13:50.456437+0000","last_fullsized":"2024-09-14T12:13:50.456437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:15.794875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'110","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.479972+0000","last_change":"2024-09-14T11:17:31.655541+0000","last_active":"2024-09-14T12:15:38.479972+0000","last_peered":"2024-09-14T12:15:38.479972+0000","last_clean":"2024-09-14T12:15:38.479972+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:15:38.479972+0000","last_undegraded":"2024-09-14T12:15:38.479972+0000","last_fullsized":"2024-09-14T12:15:38.479972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:33.617603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'541","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755553+0000","last_change":"2024-09-14T11:17:23.599981+0000","last_active":"2024-09-14T12:14:02.755553+0000","last_peered":"2024-09-14T12:14:02.755553+0000","last_clean":"2024-09-14T12:14:02.755553+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:14:02.755553+0000","last_undegraded":"2024-09-14T12:14:02.755553+0000","last_fullsized":"2024-09-14T12:14:02.755553+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:03.188860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'340","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344436+0000","last_change":"2024-09-14T11:17:21.582543+0000","last_active":"2024-09-14T12:13:53.344436+0000","last_peered":"2024-09-14T12:13:53.344436+0000","last_clean":"2024-09-14T12:13:53.344436+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:13:53.344436+0000","last_undegraded":"2024-09-14T12:13:53.344436+0000","last_fullsized":"2024-09-14T12:13:53.344436+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:42.560672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10660161,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":695,"num_read_kb":21492,"num_write":1314,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209141+0000","last_change":"2024-09-14T11:17:25.605008+0000","last_active":"2024-09-14T12:13:43.209141+0000","last_peered":"2024-09-14T12:13:43.209141+0000","last_clean":"2024-09-14T12:13:43.209141+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:13:43.209141+0000","last_undegraded":"2024-09-14T12:13:43.209141+0000","last_fullsized":"2024-09-14T12:13:43.209141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:21.712998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'301","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.239456+0000","last_change":"2024-09-14T11:17:27.627740+0000","last_active":"2024-09-14T12:15:49.239456+0000","last_peered":"2024-09-14T12:15:49.239456+0000","last_clean":"2024-09-14T12:15:49.239456+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:15:49.239456+0000","last_undegraded":"2024-09-14T12:15:49.239456+0000","last_fullsized":"2024-09-14T12:15:49.239456+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:01.987766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59739,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":483,"num_read_kb":952,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.514434+0000","last_change":"2024-09-14T11:17:29.638832+0000","last_active":"2024-09-14T12:15:52.514434+0000","last_peered":"2024-09-14T12:15:52.514434+0000","last_clean":"2024-09-14T12:15:52.514434+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:15:52.514434+0000","last_undegraded":"2024-09-14T12:15:52.514434+0000","last_fullsized":"2024-09-14T12:15:52.514434+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":701,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:59.704823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'183","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.243227+0000","last_change":"2024-09-14T11:17:31.656014+0000","last_active":"2024-09-14T12:15:49.243227+0000","last_peered":"2024-09-14T12:15:49.243227+0000","last_clean":"2024-09-14T12:15:49.243227+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:15:49.243227+0000","last_undegraded":"2024-09-14T12:15:49.243227+0000","last_fullsized":"2024-09-14T12:15:49.243227+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:31.925155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'786","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337480+0000","last_change":"2024-09-14T11:17:23.594812+0000","last_active":"2024-09-14T12:13:38.337480+0000","last_peered":"2024-09-14T12:13:38.337480+0000","last_clean":"2024-09-14T12:13:38.337480+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:13:38.337480+0000","last_undegraded":"2024-09-14T12:13:38.337480+0000","last_fullsized":"2024-09-14T12:13:38.337480+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:20.279963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'266","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338103+0000","last_change":"2024-09-14T11:17:21.572083+0000","last_active":"2024-09-14T12:13:43.338103+0000","last_peered":"2024-09-14T12:13:43.338103+0000","last_clean":"2024-09-14T12:13:43.338103+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:13:43.338103+0000","last_undegraded":"2024-09-14T12:13:43.338103+0000","last_fullsized":"2024-09-14T12:13:43.338103+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:13.146982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6951881,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":413,"num_read_kb":54221,"num_write":900,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.187936+0000","last_change":"2024-09-14T11:17:25.619652+0000","last_active":"2024-09-14T12:15:49.187936+0000","last_peered":"2024-09-14T12:15:49.187936+0000","last_clean":"2024-09-14T12:15:49.187936+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:15:49.187936+0000","last_undegraded":"2024-09-14T12:15:49.187936+0000","last_fullsized":"2024-09-14T12:15:49.187936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:20.219288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219434+0000","last_change":"2024-09-14T11:17:27.632484+0000","last_active":"2024-09-14T12:13:43.219434+0000","last_peered":"2024-09-14T12:13:43.219434+0000","last_clean":"2024-09-14T12:13:43.219434+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:13:43.219434+0000","last_undegraded":"2024-09-14T12:13:43.219434+0000","last_fullsized":"2024-09-14T12:13:43.219434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'779","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.516405+0000","last_change":"2024-09-14T11:17:29.640978+0000","last_active":"2024-09-14T12:15:52.516405+0000","last_peered":"2024-09-14T12:15:52.516405+0000","last_clean":"2024-09-14T12:15:52.516405+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:15:52.516405+0000","last_undegraded":"2024-09-14T12:15:52.516405+0000","last_fullsized":"2024-09-14T12:15:52.516405+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":702,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.396632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.764408+0000","last_change":"2024-09-14T11:17:31.656199+0000","last_active":"2024-09-14T12:14:33.764408+0000","last_peered":"2024-09-14T12:14:33.764408+0000","last_clean":"2024-09-14T12:14:33.764408+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:14:33.764408+0000","last_undegraded":"2024-09-14T12:14:33.764408+0000","last_fullsized":"2024-09-14T12:14:33.764408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:30.802461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'446","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210300+0000","last_change":"2024-09-14T11:17:23.603828+0000","last_active":"2024-09-14T12:14:31.210300+0000","last_peered":"2024-09-14T12:14:31.210300+0000","last_clean":"2024-09-14T12:14:31.210300+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:14:31.210300+0000","last_undegraded":"2024-09-14T12:14:31.210300+0000","last_fullsized":"2024-09-14T12:14:31.210300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:37.153834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'272","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219327+0000","last_change":"2024-09-14T11:17:21.585341+0000","last_active":"2024-09-14T12:13:43.219327+0000","last_peered":"2024-09-14T12:13:43.219327+0000","last_clean":"2024-09-14T12:13:43.219327+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:13:43.219327+0000","last_undegraded":"2024-09-14T12:13:43.219327+0000","last_fullsized":"2024-09-14T12:13:43.219327+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:02.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5522412,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":470,"num_read_kb":11146,"num_write":1013,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338261+0000","last_change":"2024-09-14T11:17:25.616843+0000","last_active":"2024-09-14T12:13:43.338261+0000","last_peered":"2024-09-14T12:13:43.338261+0000","last_clean":"2024-09-14T12:13:43.338261+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:13:43.338261+0000","last_undegraded":"2024-09-14T12:13:43.338261+0000","last_fullsized":"2024-09-14T12:13:43.338261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:24.981755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'359","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.224639+0000","last_change":"2024-09-14T11:17:27.635744+0000","last_active":"2024-09-14T12:15:49.224639+0000","last_peered":"2024-09-14T12:15:49.224639+0000","last_clean":"2024-09-14T12:15:49.224639+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:15:49.224639+0000","last_undegraded":"2024-09-14T12:15:49.224639+0000","last_fullsized":"2024-09-14T12:15:49.224639+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:39.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59251,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":576,"num_read_kb":1082,"num_write":460,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.343756+0000","last_change":"2024-09-14T11:17:29.646394+0000","last_active":"2024-09-14T12:13:48.343756+0000","last_peered":"2024-09-14T12:13:48.343756+0000","last_clean":"2024-09-14T12:13:48.343756+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:13:48.343756+0000","last_undegraded":"2024-09-14T12:13:48.343756+0000","last_fullsized":"2024-09-14T12:13:48.343756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:23.198544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'153","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.201239+0000","last_change":"2024-09-14T11:17:31.657114+0000","last_active":"2024-09-14T12:14:31.201239+0000","last_peered":"2024-09-14T12:14:31.201239+0000","last_clean":"2024-09-14T12:14:31.201239+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:14:31.201239+0000","last_undegraded":"2024-09-14T12:14:31.201239+0000","last_fullsized":"2024-09-14T12:14:31.201239+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:58.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'834","reported_seq":2361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.529186+0000","last_change":"2024-09-14T11:17:23.599852+0000","last_active":"2024-09-14T12:13:48.529186+0000","last_peered":"2024-09-14T12:13:48.529186+0000","last_clean":"2024-09-14T12:13:48.529186+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:13:48.529186+0000","last_undegraded":"2024-09-14T12:13:48.529186+0000","last_fullsized":"2024-09-14T12:13:48.529186+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:20.678363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.465508+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T12:13:13.465508+0000","last_peered":"2024-09-14T12:13:13.465508+0000","last_clean":"2024-09-14T12:13:13.465508+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:13:13.465508+0000","last_undegraded":"2024-09-14T12:13:13.465508+0000","last_fullsized":"2024-09-14T12:13:13.465508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221784+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T12:13:28.221784+0000","last_peered":"2024-09-14T12:13:28.221784+0000","last_clean":"2024-09-14T12:13:28.221784+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:13:28.221784+0000","last_undegraded":"2024-09-14T12:13:28.221784+0000","last_fullsized":"2024-09-14T12:13:28.221784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'286","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:59.802403+0000","last_change":"2024-09-14T11:17:21.591302+0000","last_active":"2024-09-14T12:13:59.802403+0000","last_peered":"2024-09-14T12:13:59.802403+0000","last_clean":"2024-09-14T12:13:59.802403+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:13:59.802403+0000","last_undegraded":"2024-09-14T12:13:59.802403+0000","last_fullsized":"2024-09-14T12:13:59.802403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:29.565797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5920202,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":537,"num_read_kb":16920,"num_write":1021,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470216+0000","last_change":"2024-09-14T11:17:25.613638+0000","last_active":"2024-09-14T12:13:43.470216+0000","last_peered":"2024-09-14T12:13:43.470216+0000","last_clean":"2024-09-14T12:13:43.470216+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:13:43.470216+0000","last_undegraded":"2024-09-14T12:13:43.470216+0000","last_fullsized":"2024-09-14T12:13:43.470216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:59.751658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.237428+0000","last_change":"2024-09-14T11:17:27.633577+0000","last_active":"2024-09-14T12:15:49.237428+0000","last_peered":"2024-09-14T12:15:49.237428+0000","last_clean":"2024-09-14T12:15:49.237428+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:15:49.237428+0000","last_undegraded":"2024-09-14T12:15:49.237428+0000","last_fullsized":"2024-09-14T12:15:49.237428+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.125363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1448,"num_read_kb":3032,"num_write":1382,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456404+0000","last_change":"2024-09-14T11:17:29.646281+0000","last_active":"2024-09-14T12:13:50.456404+0000","last_peered":"2024-09-14T12:13:50.456404+0000","last_clean":"2024-09-14T12:13:50.456404+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:13:50.456404+0000","last_undegraded":"2024-09-14T12:13:50.456404+0000","last_fullsized":"2024-09-14T12:13:50.456404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:03.727278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'170","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.634305+0000","last_change":"2024-09-14T11:17:31.655031+0000","last_active":"2024-09-14T12:14:34.634305+0000","last_peered":"2024-09-14T12:14:34.634305+0000","last_clean":"2024-09-14T12:14:34.634305+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:14:34.634305+0000","last_undegraded":"2024-09-14T12:14:34.634305+0000","last_fullsized":"2024-09-14T12:14:34.634305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:19.605574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'459","reported_seq":2050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208300+0000","last_change":"2024-09-14T11:17:23.599920+0000","last_active":"2024-09-14T12:14:31.208300+0000","last_peered":"2024-09-14T12:14:31.208300+0000","last_clean":"2024-09-14T12:14:31.208300+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:14:31.208300+0000","last_undegraded":"2024-09-14T12:14:31.208300+0000","last_fullsized":"2024-09-14T12:14:31.208300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:33.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466357+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T12:13:18.466357+0000","last_peered":"2024-09-14T12:13:18.466357+0000","last_clean":"2024-09-14T12:13:18.466357+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:13:18.466357+0000","last_undegraded":"2024-09-14T12:13:18.466357+0000","last_fullsized":"2024-09-14T12:13:18.466357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'306","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.117145+0000","last_change":"2024-09-14T11:17:21.582410+0000","last_active":"2024-09-14T12:13:42.117145+0000","last_peered":"2024-09-14T12:13:42.117145+0000","last_clean":"2024-09-14T12:13:42.117145+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:13:42.117145+0000","last_undegraded":"2024-09-14T12:13:42.117145+0000","last_fullsized":"2024-09-14T12:13:42.117145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.881583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730149,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":574,"num_read_kb":9080,"num_write":1205,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.224869+0000","last_change":"2024-09-14T11:17:25.617276+0000","last_active":"2024-09-14T12:13:48.224869+0000","last_peered":"2024-09-14T12:13:48.224869+0000","last_clean":"2024-09-14T12:13:48.224869+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:13:48.224869+0000","last_undegraded":"2024-09-14T12:13:48.224869+0000","last_fullsized":"2024-09-14T12:13:48.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:50.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1285","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.254822+0000","last_change":"2024-09-14T11:17:27.631903+0000","last_active":"2024-09-14T12:15:49.254822+0000","last_peered":"2024-09-14T12:15:49.254822+0000","last_clean":"2024-09-14T12:15:49.254822+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:15:49.254822+0000","last_undegraded":"2024-09-14T12:15:49.254822+0000","last_fullsized":"2024-09-14T12:15:49.254822+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:33.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259105,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2005,"num_read_kb":3622,"num_write":1136,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471608+0000","last_change":"2024-09-14T11:17:29.645394+0000","last_active":"2024-09-14T12:13:53.471608+0000","last_peered":"2024-09-14T12:13:53.471608+0000","last_clean":"2024-09-14T12:13:53.471608+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:13:53.471608+0000","last_undegraded":"2024-09-14T12:13:53.471608+0000","last_fullsized":"2024-09-14T12:13:53.471608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:49.499047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211448+0000","last_change":"2024-09-14T11:17:31.658892+0000","last_active":"2024-09-14T12:14:03.211448+0000","last_peered":"2024-09-14T12:14:03.211448+0000","last_clean":"2024-09-14T12:14:03.211448+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:14:03.211448+0000","last_undegraded":"2024-09-14T12:14:03.211448+0000","last_fullsized":"2024-09-14T12:14:03.211448+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:34.868207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'656","reported_seq":2304,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606004+0000","last_change":"2024-09-14T11:17:23.597525+0000","last_active":"2024-09-14T12:14:34.606004+0000","last_peered":"2024-09-14T12:14:34.606004+0000","last_clean":"2024-09-14T12:14:34.606004+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:14:34.606004+0000","last_undegraded":"2024-09-14T12:14:34.606004+0000","last_fullsized":"2024-09-14T12:14:34.606004+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:35.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.310703+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T12:13:28.310703+0000","last_peered":"2024-09-14T12:13:28.310703+0000","last_clean":"2024-09-14T12:13:28.310703+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:13:28.310703+0000","last_undegraded":"2024-09-14T12:13:28.310703+0000","last_fullsized":"2024-09-14T12:13:28.310703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'302","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.739230+0000","last_change":"2024-09-14T11:17:21.573767+0000","last_active":"2024-09-14T12:15:43.739230+0000","last_peered":"2024-09-14T12:15:43.739230+0000","last_clean":"2024-09-14T12:15:43.739230+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:15:43.739230+0000","last_undegraded":"2024-09-14T12:15:43.739230+0000","last_fullsized":"2024-09-14T12:15:43.739230+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:55.914740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14553424,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":614,"num_read_kb":56413,"num_write":1078,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312976+0000","last_change":"2024-09-14T11:17:25.616518+0000","last_active":"2024-09-14T12:13:48.312976+0000","last_peered":"2024-09-14T12:13:48.312976+0000","last_clean":"2024-09-14T12:13:48.312976+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:13:48.312976+0000","last_undegraded":"2024-09-14T12:13:48.312976+0000","last_fullsized":"2024-09-14T12:13:48.312976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:31.140976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'258","reported_seq":1503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.376331+0000","last_change":"2024-09-14T11:17:27.633187+0000","last_active":"2024-09-14T12:15:49.376331+0000","last_peered":"2024-09-14T12:15:49.376331+0000","last_clean":"2024-09-14T12:15:49.376331+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:15:49.376331+0000","last_undegraded":"2024-09-14T12:15:49.376331+0000","last_fullsized":"2024-09-14T12:15:49.376331+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.161248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455781+0000","last_change":"2024-09-14T11:17:29.647473+0000","last_active":"2024-09-14T12:13:45.455781+0000","last_peered":"2024-09-14T12:13:45.455781+0000","last_clean":"2024-09-14T12:13:45.455781+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:13:45.455781+0000","last_undegraded":"2024-09-14T12:13:45.455781+0000","last_fullsized":"2024-09-14T12:13:45.455781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:28.646908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'797","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.930217+0000","last_change":"2024-09-14T11:17:23.593249+0000","last_active":"2024-09-14T12:13:46.930217+0000","last_peered":"2024-09-14T12:13:46.930217+0000","last_clean":"2024-09-14T12:13:46.930217+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:13:46.930217+0000","last_undegraded":"2024-09-14T12:13:46.930217+0000","last_fullsized":"2024-09-14T12:13:46.930217+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:29.005386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221722+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T12:13:28.221722+0000","last_peered":"2024-09-14T12:13:28.221722+0000","last_clean":"2024-09-14T12:13:28.221722+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:13:28.221722+0000","last_undegraded":"2024-09-14T12:13:28.221722+0000","last_fullsized":"2024-09-14T12:13:28.221722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'349","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.745606+0000","last_change":"2024-09-14T11:17:55.703523+0000","last_active":"2024-09-14T12:13:38.745606+0000","last_peered":"2024-09-14T12:13:38.745606+0000","last_clean":"2024-09-14T12:13:38.745606+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:13:38.745606+0000","last_undegraded":"2024-09-14T12:13:38.745606+0000","last_fullsized":"2024-09-14T12:13:38.745606+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.352121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16087121,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":660,"num_read_kb":100618,"num_write":1288,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.188503+0000","last_change":"2024-09-14T11:17:25.612572+0000","last_active":"2024-09-14T12:15:49.188503+0000","last_peered":"2024-09-14T12:15:49.188503+0000","last_clean":"2024-09-14T12:15:49.188503+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:15:49.188503+0000","last_undegraded":"2024-09-14T12:15:49.188503+0000","last_fullsized":"2024-09-14T12:15:49.188503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:50.762349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'141","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.389956+0000","last_change":"2024-09-14T11:17:27.629622+0000","last_active":"2024-09-14T12:15:49.389956+0000","last_peered":"2024-09-14T12:15:49.389956+0000","last_clean":"2024-09-14T12:15:49.389956+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:15:49.389956+0000","last_undegraded":"2024-09-14T12:15:49.389956+0000","last_fullsized":"2024-09-14T12:15:49.389956+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:36.891527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344480+0000","last_change":"2024-09-14T11:17:29.643346+0000","last_active":"2024-09-14T12:13:53.344480+0000","last_peered":"2024-09-14T12:13:53.344480+0000","last_clean":"2024-09-14T12:13:53.344480+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:13:53.344480+0000","last_undegraded":"2024-09-14T12:13:53.344480+0000","last_fullsized":"2024-09-14T12:13:53.344480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:54.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'152","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225431+0000","last_change":"2024-09-14T11:17:31.658341+0000","last_active":"2024-09-14T12:13:53.225431+0000","last_peered":"2024-09-14T12:13:53.225431+0000","last_clean":"2024-09-14T12:13:53.225431+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:13:53.225431+0000","last_undegraded":"2024-09-14T12:13:53.225431+0000","last_fullsized":"2024-09-14T12:13:53.225431+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:31.293556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'538","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771726+0000","last_change":"2024-09-14T11:17:23.595767+0000","last_active":"2024-09-14T12:14:33.771726+0000","last_peered":"2024-09-14T12:14:33.771726+0000","last_clean":"2024-09-14T12:14:33.771726+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:14:33.771726+0000","last_undegraded":"2024-09-14T12:14:33.771726+0000","last_fullsized":"2024-09-14T12:14:33.771726+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:17.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'299","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225524+0000","last_change":"2024-09-14T11:17:21.587230+0000","last_active":"2024-09-14T12:13:53.225524+0000","last_peered":"2024-09-14T12:13:53.225524+0000","last_clean":"2024-09-14T12:13:53.225524+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:13:53.225524+0000","last_undegraded":"2024-09-14T12:13:53.225524+0000","last_fullsized":"2024-09-14T12:13:53.225524+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:54.075546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280479,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":539,"num_read_kb":15898,"num_write":1106,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207418+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T12:13:28.207418+0000","last_peered":"2024-09-14T12:13:28.207418+0000","last_clean":"2024-09-14T12:13:28.207418+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:13:28.207418+0000","last_undegraded":"2024-09-14T12:13:28.207418+0000","last_fullsized":"2024-09-14T12:13:28.207418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455178+0000","last_change":"2024-09-14T11:17:25.613788+0000","last_active":"2024-09-14T12:13:40.455178+0000","last_peered":"2024-09-14T12:13:40.455178+0000","last_clean":"2024-09-14T12:13:40.455178+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:13:40.455178+0000","last_undegraded":"2024-09-14T12:13:40.455178+0000","last_fullsized":"2024-09-14T12:13:40.455178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:16.381616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'586","reported_seq":1248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.218406+0000","last_change":"2024-09-14T11:17:27.638848+0000","last_active":"2024-09-14T12:15:49.218406+0000","last_peered":"2024-09-14T12:15:49.218406+0000","last_clean":"2024-09-14T12:15:49.218406+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:15:49.218406+0000","last_undegraded":"2024-09-14T12:15:49.218406+0000","last_fullsized":"2024-09-14T12:15:49.218406+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.865878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104200,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1639,"num_read_kb":2569,"num_write":2206,"num_write_kb":2029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339077+0000","last_change":"2024-09-14T11:17:29.647531+0000","last_active":"2024-09-14T12:13:48.339077+0000","last_peered":"2024-09-14T12:13:48.339077+0000","last_clean":"2024-09-14T12:13:48.339077+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:13:48.339077+0000","last_undegraded":"2024-09-14T12:13:48.339077+0000","last_fullsized":"2024-09-14T12:13:48.339077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:29.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.737717+0000","last_change":"2024-09-14T11:17:31.650597+0000","last_active":"2024-09-14T12:14:31.737717+0000","last_peered":"2024-09-14T12:14:31.737717+0000","last_clean":"2024-09-14T12:14:31.737717+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:14:31.737717+0000","last_undegraded":"2024-09-14T12:14:31.737717+0000","last_fullsized":"2024-09-14T12:14:31.737717+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:24.077884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'812","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503663+0000","last_change":"2024-09-14T11:17:23.597119+0000","last_active":"2024-09-14T12:15:18.503663+0000","last_peered":"2024-09-14T12:15:18.503663+0000","last_clean":"2024-09-14T12:15:18.503663+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:15:18.503663+0000","last_undegraded":"2024-09-14T12:15:18.503663+0000","last_fullsized":"2024-09-14T12:15:18.503663+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:41.357900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.208536+0000","last_change":"2024-09-14T11:17:21.572174+0000","last_active":"2024-09-14T12:13:38.208536+0000","last_peered":"2024-09-14T12:13:38.208536+0000","last_clean":"2024-09-14T12:13:38.208536+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:13:38.208536+0000","last_undegraded":"2024-09-14T12:13:38.208536+0000","last_fullsized":"2024-09-14T12:13:38.208536+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:44.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6367698,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":735,"num_read_kb":26393,"num_write":1206,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468686+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T12:13:33.468686+0000","last_peered":"2024-09-14T12:13:33.468686+0000","last_clean":"2024-09-14T12:13:33.468686+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:13:33.468686+0000","last_undegraded":"2024-09-14T12:13:33.468686+0000","last_fullsized":"2024-09-14T12:13:33.468686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455177+0000","last_change":"2024-09-14T11:17:25.613944+0000","last_active":"2024-09-14T12:13:43.455177+0000","last_peered":"2024-09-14T12:13:43.455177+0000","last_clean":"2024-09-14T12:13:43.455177+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:13:43.455177+0000","last_undegraded":"2024-09-14T12:13:43.455177+0000","last_fullsized":"2024-09-14T12:13:43.455177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.612668+0000","last_change":"2024-09-14T11:17:27.630067+0000","last_active":"2024-09-14T12:14:34.612668+0000","last_peered":"2024-09-14T12:14:34.612668+0000","last_clean":"2024-09-14T12:14:34.612668+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:14:34.612668+0000","last_undegraded":"2024-09-14T12:14:34.612668+0000","last_fullsized":"2024-09-14T12:14:34.612668+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:12.127579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'807","reported_seq":6805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.257470+0000","last_change":"2024-09-14T11:17:29.642605+0000","last_active":"2024-09-14T12:15:49.257470+0000","last_peered":"2024-09-14T12:15:49.257470+0000","last_clean":"2024-09-14T12:15:49.257470+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:15:49.257470+0000","last_undegraded":"2024-09-14T12:15:49.257470+0000","last_fullsized":"2024-09-14T12:15:49.257470+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:10.588277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'138","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.221695+0000","last_change":"2024-09-14T11:17:31.658974+0000","last_active":"2024-09-14T12:14:03.221695+0000","last_peered":"2024-09-14T12:14:03.221695+0000","last_clean":"2024-09-14T12:14:03.221695+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:14:03.221695+0000","last_undegraded":"2024-09-14T12:14:03.221695+0000","last_fullsized":"2024-09-14T12:14:03.221695+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:06.184401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1159","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.578456+0000","last_change":"2024-09-14T11:17:23.594825+0000","last_active":"2024-09-14T12:13:55.578456+0000","last_peered":"2024-09-14T12:13:55.578456+0000","last_clean":"2024-09-14T12:13:55.578456+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:13:55.578456+0000","last_undegraded":"2024-09-14T12:13:55.578456+0000","last_fullsized":"2024-09-14T12:13:55.578456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":1100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:08.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'256","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219480+0000","last_change":"2024-09-14T11:17:21.588659+0000","last_active":"2024-09-14T12:13:43.219480+0000","last_peered":"2024-09-14T12:13:43.219480+0000","last_clean":"2024-09-14T12:13:43.219480+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:13:43.219480+0000","last_undegraded":"2024-09-14T12:13:43.219480+0000","last_fullsized":"2024-09-14T12:13:43.219480+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:03.346229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4470127,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":464,"num_read_kb":24953,"num_write":865,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.208010+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T12:13:33.208010+0000","last_peered":"2024-09-14T12:13:33.208010+0000","last_clean":"2024-09-14T12:13:33.208010+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:13:33.208010+0000","last_undegraded":"2024-09-14T12:13:33.208010+0000","last_fullsized":"2024-09-14T12:13:33.208010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338159+0000","last_change":"2024-09-14T11:17:25.612971+0000","last_active":"2024-09-14T12:13:43.338159+0000","last_peered":"2024-09-14T12:13:43.338159+0000","last_clean":"2024-09-14T12:13:43.338159+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:13:43.338159+0000","last_undegraded":"2024-09-14T12:13:43.338159+0000","last_fullsized":"2024-09-14T12:13:43.338159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:01.406616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'112","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338189+0000","last_change":"2024-09-14T11:17:27.630261+0000","last_active":"2024-09-14T12:13:43.338189+0000","last_peered":"2024-09-14T12:13:43.338189+0000","last_clean":"2024-09-14T12:13:43.338189+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:13:43.338189+0000","last_undegraded":"2024-09-14T12:13:43.338189+0000","last_fullsized":"2024-09-14T12:13:43.338189+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:38.765597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'798","reported_seq":2498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.518226+0000","last_change":"2024-09-14T11:17:29.646106+0000","last_active":"2024-09-14T12:15:52.518226+0000","last_peered":"2024-09-14T12:15:52.518226+0000","last_clean":"2024-09-14T12:15:52.518226+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:15:52.518226+0000","last_undegraded":"2024-09-14T12:15:52.518226+0000","last_fullsized":"2024-09-14T12:15:52.518226+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.541372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'195","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.076897+0000","last_change":"2024-09-14T11:17:31.656972+0000","last_active":"2024-09-14T12:14:33.076897+0000","last_peered":"2024-09-14T12:14:33.076897+0000","last_clean":"2024-09-14T12:14:33.076897+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:14:33.076897+0000","last_undegraded":"2024-09-14T12:14:33.076897+0000","last_fullsized":"2024-09-14T12:14:33.076897+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:57.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619317+0000","last_change":"2024-09-14T11:17:23.593644+0000","last_active":"2024-09-14T12:13:57.619317+0000","last_peered":"2024-09-14T12:13:57.619317+0000","last_clean":"2024-09-14T12:13:57.619317+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:13:57.619317+0000","last_undegraded":"2024-09-14T12:13:57.619317+0000","last_fullsized":"2024-09-14T12:13:57.619317+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:42.299861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'336","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455823+0000","last_change":"2024-09-14T11:17:21.581527+0000","last_active":"2024-09-14T12:13:45.455823+0000","last_peered":"2024-09-14T12:13:45.455823+0000","last_clean":"2024-09-14T12:13:45.455823+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:13:45.455823+0000","last_undegraded":"2024-09-14T12:13:45.455823+0000","last_fullsized":"2024-09-14T12:13:45.455823+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:36.511139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3691887,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":559,"num_read_kb":7690,"num_write":1039,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453887+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T12:13:33.453887+0000","last_peered":"2024-09-14T12:13:33.453887+0000","last_clean":"2024-09-14T12:13:33.453887+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:13:33.453887+0000","last_undegraded":"2024-09-14T12:13:33.453887+0000","last_fullsized":"2024-09-14T12:13:33.453887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219350+0000","last_change":"2024-09-14T11:17:25.617838+0000","last_active":"2024-09-14T12:13:43.219350+0000","last_peered":"2024-09-14T12:13:43.219350+0000","last_clean":"2024-09-14T12:13:43.219350+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:13:43.219350+0000","last_undegraded":"2024-09-14T12:13:43.219350+0000","last_fullsized":"2024-09-14T12:13:43.219350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.722602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'704","reported_seq":1413,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.214861+0000","last_change":"2024-09-14T11:17:27.628721+0000","last_active":"2024-09-14T12:15:49.214861+0000","last_peered":"2024-09-14T12:15:49.214861+0000","last_clean":"2024-09-14T12:15:49.214861+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:15:49.214861+0000","last_undegraded":"2024-09-14T12:15:49.214861+0000","last_fullsized":"2024-09-14T12:15:49.214861+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:43.091580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1237,"num_read_kb":2632,"num_write":1012,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219994+0000","last_change":"2024-09-14T11:17:29.643858+0000","last_active":"2024-09-14T12:13:48.219994+0000","last_peered":"2024-09-14T12:13:48.219994+0000","last_clean":"2024-09-14T12:13:48.219994+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:13:48.219994+0000","last_undegraded":"2024-09-14T12:13:48.219994+0000","last_fullsized":"2024-09-14T12:13:48.219994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.290912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'112","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.590948+0000","last_change":"2024-09-14T11:17:31.659136+0000","last_active":"2024-09-14T12:14:34.590948+0000","last_peered":"2024-09-14T12:14:34.590948+0000","last_clean":"2024-09-14T12:14:34.590948+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:14:34.590948+0000","last_undegraded":"2024-09-14T12:14:34.590948+0000","last_fullsized":"2024-09-14T12:14:34.590948+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:30.679212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'154","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.818840+0000","last_change":"2024-09-14T11:17:31.657903+0000","last_active":"2024-09-14T12:14:34.818840+0000","last_peered":"2024-09-14T12:14:34.818840+0000","last_clean":"2024-09-14T12:14:34.818840+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:14:34.818840+0000","last_undegraded":"2024-09-14T12:14:34.818840+0000","last_fullsized":"2024-09-14T12:14:34.818840+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:29.439862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'376","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.886093+0000","last_change":"2024-09-14T11:17:23.593275+0000","last_active":"2024-09-14T12:13:38.886093+0000","last_peered":"2024-09-14T12:13:38.886093+0000","last_clean":"2024-09-14T12:13:38.886093+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:13:38.886093+0000","last_undegraded":"2024-09-14T12:13:38.886093+0000","last_fullsized":"2024-09-14T12:13:38.886093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:51.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'293","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.336037+0000","last_change":"2024-09-14T11:17:21.585438+0000","last_active":"2024-09-14T12:13:28.336037+0000","last_peered":"2024-09-14T12:13:28.336037+0000","last_clean":"2024-09-14T12:13:28.336037+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:13:28.336037+0000","last_undegraded":"2024-09-14T12:13:28.336037+0000","last_fullsized":"2024-09-14T12:13:28.336037+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:54.991062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049101,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":641,"num_read_kb":30194,"num_write":1071,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.962929+0000","last_change":"2024-09-14T11:17:25.614818+0000","last_active":"2024-09-14T12:15:48.962929+0000","last_peered":"2024-09-14T12:15:48.962929+0000","last_clean":"2024-09-14T12:15:48.962929+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:15:48.962929+0000","last_undegraded":"2024-09-14T12:15:48.962929+0000","last_fullsized":"2024-09-14T12:15:48.962929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.190710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'294","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236190+0000","last_change":"2024-09-14T11:17:27.630446+0000","last_active":"2024-09-14T12:15:48.236190+0000","last_peered":"2024-09-14T12:15:48.236190+0000","last_clean":"2024-09-14T12:15:48.236190+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:15:48.236190+0000","last_undegraded":"2024-09-14T12:15:48.236190+0000","last_fullsized":"2024-09-14T12:15:48.236190+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:50.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66272,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1020,"num_write":404,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.218125+0000","last_change":"2024-09-14T11:17:29.645258+0000","last_active":"2024-09-14T12:13:33.218125+0000","last_peered":"2024-09-14T12:13:33.218125+0000","last_clean":"2024-09-14T12:13:33.218125+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:13:33.218125+0000","last_undegraded":"2024-09-14T12:13:33.218125+0000","last_fullsized":"2024-09-14T12:13:33.218125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:46.921971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'432","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605972+0000","last_change":"2024-09-14T11:17:23.600768+0000","last_active":"2024-09-14T12:14:34.605972+0000","last_peered":"2024-09-14T12:14:34.605972+0000","last_clean":"2024-09-14T12:14:34.605972+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:14:34.605972+0000","last_undegraded":"2024-09-14T12:14:34.605972+0000","last_fullsized":"2024-09-14T12:14:34.605972+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:12.282064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'317","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.463351+0000","last_change":"2024-09-14T11:17:21.581055+0000","last_active":"2024-09-14T12:12:58.463351+0000","last_peered":"2024-09-14T12:12:58.463351+0000","last_clean":"2024-09-14T12:12:58.463351+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:12:58.463351+0000","last_undegraded":"2024-09-14T12:12:58.463351+0000","last_fullsized":"2024-09-14T12:12:58.463351+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.405999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2349190,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":512,"num_read_kb":23221,"num_write":1133,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.217660+0000","last_change":"2024-09-14T11:17:25.615312+0000","last_active":"2024-09-14T12:13:28.217660+0000","last_peered":"2024-09-14T12:13:28.217660+0000","last_clean":"2024-09-14T12:13:28.217660+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:13:28.217660+0000","last_undegraded":"2024-09-14T12:13:28.217660+0000","last_fullsized":"2024-09-14T12:13:28.217660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:18.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.936226+0000","last_change":"2024-09-14T11:17:27.636113+0000","last_active":"2024-09-14T12:13:46.936226+0000","last_peered":"2024-09-14T12:13:46.936226+0000","last_clean":"2024-09-14T12:13:46.936226+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:13:46.936226+0000","last_undegraded":"2024-09-14T12:13:46.936226+0000","last_fullsized":"2024-09-14T12:13:46.936226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:28.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468624+0000","last_change":"2024-09-14T11:17:29.642497+0000","last_active":"2024-09-14T12:13:33.468624+0000","last_peered":"2024-09-14T12:13:33.468624+0000","last_clean":"2024-09-14T12:13:33.468624+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:13:33.468624+0000","last_undegraded":"2024-09-14T12:13:33.468624+0000","last_fullsized":"2024-09-14T12:13:33.468624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:18.572740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.825413+0000","last_change":"2024-09-14T11:17:31.655716+0000","last_active":"2024-09-14T12:14:33.825413+0000","last_peered":"2024-09-14T12:14:33.825413+0000","last_clean":"2024-09-14T12:14:33.825413+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:14:33.825413+0000","last_undegraded":"2024-09-14T12:14:33.825413+0000","last_fullsized":"2024-09-14T12:14:33.825413+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:00.360800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'491","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.116559+0000","last_change":"2024-09-14T11:17:23.601965+0000","last_active":"2024-09-14T12:15:48.116559+0000","last_peered":"2024-09-14T12:15:48.116559+0000","last_clean":"2024-09-14T12:15:48.116559+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:15:48.116559+0000","last_undegraded":"2024-09-14T12:15:48.116559+0000","last_fullsized":"2024-09-14T12:15:48.116559+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:59.504121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'290","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:22.843550+0000","last_change":"2024-09-14T11:17:21.589616+0000","last_active":"2024-09-14T12:13:22.843550+0000","last_peered":"2024-09-14T12:13:22.843550+0000","last_clean":"2024-09-14T12:13:22.843550+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:13:22.843550+0000","last_undegraded":"2024-09-14T12:13:22.843550+0000","last_fullsized":"2024-09-14T12:13:22.843550+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:27.751657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14192749,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":584,"num_read_kb":51938,"num_write":1037,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.467979+0000","last_change":"2024-09-14T11:17:25.617478+0000","last_active":"2024-09-14T12:13:28.467979+0000","last_peered":"2024-09-14T12:13:28.467979+0000","last_clean":"2024-09-14T12:13:28.467979+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:13:28.467979+0000","last_undegraded":"2024-09-14T12:13:28.467979+0000","last_fullsized":"2024-09-14T12:13:28.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:19.271955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236218+0000","last_change":"2024-09-14T11:17:27.636107+0000","last_active":"2024-09-14T12:15:48.236218+0000","last_peered":"2024-09-14T12:15:48.236218+0000","last_clean":"2024-09-14T12:15:48.236218+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:15:48.236218+0000","last_undegraded":"2024-09-14T12:15:48.236218+0000","last_fullsized":"2024-09-14T12:15:48.236218+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:04.296570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1069,"num_write":430,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453820+0000","last_change":"2024-09-14T11:17:29.643307+0000","last_active":"2024-09-14T12:13:33.453820+0000","last_peered":"2024-09-14T12:13:33.453820+0000","last_clean":"2024-09-14T12:13:33.453820+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:13:33.453820+0000","last_undegraded":"2024-09-14T12:13:33.453820+0000","last_fullsized":"2024-09-14T12:13:33.453820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:35.656780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.811510+0000","last_change":"2024-09-14T11:17:31.659547+0000","last_active":"2024-09-14T12:13:42.811510+0000","last_peered":"2024-09-14T12:13:42.811510+0000","last_clean":"2024-09-14T12:13:42.811510+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:13:42.811510+0000","last_undegraded":"2024-09-14T12:13:42.811510+0000","last_fullsized":"2024-09-14T12:13:42.811510+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:01.530736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'927","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208965+0000","last_change":"2024-09-14T11:17:23.598429+0000","last_active":"2024-09-14T12:14:31.208965+0000","last_peered":"2024-09-14T12:14:31.208965+0000","last_clean":"2024-09-14T12:14:31.208965+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:14:31.208965+0000","last_undegraded":"2024-09-14T12:14:31.208965+0000","last_fullsized":"2024-09-14T12:14:31.208965+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.669362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'282","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.849222+0000","last_change":"2024-09-14T11:17:21.587300+0000","last_active":"2024-09-14T12:14:28.849222+0000","last_peered":"2024-09-14T12:14:28.849222+0000","last_clean":"2024-09-14T12:14:28.849222+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:14:28.849222+0000","last_undegraded":"2024-09-14T12:14:28.849222+0000","last_fullsized":"2024-09-14T12:14:28.849222+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:29.886995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7128357,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":600,"num_read_kb":18788,"num_write":1048,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453138+0000","last_change":"2024-09-14T11:17:25.614842+0000","last_active":"2024-09-14T12:13:28.453138+0000","last_peered":"2024-09-14T12:13:28.453138+0000","last_clean":"2024-09-14T12:13:28.453138+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:13:28.453138+0000","last_undegraded":"2024-09-14T12:13:28.453138+0000","last_fullsized":"2024-09-14T12:13:28.453138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:42.011559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'298","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.488988+0000","last_change":"2024-09-14T11:17:27.628464+0000","last_active":"2024-09-14T12:15:48.488988+0000","last_peered":"2024-09-14T12:15:48.488988+0000","last_clean":"2024-09-14T12:15:48.488988+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:15:48.488988+0000","last_undegraded":"2024-09-14T12:15:48.488988+0000","last_fullsized":"2024-09-14T12:15:48.488988+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.155512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":1097,"num_write":412,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453988+0000","last_change":"2024-09-14T11:17:29.647028+0000","last_active":"2024-09-14T12:13:30.453988+0000","last_peered":"2024-09-14T12:13:30.453988+0000","last_clean":"2024-09-14T12:13:30.453988+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:13:30.453988+0000","last_undegraded":"2024-09-14T12:13:30.453988+0000","last_fullsized":"2024-09-14T12:13:30.453988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:25.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'446","reported_seq":2072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208631+0000","last_change":"2024-09-14T11:17:23.593931+0000","last_active":"2024-09-14T12:14:31.208631+0000","last_peered":"2024-09-14T12:14:31.208631+0000","last_clean":"2024-09-14T12:14:31.208631+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:14:31.208631+0000","last_undegraded":"2024-09-14T12:14:31.208631+0000","last_fullsized":"2024-09-14T12:14:31.208631+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:31.575674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'271","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213772+0000","last_change":"2024-09-14T11:17:21.580778+0000","last_active":"2024-09-14T12:12:58.213772+0000","last_peered":"2024-09-14T12:12:58.213772+0000","last_clean":"2024-09-14T12:12:58.213772+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:12:58.213772+0000","last_undegraded":"2024-09-14T12:12:58.213772+0000","last_fullsized":"2024-09-14T12:12:58.213772+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.109271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11405599,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":713,"num_read_kb":38674,"num_write":1003,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454040+0000","last_change":"2024-09-14T11:17:25.616189+0000","last_active":"2024-09-14T12:13:30.454040+0000","last_peered":"2024-09-14T12:13:30.454040+0000","last_clean":"2024-09-14T12:13:30.454040+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:13:30.454040+0000","last_undegraded":"2024-09-14T12:13:30.454040+0000","last_fullsized":"2024-09-14T12:13:30.454040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:01.244165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'482","reported_seq":1102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.211205+0000","last_change":"2024-09-14T11:17:27.633619+0000","last_active":"2024-09-14T12:15:49.211205+0000","last_peered":"2024-09-14T12:15:49.211205+0000","last_clean":"2024-09-14T12:15:49.211205+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:15:49.211205+0000","last_undegraded":"2024-09-14T12:15:49.211205+0000","last_fullsized":"2024-09-14T12:15:49.211205+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:36.703508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":852,"num_read_kb":1825,"num_write":744,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213328+0000","last_change":"2024-09-14T11:17:29.645579+0000","last_active":"2024-09-14T12:12:33.213328+0000","last_peered":"2024-09-14T12:12:33.213328+0000","last_clean":"2024-09-14T12:12:33.213328+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:12:33.213328+0000","last_undegraded":"2024-09-14T12:12:33.213328+0000","last_fullsized":"2024-09-14T12:12:33.213328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:26.891079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'838","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208276+0000","last_change":"2024-09-14T11:17:23.595214+0000","last_active":"2024-09-14T12:14:31.208276+0000","last_peered":"2024-09-14T12:14:31.208276+0000","last_clean":"2024-09-14T12:14:31.208276+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:14:31.208276+0000","last_undegraded":"2024-09-14T12:14:31.208276+0000","last_fullsized":"2024-09-14T12:14:31.208276+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:09.844778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'324","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.453765+0000","last_change":"2024-09-14T11:17:21.579786+0000","last_active":"2024-09-14T12:13:32.453765+0000","last_peered":"2024-09-14T12:13:32.453765+0000","last_clean":"2024-09-14T12:13:32.453765+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:13:32.453765+0000","last_undegraded":"2024-09-14T12:13:32.453765+0000","last_fullsized":"2024-09-14T12:13:32.453765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733331,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":565,"num_read_kb":5748,"num_write":1181,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455241+0000","last_change":"2024-09-14T11:17:25.616062+0000","last_active":"2024-09-14T12:13:43.455241+0000","last_peered":"2024-09-14T12:13:43.455241+0000","last_clean":"2024-09-14T12:13:43.455241+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:13:43.455241+0000","last_undegraded":"2024-09-14T12:13:43.455241+0000","last_fullsized":"2024-09-14T12:13:43.455241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.590638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'308","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.481804+0000","last_change":"2024-09-14T11:17:27.631864+0000","last_active":"2024-09-14T12:14:58.481804+0000","last_peered":"2024-09-14T12:14:58.481804+0000","last_clean":"2024-09-14T12:14:58.481804+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:14:58.481804+0000","last_undegraded":"2024-09-14T12:14:58.481804+0000","last_fullsized":"2024-09-14T12:14:58.481804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.144668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":978,"num_write":424,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201536+0000","last_change":"2024-09-14T11:17:29.640091+0000","last_active":"2024-09-14T12:12:33.201536+0000","last_peered":"2024-09-14T12:12:33.201536+0000","last_clean":"2024-09-14T12:12:33.201536+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:12:33.201536+0000","last_undegraded":"2024-09-14T12:12:33.201536+0000","last_fullsized":"2024-09-14T12:12:33.201536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:15.297752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'201","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.078225+0000","last_change":"2024-09-14T11:17:31.654553+0000","last_active":"2024-09-14T12:14:32.078225+0000","last_peered":"2024-09-14T12:14:32.078225+0000","last_clean":"2024-09-14T12:14:32.078225+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:14:32.078225+0000","last_undegraded":"2024-09-14T12:14:32.078225+0000","last_fullsized":"2024-09-14T12:14:32.078225+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:30.957381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'415","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208752+0000","last_change":"2024-09-14T11:17:23.597737+0000","last_active":"2024-09-14T12:14:31.208752+0000","last_peered":"2024-09-14T12:14:31.208752+0000","last_clean":"2024-09-14T12:14:31.208752+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:14:31.208752+0000","last_undegraded":"2024-09-14T12:14:31.208752+0000","last_fullsized":"2024-09-14T12:14:31.208752+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.853930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'308","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:24.386036+0000","last_change":"2024-09-14T11:17:21.572704+0000","last_active":"2024-09-14T12:12:24.386036+0000","last_peered":"2024-09-14T12:12:24.386036+0000","last_clean":"2024-09-14T12:12:24.386036+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:12:24.386036+0000","last_undegraded":"2024-09-14T12:12:24.386036+0000","last_fullsized":"2024-09-14T12:12:24.386036+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:48.097453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13018890,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":718,"num_read_kb":55641,"num_write":1232,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.327534+0000","last_change":"2024-09-14T11:17:25.615822+0000","last_active":"2024-09-14T12:12:28.327534+0000","last_peered":"2024-09-14T12:12:28.327534+0000","last_clean":"2024-09-14T12:12:28.327534+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:12:28.327534+0000","last_undegraded":"2024-09-14T12:12:28.327534+0000","last_fullsized":"2024-09-14T12:12:28.327534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:36.413046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236297+0000","last_change":"2024-09-14T11:17:27.632371+0000","last_active":"2024-09-14T12:15:48.236297+0000","last_peered":"2024-09-14T12:15:48.236297+0000","last_clean":"2024-09-14T12:15:48.236297+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:15:48.236297+0000","last_undegraded":"2024-09-14T12:15:48.236297+0000","last_fullsized":"2024-09-14T12:15:48.236297+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:48.220034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64399,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1008,"num_write":400,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209176+0000","last_change":"2024-09-14T11:17:29.643082+0000","last_active":"2024-09-14T12:13:43.209176+0000","last_peered":"2024-09-14T12:13:43.209176+0000","last_clean":"2024-09-14T12:13:43.209176+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:13:43.209176+0000","last_undegraded":"2024-09-14T12:13:43.209176+0000","last_fullsized":"2024-09-14T12:13:43.209176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:03.359386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'100","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.251218+0000","last_change":"2024-09-14T11:17:31.657761+0000","last_active":"2024-09-14T12:15:49.251218+0000","last_peered":"2024-09-14T12:15:49.251218+0000","last_clean":"2024-09-14T12:15:49.251218+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:15:49.251218+0000","last_undegraded":"2024-09-14T12:15:49.251218+0000","last_fullsized":"2024-09-14T12:15:49.251218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.568137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'483","reported_seq":2020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869633+0000","last_change":"2024-09-14T11:17:23.594002+0000","last_active":"2024-09-14T12:13:31.869633+0000","last_peered":"2024-09-14T12:13:31.869633+0000","last_clean":"2024-09-14T12:13:31.869633+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:13:31.869633+0000","last_undegraded":"2024-09-14T12:13:31.869633+0000","last_fullsized":"2024-09-14T12:13:31.869633+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:29.422949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'375","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.446252+0000","last_change":"2024-09-14T11:17:21.582882+0000","last_active":"2024-09-14T12:12:25.446252+0000","last_peered":"2024-09-14T12:12:25.446252+0000","last_clean":"2024-09-14T12:12:25.446252+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:12:25.446252+0000","last_undegraded":"2024-09-14T12:12:25.446252+0000","last_fullsized":"2024-09-14T12:12:25.446252+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:26.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250648,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1125,"num_read_kb":773,"num_write":1245,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.200982+0000","last_change":"2024-09-14T11:17:25.606521+0000","last_active":"2024-09-14T12:12:28.200982+0000","last_peered":"2024-09-14T12:12:28.200982+0000","last_clean":"2024-09-14T12:12:28.200982+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:12:28.200982+0000","last_undegraded":"2024-09-14T12:12:28.200982+0000","last_fullsized":"2024-09-14T12:12:28.200982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.190615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.336647+0000","last_change":"2024-09-14T11:17:27.625718+0000","last_active":"2024-09-14T12:13:33.336647+0000","last_peered":"2024-09-14T12:13:33.336647+0000","last_clean":"2024-09-14T12:13:33.336647+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:13:33.336647+0000","last_undegraded":"2024-09-14T12:13:33.336647+0000","last_fullsized":"2024-09-14T12:13:33.336647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:13.564944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'778","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.483250+0000","last_change":"2024-09-14T11:17:29.641638+0000","last_active":"2024-09-14T12:15:52.483250+0000","last_peered":"2024-09-14T12:15:52.483250+0000","last_clean":"2024-09-14T12:15:52.483250+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:15:52.483250+0000","last_undegraded":"2024-09-14T12:15:52.483250+0000","last_fullsized":"2024-09-14T12:15:52.483250+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:54.865127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'126","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.517595+0000","last_change":"2024-09-14T11:17:31.654896+0000","last_active":"2024-09-14T12:13:48.517595+0000","last_peered":"2024-09-14T12:13:48.517595+0000","last_clean":"2024-09-14T12:13:48.517595+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:13:48.517595+0000","last_undegraded":"2024-09-14T12:13:48.517595+0000","last_fullsized":"2024-09-14T12:13:48.517595+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:18.947558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'482","reported_seq":2002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606832+0000","last_change":"2024-09-14T11:17:23.603409+0000","last_active":"2024-09-14T12:14:34.606832+0000","last_peered":"2024-09-14T12:14:34.606832+0000","last_clean":"2024-09-14T12:14:34.606832+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:14:34.606832+0000","last_undegraded":"2024-09-14T12:14:34.606832+0000","last_fullsized":"2024-09-14T12:14:34.606832+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:58.876757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'299","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330319+0000","last_change":"2024-09-14T11:17:21.584853+0000","last_active":"2024-09-14T12:12:23.330319+0000","last_peered":"2024-09-14T12:12:23.330319+0000","last_clean":"2024-09-14T12:12:23.330319+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:12:23.330319+0000","last_undegraded":"2024-09-14T12:12:23.330319+0000","last_fullsized":"2024-09-14T12:12:23.330319+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:42.636525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14722428,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":599,"num_read_kb":45610,"num_write":977,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.456732+0000","last_change":"2024-09-14T11:17:25.618200+0000","last_active":"2024-09-14T12:12:28.456732+0000","last_peered":"2024-09-14T12:12:28.456732+0000","last_clean":"2024-09-14T12:12:28.456732+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:12:28.456732+0000","last_undegraded":"2024-09-14T12:12:28.456732+0000","last_fullsized":"2024-09-14T12:12:28.456732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:36.032390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'312","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.241335+0000","last_change":"2024-09-14T11:17:27.632003+0000","last_active":"2024-09-14T12:15:43.241335+0000","last_peered":"2024-09-14T12:15:43.241335+0000","last_clean":"2024-09-14T12:15:43.241335+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:15:43.241335+0000","last_undegraded":"2024-09-14T12:15:43.241335+0000","last_fullsized":"2024-09-14T12:15:43.241335+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50001,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":888,"num_write":376,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:05.450810+0000","last_change":"2024-09-14T11:17:29.642860+0000","last_active":"2024-09-14T12:13:05.450810+0000","last_peered":"2024-09-14T12:13:05.450810+0000","last_clean":"2024-09-14T12:13:05.450810+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:13:05.450810+0000","last_undegraded":"2024-09-14T12:13:05.450810+0000","last_fullsized":"2024-09-14T12:13:05.450810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:49.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'163","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.740671+0000","last_change":"2024-09-14T11:17:31.659537+0000","last_active":"2024-09-14T12:14:31.740671+0000","last_peered":"2024-09-14T12:14:31.740671+0000","last_clean":"2024-09-14T12:14:31.740671+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:14:31.740671+0000","last_undegraded":"2024-09-14T12:14:31.740671+0000","last_fullsized":"2024-09-14T12:14:31.740671+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:58.564304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'823","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.532267+0000","last_change":"2024-09-14T11:17:23.603348+0000","last_active":"2024-09-14T12:13:48.532267+0000","last_peered":"2024-09-14T12:13:48.532267+0000","last_clean":"2024-09-14T12:13:48.532267+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:13:48.532267+0000","last_undegraded":"2024-09-14T12:13:48.532267+0000","last_fullsized":"2024-09-14T12:13:48.532267+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.172017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'333","reported_seq":1190,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.301913+0000","last_change":"2024-09-14T11:17:21.586488+0000","last_active":"2024-09-14T12:14:02.301913+0000","last_peered":"2024-09-14T12:14:02.301913+0000","last_clean":"2024-09-14T12:14:02.301913+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:14:02.301913+0000","last_undegraded":"2024-09-14T12:14:02.301913+0000","last_fullsized":"2024-09-14T12:14:02.301913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:17.459649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3993460,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1259,"num_read_kb":37456,"num_write":1235,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331124+0000","last_change":"2024-09-14T11:17:25.617051+0000","last_active":"2024-09-14T12:12:28.331124+0000","last_peered":"2024-09-14T12:12:28.331124+0000","last_clean":"2024-09-14T12:12:28.331124+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:12:28.331124+0000","last_undegraded":"2024-09-14T12:12:28.331124+0000","last_fullsized":"2024-09-14T12:12:28.331124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:24.207846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.736743+0000","last_change":"2024-09-14T11:17:27.635755+0000","last_active":"2024-09-14T12:15:43.736743+0000","last_peered":"2024-09-14T12:15:43.736743+0000","last_clean":"2024-09-14T12:15:43.736743+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:15:43.736743+0000","last_undegraded":"2024-09-14T12:15:43.736743+0000","last_fullsized":"2024-09-14T12:15:43.736743+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":933,"num_write":370,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.450854+0000","last_change":"2024-09-14T11:17:29.642662+0000","last_active":"2024-09-14T12:13:13.450854+0000","last_peered":"2024-09-14T12:13:13.450854+0000","last_clean":"2024-09-14T12:13:13.450854+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:13:13.450854+0000","last_undegraded":"2024-09-14T12:13:13.450854+0000","last_fullsized":"2024-09-14T12:13:13.450854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:37.438168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'101","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:52.066499+0000","last_change":"2024-09-14T11:17:31.653130+0000","last_active":"2024-09-14T12:13:52.066499+0000","last_peered":"2024-09-14T12:13:52.066499+0000","last_clean":"2024-09-14T12:13:52.066499+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:13:52.066499+0000","last_undegraded":"2024-09-14T12:13:52.066499+0000","last_fullsized":"2024-09-14T12:13:52.066499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:01.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'466","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.118951+0000","last_change":"2024-09-14T11:17:23.598902+0000","last_active":"2024-09-14T12:15:48.118951+0000","last_peered":"2024-09-14T12:15:48.118951+0000","last_clean":"2024-09-14T12:15:48.118951+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:15:48.118951+0000","last_undegraded":"2024-09-14T12:15:48.118951+0000","last_fullsized":"2024-09-14T12:15:48.118951+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:31.355611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'302","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218830+0000","last_change":"2024-09-14T11:17:21.589014+0000","last_active":"2024-09-14T12:13:38.218830+0000","last_peered":"2024-09-14T12:13:38.218830+0000","last_clean":"2024-09-14T12:13:38.218830+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:13:38.218830+0000","last_undegraded":"2024-09-14T12:13:38.218830+0000","last_fullsized":"2024-09-14T12:13:38.218830+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:25.221696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054523,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":529,"num_read_kb":9738,"num_write":1104,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332528+0000","last_change":"2024-09-14T11:17:25.610612+0000","last_active":"2024-09-14T12:13:03.332528+0000","last_peered":"2024-09-14T12:13:03.332528+0000","last_clean":"2024-09-14T12:13:03.332528+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:13:03.332528+0000","last_undegraded":"2024-09-14T12:13:03.332528+0000","last_fullsized":"2024-09-14T12:13:03.332528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:48.115678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'251","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.229206+0000","last_change":"2024-09-14T11:17:27.631891+0000","last_active":"2024-09-14T12:14:58.229206+0000","last_peered":"2024-09-14T12:14:58.229206+0000","last_clean":"2024-09-14T12:14:58.229206+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:14:58.229206+0000","last_undegraded":"2024-09-14T12:14:58.229206+0000","last_fullsized":"2024-09-14T12:14:58.229206+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:44.534516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":945,"num_write":360,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328284+0000","last_change":"2024-09-14T11:17:29.643072+0000","last_active":"2024-09-14T12:12:33.328284+0000","last_peered":"2024-09-14T12:12:33.328284+0000","last_clean":"2024-09-14T12:12:33.328284+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:12:33.328284+0000","last_undegraded":"2024-09-14T12:12:33.328284+0000","last_fullsized":"2024-09-14T12:12:33.328284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:34.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'185","reported_seq":1645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.716019+0000","last_change":"2024-09-14T11:17:31.657886+0000","last_active":"2024-09-14T12:14:31.716019+0000","last_peered":"2024-09-14T12:14:31.716019+0000","last_clean":"2024-09-14T12:14:31.716019+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:14:31.716019+0000","last_undegraded":"2024-09-14T12:14:31.716019+0000","last_fullsized":"2024-09-14T12:14:31.716019+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:25.875385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'587","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619382+0000","last_change":"2024-09-14T11:17:23.593981+0000","last_active":"2024-09-14T12:13:57.619382+0000","last_peered":"2024-09-14T12:13:57.619382+0000","last_clean":"2024-09-14T12:13:57.619382+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:13:57.619382+0000","last_undegraded":"2024-09-14T12:13:57.619382+0000","last_fullsized":"2024-09-14T12:13:57.619382+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:57.500739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'285","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.894234+0000","last_change":"2024-09-14T11:17:55.706003+0000","last_active":"2024-09-14T12:14:28.894234+0000","last_peered":"2024-09-14T12:14:28.894234+0000","last_clean":"2024-09-14T12:14:28.894234+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:14:28.894234+0000","last_undegraded":"2024-09-14T12:14:28.894234+0000","last_fullsized":"2024-09-14T12:14:28.894234+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.137533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6358364,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1129,"num_read_kb":9181,"num_write":1079,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205682+0000","last_change":"2024-09-14T11:17:25.611418+0000","last_active":"2024-09-14T12:13:13.205682+0000","last_peered":"2024-09-14T12:13:13.205682+0000","last_clean":"2024-09-14T12:13:13.205682+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:13:13.205682+0000","last_undegraded":"2024-09-14T12:13:13.205682+0000","last_fullsized":"2024-09-14T12:13:13.205682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.637349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'323","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.348967+0000","last_change":"2024-09-14T11:17:27.631558+0000","last_active":"2024-09-14T12:14:58.348967+0000","last_peered":"2024-09-14T12:14:58.348967+0000","last_clean":"2024-09-14T12:14:58.348967+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:14:58.348967+0000","last_undegraded":"2024-09-14T12:14:58.348967+0000","last_fullsized":"2024-09-14T12:14:58.348967+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:57.236491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1084,"num_write":436,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446967+0000","last_change":"2024-09-14T11:17:29.643690+0000","last_active":"2024-09-14T12:12:30.446967+0000","last_peered":"2024-09-14T12:12:30.446967+0000","last_clean":"2024-09-14T12:12:30.446967+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:12:30.446967+0000","last_undegraded":"2024-09-14T12:12:30.446967+0000","last_fullsized":"2024-09-14T12:12:30.446967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:41.882853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'98","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.149653+0000","last_change":"2024-09-14T11:17:31.656443+0000","last_active":"2024-09-14T12:15:48.149653+0000","last_peered":"2024-09-14T12:15:48.149653+0000","last_clean":"2024-09-14T12:15:48.149653+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:15:48.149653+0000","last_undegraded":"2024-09-14T12:15:48.149653+0000","last_fullsized":"2024-09-14T12:15:48.149653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:42.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'539","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.591433+0000","last_change":"2024-09-14T11:17:23.600867+0000","last_active":"2024-09-14T12:14:01.591433+0000","last_peered":"2024-09-14T12:14:01.591433+0000","last_clean":"2024-09-14T12:14:01.591433+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:14:01.591433+0000","last_undegraded":"2024-09-14T12:14:01.591433+0000","last_fullsized":"2024-09-14T12:14:01.591433+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:37.601941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.454382+0000","last_change":"2024-09-14T11:17:21.582606+0000","last_active":"2024-09-14T12:13:38.454382+0000","last_peered":"2024-09-14T12:13:38.454382+0000","last_clean":"2024-09-14T12:13:38.454382+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:13:38.454382+0000","last_undegraded":"2024-09-14T12:13:38.454382+0000","last_fullsized":"2024-09-14T12:13:38.454382+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.655925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437957,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":598,"num_read_kb":34320,"num_write":1205,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'835","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.500767+0000","last_change":"2024-09-14T11:17:23.593094+0000","last_active":"2024-09-14T12:15:18.500767+0000","last_peered":"2024-09-14T12:15:18.500767+0000","last_clean":"2024-09-14T12:15:18.500767+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:15:18.500767+0000","last_undegraded":"2024-09-14T12:15:18.500767+0000","last_fullsized":"2024-09-14T12:15:18.500767+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:00.728519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'370","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671665+0000","last_change":"2024-09-14T11:17:21.587023+0000","last_active":"2024-09-14T12:14:17.671665+0000","last_peered":"2024-09-14T12:14:17.671665+0000","last_clean":"2024-09-14T12:14:17.671665+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:14:17.671665+0000","last_undegraded":"2024-09-14T12:14:17.671665+0000","last_fullsized":"2024-09-14T12:14:17.671665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:28.536485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23470781,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":689,"num_read_kb":108288,"num_write":1311,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'490","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.751737+0000","last_change":"2024-09-14T11:17:23.594077+0000","last_active":"2024-09-14T12:14:02.751737+0000","last_peered":"2024-09-14T12:14:02.751737+0000","last_clean":"2024-09-14T12:14:02.751737+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:14:02.751737+0000","last_undegraded":"2024-09-14T12:14:02.751737+0000","last_fullsized":"2024-09-14T12:14:02.751737+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:09.993223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'276","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223288+0000","last_change":"2024-09-14T11:17:21.586835+0000","last_active":"2024-09-14T12:13:38.223288+0000","last_peered":"2024-09-14T12:13:38.223288+0000","last_clean":"2024-09-14T12:13:38.223288+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:13:38.223288+0000","last_undegraded":"2024-09-14T12:13:38.223288+0000","last_fullsized":"2024-09-14T12:13:38.223288+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:19.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8420620,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":518,"num_read_kb":31259,"num_write":1040,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1198","reported_seq":2729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210733+0000","last_change":"2024-09-14T11:17:23.592819+0000","last_active":"2024-09-14T12:14:31.210733+0000","last_peered":"2024-09-14T12:14:31.210733+0000","last_clean":"2024-09-14T12:14:31.210733+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:14:31.210733+0000","last_undegraded":"2024-09-14T12:14:31.210733+0000","last_fullsized":"2024-09-14T12:14:31.210733+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:27.543641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'310","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455745+0000","last_change":"2024-09-14T11:17:21.585188+0000","last_active":"2024-09-14T12:13:45.455745+0000","last_peered":"2024-09-14T12:13:45.455745+0000","last_clean":"2024-09-14T12:13:45.455745+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:13:45.455745+0000","last_undegraded":"2024-09-14T12:13:45.455745+0000","last_fullsized":"2024-09-14T12:13:45.455745+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:07.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290954,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":15201,"num_write":1236,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'918","reported_seq":2573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.502687+0000","last_change":"2024-09-14T11:17:23.601191+0000","last_active":"2024-09-14T12:15:18.502687+0000","last_peered":"2024-09-14T12:15:18.502687+0000","last_clean":"2024-09-14T12:15:18.502687+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:15:18.502687+0000","last_undegraded":"2024-09-14T12:15:18.502687+0000","last_fullsized":"2024-09-14T12:15:18.502687+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:39.840105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'250","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.613284+0000","last_change":"2024-09-14T11:17:21.584208+0000","last_active":"2024-09-14T12:13:51.613284+0000","last_peered":"2024-09-14T12:13:51.613284+0000","last_clean":"2024-09-14T12:13:51.613284+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:13:51.613284+0000","last_undegraded":"2024-09-14T12:13:51.613284+0000","last_fullsized":"2024-09-14T12:13:51.613284+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5737636,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":491,"num_read_kb":7710,"num_write":891,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'501","reported_seq":2112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.120303+0000","last_change":"2024-09-14T11:17:23.594912+0000","last_active":"2024-09-14T12:15:48.120303+0000","last_peered":"2024-09-14T12:15:48.120303+0000","last_clean":"2024-09-14T12:15:48.120303+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:15:48.120303+0000","last_undegraded":"2024-09-14T12:15:48.120303+0000","last_fullsized":"2024-09-14T12:15:48.120303+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:05.056139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'342","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209162+0000","last_change":"2024-09-14T11:17:21.579512+0000","last_active":"2024-09-14T12:13:43.209162+0000","last_peered":"2024-09-14T12:13:43.209162+0000","last_clean":"2024-09-14T12:13:43.209162+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:13:43.209162+0000","last_undegraded":"2024-09-14T12:13:43.209162+0000","last_fullsized":"2024-09-14T12:13:43.209162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:50.912297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12577240,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":612,"num_read_kb":78819,"num_write":1193,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'832","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.122782+0000","last_change":"2024-09-14T11:17:23.602134+0000","last_active":"2024-09-14T12:15:48.122782+0000","last_peered":"2024-09-14T12:15:48.122782+0000","last_clean":"2024-09-14T12:15:48.122782+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:15:48.122782+0000","last_undegraded":"2024-09-14T12:15:48.122782+0000","last_fullsized":"2024-09-14T12:15:48.122782+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:55.121466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'379","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.864741+0000","last_change":"2024-09-14T11:17:21.587871+0000","last_active":"2024-09-14T12:15:38.864741+0000","last_peered":"2024-09-14T12:15:38.864741+0000","last_clean":"2024-09-14T12:15:38.864741+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:15:38.864741+0000","last_undegraded":"2024-09-14T12:15:38.864741+0000","last_fullsized":"2024-09-14T12:15:38.864741+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:00.375845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3958235,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":797,"num_read_kb":42745,"num_write":1534,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771846+0000","last_change":"2024-09-14T11:17:23.596351+0000","last_active":"2024-09-14T12:14:33.771846+0000","last_peered":"2024-09-14T12:14:33.771846+0000","last_clean":"2024-09-14T12:14:33.771846+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:14:33.771846+0000","last_undegraded":"2024-09-14T12:14:33.771846+0000","last_fullsized":"2024-09-14T12:14:33.771846+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'294","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:47.252551+0000","last_change":"2024-09-14T11:17:21.583193+0000","last_active":"2024-09-14T12:15:47.252551+0000","last_peered":"2024-09-14T12:15:47.252551+0000","last_clean":"2024-09-14T12:15:47.252551+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:15:47.252551+0000","last_undegraded":"2024-09-14T12:15:47.252551+0000","last_fullsized":"2024-09-14T12:15:47.252551+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:06.631109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5913903,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":660,"num_read_kb":25683,"num_write":1142,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'724","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.121608+0000","last_change":"2024-09-14T11:17:23.604245+0000","last_active":"2024-09-14T12:15:48.121608+0000","last_peered":"2024-09-14T12:15:48.121608+0000","last_clean":"2024-09-14T12:15:48.121608+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:15:48.121608+0000","last_undegraded":"2024-09-14T12:15:48.121608+0000","last_fullsized":"2024-09-14T12:15:48.121608+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:40.467603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'255","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.226111+0000","last_change":"2024-09-14T11:17:21.580614+0000","last_active":"2024-09-14T12:13:58.226111+0000","last_peered":"2024-09-14T12:13:58.226111+0000","last_clean":"2024-09-14T12:13:58.226111+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:13:58.226111+0000","last_undegraded":"2024-09-14T12:13:58.226111+0000","last_fullsized":"2024-09-14T12:13:58.226111+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:49.477505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521661,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":473,"num_read_kb":13775,"num_write":915,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'542","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755084+0000","last_change":"2024-09-14T11:17:23.597056+0000","last_active":"2024-09-14T12:14:02.755084+0000","last_peered":"2024-09-14T12:14:02.755084+0000","last_clean":"2024-09-14T12:14:02.755084+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:14:02.755084+0000","last_undegraded":"2024-09-14T12:14:02.755084+0000","last_fullsized":"2024-09-14T12:14:02.755084+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:25.820590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'302","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.673579+0000","last_change":"2024-09-14T11:17:21.583089+0000","last_active":"2024-09-14T12:14:17.673579+0000","last_peered":"2024-09-14T12:14:17.673579+0000","last_clean":"2024-09-14T12:14:17.673579+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:14:17.673579+0000","last_undegraded":"2024-09-14T12:14:17.673579+0000","last_fullsized":"2024-09-14T12:14:17.673579+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140678,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":542,"num_read_kb":24861,"num_write":1084,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'886","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.506780+0000","last_change":"2024-09-14T11:17:23.590933+0000","last_active":"2024-09-14T12:15:18.506780+0000","last_peered":"2024-09-14T12:15:18.506780+0000","last_clean":"2024-09-14T12:15:18.506780+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:15:18.506780+0000","last_undegraded":"2024-09-14T12:15:18.506780+0000","last_fullsized":"2024-09-14T12:15:18.506780+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.559604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'314","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.066911+0000","last_change":"2024-09-14T11:17:21.589675+0000","last_active":"2024-09-14T12:14:31.066911+0000","last_peered":"2024-09-14T12:14:31.066911+0000","last_clean":"2024-09-14T12:14:31.066911+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:14:31.066911+0000","last_undegraded":"2024-09-14T12:14:31.066911+0000","last_fullsized":"2024-09-14T12:14:31.066911+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:06.262409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8888920,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":612,"num_read_kb":50704,"num_write":1163,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'681","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606396+0000","last_change":"2024-09-14T11:17:23.595898+0000","last_active":"2024-09-14T12:14:34.606396+0000","last_peered":"2024-09-14T12:14:34.606396+0000","last_clean":"2024-09-14T12:14:34.606396+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:14:34.606396+0000","last_undegraded":"2024-09-14T12:14:34.606396+0000","last_fullsized":"2024-09-14T12:14:34.606396+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:45.372928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'277","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455187+0000","last_change":"2024-09-14T11:17:21.589111+0000","last_active":"2024-09-14T12:13:40.455187+0000","last_peered":"2024-09-14T12:13:40.455187+0000","last_clean":"2024-09-14T12:13:40.455187+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:13:40.455187+0000","last_undegraded":"2024-09-14T12:13:40.455187+0000","last_fullsized":"2024-09-14T12:13:40.455187+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:16.334007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442947,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":562,"num_read_kb":2144,"num_write":981,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'754","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.576424+0000","last_change":"2024-09-14T11:17:55.700734+0000","last_active":"2024-09-14T12:13:55.576424+0000","last_peered":"2024-09-14T12:13:55.576424+0000","last_clean":"2024-09-14T12:13:55.576424+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:13:55.576424+0000","last_undegraded":"2024-09-14T12:13:55.576424+0000","last_fullsized":"2024-09-14T12:13:55.576424+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.642169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'261","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:40.731776+0000","last_change":"2024-09-14T11:17:21.582462+0000","last_active":"2024-09-14T12:15:40.731776+0000","last_peered":"2024-09-14T12:15:40.731776+0000","last_clean":"2024-09-14T12:15:40.731776+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:15:40.731776+0000","last_undegraded":"2024-09-14T12:15:40.731776+0000","last_fullsized":"2024-09-14T12:15:40.731776+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.146715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9504952,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":46679,"num_write":889,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'468","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.507172+0000","last_change":"2024-09-14T11:17:23.606550+0000","last_active":"2024-09-14T12:15:18.507172+0000","last_peered":"2024-09-14T12:15:18.507172+0000","last_clean":"2024-09-14T12:15:18.507172+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:15:18.507172+0000","last_undegraded":"2024-09-14T12:15:18.507172+0000","last_fullsized":"2024-09-14T12:15:18.507172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:25.294313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'278","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:23.213600+0000","last_change":"2024-09-14T11:17:55.703532+0000","last_active":"2024-09-14T12:14:23.213600+0000","last_peered":"2024-09-14T12:14:23.213600+0000","last_clean":"2024-09-14T12:14:23.213600+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:14:23.213600+0000","last_undegraded":"2024-09-14T12:14:23.213600+0000","last_fullsized":"2024-09-14T12:14:23.213600+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:23.137411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6360112,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":845,"num_read_kb":19019,"num_write":949,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'441","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.819923+0000","last_change":"2024-09-14T11:17:23.602231+0000","last_active":"2024-09-14T12:13:42.819923+0000","last_peered":"2024-09-14T12:13:42.819923+0000","last_clean":"2024-09-14T12:13:42.819923+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:13:42.819923+0000","last_undegraded":"2024-09-14T12:13:42.819923+0000","last_fullsized":"2024-09-14T12:13:42.819923+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:53.898892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'341","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.325603+0000","last_change":"2024-09-14T11:17:21.578753+0000","last_active":"2024-09-14T12:15:43.325603+0000","last_peered":"2024-09-14T12:15:43.325603+0000","last_clean":"2024-09-14T12:15:43.325603+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:15:43.325603+0000","last_undegraded":"2024-09-14T12:15:43.325603+0000","last_fullsized":"2024-09-14T12:15:43.325603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:48.907563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8442947,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":685,"num_read_kb":76781,"num_write":1218,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755681+0000","last_change":"2024-09-14T11:17:23.603778+0000","last_active":"2024-09-14T12:14:02.755681+0000","last_peered":"2024-09-14T12:14:02.755681+0000","last_clean":"2024-09-14T12:14:02.755681+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:14:02.755681+0000","last_undegraded":"2024-09-14T12:14:02.755681+0000","last_fullsized":"2024-09-14T12:14:02.755681+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:48.188661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'309","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.221072+0000","last_change":"2024-09-14T11:17:21.587433+0000","last_active":"2024-09-14T12:13:23.221072+0000","last_peered":"2024-09-14T12:13:23.221072+0000","last_clean":"2024-09-14T12:13:23.221072+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:13:23.221072+0000","last_undegraded":"2024-09-14T12:13:23.221072+0000","last_fullsized":"2024-09-14T12:13:23.221072+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:02.070789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5236306,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":506,"num_read_kb":6454,"num_write":1149,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'263","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.220982+0000","last_change":"2024-09-14T11:17:21.583452+0000","last_active":"2024-09-14T12:13:23.220982+0000","last_peered":"2024-09-14T12:13:23.220982+0000","last_clean":"2024-09-14T12:13:23.220982+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:13:23.220982+0000","last_undegraded":"2024-09-14T12:13:23.220982+0000","last_fullsized":"2024-09-14T12:13:23.220982+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:53.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116338,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":597,"num_read_kb":1699,"num_write":972,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'562","reported_seq":2258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.111067+0000","last_change":"2024-09-14T11:17:23.605011+0000","last_active":"2024-09-14T12:15:48.111067+0000","last_peered":"2024-09-14T12:15:48.111067+0000","last_clean":"2024-09-14T12:15:48.111067+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:15:48.111067+0000","last_undegraded":"2024-09-14T12:15:48.111067+0000","last_fullsized":"2024-09-14T12:15:48.111067+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:39.124367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'330","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671862+0000","last_change":"2024-09-14T11:17:21.571626+0000","last_active":"2024-09-14T12:14:17.671862+0000","last_peered":"2024-09-14T12:14:17.671862+0000","last_clean":"2024-09-14T12:14:17.671862+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:14:17.671862+0000","last_undegraded":"2024-09-14T12:14:17.671862+0000","last_fullsized":"2024-09-14T12:14:17.671862+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:58.165741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9786636,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":658,"num_read_kb":16752,"num_write":1197,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'915","reported_seq":2580,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605275+0000","last_change":"2024-09-14T11:17:23.597555+0000","last_active":"2024-09-14T12:14:34.605275+0000","last_peered":"2024-09-14T12:14:34.605275+0000","last_clean":"2024-09-14T12:14:34.605275+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:14:34.605275+0000","last_undegraded":"2024-09-14T12:14:34.605275+0000","last_fullsized":"2024-09-14T12:14:34.605275+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:39.353271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1791,"ondisk_log_size":1791,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2027907,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":17668,"num_read_kb":33740,"num_write":15057,"num_write_kb":12005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3350528,"data_stored":2810770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2142,"ondisk_log_size":2142,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":494933887,"num_objects":4404,"num_object_clones":0,"num_object_copies":8808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4404,"num_whiteouts":0,"num_read":40342,"num_read_kb":1801257,"num_write":69776,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1022427136,"data_stored":989867774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4397,"ondisk_log_size":4397,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":187942,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":143,"num_read_kb":186673,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510155,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421560,"kb_used_data":159912,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93950280,"statfs":{"total":96636764160,"available":96205086720,"internally_reserved":0,"allocated":163749888,"data_stored":157535924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374332,"kb_used_data":118252,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93997508,"statfs":{"total":96636764160,"available":96253448192,"internally_reserved":0,"allocated":121090048,"data_stored":116618273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510156,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296908,"kb_used_data":197756,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94074932,"statfs":{"total":96636764160,"available":96332730368,"internally_reserved":0,"allocated":202502144,"data_stored":196273581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510155,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248320,"kb_used_data":181040,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94123520,"statfs":{"total":96636764160,"available":96382484480,"internally_reserved":0,"allocated":185384960,"data_stored":179412959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510154,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433644,"kb_used_data":177564,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93938196,"statfs":{"total":96636764160,"available":96192712704,"internally_reserved":0,"allocated":181825536,"data_stored":175371481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510155,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221540,"kb_used_data":140436,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94150300,"statfs":{"total":96636764160,"available":96409907200,"internally_reserved":0,"allocated":143806464,"data_stored":139473832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510154,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309052,"kb_used_data":157164,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94062788,"statfs":{"total":96636764160,"available":96320294912,"internally_reserved":0,"allocated":160935936,"data_stored":156075796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575563,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401828,"kb_used_data":149972,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93970012,"statfs":{"total":96636764160,"available":96225292288,"internally_reserved":0,"allocated":153571328,"data_stored":147213572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":124071936,"data_stored":119267109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102313984,"data_stored":98986895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110706688,"data_stored":107837006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143204352,"data_stored":138319362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":155963525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158273536,"data_stored":153676881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":88297472,"data_stored":85327626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135106560,"data_stored":130489370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":386430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":141601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":486522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":256178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":533037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10194944,"data_stored":10191554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33595392,"data_stored":33594577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27557888,"data_stored":27553133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13672448,"data_stored":13671633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11075584,"data_stored":11073336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:16:16.270 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T12:16:16.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:16:16.614 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:16.625 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:16:16.627 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2033,"stamp":"2024-09-14T12:16:15.254145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":626082067,"num_objects":4911,"num_object_clones":0,"num_object_copies":9822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4911,"num_whiteouts":0,"num_read":308460,"num_read_kb":2439320,"num_write":161765,"num_write_kb":2394034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13942,"ondisk_log_size":13942,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2707184,"kb_used_data":1282096,"kb_used_omap":12,"kb_used_meta":1424947,"kb_avail":752267536,"statfs":{"total":773094113280,"available":770321956864,"internally_reserved":0,"allocated":1312866304,"data_stored":1267975418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1459146291},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005414"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213341+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:12:33.213341+0000","last_peered":"2024-09-14T12:12:33.213341+0000","last_clean":"2024-09-14T12:12:33.213341+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:12:33.213341+0000","last_undegraded":"2024-09-14T12:12:33.213341+0000","last_fullsized":"2024-09-14T12:12:33.213341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311879+0000","last_change":"2024-09-14T11:51:07.025774+0000","last_active":"2024-09-14T12:13:38.311879+0000","last_peered":"2024-09-14T12:13:38.311879+0000","last_clean":"2024-09-14T12:13:38.311879+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:13:38.311879+0000","last_undegraded":"2024-09-14T12:13:38.311879+0000","last_fullsized":"2024-09-14T12:13:38.311879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.449121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201523+0000","last_change":"2024-09-14T11:35:00.449276+0000","last_active":"2024-09-14T12:12:33.201523+0000","last_peered":"2024-09-14T12:12:33.201523+0000","last_clean":"2024-09-14T12:12:33.201523+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:12:33.201523+0000","last_undegraded":"2024-09-14T12:12:33.201523+0000","last_fullsized":"2024-09-14T12:12:33.201523+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:28.070565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":2,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313986+0000","last_change":"2024-09-14T11:31:47.462526+0000","last_active":"2024-09-14T12:13:58.313986+0000","last_peered":"2024-09-14T12:13:58.313986+0000","last_clean":"2024-09-14T12:13:58.313986+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:13:58.313986+0000","last_undegraded":"2024-09-14T12:13:58.313986+0000","last_fullsized":"2024-09-14T12:13:58.313986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:37.396723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.448111+0000","last_change":"2024-09-14T11:51:07.028080+0000","last_active":"2024-09-14T12:12:53.448111+0000","last_peered":"2024-09-14T12:12:53.448111+0000","last_clean":"2024-09-14T12:12:53.448111+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:12:53.448111+0000","last_undegraded":"2024-09-14T12:12:53.448111+0000","last_fullsized":"2024-09-14T12:12:53.448111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.359237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447637+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:12:35.447637+0000","last_peered":"2024-09-14T12:12:35.447637+0000","last_clean":"2024-09-14T12:12:35.447637+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:12:35.447637+0000","last_undegraded":"2024-09-14T12:12:35.447637+0000","last_fullsized":"2024-09-14T12:12:35.447637+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:50.280918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'1","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.309024+0000","last_change":"2024-09-14T11:35:00.438757+0000","last_active":"2024-09-14T12:13:13.309024+0000","last_peered":"2024-09-14T12:13:13.309024+0000","last_clean":"2024-09-14T12:13:13.309024+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:13:13.309024+0000","last_undegraded":"2024-09-14T12:13:13.309024+0000","last_fullsized":"2024-09-14T12:13:13.309024+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:50.182947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:50.442209+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:11:50.442209+0000","last_peered":"2024-09-14T12:11:50.442209+0000","last_clean":"2024-09-14T12:11:50.442209+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:11:50.442209+0000","last_undegraded":"2024-09-14T12:11:50.442209+0000","last_fullsized":"2024-09-14T12:11:50.442209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:01.804143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215760+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:13:13.215760+0000","last_peered":"2024-09-14T12:13:13.215760+0000","last_clean":"2024-09-14T12:13:13.215760+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:13:13.215760+0000","last_undegraded":"2024-09-14T12:13:13.215760+0000","last_fullsized":"2024-09-14T12:13:13.215760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328354+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:12:33.328354+0000","last_peered":"2024-09-14T12:12:33.328354+0000","last_clean":"2024-09-14T12:12:33.328354+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:12:33.328354+0000","last_undegraded":"2024-09-14T12:12:33.328354+0000","last_fullsized":"2024-09-14T12:12:33.328354+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.966334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205890+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:11:48.205890+0000","last_peered":"2024-09-14T12:11:48.205890+0000","last_clean":"2024-09-14T12:11:48.205890+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:11:48.205890+0000","last_undegraded":"2024-09-14T12:11:48.205890+0000","last_fullsized":"2024-09-14T12:11:48.205890+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:51.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.321996+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:11:23.321996+0000","last_peered":"2024-09-14T12:11:23.321996+0000","last_clean":"2024-09-14T12:11:23.321996+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:11:23.321996+0000","last_undegraded":"2024-09-14T12:11:23.321996+0000","last_fullsized":"2024-09-14T12:11:23.321996+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":10,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205846+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:11:48.205846+0000","last_peered":"2024-09-14T12:11:48.205846+0000","last_clean":"2024-09-14T12:11:48.205846+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:11:48.205846+0000","last_undegraded":"2024-09-14T12:11:48.205846+0000","last_fullsized":"2024-09-14T12:11:48.205846+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211503+0000","last_change":"2024-09-14T11:51:07.022651+0000","last_active":"2024-09-14T12:14:03.211503+0000","last_peered":"2024-09-14T12:14:03.211503+0000","last_clean":"2024-09-14T12:14:03.211503+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:14:03.211503+0000","last_undegraded":"2024-09-14T12:14:03.211503+0000","last_fullsized":"2024-09-14T12:14:03.211503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:59.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455134+0000","last_change":"2024-09-14T11:35:03.472494+0000","last_active":"2024-09-14T12:13:43.455134+0000","last_peered":"2024-09-14T12:13:43.455134+0000","last_clean":"2024-09-14T12:13:43.455134+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:13:43.455134+0000","last_undegraded":"2024-09-14T12:13:43.455134+0000","last_fullsized":"2024-09-14T12:13:43.455134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:49.051891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:23.317809+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:11:23.317809+0000","last_peered":"2024-09-14T12:11:23.317809+0000","last_clean":"2024-09-14T12:11:23.317809+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:11:23.317809+0000","last_undegraded":"2024-09-14T12:11:23.317809+0000","last_fullsized":"2024-09-14T12:11:23.317809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.439584+0000","last_change":"2024-09-14T11:31:47.462449+0000","last_active":"2024-09-14T12:11:48.439584+0000","last_peered":"2024-09-14T12:11:48.439584+0000","last_clean":"2024-09-14T12:11:48.439584+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:11:48.439584+0000","last_undegraded":"2024-09-14T12:11:48.439584+0000","last_fullsized":"2024-09-14T12:11:48.439584+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:14.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445264+0000","last_change":"2024-09-14T11:35:03.473587+0000","last_active":"2024-09-14T12:12:33.445264+0000","last_peered":"2024-09-14T12:12:33.445264+0000","last_clean":"2024-09-14T12:12:33.445264+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:12:33.445264+0000","last_undegraded":"2024-09-14T12:12:33.445264+0000","last_fullsized":"2024-09-14T12:12:33.445264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.755910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'13","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211025+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:12:33.211025+0000","last_peered":"2024-09-14T12:12:33.211025+0000","last_clean":"2024-09-14T12:12:33.211025+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:12:33.211025+0000","last_undegraded":"2024-09-14T12:12:33.211025+0000","last_fullsized":"2024-09-14T12:12:33.211025+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":17412,"num_write":23,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.203551+0000","last_change":"2024-09-14T11:31:47.457527+0000","last_active":"2024-09-14T12:12:53.203551+0000","last_peered":"2024-09-14T12:12:53.203551+0000","last_clean":"2024-09-14T12:12:53.203551+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:12:53.203551+0000","last_undegraded":"2024-09-14T12:12:53.203551+0000","last_fullsized":"2024-09-14T12:12:53.203551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:10.893316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.198600+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:12:08.198600+0000","last_peered":"2024-09-14T12:12:08.198600+0000","last_clean":"2024-09-14T12:12:08.198600+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:12:08.198600+0000","last_undegraded":"2024-09-14T12:12:08.198600+0000","last_fullsized":"2024-09-14T12:12:08.198600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:27.310781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331145+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:12:28.331145+0000","last_peered":"2024-09-14T12:12:28.331145+0000","last_clean":"2024-09-14T12:12:28.331145+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:12:28.331145+0000","last_undegraded":"2024-09-14T12:12:28.331145+0000","last_fullsized":"2024-09-14T12:12:28.331145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6146,"num_write":4,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.302497+0000","last_change":"2024-09-14T11:51:07.028060+0000","last_active":"2024-09-14T12:12:08.302497+0000","last_peered":"2024-09-14T12:12:08.302497+0000","last_clean":"2024-09-14T12:12:08.302497+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:12:08.302497+0000","last_undegraded":"2024-09-14T12:12:08.302497+0000","last_fullsized":"2024-09-14T12:12:08.302497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.552311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.453694+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:12:08.453694+0000","last_peered":"2024-09-14T12:12:08.453694+0000","last_clean":"2024-09-14T12:12:08.453694+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:12:08.453694+0000","last_undegraded":"2024-09-14T12:12:08.453694+0000","last_fullsized":"2024-09-14T12:12:08.453694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:12.592203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219471+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:13:43.219471+0000","last_peered":"2024-09-14T12:13:43.219471+0000","last_clean":"2024-09-14T12:13:43.219471+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:13:43.219471+0000","last_undegraded":"2024-09-14T12:13:43.219471+0000","last_fullsized":"2024-09-14T12:13:43.219471+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":13,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312475+0000","last_change":"2024-09-14T11:35:00.443367+0000","last_active":"2024-09-14T12:13:43.312475+0000","last_peered":"2024-09-14T12:13:43.312475+0000","last_clean":"2024-09-14T12:13:43.312475+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:13:43.312475+0000","last_undegraded":"2024-09-14T12:13:43.312475+0000","last_fullsized":"2024-09-14T12:13:43.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:39.932103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.307053+0000","last_change":"2024-09-14T11:31:47.459863+0000","last_active":"2024-09-14T12:12:53.307053+0000","last_peered":"2024-09-14T12:12:53.307053+0000","last_clean":"2024-09-14T12:12:53.307053+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:12:53.307053+0000","last_undegraded":"2024-09-14T12:12:53.307053+0000","last_fullsized":"2024-09-14T12:12:53.307053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.115513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.328248+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:12:08.328248+0000","last_peered":"2024-09-14T12:12:08.328248+0000","last_clean":"2024-09-14T12:12:08.328248+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:12:08.328248+0000","last_undegraded":"2024-09-14T12:12:08.328248+0000","last_fullsized":"2024-09-14T12:12:08.328248+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:28.383593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338233+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:13:43.338233+0000","last_peered":"2024-09-14T12:13:43.338233+0000","last_clean":"2024-09-14T12:13:43.338233+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:13:43.338233+0000","last_undegraded":"2024-09-14T12:13:43.338233+0000","last_fullsized":"2024-09-14T12:13:43.338233+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200369+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:12:23.200369+0000","last_peered":"2024-09-14T12:12:23.200369+0000","last_clean":"2024-09-14T12:12:23.200369+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:12:23.200369+0000","last_undegraded":"2024-09-14T12:12:23.200369+0000","last_fullsized":"2024-09-14T12:12:23.200369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.326665+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:12:23.326665+0000","last_peered":"2024-09-14T12:12:23.326665+0000","last_clean":"2024-09-14T12:12:23.326665+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:12:23.326665+0000","last_undegraded":"2024-09-14T12:12:23.326665+0000","last_fullsized":"2024-09-14T12:12:23.326665+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.200345+0000","last_change":"2024-09-14T11:35:03.476474+0000","last_active":"2024-09-14T12:12:23.200345+0000","last_peered":"2024-09-14T12:12:23.200345+0000","last_clean":"2024-09-14T12:12:23.200345+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:12:23.200345+0000","last_undegraded":"2024-09-14T12:12:23.200345+0000","last_fullsized":"2024-09-14T12:12:23.200345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:43.941080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209824+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:12:23.209824+0000","last_peered":"2024-09-14T12:12:23.209824+0000","last_clean":"2024-09-14T12:12:23.209824+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:12:23.209824+0000","last_undegraded":"2024-09-14T12:12:23.209824+0000","last_fullsized":"2024-09-14T12:12:23.209824+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:15.445086+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:12:15.445086+0000","last_peered":"2024-09-14T12:12:15.445086+0000","last_clean":"2024-09-14T12:12:15.445086+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:12:15.445086+0000","last_undegraded":"2024-09-14T12:12:15.445086+0000","last_fullsized":"2024-09-14T12:12:15.445086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:16.454913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.209866+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:12:23.209866+0000","last_peered":"2024-09-14T12:12:23.209866+0000","last_clean":"2024-09-14T12:12:23.209866+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:12:23.209866+0000","last_undegraded":"2024-09-14T12:12:23.209866+0000","last_fullsized":"2024-09-14T12:12:23.209866+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":7286,"num_write":3,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'10","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443925+0000","last_change":"2024-09-14T11:35:00.447506+0000","last_active":"2024-09-14T12:12:23.443925+0000","last_peered":"2024-09-14T12:12:23.443925+0000","last_clean":"2024-09-14T12:12:23.443925+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:12:23.443925+0000","last_undegraded":"2024-09-14T12:12:23.443925+0000","last_fullsized":"2024-09-14T12:12:23.443925+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:00.533644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":16386,"num_write":15,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.443907+0000","last_change":"2024-09-14T11:35:03.480075+0000","last_active":"2024-09-14T12:12:23.443907+0000","last_peered":"2024-09-14T12:12:23.443907+0000","last_clean":"2024-09-14T12:12:23.443907+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:12:23.443907+0000","last_undegraded":"2024-09-14T12:12:23.443907+0000","last_fullsized":"2024-09-14T12:12:23.443907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:33.496292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330297+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:12:23.330297+0000","last_peered":"2024-09-14T12:12:23.330297+0000","last_clean":"2024-09-14T12:12:23.330297+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:12:23.330297+0000","last_undegraded":"2024-09-14T12:12:23.330297+0000","last_fullsized":"2024-09-14T12:12:23.330297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.306990+0000","last_change":"2024-09-14T11:51:07.027822+0000","last_active":"2024-09-14T12:12:53.306990+0000","last_peered":"2024-09-14T12:12:53.306990+0000","last_clean":"2024-09-14T12:12:53.306990+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:12:53.306990+0000","last_undegraded":"2024-09-14T12:12:53.306990+0000","last_fullsized":"2024-09-14T12:12:53.306990+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:23.309895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216361+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:13:18.216361+0000","last_peered":"2024-09-14T12:13:18.216361+0000","last_clean":"2024-09-14T12:13:18.216361+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:13:18.216361+0000","last_undegraded":"2024-09-14T12:13:18.216361+0000","last_fullsized":"2024-09-14T12:13:18.216361+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.309609+0000","last_change":"2024-09-14T11:35:00.448968+0000","last_active":"2024-09-14T12:13:18.309609+0000","last_peered":"2024-09-14T12:13:18.309609+0000","last_clean":"2024-09-14T12:13:18.309609+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:13:18.309609+0000","last_undegraded":"2024-09-14T12:13:18.309609+0000","last_fullsized":"2024-09-14T12:13:18.309609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.693742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.329763+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:12:18.329763+0000","last_peered":"2024-09-14T12:12:18.329763+0000","last_clean":"2024-09-14T12:12:18.329763+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:12:18.329763+0000","last_undegraded":"2024-09-14T12:12:18.329763+0000","last_fullsized":"2024-09-14T12:12:18.329763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:10.558327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.447497+0000","last_change":"2024-09-14T11:51:07.027403+0000","last_active":"2024-09-14T12:12:48.447497+0000","last_peered":"2024-09-14T12:12:48.447497+0000","last_clean":"2024-09-14T12:12:48.447497+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:12:48.447497+0000","last_undegraded":"2024-09-14T12:12:48.447497+0000","last_fullsized":"2024-09-14T12:12:48.447497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:41.431415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207455+0000","last_change":"2024-09-14T11:35:03.477782+0000","last_active":"2024-09-14T12:13:28.207455+0000","last_peered":"2024-09-14T12:13:28.207455+0000","last_clean":"2024-09-14T12:13:28.207455+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:13:28.207455+0000","last_undegraded":"2024-09-14T12:13:28.207455+0000","last_fullsized":"2024-09-14T12:13:28.207455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:40.078111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.443370+0000","last_change":"2024-09-14T11:31:47.459051+0000","last_active":"2024-09-14T12:12:18.443370+0000","last_peered":"2024-09-14T12:12:18.443370+0000","last_clean":"2024-09-14T12:12:18.443370+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:12:18.443370+0000","last_undegraded":"2024-09-14T12:12:18.443370+0000","last_fullsized":"2024-09-14T12:12:18.443370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:51.494106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207443+0000","last_change":"2024-09-14T11:35:00.446767+0000","last_active":"2024-09-14T12:13:28.207443+0000","last_peered":"2024-09-14T12:13:28.207443+0000","last_clean":"2024-09-14T12:13:28.207443+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:13:28.207443+0000","last_undegraded":"2024-09-14T12:13:28.207443+0000","last_fullsized":"2024-09-14T12:13:28.207443+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:07.682575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.303508+0000","last_change":"2024-09-14T11:31:47.461172+0000","last_active":"2024-09-14T12:12:18.303508+0000","last_peered":"2024-09-14T12:12:18.303508+0000","last_clean":"2024-09-14T12:12:18.303508+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:12:18.303508+0000","last_undegraded":"2024-09-14T12:12:18.303508+0000","last_fullsized":"2024-09-14T12:12:18.303508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:24.137730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341112+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:14:03.341112+0000","last_peered":"2024-09-14T12:14:03.341112+0000","last_clean":"2024-09-14T12:14:03.341112+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:14:03.341112+0000","last_undegraded":"2024-09-14T12:14:03.341112+0000","last_fullsized":"2024-09-14T12:14:03.341112+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9588,"num_write":4,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:00.457511+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:14:00.457511+0000","last_peered":"2024-09-14T12:14:00.457511+0000","last_clean":"2024-09-14T12:14:00.457511+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:14:00.457511+0000","last_undegraded":"2024-09-14T12:14:00.457511+0000","last_fullsized":"2024-09-14T12:14:00.457511+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:20.445608+0000","last_change":"2024-09-14T11:31:47.455100+0000","last_active":"2024-09-14T12:12:20.445608+0000","last_peered":"2024-09-14T12:12:20.445608+0000","last_clean":"2024-09-14T12:12:20.445608+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:12:20.445608+0000","last_undegraded":"2024-09-14T12:12:20.445608+0000","last_fullsized":"2024-09-14T12:12:20.445608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:09.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211406+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:14:03.211406+0000","last_peered":"2024-09-14T12:14:03.211406+0000","last_clean":"2024-09-14T12:14:03.211406+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:14:03.211406+0000","last_undegraded":"2024-09-14T12:14:03.211406+0000","last_fullsized":"2024-09-14T12:14:03.211406+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464147+0000","last_change":"2024-09-14T11:31:47.454175+0000","last_active":"2024-09-14T12:13:03.464147+0000","last_peered":"2024-09-14T12:13:03.464147+0000","last_clean":"2024-09-14T12:13:03.464147+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:13:03.464147+0000","last_undegraded":"2024-09-14T12:13:03.464147+0000","last_fullsized":"2024-09-14T12:13:03.464147+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.297114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.206264+0000","last_change":"2024-09-14T11:35:03.477505+0000","last_active":"2024-09-14T12:13:18.206264+0000","last_peered":"2024-09-14T12:13:18.206264+0000","last_clean":"2024-09-14T12:13:18.206264+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:13:18.206264+0000","last_undegraded":"2024-09-14T12:13:18.206264+0000","last_fullsized":"2024-09-14T12:13:18.206264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:56.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:55.442720+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:11:55.442720+0000","last_peered":"2024-09-14T12:11:55.442720+0000","last_clean":"2024-09-14T12:11:55.442720+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:11:55.442720+0000","last_undegraded":"2024-09-14T12:11:55.442720+0000","last_fullsized":"2024-09-14T12:11:55.442720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.452072+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:11:58.452072+0000","last_peered":"2024-09-14T12:11:58.452072+0000","last_clean":"2024-09-14T12:11:58.452072+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:11:58.452072+0000","last_undegraded":"2024-09-14T12:11:58.452072+0000","last_fullsized":"2024-09-14T12:11:58.452072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.334737+0000","last_change":"2024-09-14T11:35:00.437763+0000","last_active":"2024-09-14T12:13:18.334737+0000","last_peered":"2024-09-14T12:13:18.334737+0000","last_clean":"2024-09-14T12:13:18.334737+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:13:18.334737+0000","last_undegraded":"2024-09-14T12:13:18.334737+0000","last_fullsized":"2024-09-14T12:13:18.334737+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:10.195413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448816+0000","last_change":"2024-09-14T11:31:47.455016+0000","last_active":"2024-09-14T12:12:58.448816+0000","last_peered":"2024-09-14T12:12:58.448816+0000","last_clean":"2024-09-14T12:12:58.448816+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:12:58.448816+0000","last_undegraded":"2024-09-14T12:12:58.448816+0000","last_fullsized":"2024-09-14T12:12:58.448816+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:05.916872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:40.448133+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:12:40.448133+0000","last_peered":"2024-09-14T12:12:40.448133+0000","last_clean":"2024-09-14T12:12:40.448133+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:12:40.448133+0000","last_undegraded":"2024-09-14T12:12:40.448133+0000","last_fullsized":"2024-09-14T12:12:40.448133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:19.901941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'10","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457537+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:12:33.457537+0000","last_peered":"2024-09-14T12:12:33.457537+0000","last_clean":"2024-09-14T12:12:33.457537+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:12:33.457537+0000","last_undegraded":"2024-09-14T12:12:33.457537+0000","last_fullsized":"2024-09-14T12:12:33.457537+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:41.032154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":12294,"num_write":15,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450330+0000","last_change":"2024-09-14T11:31:47.456677+0000","last_active":"2024-09-14T12:13:00.450330+0000","last_peered":"2024-09-14T12:13:00.450330+0000","last_clean":"2024-09-14T12:13:00.450330+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:13:00.450330+0000","last_undegraded":"2024-09-14T12:13:00.450330+0000","last_fullsized":"2024-09-14T12:13:00.450330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.544493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447594+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:12:35.447594+0000","last_peered":"2024-09-14T12:12:35.447594+0000","last_clean":"2024-09-14T12:12:35.447594+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:12:35.447594+0000","last_undegraded":"2024-09-14T12:12:35.447594+0000","last_fullsized":"2024-09-14T12:12:35.447594+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:39.273428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:43.305948+0000","last_change":"2024-09-14T11:35:00.449492+0000","last_active":"2024-09-14T12:12:43.305948+0000","last_peered":"2024-09-14T12:12:43.305948+0000","last_clean":"2024-09-14T12:12:43.305948+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:12:43.305948+0000","last_undegraded":"2024-09-14T12:12:43.305948+0000","last_fullsized":"2024-09-14T12:12:43.305948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:07.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448902+0000","last_change":"2024-09-14T11:31:47.458093+0000","last_active":"2024-09-14T12:12:58.448902+0000","last_peered":"2024-09-14T12:12:58.448902+0000","last_clean":"2024-09-14T12:12:58.448902+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:12:58.448902+0000","last_undegraded":"2024-09-14T12:12:58.448902+0000","last_fullsized":"2024-09-14T12:12:58.448902+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:32.003627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473241+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:14:03.473241+0000","last_peered":"2024-09-14T12:14:03.473241+0000","last_clean":"2024-09-14T12:14:03.473241+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:14:03.473241+0000","last_undegraded":"2024-09-14T12:14:03.473241+0000","last_fullsized":"2024-09-14T12:14:03.473241+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468672+0000","last_change":"2024-09-14T11:31:47.461691+0000","last_active":"2024-09-14T12:13:33.468672+0000","last_peered":"2024-09-14T12:13:33.468672+0000","last_clean":"2024-09-14T12:13:33.468672+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:13:33.468672+0000","last_undegraded":"2024-09-14T12:13:33.468672+0000","last_fullsized":"2024-09-14T12:13:33.468672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:28.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207399+0000","last_change":"2024-09-14T11:31:47.462125+0000","last_active":"2024-09-14T12:13:28.207399+0000","last_peered":"2024-09-14T12:13:28.207399+0000","last_clean":"2024-09-14T12:13:28.207399+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:13:28.207399+0000","last_undegraded":"2024-09-14T12:13:28.207399+0000","last_fullsized":"2024-09-14T12:13:28.207399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:55.114065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.306468+0000","last_change":"2024-09-14T11:51:07.031655+0000","last_active":"2024-09-14T12:12:48.306468+0000","last_peered":"2024-09-14T12:12:48.306468+0000","last_clean":"2024-09-14T12:12:48.306468+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:12:48.306468+0000","last_undegraded":"2024-09-14T12:12:48.306468+0000","last_fullsized":"2024-09-14T12:12:48.306468+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:23.951366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201466+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:12:33.201466+0000","last_peered":"2024-09-14T12:12:33.201466+0000","last_clean":"2024-09-14T12:12:33.201466+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:12:33.201466+0000","last_undegraded":"2024-09-14T12:12:33.201466+0000","last_fullsized":"2024-09-14T12:12:33.201466+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:50.359964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24578,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.464857+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:13:08.464857+0000","last_peered":"2024-09-14T12:13:08.464857+0000","last_clean":"2024-09-14T12:13:08.464857+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:13:08.464857+0000","last_undegraded":"2024-09-14T12:13:08.464857+0000","last_fullsized":"2024-09-14T12:13:08.464857+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221763+0000","last_change":"2024-09-14T11:31:47.454368+0000","last_active":"2024-09-14T12:13:28.221763+0000","last_peered":"2024-09-14T12:13:28.221763+0000","last_clean":"2024-09-14T12:13:28.221763+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:13:28.221763+0000","last_undegraded":"2024-09-14T12:13:28.221763+0000","last_fullsized":"2024-09-14T12:13:28.221763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:49.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457485+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:12:33.457485+0000","last_peered":"2024-09-14T12:12:33.457485+0000","last_clean":"2024-09-14T12:12:33.457485+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:12:33.457485+0000","last_undegraded":"2024-09-14T12:12:33.457485+0000","last_fullsized":"2024-09-14T12:12:33.457485+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:14.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.335995+0000","last_change":"2024-09-14T11:31:47.458566+0000","last_active":"2024-09-14T12:13:28.335995+0000","last_peered":"2024-09-14T12:13:28.335995+0000","last_clean":"2024-09-14T12:13:28.335995+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:13:28.335995+0000","last_undegraded":"2024-09-14T12:13:28.335995+0000","last_fullsized":"2024-09-14T12:13:28.335995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:16.885698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445234+0000","last_change":"2024-09-14T11:35:03.475098+0000","last_active":"2024-09-14T12:12:33.445234+0000","last_peered":"2024-09-14T12:12:33.445234+0000","last_clean":"2024-09-14T12:12:33.445234+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:12:33.445234+0000","last_undegraded":"2024-09-14T12:12:33.445234+0000","last_fullsized":"2024-09-14T12:12:33.445234+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:47.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'5","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201494+0000","last_change":"2024-09-14T11:35:00.441606+0000","last_active":"2024-09-14T12:12:33.201494+0000","last_peered":"2024-09-14T12:12:33.201494+0000","last_clean":"2024-09-14T12:12:33.201494+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:12:33.201494+0000","last_undegraded":"2024-09-14T12:12:33.201494+0000","last_fullsized":"2024-09-14T12:12:33.201494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.099191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453081+0000","last_change":"2024-09-14T11:31:47.457442+0000","last_active":"2024-09-14T12:13:28.453081+0000","last_peered":"2024-09-14T12:13:28.453081+0000","last_clean":"2024-09-14T12:13:28.453081+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:13:28.453081+0000","last_undegraded":"2024-09-14T12:13:28.453081+0000","last_fullsized":"2024-09-14T12:13:28.453081+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.421189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328235+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:12:33.328235+0000","last_peered":"2024-09-14T12:12:33.328235+0000","last_clean":"2024-09-14T12:12:33.328235+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:12:33.328235+0000","last_undegraded":"2024-09-14T12:12:33.328235+0000","last_fullsized":"2024-09-14T12:12:33.328235+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.691369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445253+0000","last_change":"2024-09-14T11:35:00.438555+0000","last_active":"2024-09-14T12:12:33.445253+0000","last_peered":"2024-09-14T12:12:33.445253+0000","last_clean":"2024-09-14T12:12:33.445253+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:12:33.445253+0000","last_undegraded":"2024-09-14T12:12:33.445253+0000","last_fullsized":"2024-09-14T12:12:33.445253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:40.844681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471478+0000","last_change":"2024-09-14T11:31:47.457290+0000","last_active":"2024-09-14T12:13:53.471478+0000","last_peered":"2024-09-14T12:13:53.471478+0000","last_clean":"2024-09-14T12:13:53.471478+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:13:53.471478+0000","last_undegraded":"2024-09-14T12:13:53.471478+0000","last_fullsized":"2024-09-14T12:13:53.471478+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:56.244895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'308","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.108039+0000","last_change":"2024-09-14T11:17:21.587746+0000","last_active":"2024-09-14T12:15:43.108039+0000","last_peered":"2024-09-14T12:15:43.108039+0000","last_clean":"2024-09-14T12:15:43.108039+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:15:43.108039+0000","last_undegraded":"2024-09-14T12:15:43.108039+0000","last_fullsized":"2024-09-14T12:15:43.108039+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:26.043334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430926,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":565,"num_read_kb":9737,"num_write":1184,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'480","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869433+0000","last_change":"2024-09-14T11:17:23.596289+0000","last_active":"2024-09-14T12:13:31.869433+0000","last_peered":"2024-09-14T12:13:31.869433+0000","last_clean":"2024-09-14T12:13:31.869433+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:13:31.869433+0000","last_undegraded":"2024-09-14T12:13:31.869433+0000","last_fullsized":"2024-09-14T12:13:31.869433+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.016139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'264","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.841386+0000","last_change":"2024-09-14T11:17:21.584104+0000","last_active":"2024-09-14T12:14:17.841386+0000","last_peered":"2024-09-14T12:14:17.841386+0000","last_clean":"2024-09-14T12:14:17.841386+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:14:17.841386+0000","last_undegraded":"2024-09-14T12:14:17.841386+0000","last_fullsized":"2024-09-14T12:14:17.841386+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:46.479650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8699282,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":471,"num_read_kb":22750,"num_write":944,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'451","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.480890+0000","last_change":"2024-09-14T11:17:23.592564+0000","last_active":"2024-09-14T12:14:53.480890+0000","last_peered":"2024-09-14T12:14:53.480890+0000","last_clean":"2024-09-14T12:14:53.480890+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:14:53.480890+0000","last_undegraded":"2024-09-14T12:14:53.480890+0000","last_fullsized":"2024-09-14T12:14:53.480890+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:08.504401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'298","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455236+0000","last_change":"2024-09-14T11:17:21.580337+0000","last_active":"2024-09-14T12:13:40.455236+0000","last_peered":"2024-09-14T12:13:40.455236+0000","last_clean":"2024-09-14T12:13:40.455236+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:13:40.455236+0000","last_undegraded":"2024-09-14T12:13:40.455236+0000","last_fullsized":"2024-09-14T12:13:40.455236+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:44.574988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5644441,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":645,"num_read_kb":8093,"num_write":1094,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'828","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.348237+0000","last_change":"2024-09-14T11:17:23.599492+0000","last_active":"2024-09-14T12:14:53.348237+0000","last_peered":"2024-09-14T12:14:53.348237+0000","last_clean":"2024-09-14T12:14:53.348237+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:14:53.348237+0000","last_undegraded":"2024-09-14T12:14:53.348237+0000","last_fullsized":"2024-09-14T12:14:53.348237+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:31.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'320","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223314+0000","last_change":"2024-09-14T11:17:21.587518+0000","last_active":"2024-09-14T12:13:38.223314+0000","last_peered":"2024-09-14T12:13:38.223314+0000","last_clean":"2024-09-14T12:13:38.223314+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:13:38.223314+0000","last_undegraded":"2024-09-14T12:13:38.223314+0000","last_fullsized":"2024-09-14T12:13:38.223314+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.780145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11836321,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":624,"num_read_kb":69334,"num_write":1171,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'478","reported_seq":2201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:55.464747+0000","last_change":"2024-09-14T11:17:23.604953+0000","last_active":"2024-09-14T12:14:55.464747+0000","last_peered":"2024-09-14T12:14:55.464747+0000","last_clean":"2024-09-14T12:14:55.464747+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:14:55.464747+0000","last_undegraded":"2024-09-14T12:14:55.464747+0000","last_fullsized":"2024-09-14T12:14:55.464747+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.132184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'288","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.776642+0000","last_change":"2024-09-14T11:17:21.585772+0000","last_active":"2024-09-14T12:13:33.776642+0000","last_peered":"2024-09-14T12:13:33.776642+0000","last_clean":"2024-09-14T12:13:33.776642+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:13:33.776642+0000","last_undegraded":"2024-09-14T12:13:33.776642+0000","last_fullsized":"2024-09-14T12:13:33.776642+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:30.264733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353450,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":577,"num_read_kb":8504,"num_write":1053,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'928","reported_seq":2495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.884819+0000","last_change":"2024-09-14T11:17:23.598765+0000","last_active":"2024-09-14T12:13:38.884819+0000","last_peered":"2024-09-14T12:13:38.884819+0000","last_clean":"2024-09-14T12:13:38.884819+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:13:38.884819+0000","last_undegraded":"2024-09-14T12:13:38.884819+0000","last_fullsized":"2024-09-14T12:13:38.884819+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:07.244374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'276","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:29.940360+0000","last_change":"2024-09-14T11:17:21.586031+0000","last_active":"2024-09-14T12:12:29.940360+0000","last_peered":"2024-09-14T12:12:29.940360+0000","last_clean":"2024-09-14T12:12:29.940360+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:12:29.940360+0000","last_undegraded":"2024-09-14T12:12:29.940360+0000","last_fullsized":"2024-09-14T12:12:29.940360+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:35.597137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1550973,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":530,"num_read_kb":13219,"num_write":1002,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'322","reported_seq":1677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.773491+0000","last_change":"2024-09-14T11:17:23.598233+0000","last_active":"2024-09-14T12:14:33.773491+0000","last_peered":"2024-09-14T12:14:33.773491+0000","last_clean":"2024-09-14T12:14:33.773491+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:14:33.773491+0000","last_undegraded":"2024-09-14T12:14:33.773491+0000","last_fullsized":"2024-09-14T12:14:33.773491+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:42.186568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'269","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.884175+0000","last_change":"2024-09-14T11:17:21.583061+0000","last_active":"2024-09-14T12:12:25.884175+0000","last_peered":"2024-09-14T12:12:25.884175+0000","last_clean":"2024-09-14T12:12:25.884175+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:12:25.884175+0000","last_undegraded":"2024-09-14T12:12:25.884175+0000","last_fullsized":"2024-09-14T12:12:25.884175+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:35.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8089099,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":445,"num_read_kb":13115,"num_write":950,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'406","reported_seq":1944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.589436+0000","last_change":"2024-09-14T11:17:23.595095+0000","last_active":"2024-09-14T12:14:01.589436+0000","last_peered":"2024-09-14T12:14:01.589436+0000","last_clean":"2024-09-14T12:14:01.589436+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:14:01.589436+0000","last_undegraded":"2024-09-14T12:14:01.589436+0000","last_fullsized":"2024-09-14T12:14:01.589436+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:51.571958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'283","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.611116+0000","last_change":"2024-09-14T11:17:55.703681+0000","last_active":"2024-09-14T12:14:02.611116+0000","last_peered":"2024-09-14T12:14:02.611116+0000","last_clean":"2024-09-14T12:14:02.611116+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:14:02.611116+0000","last_undegraded":"2024-09-14T12:14:02.611116+0000","last_fullsized":"2024-09-14T12:14:02.611116+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:43.991223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100038,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":520,"num_read_kb":3515,"num_write":1040,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'928","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.115259+0000","last_change":"2024-09-14T11:17:23.602237+0000","last_active":"2024-09-14T12:15:48.115259+0000","last_peered":"2024-09-14T12:15:48.115259+0000","last_clean":"2024-09-14T12:15:48.115259+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:15:48.115259+0000","last_undegraded":"2024-09-14T12:15:48.115259+0000","last_fullsized":"2024-09-14T12:15:48.115259+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:07.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'883","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606712+0000","last_change":"2024-09-14T11:17:23.599033+0000","last_active":"2024-09-14T12:14:34.606712+0000","last_peered":"2024-09-14T12:14:34.606712+0000","last_clean":"2024-09-14T12:14:34.606712+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:14:34.606712+0000","last_undegraded":"2024-09-14T12:14:34.606712+0000","last_fullsized":"2024-09-14T12:14:34.606712+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:02.965131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'310","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464273+0000","last_change":"2024-09-14T11:17:21.590951+0000","last_active":"2024-09-14T12:13:03.464273+0000","last_peered":"2024-09-14T12:13:03.464273+0000","last_clean":"2024-09-14T12:13:03.464273+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:13:03.464273+0000","last_undegraded":"2024-09-14T12:13:03.464273+0000","last_fullsized":"2024-09-14T12:13:03.464273+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:04.497926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4275713,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":605,"num_read_kb":33506,"num_write":1154,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'723","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.112494+0000","last_change":"2024-09-14T11:17:55.874871+0000","last_active":"2024-09-14T12:15:48.112494+0000","last_peered":"2024-09-14T12:15:48.112494+0000","last_clean":"2024-09-14T12:15:48.112494+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:15:48.112494+0000","last_undegraded":"2024-09-14T12:15:48.112494+0000","last_fullsized":"2024-09-14T12:15:48.112494+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:09.467887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'412","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448912+0000","last_change":"2024-09-14T11:17:21.591292+0000","last_active":"2024-09-14T12:12:58.448912+0000","last_peered":"2024-09-14T12:12:58.448912+0000","last_clean":"2024-09-14T12:12:58.448912+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:12:58.448912+0000","last_undegraded":"2024-09-14T12:12:58.448912+0000","last_fullsized":"2024-09-14T12:12:58.448912+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.290528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8714049,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":871,"num_read_kb":10641,"num_write":1158,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'766","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.137705+0000","last_change":"2024-09-14T11:17:23.599028+0000","last_active":"2024-09-14T12:15:48.137705+0000","last_peered":"2024-09-14T12:15:48.137705+0000","last_clean":"2024-09-14T12:15:48.137705+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:15:48.137705+0000","last_undegraded":"2024-09-14T12:15:48.137705+0000","last_fullsized":"2024-09-14T12:15:48.137705+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'319","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.585271+0000","last_change":"2024-09-14T11:17:21.590804+0000","last_active":"2024-09-14T12:13:32.585271+0000","last_peered":"2024-09-14T12:13:32.585271+0000","last_clean":"2024-09-14T12:13:32.585271+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:13:32.585271+0000","last_undegraded":"2024-09-14T12:13:32.585271+0000","last_fullsized":"2024-09-14T12:13:32.585271+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:31.068330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5357337,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":598,"num_read_kb":6370,"num_write":1006,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.113932+0000","last_change":"2024-09-14T11:17:23.602214+0000","last_active":"2024-09-14T12:15:48.113932+0000","last_peered":"2024-09-14T12:15:48.113932+0000","last_clean":"2024-09-14T12:15:48.113932+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:15:48.113932+0000","last_undegraded":"2024-09-14T12:15:48.113932+0000","last_fullsized":"2024-09-14T12:15:48.113932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:16.076422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'268","reported_seq":927,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.331946+0000","last_change":"2024-09-14T11:17:21.580921+0000","last_active":"2024-09-14T12:12:58.331946+0000","last_peered":"2024-09-14T12:12:58.331946+0000","last_clean":"2024-09-14T12:12:58.331946+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:12:58.331946+0000","last_undegraded":"2024-09-14T12:12:58.331946+0000","last_fullsized":"2024-09-14T12:12:58.331946+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440903,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":619,"num_read_kb":17017,"num_write":902,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'903","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.117762+0000","last_change":"2024-09-14T11:17:23.599615+0000","last_active":"2024-09-14T12:15:48.117762+0000","last_peered":"2024-09-14T12:15:48.117762+0000","last_clean":"2024-09-14T12:15:48.117762+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:15:48.117762+0000","last_undegraded":"2024-09-14T12:15:48.117762+0000","last_fullsized":"2024-09-14T12:15:48.117762+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:54.414087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'241","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213854+0000","last_change":"2024-09-14T11:17:21.586068+0000","last_active":"2024-09-14T12:12:58.213854+0000","last_peered":"2024-09-14T12:12:58.213854+0000","last_clean":"2024-09-14T12:12:58.213854+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:12:58.213854+0000","last_undegraded":"2024-09-14T12:12:58.213854+0000","last_fullsized":"2024-09-14T12:12:58.213854+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.111859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8739959,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19406,"num_write":803,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1142","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503777+0000","last_change":"2024-09-14T11:17:23.592841+0000","last_active":"2024-09-14T12:15:18.503777+0000","last_peered":"2024-09-14T12:15:18.503777+0000","last_clean":"2024-09-14T12:15:18.503777+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:15:18.503777+0000","last_undegraded":"2024-09-14T12:15:18.503777+0000","last_fullsized":"2024-09-14T12:15:18.503777+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:33.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'291","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453969+0000","last_change":"2024-09-14T11:17:21.581385+0000","last_active":"2024-09-14T12:13:30.453969+0000","last_peered":"2024-09-14T12:13:30.453969+0000","last_clean":"2024-09-14T12:13:30.453969+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:13:30.453969+0000","last_undegraded":"2024-09-14T12:13:30.453969+0000","last_fullsized":"2024-09-14T12:13:30.453969+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:13.497850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217581,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":658,"num_read_kb":10760,"num_write":949,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'124","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.745040+0000","last_change":"2024-09-14T11:17:31.654831+0000","last_active":"2024-09-14T12:14:34.745040+0000","last_peered":"2024-09-14T12:14:34.745040+0000","last_clean":"2024-09-14T12:14:34.745040+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:14:34.745040+0000","last_undegraded":"2024-09-14T12:14:34.745040+0000","last_fullsized":"2024-09-14T12:14:34.745040+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:31.244666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'519","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.588328+0000","last_change":"2024-09-14T11:17:23.599731+0000","last_active":"2024-09-14T12:14:01.588328+0000","last_peered":"2024-09-14T12:14:01.588328+0000","last_clean":"2024-09-14T12:14:01.588328+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:14:01.588328+0000","last_undegraded":"2024-09-14T12:14:01.588328+0000","last_fullsized":"2024-09-14T12:14:01.588328+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:06.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'232","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.467113+0000","last_change":"2024-09-14T11:17:21.582288+0000","last_active":"2024-09-14T12:13:23.467113+0000","last_peered":"2024-09-14T12:13:23.467113+0000","last_clean":"2024-09-14T12:13:23.467113+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:13:23.467113+0000","last_undegraded":"2024-09-14T12:13:23.467113+0000","last_fullsized":"2024-09-14T12:13:23.467113+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:12.066003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5249689,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":400,"num_read_kb":3402,"num_write":817,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217819+0000","last_change":"2024-09-14T11:17:25.615823+0000","last_active":"2024-09-14T12:13:03.217819+0000","last_peered":"2024-09-14T12:13:03.217819+0000","last_clean":"2024-09-14T12:13:03.217819+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:13:03.217819+0000","last_undegraded":"2024-09-14T12:13:03.217819+0000","last_fullsized":"2024-09-14T12:13:03.217819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:11.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:30.469572+0000","last_change":"2024-09-14T11:17:27.635100+0000","last_active":"2024-09-14T12:15:30.469572+0000","last_peered":"2024-09-14T12:15:30.469572+0000","last_clean":"2024-09-14T12:15:30.469572+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:15:30.469572+0000","last_undegraded":"2024-09-14T12:15:30.469572+0000","last_fullsized":"2024-09-14T12:15:30.469572+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:40.414857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":1083,"num_write":448,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.465023+0000","last_change":"2024-09-14T11:17:29.648345+0000","last_active":"2024-09-14T12:13:08.465023+0000","last_peered":"2024-09-14T12:13:08.465023+0000","last_clean":"2024-09-14T12:13:08.465023+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:13:08.465023+0000","last_undegraded":"2024-09-14T12:13:08.465023+0000","last_fullsized":"2024-09-14T12:13:08.465023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:26.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'125","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.666407+0000","last_change":"2024-09-14T11:17:31.655931+0000","last_active":"2024-09-14T12:14:32.666407+0000","last_peered":"2024-09-14T12:14:32.666407+0000","last_clean":"2024-09-14T12:14:32.666407+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:14:32.666407+0000","last_undegraded":"2024-09-14T12:14:32.666407+0000","last_fullsized":"2024-09-14T12:14:32.666407+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.187962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'403","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605468+0000","last_change":"2024-09-14T11:17:23.593797+0000","last_active":"2024-09-14T12:14:34.605468+0000","last_peered":"2024-09-14T12:14:34.605468+0000","last_clean":"2024-09-14T12:14:34.605468+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:14:34.605468+0000","last_undegraded":"2024-09-14T12:14:34.605468+0000","last_fullsized":"2024-09-14T12:14:34.605468+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:55.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'306","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.125338+0000","last_change":"2024-09-14T11:17:21.586646+0000","last_active":"2024-09-14T12:15:43.125338+0000","last_peered":"2024-09-14T12:15:43.125338+0000","last_clean":"2024-09-14T12:15:43.125338+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:15:43.125338+0000","last_undegraded":"2024-09-14T12:15:43.125338+0000","last_fullsized":"2024-09-14T12:15:43.125338+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:04.270874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2640321,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":500,"num_read_kb":9431,"num_write":1065,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219417+0000","last_change":"2024-09-14T11:17:25.616433+0000","last_active":"2024-09-14T12:13:43.219417+0000","last_peered":"2024-09-14T12:13:43.219417+0000","last_clean":"2024-09-14T12:13:43.219417+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:13:43.219417+0000","last_undegraded":"2024-09-14T12:13:43.219417+0000","last_fullsized":"2024-09-14T12:13:43.219417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:30.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332635+0000","last_change":"2024-09-14T11:17:27.625733+0000","last_active":"2024-09-14T12:13:03.332635+0000","last_peered":"2024-09-14T12:13:03.332635+0000","last_clean":"2024-09-14T12:13:03.332635+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:13:03.332635+0000","last_undegraded":"2024-09-14T12:13:03.332635+0000","last_fullsized":"2024-09-14T12:13:03.332635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.964076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.333430+0000","last_change":"2024-09-14T11:17:29.644069+0000","last_active":"2024-09-14T12:13:08.333430+0000","last_peered":"2024-09-14T12:13:08.333430+0000","last_clean":"2024-09-14T12:13:08.333430+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:13:08.333430+0000","last_undegraded":"2024-09-14T12:13:08.333430+0000","last_fullsized":"2024-09-14T12:13:08.333430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:57.125690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'115","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447544+0000","last_change":"2024-09-14T11:17:31.656073+0000","last_active":"2024-09-14T12:12:35.447544+0000","last_peered":"2024-09-14T12:12:35.447544+0000","last_clean":"2024-09-14T12:12:35.447544+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:12:35.447544+0000","last_undegraded":"2024-09-14T12:12:35.447544+0000","last_fullsized":"2024-09-14T12:12:35.447544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.047265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'515","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.577498+0000","last_change":"2024-09-14T11:17:23.603416+0000","last_active":"2024-09-14T12:13:55.577498+0000","last_peered":"2024-09-14T12:13:55.577498+0000","last_clean":"2024-09-14T12:13:55.577498+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:13:55.577498+0000","last_undegraded":"2024-09-14T12:13:55.577498+0000","last_fullsized":"2024-09-14T12:13:55.577498+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:40.391533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'377","reported_seq":1092,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.441992+0000","last_change":"2024-09-14T11:17:21.581059+0000","last_active":"2024-09-14T12:14:01.441992+0000","last_peered":"2024-09-14T12:14:01.441992+0000","last_clean":"2024-09-14T12:14:01.441992+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:14:01.441992+0000","last_undegraded":"2024-09-14T12:14:01.441992+0000","last_fullsized":"2024-09-14T12:14:01.441992+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:45.085082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20627141,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":959,"num_read_kb":13380,"num_write":1346,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.214581+0000","last_change":"2024-09-14T11:17:25.616302+0000","last_active":"2024-09-14T12:13:03.214581+0000","last_peered":"2024-09-14T12:13:03.214581+0000","last_clean":"2024-09-14T12:13:03.214581+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:13:03.214581+0000","last_undegraded":"2024-09-14T12:13:03.214581+0000","last_fullsized":"2024-09-14T12:13:03.214581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:14.747448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311910+0000","last_change":"2024-09-14T11:17:27.629551+0000","last_active":"2024-09-14T12:13:38.311910+0000","last_peered":"2024-09-14T12:13:38.311910+0000","last_clean":"2024-09-14T12:13:38.311910+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:13:38.311910+0000","last_undegraded":"2024-09-14T12:13:38.311910+0000","last_fullsized":"2024-09-14T12:13:38.311910+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'760","reported_seq":2257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.258497+0000","last_change":"2024-09-14T11:17:29.644411+0000","last_active":"2024-09-14T12:15:49.258497+0000","last_peered":"2024-09-14T12:15:49.258497+0000","last_clean":"2024-09-14T12:15:49.258497+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:15:49.258497+0000","last_undegraded":"2024-09-14T12:15:49.258497+0000","last_fullsized":"2024-09-14T12:15:49.258497+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:09.032379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.802436+0000","last_change":"2024-09-14T11:17:31.653029+0000","last_active":"2024-09-14T12:14:34.802436+0000","last_peered":"2024-09-14T12:14:34.802436+0000","last_clean":"2024-09-14T12:14:34.802436+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:14:34.802436+0000","last_undegraded":"2024-09-14T12:14:34.802436+0000","last_fullsized":"2024-09-14T12:14:34.802436+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.378206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1034","reported_seq":2653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208892+0000","last_change":"2024-09-14T11:17:23.595010+0000","last_active":"2024-09-14T12:14:31.208892+0000","last_peered":"2024-09-14T12:14:31.208892+0000","last_clean":"2024-09-14T12:14:31.208892+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:14:31.208892+0000","last_undegraded":"2024-09-14T12:14:31.208892+0000","last_fullsized":"2024-09-14T12:14:31.208892+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'281","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.939272+0000","last_change":"2024-09-14T11:17:21.584036+0000","last_active":"2024-09-14T12:13:51.939272+0000","last_peered":"2024-09-14T12:13:51.939272+0000","last_clean":"2024-09-14T12:13:51.939272+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:13:51.939272+0000","last_undegraded":"2024-09-14T12:13:51.939272+0000","last_fullsized":"2024-09-14T12:13:51.939272+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:15.378108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5585677,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":661,"num_read_kb":31887,"num_write":1040,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217853+0000","last_change":"2024-09-14T11:17:25.618783+0000","last_active":"2024-09-14T12:13:03.217853+0000","last_peered":"2024-09-14T12:13:03.217853+0000","last_clean":"2024-09-14T12:13:03.217853+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:13:03.217853+0000","last_undegraded":"2024-09-14T12:13:03.217853+0000","last_fullsized":"2024-09-14T12:13:03.217853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:17.470265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'266","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.147383+0000","last_change":"2024-09-14T11:17:27.633216+0000","last_active":"2024-09-14T12:15:48.147383+0000","last_peered":"2024-09-14T12:15:48.147383+0000","last_clean":"2024-09-14T12:15:48.147383+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:15:48.147383+0000","last_undegraded":"2024-09-14T12:15:48.147383+0000","last_fullsized":"2024-09-14T12:15:48.147383+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.992449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":965,"num_write":372,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'797","reported_seq":2950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.519993+0000","last_change":"2024-09-14T11:17:29.645452+0000","last_active":"2024-09-14T12:15:52.519993+0000","last_peered":"2024-09-14T12:15:52.519993+0000","last_clean":"2024-09-14T12:15:52.519993+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:15:52.519993+0000","last_undegraded":"2024-09-14T12:15:52.519993+0000","last_fullsized":"2024-09-14T12:15:52.519993+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:20.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'781","reported_seq":2531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.772745+0000","last_change":"2024-09-14T11:17:23.592552+0000","last_active":"2024-09-14T12:14:33.772745+0000","last_peered":"2024-09-14T12:14:33.772745+0000","last_clean":"2024-09-14T12:14:33.772745+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:14:33.772745+0000","last_undegraded":"2024-09-14T12:14:33.772745+0000","last_fullsized":"2024-09-14T12:14:33.772745+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.626824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'321","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470266+0000","last_change":"2024-09-14T11:17:21.585562+0000","last_active":"2024-09-14T12:13:43.470266+0000","last_peered":"2024-09-14T12:13:43.470266+0000","last_clean":"2024-09-14T12:13:43.470266+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:13:43.470266+0000","last_undegraded":"2024-09-14T12:13:43.470266+0000","last_fullsized":"2024-09-14T12:13:43.470266+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:32.839861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10701649,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":609,"num_read_kb":56115,"num_write":1049,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470857+0000","last_change":"2024-09-14T11:17:25.612123+0000","last_active":"2024-09-14T12:13:48.470857+0000","last_peered":"2024-09-14T12:13:48.470857+0000","last_clean":"2024-09-14T12:13:48.470857+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:13:48.470857+0000","last_undegraded":"2024-09-14T12:13:48.470857+0000","last_fullsized":"2024-09-14T12:13:48.470857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.389407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'349","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.228278+0000","last_change":"2024-09-14T11:17:27.632368+0000","last_active":"2024-09-14T12:15:49.228278+0000","last_peered":"2024-09-14T12:15:49.228278+0000","last_clean":"2024-09-14T12:15:49.228278+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:15:49.228278+0000","last_undegraded":"2024-09-14T12:15:49.228278+0000","last_fullsized":"2024-09-14T12:15:49.228278+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.760176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65135,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":578,"num_read_kb":1087,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.209730+0000","last_change":"2024-09-14T11:17:29.646397+0000","last_active":"2024-09-14T12:13:48.209730+0000","last_peered":"2024-09-14T12:13:48.209730+0000","last_clean":"2024-09-14T12:13:48.209730+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:13:48.209730+0000","last_undegraded":"2024-09-14T12:13:48.209730+0000","last_fullsized":"2024-09-14T12:13:48.209730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.686669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'546","reported_seq":1351,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.248613+0000","last_change":"2024-09-14T11:17:31.656988+0000","last_active":"2024-09-14T12:15:49.248613+0000","last_peered":"2024-09-14T12:15:49.248613+0000","last_clean":"2024-09-14T12:15:49.248613+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:15:49.248613+0000","last_undegraded":"2024-09-14T12:15:49.248613+0000","last_fullsized":"2024-09-14T12:15:49.248613+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:43.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'387","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338146+0000","last_change":"2024-09-14T11:17:23.594471+0000","last_active":"2024-09-14T12:13:43.338146+0000","last_peered":"2024-09-14T12:13:43.338146+0000","last_clean":"2024-09-14T12:13:43.338146+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:13:43.338146+0000","last_undegraded":"2024-09-14T12:13:43.338146+0000","last_fullsized":"2024-09-14T12:13:43.338146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:33.360740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'321","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.127362+0000","last_change":"2024-09-14T11:17:21.582857+0000","last_active":"2024-09-14T12:13:57.127362+0000","last_peered":"2024-09-14T12:13:57.127362+0000","last_clean":"2024-09-14T12:13:57.127362+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:13:57.127362+0000","last_undegraded":"2024-09-14T12:13:57.127362+0000","last_fullsized":"2024-09-14T12:13:57.127362+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:31.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7483620,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":979,"num_read_kb":12713,"num_write":1195,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312912+0000","last_change":"2024-09-14T11:17:25.611404+0000","last_active":"2024-09-14T12:13:48.312912+0000","last_peered":"2024-09-14T12:13:48.312912+0000","last_clean":"2024-09-14T12:13:48.312912+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:13:48.312912+0000","last_undegraded":"2024-09-14T12:13:48.312912+0000","last_fullsized":"2024-09-14T12:13:48.312912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:08.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'247","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.205235+0000","last_change":"2024-09-14T11:17:27.631285+0000","last_active":"2024-09-14T12:15:49.205235+0000","last_peered":"2024-09-14T12:15:49.205235+0000","last_clean":"2024-09-14T12:15:49.205235+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:15:49.205235+0000","last_undegraded":"2024-09-14T12:15:49.205235+0000","last_fullsized":"2024-09-14T12:15:49.205235+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:15.793000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59901,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":408,"num_read_kb":858,"num_write":330,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:58.207057+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:11:58.207057+0000","last_peered":"2024-09-14T12:11:58.207057+0000","last_clean":"2024-09-14T12:11:58.207057+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:11:58.207057+0000","last_undegraded":"2024-09-14T12:11:58.207057+0000","last_fullsized":"2024-09-14T12:11:58.207057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2525","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.132063+0000","last_change":"2024-09-14T11:17:31.655728+0000","last_active":"2024-09-14T12:15:48.132063+0000","last_peered":"2024-09-14T12:15:48.132063+0000","last_clean":"2024-09-14T12:15:48.132063+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:15:48.132063+0000","last_undegraded":"2024-09-14T12:15:48.132063+0000","last_fullsized":"2024-09-14T12:15:48.132063+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:25.453442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1156","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344423+0000","last_change":"2024-09-14T11:17:23.605410+0000","last_active":"2024-09-14T12:13:53.344423+0000","last_peered":"2024-09-14T12:13:53.344423+0000","last_clean":"2024-09-14T12:13:53.344423+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:13:53.344423+0000","last_undegraded":"2024-09-14T12:13:53.344423+0000","last_fullsized":"2024-09-14T12:13:53.344423+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:20.036802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'307","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:19.299582+0000","last_change":"2024-09-14T11:17:21.589280+0000","last_active":"2024-09-14T12:14:19.299582+0000","last_peered":"2024-09-14T12:14:19.299582+0000","last_clean":"2024-09-14T12:14:19.299582+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:14:19.299582+0000","last_undegraded":"2024-09-14T12:14:19.299582+0000","last_fullsized":"2024-09-14T12:14:19.299582+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.602370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21050187,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":579,"num_read_kb":71361,"num_write":1042,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312428+0000","last_change":"2024-09-14T11:17:25.610821+0000","last_active":"2024-09-14T12:13:43.312428+0000","last_peered":"2024-09-14T12:13:43.312428+0000","last_clean":"2024-09-14T12:13:43.312428+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:13:43.312428+0000","last_undegraded":"2024-09-14T12:13:43.312428+0000","last_fullsized":"2024-09-14T12:13:43.312428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:02.190026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'303","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.230589+0000","last_change":"2024-09-14T11:17:27.635877+0000","last_active":"2024-09-14T12:15:49.230589+0000","last_peered":"2024-09-14T12:15:49.230589+0000","last_clean":"2024-09-14T12:15:49.230589+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:15:49.230589+0000","last_undegraded":"2024-09-14T12:15:49.230589+0000","last_fullsized":"2024-09-14T12:15:49.230589+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:09.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63434,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1010,"num_write":408,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'793","reported_seq":2533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.521807+0000","last_change":"2024-09-14T11:17:29.645441+0000","last_active":"2024-09-14T12:15:52.521807+0000","last_peered":"2024-09-14T12:15:52.521807+0000","last_clean":"2024-09-14T12:15:52.521807+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:15:52.521807+0000","last_undegraded":"2024-09-14T12:15:52.521807+0000","last_fullsized":"2024-09-14T12:15:52.521807+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":701,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.991498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.126444+0000","last_change":"2024-09-14T11:17:31.657084+0000","last_active":"2024-09-14T12:15:48.126444+0000","last_peered":"2024-09-14T12:15:48.126444+0000","last_clean":"2024-09-14T12:15:48.126444+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:15:48.126444+0000","last_undegraded":"2024-09-14T12:15:48.126444+0000","last_fullsized":"2024-09-14T12:15:48.126444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:26.090131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'579","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606091+0000","last_change":"2024-09-14T11:17:23.600240+0000","last_active":"2024-09-14T12:14:34.606091+0000","last_peered":"2024-09-14T12:14:34.606091+0000","last_clean":"2024-09-14T12:14:34.606091+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:14:34.606091+0000","last_undegraded":"2024-09-14T12:14:34.606091+0000","last_fullsized":"2024-09-14T12:14:34.606091+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:34.546153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:20.789966+0000","last_change":"2024-09-14T11:17:55.874169+0000","last_active":"2024-09-14T12:13:20.789966+0000","last_peered":"2024-09-14T12:13:20.789966+0000","last_clean":"2024-09-14T12:13:20.789966+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:13:20.789966+0000","last_undegraded":"2024-09-14T12:13:20.789966+0000","last_fullsized":"2024-09-14T12:13:20.789966+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.787464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17505113,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":715,"num_read_kb":58894,"num_write":1317,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313940+0000","last_change":"2024-09-14T11:17:25.606685+0000","last_active":"2024-09-14T12:13:58.313940+0000","last_peered":"2024-09-14T12:13:58.313940+0000","last_clean":"2024-09-14T12:13:58.313940+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:13:58.313940+0000","last_undegraded":"2024-09-14T12:13:58.313940+0000","last_fullsized":"2024-09-14T12:13:58.313940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:26.184797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'479","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.233091+0000","last_change":"2024-09-14T11:17:27.632963+0000","last_active":"2024-09-14T12:15:49.233091+0000","last_peered":"2024-09-14T12:15:49.233091+0000","last_clean":"2024-09-14T12:15:49.233091+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:15:49.233091+0000","last_undegraded":"2024-09-14T12:15:49.233091+0000","last_fullsized":"2024-09-14T12:15:49.233091+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:19.107003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112651,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":1798,"num_write":694,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.313426+0000","last_change":"2024-09-14T11:17:29.642604+0000","last_active":"2024-09-14T12:13:53.313426+0000","last_peered":"2024-09-14T12:13:53.313426+0000","last_clean":"2024-09-14T12:13:53.313426+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:13:53.313426+0000","last_undegraded":"2024-09-14T12:13:53.313426+0000","last_fullsized":"2024-09-14T12:13:53.313426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:39.976613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.210299+0000","last_change":"2024-09-14T11:17:31.660313+0000","last_active":"2024-09-14T12:13:53.210299+0000","last_peered":"2024-09-14T12:13:53.210299+0000","last_clean":"2024-09-14T12:13:53.210299+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:13:53.210299+0000","last_undegraded":"2024-09-14T12:13:53.210299+0000","last_fullsized":"2024-09-14T12:13:53.210299+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:47.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'491","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337413+0000","last_change":"2024-09-14T11:17:23.603415+0000","last_active":"2024-09-14T12:13:38.337413+0000","last_peered":"2024-09-14T12:13:38.337413+0000","last_clean":"2024-09-14T12:13:38.337413+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:13:38.337413+0000","last_undegraded":"2024-09-14T12:13:38.337413+0000","last_fullsized":"2024-09-14T12:13:38.337413+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.406649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'277","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.387199+0000","last_change":"2024-09-14T11:17:21.580769+0000","last_active":"2024-09-14T12:13:48.387199+0000","last_peered":"2024-09-14T12:13:48.387199+0000","last_clean":"2024-09-14T12:13:48.387199+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:13:48.387199+0000","last_undegraded":"2024-09-14T12:13:48.387199+0000","last_fullsized":"2024-09-14T12:13:48.387199+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:27.335044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899414,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":604,"num_read_kb":23428,"num_write":1046,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312463+0000","last_change":"2024-09-14T11:17:25.615155+0000","last_active":"2024-09-14T12:13:43.312463+0000","last_peered":"2024-09-14T12:13:43.312463+0000","last_clean":"2024-09-14T12:13:43.312463+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:13:43.312463+0000","last_undegraded":"2024-09-14T12:13:43.312463+0000","last_fullsized":"2024-09-14T12:13:43.312463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.760805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'283","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.209878+0000","last_change":"2024-09-14T11:17:27.634022+0000","last_active":"2024-09-14T12:15:49.209878+0000","last_peered":"2024-09-14T12:15:49.209878+0000","last_clean":"2024-09-14T12:15:49.209878+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:15:49.209878+0000","last_undegraded":"2024-09-14T12:15:49.209878+0000","last_fullsized":"2024-09-14T12:15:49.209878+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:42.665521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62230,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":1018,"num_write":456,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456437+0000","last_change":"2024-09-14T11:17:29.647566+0000","last_active":"2024-09-14T12:13:50.456437+0000","last_peered":"2024-09-14T12:13:50.456437+0000","last_clean":"2024-09-14T12:13:50.456437+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:13:50.456437+0000","last_undegraded":"2024-09-14T12:13:50.456437+0000","last_fullsized":"2024-09-14T12:13:50.456437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:15.794875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'110","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.479972+0000","last_change":"2024-09-14T11:17:31.655541+0000","last_active":"2024-09-14T12:15:38.479972+0000","last_peered":"2024-09-14T12:15:38.479972+0000","last_clean":"2024-09-14T12:15:38.479972+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:15:38.479972+0000","last_undegraded":"2024-09-14T12:15:38.479972+0000","last_fullsized":"2024-09-14T12:15:38.479972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:33.617603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'541","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755553+0000","last_change":"2024-09-14T11:17:23.599981+0000","last_active":"2024-09-14T12:14:02.755553+0000","last_peered":"2024-09-14T12:14:02.755553+0000","last_clean":"2024-09-14T12:14:02.755553+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:14:02.755553+0000","last_undegraded":"2024-09-14T12:14:02.755553+0000","last_fullsized":"2024-09-14T12:14:02.755553+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:03.188860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'340","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344436+0000","last_change":"2024-09-14T11:17:21.582543+0000","last_active":"2024-09-14T12:13:53.344436+0000","last_peered":"2024-09-14T12:13:53.344436+0000","last_clean":"2024-09-14T12:13:53.344436+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:13:53.344436+0000","last_undegraded":"2024-09-14T12:13:53.344436+0000","last_fullsized":"2024-09-14T12:13:53.344436+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:42.560672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10660161,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":695,"num_read_kb":21492,"num_write":1314,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209141+0000","last_change":"2024-09-14T11:17:25.605008+0000","last_active":"2024-09-14T12:13:43.209141+0000","last_peered":"2024-09-14T12:13:43.209141+0000","last_clean":"2024-09-14T12:13:43.209141+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:13:43.209141+0000","last_undegraded":"2024-09-14T12:13:43.209141+0000","last_fullsized":"2024-09-14T12:13:43.209141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:21.712998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'301","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.239456+0000","last_change":"2024-09-14T11:17:27.627740+0000","last_active":"2024-09-14T12:15:49.239456+0000","last_peered":"2024-09-14T12:15:49.239456+0000","last_clean":"2024-09-14T12:15:49.239456+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:15:49.239456+0000","last_undegraded":"2024-09-14T12:15:49.239456+0000","last_fullsized":"2024-09-14T12:15:49.239456+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:01.987766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59739,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":483,"num_read_kb":952,"num_write":386,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'744","reported_seq":2431,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.514434+0000","last_change":"2024-09-14T11:17:29.638832+0000","last_active":"2024-09-14T12:15:52.514434+0000","last_peered":"2024-09-14T12:15:52.514434+0000","last_clean":"2024-09-14T12:15:52.514434+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:15:52.514434+0000","last_undegraded":"2024-09-14T12:15:52.514434+0000","last_fullsized":"2024-09-14T12:15:52.514434+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":701,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:59.704823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'183","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.243227+0000","last_change":"2024-09-14T11:17:31.656014+0000","last_active":"2024-09-14T12:15:49.243227+0000","last_peered":"2024-09-14T12:15:49.243227+0000","last_clean":"2024-09-14T12:15:49.243227+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:15:49.243227+0000","last_undegraded":"2024-09-14T12:15:49.243227+0000","last_fullsized":"2024-09-14T12:15:49.243227+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:31.925155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'786","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337480+0000","last_change":"2024-09-14T11:17:23.594812+0000","last_active":"2024-09-14T12:13:38.337480+0000","last_peered":"2024-09-14T12:13:38.337480+0000","last_clean":"2024-09-14T12:13:38.337480+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:13:38.337480+0000","last_undegraded":"2024-09-14T12:13:38.337480+0000","last_fullsized":"2024-09-14T12:13:38.337480+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:20.279963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'266","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338103+0000","last_change":"2024-09-14T11:17:21.572083+0000","last_active":"2024-09-14T12:13:43.338103+0000","last_peered":"2024-09-14T12:13:43.338103+0000","last_clean":"2024-09-14T12:13:43.338103+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:13:43.338103+0000","last_undegraded":"2024-09-14T12:13:43.338103+0000","last_fullsized":"2024-09-14T12:13:43.338103+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:13.146982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6951881,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":413,"num_read_kb":54221,"num_write":900,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.187936+0000","last_change":"2024-09-14T11:17:25.619652+0000","last_active":"2024-09-14T12:15:49.187936+0000","last_peered":"2024-09-14T12:15:49.187936+0000","last_clean":"2024-09-14T12:15:49.187936+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:15:49.187936+0000","last_undegraded":"2024-09-14T12:15:49.187936+0000","last_fullsized":"2024-09-14T12:15:49.187936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:20.219288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219434+0000","last_change":"2024-09-14T11:17:27.632484+0000","last_active":"2024-09-14T12:13:43.219434+0000","last_peered":"2024-09-14T12:13:43.219434+0000","last_clean":"2024-09-14T12:13:43.219434+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:13:43.219434+0000","last_undegraded":"2024-09-14T12:13:43.219434+0000","last_fullsized":"2024-09-14T12:13:43.219434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'779","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.516405+0000","last_change":"2024-09-14T11:17:29.640978+0000","last_active":"2024-09-14T12:15:52.516405+0000","last_peered":"2024-09-14T12:15:52.516405+0000","last_clean":"2024-09-14T12:15:52.516405+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:15:52.516405+0000","last_undegraded":"2024-09-14T12:15:52.516405+0000","last_fullsized":"2024-09-14T12:15:52.516405+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":702,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.396632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.764408+0000","last_change":"2024-09-14T11:17:31.656199+0000","last_active":"2024-09-14T12:14:33.764408+0000","last_peered":"2024-09-14T12:14:33.764408+0000","last_clean":"2024-09-14T12:14:33.764408+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:14:33.764408+0000","last_undegraded":"2024-09-14T12:14:33.764408+0000","last_fullsized":"2024-09-14T12:14:33.764408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:30.802461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'446","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210300+0000","last_change":"2024-09-14T11:17:23.603828+0000","last_active":"2024-09-14T12:14:31.210300+0000","last_peered":"2024-09-14T12:14:31.210300+0000","last_clean":"2024-09-14T12:14:31.210300+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:14:31.210300+0000","last_undegraded":"2024-09-14T12:14:31.210300+0000","last_fullsized":"2024-09-14T12:14:31.210300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:37.153834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'272","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219327+0000","last_change":"2024-09-14T11:17:21.585341+0000","last_active":"2024-09-14T12:13:43.219327+0000","last_peered":"2024-09-14T12:13:43.219327+0000","last_clean":"2024-09-14T12:13:43.219327+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:13:43.219327+0000","last_undegraded":"2024-09-14T12:13:43.219327+0000","last_fullsized":"2024-09-14T12:13:43.219327+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:02.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5522412,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":470,"num_read_kb":11146,"num_write":1013,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338261+0000","last_change":"2024-09-14T11:17:25.616843+0000","last_active":"2024-09-14T12:13:43.338261+0000","last_peered":"2024-09-14T12:13:43.338261+0000","last_clean":"2024-09-14T12:13:43.338261+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:13:43.338261+0000","last_undegraded":"2024-09-14T12:13:43.338261+0000","last_fullsized":"2024-09-14T12:13:43.338261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:24.981755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'359","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.224639+0000","last_change":"2024-09-14T11:17:27.635744+0000","last_active":"2024-09-14T12:15:49.224639+0000","last_peered":"2024-09-14T12:15:49.224639+0000","last_clean":"2024-09-14T12:15:49.224639+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:15:49.224639+0000","last_undegraded":"2024-09-14T12:15:49.224639+0000","last_fullsized":"2024-09-14T12:15:49.224639+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:39.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59251,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":576,"num_read_kb":1082,"num_write":460,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.343756+0000","last_change":"2024-09-14T11:17:29.646394+0000","last_active":"2024-09-14T12:13:48.343756+0000","last_peered":"2024-09-14T12:13:48.343756+0000","last_clean":"2024-09-14T12:13:48.343756+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:13:48.343756+0000","last_undegraded":"2024-09-14T12:13:48.343756+0000","last_fullsized":"2024-09-14T12:13:48.343756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:23.198544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'153","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.201239+0000","last_change":"2024-09-14T11:17:31.657114+0000","last_active":"2024-09-14T12:14:31.201239+0000","last_peered":"2024-09-14T12:14:31.201239+0000","last_clean":"2024-09-14T12:14:31.201239+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:14:31.201239+0000","last_undegraded":"2024-09-14T12:14:31.201239+0000","last_fullsized":"2024-09-14T12:14:31.201239+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:58.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'834","reported_seq":2361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.529186+0000","last_change":"2024-09-14T11:17:23.599852+0000","last_active":"2024-09-14T12:13:48.529186+0000","last_peered":"2024-09-14T12:13:48.529186+0000","last_clean":"2024-09-14T12:13:48.529186+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:13:48.529186+0000","last_undegraded":"2024-09-14T12:13:48.529186+0000","last_fullsized":"2024-09-14T12:13:48.529186+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:20.678363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.465508+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T12:13:13.465508+0000","last_peered":"2024-09-14T12:13:13.465508+0000","last_clean":"2024-09-14T12:13:13.465508+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:13:13.465508+0000","last_undegraded":"2024-09-14T12:13:13.465508+0000","last_fullsized":"2024-09-14T12:13:13.465508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221784+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T12:13:28.221784+0000","last_peered":"2024-09-14T12:13:28.221784+0000","last_clean":"2024-09-14T12:13:28.221784+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:13:28.221784+0000","last_undegraded":"2024-09-14T12:13:28.221784+0000","last_fullsized":"2024-09-14T12:13:28.221784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'286","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:59.802403+0000","last_change":"2024-09-14T11:17:21.591302+0000","last_active":"2024-09-14T12:13:59.802403+0000","last_peered":"2024-09-14T12:13:59.802403+0000","last_clean":"2024-09-14T12:13:59.802403+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:13:59.802403+0000","last_undegraded":"2024-09-14T12:13:59.802403+0000","last_fullsized":"2024-09-14T12:13:59.802403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:29.565797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5920202,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":537,"num_read_kb":16920,"num_write":1021,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470216+0000","last_change":"2024-09-14T11:17:25.613638+0000","last_active":"2024-09-14T12:13:43.470216+0000","last_peered":"2024-09-14T12:13:43.470216+0000","last_clean":"2024-09-14T12:13:43.470216+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:13:43.470216+0000","last_undegraded":"2024-09-14T12:13:43.470216+0000","last_fullsized":"2024-09-14T12:13:43.470216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:59.751658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'747","reported_seq":1433,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.237428+0000","last_change":"2024-09-14T11:17:27.633577+0000","last_active":"2024-09-14T12:15:49.237428+0000","last_peered":"2024-09-14T12:15:49.237428+0000","last_clean":"2024-09-14T12:15:49.237428+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:15:49.237428+0000","last_undegraded":"2024-09-14T12:15:49.237428+0000","last_fullsized":"2024-09-14T12:15:49.237428+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.125363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1448,"num_read_kb":3032,"num_write":1382,"num_write_kb":1242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456404+0000","last_change":"2024-09-14T11:17:29.646281+0000","last_active":"2024-09-14T12:13:50.456404+0000","last_peered":"2024-09-14T12:13:50.456404+0000","last_clean":"2024-09-14T12:13:50.456404+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:13:50.456404+0000","last_undegraded":"2024-09-14T12:13:50.456404+0000","last_fullsized":"2024-09-14T12:13:50.456404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:03.727278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'170","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.634305+0000","last_change":"2024-09-14T11:17:31.655031+0000","last_active":"2024-09-14T12:14:34.634305+0000","last_peered":"2024-09-14T12:14:34.634305+0000","last_clean":"2024-09-14T12:14:34.634305+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:14:34.634305+0000","last_undegraded":"2024-09-14T12:14:34.634305+0000","last_fullsized":"2024-09-14T12:14:34.634305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:19.605574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'459","reported_seq":2050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208300+0000","last_change":"2024-09-14T11:17:23.599920+0000","last_active":"2024-09-14T12:14:31.208300+0000","last_peered":"2024-09-14T12:14:31.208300+0000","last_clean":"2024-09-14T12:14:31.208300+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:14:31.208300+0000","last_undegraded":"2024-09-14T12:14:31.208300+0000","last_fullsized":"2024-09-14T12:14:31.208300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:33.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466357+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T12:13:18.466357+0000","last_peered":"2024-09-14T12:13:18.466357+0000","last_clean":"2024-09-14T12:13:18.466357+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:13:18.466357+0000","last_undegraded":"2024-09-14T12:13:18.466357+0000","last_fullsized":"2024-09-14T12:13:18.466357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'306","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.117145+0000","last_change":"2024-09-14T11:17:21.582410+0000","last_active":"2024-09-14T12:13:42.117145+0000","last_peered":"2024-09-14T12:13:42.117145+0000","last_clean":"2024-09-14T12:13:42.117145+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:13:42.117145+0000","last_undegraded":"2024-09-14T12:13:42.117145+0000","last_fullsized":"2024-09-14T12:13:42.117145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:19.881583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730149,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":574,"num_read_kb":9080,"num_write":1205,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.224869+0000","last_change":"2024-09-14T11:17:25.617276+0000","last_active":"2024-09-14T12:13:48.224869+0000","last_peered":"2024-09-14T12:13:48.224869+0000","last_clean":"2024-09-14T12:13:48.224869+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:13:48.224869+0000","last_undegraded":"2024-09-14T12:13:48.224869+0000","last_fullsized":"2024-09-14T12:13:48.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:50.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1285","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.254822+0000","last_change":"2024-09-14T11:17:27.631903+0000","last_active":"2024-09-14T12:15:49.254822+0000","last_peered":"2024-09-14T12:15:49.254822+0000","last_clean":"2024-09-14T12:15:49.254822+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:15:49.254822+0000","last_undegraded":"2024-09-14T12:15:49.254822+0000","last_fullsized":"2024-09-14T12:15:49.254822+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:33.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":259105,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2005,"num_read_kb":3622,"num_write":1136,"num_write_kb":1057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471608+0000","last_change":"2024-09-14T11:17:29.645394+0000","last_active":"2024-09-14T12:13:53.471608+0000","last_peered":"2024-09-14T12:13:53.471608+0000","last_clean":"2024-09-14T12:13:53.471608+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:13:53.471608+0000","last_undegraded":"2024-09-14T12:13:53.471608+0000","last_fullsized":"2024-09-14T12:13:53.471608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:49.499047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211448+0000","last_change":"2024-09-14T11:17:31.658892+0000","last_active":"2024-09-14T12:14:03.211448+0000","last_peered":"2024-09-14T12:14:03.211448+0000","last_clean":"2024-09-14T12:14:03.211448+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:14:03.211448+0000","last_undegraded":"2024-09-14T12:14:03.211448+0000","last_fullsized":"2024-09-14T12:14:03.211448+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:34.868207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'656","reported_seq":2304,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606004+0000","last_change":"2024-09-14T11:17:23.597525+0000","last_active":"2024-09-14T12:14:34.606004+0000","last_peered":"2024-09-14T12:14:34.606004+0000","last_clean":"2024-09-14T12:14:34.606004+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:14:34.606004+0000","last_undegraded":"2024-09-14T12:14:34.606004+0000","last_fullsized":"2024-09-14T12:14:34.606004+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:35.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.310703+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T12:13:28.310703+0000","last_peered":"2024-09-14T12:13:28.310703+0000","last_clean":"2024-09-14T12:13:28.310703+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:13:28.310703+0000","last_undegraded":"2024-09-14T12:13:28.310703+0000","last_fullsized":"2024-09-14T12:13:28.310703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'302","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.739230+0000","last_change":"2024-09-14T11:17:21.573767+0000","last_active":"2024-09-14T12:15:43.739230+0000","last_peered":"2024-09-14T12:15:43.739230+0000","last_clean":"2024-09-14T12:15:43.739230+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:15:43.739230+0000","last_undegraded":"2024-09-14T12:15:43.739230+0000","last_fullsized":"2024-09-14T12:15:43.739230+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:55.914740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14553424,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":614,"num_read_kb":56413,"num_write":1078,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312976+0000","last_change":"2024-09-14T11:17:25.616518+0000","last_active":"2024-09-14T12:13:48.312976+0000","last_peered":"2024-09-14T12:13:48.312976+0000","last_clean":"2024-09-14T12:13:48.312976+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:13:48.312976+0000","last_undegraded":"2024-09-14T12:13:48.312976+0000","last_fullsized":"2024-09-14T12:13:48.312976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:31.140976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'258","reported_seq":1503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.376331+0000","last_change":"2024-09-14T11:17:27.633187+0000","last_active":"2024-09-14T12:15:49.376331+0000","last_peered":"2024-09-14T12:15:49.376331+0000","last_clean":"2024-09-14T12:15:49.376331+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:15:49.376331+0000","last_undegraded":"2024-09-14T12:15:49.376331+0000","last_fullsized":"2024-09-14T12:15:49.376331+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.161248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455781+0000","last_change":"2024-09-14T11:17:29.647473+0000","last_active":"2024-09-14T12:13:45.455781+0000","last_peered":"2024-09-14T12:13:45.455781+0000","last_clean":"2024-09-14T12:13:45.455781+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:13:45.455781+0000","last_undegraded":"2024-09-14T12:13:45.455781+0000","last_fullsized":"2024-09-14T12:13:45.455781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:28.646908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'797","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.930217+0000","last_change":"2024-09-14T11:17:23.593249+0000","last_active":"2024-09-14T12:13:46.930217+0000","last_peered":"2024-09-14T12:13:46.930217+0000","last_clean":"2024-09-14T12:13:46.930217+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:13:46.930217+0000","last_undegraded":"2024-09-14T12:13:46.930217+0000","last_fullsized":"2024-09-14T12:13:46.930217+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:29.005386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221722+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T12:13:28.221722+0000","last_peered":"2024-09-14T12:13:28.221722+0000","last_clean":"2024-09-14T12:13:28.221722+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:13:28.221722+0000","last_undegraded":"2024-09-14T12:13:28.221722+0000","last_fullsized":"2024-09-14T12:13:28.221722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'349","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.745606+0000","last_change":"2024-09-14T11:17:55.703523+0000","last_active":"2024-09-14T12:13:38.745606+0000","last_peered":"2024-09-14T12:13:38.745606+0000","last_clean":"2024-09-14T12:13:38.745606+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:13:38.745606+0000","last_undegraded":"2024-09-14T12:13:38.745606+0000","last_fullsized":"2024-09-14T12:13:38.745606+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.352121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16087121,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":660,"num_read_kb":100618,"num_write":1288,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.188503+0000","last_change":"2024-09-14T11:17:25.612572+0000","last_active":"2024-09-14T12:15:49.188503+0000","last_peered":"2024-09-14T12:15:49.188503+0000","last_clean":"2024-09-14T12:15:49.188503+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:15:49.188503+0000","last_undegraded":"2024-09-14T12:15:49.188503+0000","last_fullsized":"2024-09-14T12:15:49.188503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:50.762349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":724,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'141","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.389956+0000","last_change":"2024-09-14T11:17:27.629622+0000","last_active":"2024-09-14T12:15:49.389956+0000","last_peered":"2024-09-14T12:15:49.389956+0000","last_clean":"2024-09-14T12:15:49.389956+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:15:49.389956+0000","last_undegraded":"2024-09-14T12:15:49.389956+0000","last_fullsized":"2024-09-14T12:15:49.389956+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:36.891527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344480+0000","last_change":"2024-09-14T11:17:29.643346+0000","last_active":"2024-09-14T12:13:53.344480+0000","last_peered":"2024-09-14T12:13:53.344480+0000","last_clean":"2024-09-14T12:13:53.344480+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:13:53.344480+0000","last_undegraded":"2024-09-14T12:13:53.344480+0000","last_fullsized":"2024-09-14T12:13:53.344480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:54.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'152","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225431+0000","last_change":"2024-09-14T11:17:31.658341+0000","last_active":"2024-09-14T12:13:53.225431+0000","last_peered":"2024-09-14T12:13:53.225431+0000","last_clean":"2024-09-14T12:13:53.225431+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:13:53.225431+0000","last_undegraded":"2024-09-14T12:13:53.225431+0000","last_fullsized":"2024-09-14T12:13:53.225431+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:31.293556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'538","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771726+0000","last_change":"2024-09-14T11:17:23.595767+0000","last_active":"2024-09-14T12:14:33.771726+0000","last_peered":"2024-09-14T12:14:33.771726+0000","last_clean":"2024-09-14T12:14:33.771726+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:14:33.771726+0000","last_undegraded":"2024-09-14T12:14:33.771726+0000","last_fullsized":"2024-09-14T12:14:33.771726+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:17.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'299","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225524+0000","last_change":"2024-09-14T11:17:21.587230+0000","last_active":"2024-09-14T12:13:53.225524+0000","last_peered":"2024-09-14T12:13:53.225524+0000","last_clean":"2024-09-14T12:13:53.225524+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:13:53.225524+0000","last_undegraded":"2024-09-14T12:13:53.225524+0000","last_fullsized":"2024-09-14T12:13:53.225524+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:54.075546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280479,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":539,"num_read_kb":15898,"num_write":1106,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207418+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T12:13:28.207418+0000","last_peered":"2024-09-14T12:13:28.207418+0000","last_clean":"2024-09-14T12:13:28.207418+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:13:28.207418+0000","last_undegraded":"2024-09-14T12:13:28.207418+0000","last_fullsized":"2024-09-14T12:13:28.207418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455178+0000","last_change":"2024-09-14T11:17:25.613788+0000","last_active":"2024-09-14T12:13:40.455178+0000","last_peered":"2024-09-14T12:13:40.455178+0000","last_clean":"2024-09-14T12:13:40.455178+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:13:40.455178+0000","last_undegraded":"2024-09-14T12:13:40.455178+0000","last_fullsized":"2024-09-14T12:13:40.455178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:16.381616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'586","reported_seq":1248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.218406+0000","last_change":"2024-09-14T11:17:27.638848+0000","last_active":"2024-09-14T12:15:49.218406+0000","last_peered":"2024-09-14T12:15:49.218406+0000","last_clean":"2024-09-14T12:15:49.218406+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:15:49.218406+0000","last_undegraded":"2024-09-14T12:15:49.218406+0000","last_fullsized":"2024-09-14T12:15:49.218406+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.865878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104200,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1639,"num_read_kb":2569,"num_write":2206,"num_write_kb":2029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339077+0000","last_change":"2024-09-14T11:17:29.647531+0000","last_active":"2024-09-14T12:13:48.339077+0000","last_peered":"2024-09-14T12:13:48.339077+0000","last_clean":"2024-09-14T12:13:48.339077+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:13:48.339077+0000","last_undegraded":"2024-09-14T12:13:48.339077+0000","last_fullsized":"2024-09-14T12:13:48.339077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:29.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.737717+0000","last_change":"2024-09-14T11:17:31.650597+0000","last_active":"2024-09-14T12:14:31.737717+0000","last_peered":"2024-09-14T12:14:31.737717+0000","last_clean":"2024-09-14T12:14:31.737717+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:14:31.737717+0000","last_undegraded":"2024-09-14T12:14:31.737717+0000","last_fullsized":"2024-09-14T12:14:31.737717+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:24.077884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'812","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503663+0000","last_change":"2024-09-14T11:17:23.597119+0000","last_active":"2024-09-14T12:15:18.503663+0000","last_peered":"2024-09-14T12:15:18.503663+0000","last_clean":"2024-09-14T12:15:18.503663+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:15:18.503663+0000","last_undegraded":"2024-09-14T12:15:18.503663+0000","last_fullsized":"2024-09-14T12:15:18.503663+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:41.357900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.208536+0000","last_change":"2024-09-14T11:17:21.572174+0000","last_active":"2024-09-14T12:13:38.208536+0000","last_peered":"2024-09-14T12:13:38.208536+0000","last_clean":"2024-09-14T12:13:38.208536+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:13:38.208536+0000","last_undegraded":"2024-09-14T12:13:38.208536+0000","last_fullsized":"2024-09-14T12:13:38.208536+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:44.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6367698,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":735,"num_read_kb":26393,"num_write":1206,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468686+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T12:13:33.468686+0000","last_peered":"2024-09-14T12:13:33.468686+0000","last_clean":"2024-09-14T12:13:33.468686+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:13:33.468686+0000","last_undegraded":"2024-09-14T12:13:33.468686+0000","last_fullsized":"2024-09-14T12:13:33.468686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455177+0000","last_change":"2024-09-14T11:17:25.613944+0000","last_active":"2024-09-14T12:13:43.455177+0000","last_peered":"2024-09-14T12:13:43.455177+0000","last_clean":"2024-09-14T12:13:43.455177+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:13:43.455177+0000","last_undegraded":"2024-09-14T12:13:43.455177+0000","last_fullsized":"2024-09-14T12:13:43.455177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.612668+0000","last_change":"2024-09-14T11:17:27.630067+0000","last_active":"2024-09-14T12:14:34.612668+0000","last_peered":"2024-09-14T12:14:34.612668+0000","last_clean":"2024-09-14T12:14:34.612668+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:14:34.612668+0000","last_undegraded":"2024-09-14T12:14:34.612668+0000","last_fullsized":"2024-09-14T12:14:34.612668+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:12.127579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'807","reported_seq":6805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.257470+0000","last_change":"2024-09-14T11:17:29.642605+0000","last_active":"2024-09-14T12:15:49.257470+0000","last_peered":"2024-09-14T12:15:49.257470+0000","last_clean":"2024-09-14T12:15:49.257470+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:15:49.257470+0000","last_undegraded":"2024-09-14T12:15:49.257470+0000","last_fullsized":"2024-09-14T12:15:49.257470+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:10.588277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'138","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.221695+0000","last_change":"2024-09-14T11:17:31.658974+0000","last_active":"2024-09-14T12:14:03.221695+0000","last_peered":"2024-09-14T12:14:03.221695+0000","last_clean":"2024-09-14T12:14:03.221695+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:14:03.221695+0000","last_undegraded":"2024-09-14T12:14:03.221695+0000","last_fullsized":"2024-09-14T12:14:03.221695+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:06.184401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1159","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.578456+0000","last_change":"2024-09-14T11:17:23.594825+0000","last_active":"2024-09-14T12:13:55.578456+0000","last_peered":"2024-09-14T12:13:55.578456+0000","last_clean":"2024-09-14T12:13:55.578456+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:13:55.578456+0000","last_undegraded":"2024-09-14T12:13:55.578456+0000","last_fullsized":"2024-09-14T12:13:55.578456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":1100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:08.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'256","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219480+0000","last_change":"2024-09-14T11:17:21.588659+0000","last_active":"2024-09-14T12:13:43.219480+0000","last_peered":"2024-09-14T12:13:43.219480+0000","last_clean":"2024-09-14T12:13:43.219480+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:13:43.219480+0000","last_undegraded":"2024-09-14T12:13:43.219480+0000","last_fullsized":"2024-09-14T12:13:43.219480+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:03.346229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4470127,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":464,"num_read_kb":24953,"num_write":865,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.208010+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T12:13:33.208010+0000","last_peered":"2024-09-14T12:13:33.208010+0000","last_clean":"2024-09-14T12:13:33.208010+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:13:33.208010+0000","last_undegraded":"2024-09-14T12:13:33.208010+0000","last_fullsized":"2024-09-14T12:13:33.208010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338159+0000","last_change":"2024-09-14T11:17:25.612971+0000","last_active":"2024-09-14T12:13:43.338159+0000","last_peered":"2024-09-14T12:13:43.338159+0000","last_clean":"2024-09-14T12:13:43.338159+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:13:43.338159+0000","last_undegraded":"2024-09-14T12:13:43.338159+0000","last_fullsized":"2024-09-14T12:13:43.338159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:01.406616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'112","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338189+0000","last_change":"2024-09-14T11:17:27.630261+0000","last_active":"2024-09-14T12:13:43.338189+0000","last_peered":"2024-09-14T12:13:43.338189+0000","last_clean":"2024-09-14T12:13:43.338189+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:13:43.338189+0000","last_undegraded":"2024-09-14T12:13:43.338189+0000","last_fullsized":"2024-09-14T12:13:43.338189+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:38.765597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'798","reported_seq":2498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.518226+0000","last_change":"2024-09-14T11:17:29.646106+0000","last_active":"2024-09-14T12:15:52.518226+0000","last_peered":"2024-09-14T12:15:52.518226+0000","last_clean":"2024-09-14T12:15:52.518226+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:15:52.518226+0000","last_undegraded":"2024-09-14T12:15:52.518226+0000","last_fullsized":"2024-09-14T12:15:52.518226+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.541372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'195","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.076897+0000","last_change":"2024-09-14T11:17:31.656972+0000","last_active":"2024-09-14T12:14:33.076897+0000","last_peered":"2024-09-14T12:14:33.076897+0000","last_clean":"2024-09-14T12:14:33.076897+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:14:33.076897+0000","last_undegraded":"2024-09-14T12:14:33.076897+0000","last_fullsized":"2024-09-14T12:14:33.076897+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:57.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619317+0000","last_change":"2024-09-14T11:17:23.593644+0000","last_active":"2024-09-14T12:13:57.619317+0000","last_peered":"2024-09-14T12:13:57.619317+0000","last_clean":"2024-09-14T12:13:57.619317+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:13:57.619317+0000","last_undegraded":"2024-09-14T12:13:57.619317+0000","last_fullsized":"2024-09-14T12:13:57.619317+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:42.299861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'336","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455823+0000","last_change":"2024-09-14T11:17:21.581527+0000","last_active":"2024-09-14T12:13:45.455823+0000","last_peered":"2024-09-14T12:13:45.455823+0000","last_clean":"2024-09-14T12:13:45.455823+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:13:45.455823+0000","last_undegraded":"2024-09-14T12:13:45.455823+0000","last_fullsized":"2024-09-14T12:13:45.455823+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:36.511139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3691887,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":559,"num_read_kb":7690,"num_write":1039,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453887+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T12:13:33.453887+0000","last_peered":"2024-09-14T12:13:33.453887+0000","last_clean":"2024-09-14T12:13:33.453887+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:13:33.453887+0000","last_undegraded":"2024-09-14T12:13:33.453887+0000","last_fullsized":"2024-09-14T12:13:33.453887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219350+0000","last_change":"2024-09-14T11:17:25.617838+0000","last_active":"2024-09-14T12:13:43.219350+0000","last_peered":"2024-09-14T12:13:43.219350+0000","last_clean":"2024-09-14T12:13:43.219350+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:13:43.219350+0000","last_undegraded":"2024-09-14T12:13:43.219350+0000","last_fullsized":"2024-09-14T12:13:43.219350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.722602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'704","reported_seq":1413,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.214861+0000","last_change":"2024-09-14T11:17:27.628721+0000","last_active":"2024-09-14T12:15:49.214861+0000","last_peered":"2024-09-14T12:15:49.214861+0000","last_clean":"2024-09-14T12:15:49.214861+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:15:49.214861+0000","last_undegraded":"2024-09-14T12:15:49.214861+0000","last_fullsized":"2024-09-14T12:15:49.214861+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:43.091580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167981,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1237,"num_read_kb":2632,"num_write":1012,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219994+0000","last_change":"2024-09-14T11:17:29.643858+0000","last_active":"2024-09-14T12:13:48.219994+0000","last_peered":"2024-09-14T12:13:48.219994+0000","last_clean":"2024-09-14T12:13:48.219994+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:13:48.219994+0000","last_undegraded":"2024-09-14T12:13:48.219994+0000","last_fullsized":"2024-09-14T12:13:48.219994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.290912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'112","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.590948+0000","last_change":"2024-09-14T11:17:31.659136+0000","last_active":"2024-09-14T12:14:34.590948+0000","last_peered":"2024-09-14T12:14:34.590948+0000","last_clean":"2024-09-14T12:14:34.590948+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:14:34.590948+0000","last_undegraded":"2024-09-14T12:14:34.590948+0000","last_fullsized":"2024-09-14T12:14:34.590948+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:30.679212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'154","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.818840+0000","last_change":"2024-09-14T11:17:31.657903+0000","last_active":"2024-09-14T12:14:34.818840+0000","last_peered":"2024-09-14T12:14:34.818840+0000","last_clean":"2024-09-14T12:14:34.818840+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:14:34.818840+0000","last_undegraded":"2024-09-14T12:14:34.818840+0000","last_fullsized":"2024-09-14T12:14:34.818840+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:29.439862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'376","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.886093+0000","last_change":"2024-09-14T11:17:23.593275+0000","last_active":"2024-09-14T12:13:38.886093+0000","last_peered":"2024-09-14T12:13:38.886093+0000","last_clean":"2024-09-14T12:13:38.886093+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:13:38.886093+0000","last_undegraded":"2024-09-14T12:13:38.886093+0000","last_fullsized":"2024-09-14T12:13:38.886093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:51.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'293","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.336037+0000","last_change":"2024-09-14T11:17:21.585438+0000","last_active":"2024-09-14T12:13:28.336037+0000","last_peered":"2024-09-14T12:13:28.336037+0000","last_clean":"2024-09-14T12:13:28.336037+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:13:28.336037+0000","last_undegraded":"2024-09-14T12:13:28.336037+0000","last_fullsized":"2024-09-14T12:13:28.336037+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:54.991062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049101,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":641,"num_read_kb":30194,"num_write":1071,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.962929+0000","last_change":"2024-09-14T11:17:25.614818+0000","last_active":"2024-09-14T12:15:48.962929+0000","last_peered":"2024-09-14T12:15:48.962929+0000","last_clean":"2024-09-14T12:15:48.962929+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:15:48.962929+0000","last_undegraded":"2024-09-14T12:15:48.962929+0000","last_fullsized":"2024-09-14T12:15:48.962929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.190710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'294","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236190+0000","last_change":"2024-09-14T11:17:27.630446+0000","last_active":"2024-09-14T12:15:48.236190+0000","last_peered":"2024-09-14T12:15:48.236190+0000","last_clean":"2024-09-14T12:15:48.236190+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:15:48.236190+0000","last_undegraded":"2024-09-14T12:15:48.236190+0000","last_fullsized":"2024-09-14T12:15:48.236190+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:50.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66272,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1020,"num_write":404,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.218125+0000","last_change":"2024-09-14T11:17:29.645258+0000","last_active":"2024-09-14T12:13:33.218125+0000","last_peered":"2024-09-14T12:13:33.218125+0000","last_clean":"2024-09-14T12:13:33.218125+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:13:33.218125+0000","last_undegraded":"2024-09-14T12:13:33.218125+0000","last_fullsized":"2024-09-14T12:13:33.218125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:46.921971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'432","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605972+0000","last_change":"2024-09-14T11:17:23.600768+0000","last_active":"2024-09-14T12:14:34.605972+0000","last_peered":"2024-09-14T12:14:34.605972+0000","last_clean":"2024-09-14T12:14:34.605972+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:14:34.605972+0000","last_undegraded":"2024-09-14T12:14:34.605972+0000","last_fullsized":"2024-09-14T12:14:34.605972+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:12.282064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'317","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.463351+0000","last_change":"2024-09-14T11:17:21.581055+0000","last_active":"2024-09-14T12:12:58.463351+0000","last_peered":"2024-09-14T12:12:58.463351+0000","last_clean":"2024-09-14T12:12:58.463351+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:12:58.463351+0000","last_undegraded":"2024-09-14T12:12:58.463351+0000","last_fullsized":"2024-09-14T12:12:58.463351+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.405999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2349190,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":512,"num_read_kb":23221,"num_write":1133,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.217660+0000","last_change":"2024-09-14T11:17:25.615312+0000","last_active":"2024-09-14T12:13:28.217660+0000","last_peered":"2024-09-14T12:13:28.217660+0000","last_clean":"2024-09-14T12:13:28.217660+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:13:28.217660+0000","last_undegraded":"2024-09-14T12:13:28.217660+0000","last_fullsized":"2024-09-14T12:13:28.217660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:18.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.936226+0000","last_change":"2024-09-14T11:17:27.636113+0000","last_active":"2024-09-14T12:13:46.936226+0000","last_peered":"2024-09-14T12:13:46.936226+0000","last_clean":"2024-09-14T12:13:46.936226+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:13:46.936226+0000","last_undegraded":"2024-09-14T12:13:46.936226+0000","last_fullsized":"2024-09-14T12:13:46.936226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:28.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468624+0000","last_change":"2024-09-14T11:17:29.642497+0000","last_active":"2024-09-14T12:13:33.468624+0000","last_peered":"2024-09-14T12:13:33.468624+0000","last_clean":"2024-09-14T12:13:33.468624+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:13:33.468624+0000","last_undegraded":"2024-09-14T12:13:33.468624+0000","last_fullsized":"2024-09-14T12:13:33.468624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:18.572740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.825413+0000","last_change":"2024-09-14T11:17:31.655716+0000","last_active":"2024-09-14T12:14:33.825413+0000","last_peered":"2024-09-14T12:14:33.825413+0000","last_clean":"2024-09-14T12:14:33.825413+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:14:33.825413+0000","last_undegraded":"2024-09-14T12:14:33.825413+0000","last_fullsized":"2024-09-14T12:14:33.825413+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:00.360800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'491","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.116559+0000","last_change":"2024-09-14T11:17:23.601965+0000","last_active":"2024-09-14T12:15:48.116559+0000","last_peered":"2024-09-14T12:15:48.116559+0000","last_clean":"2024-09-14T12:15:48.116559+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:15:48.116559+0000","last_undegraded":"2024-09-14T12:15:48.116559+0000","last_fullsized":"2024-09-14T12:15:48.116559+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:59.504121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'290","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:22.843550+0000","last_change":"2024-09-14T11:17:21.589616+0000","last_active":"2024-09-14T12:13:22.843550+0000","last_peered":"2024-09-14T12:13:22.843550+0000","last_clean":"2024-09-14T12:13:22.843550+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:13:22.843550+0000","last_undegraded":"2024-09-14T12:13:22.843550+0000","last_fullsized":"2024-09-14T12:13:22.843550+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:27.751657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14192749,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":584,"num_read_kb":51938,"num_write":1037,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.467979+0000","last_change":"2024-09-14T11:17:25.617478+0000","last_active":"2024-09-14T12:13:28.467979+0000","last_peered":"2024-09-14T12:13:28.467979+0000","last_clean":"2024-09-14T12:13:28.467979+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:13:28.467979+0000","last_undegraded":"2024-09-14T12:13:28.467979+0000","last_fullsized":"2024-09-14T12:13:28.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:19.271955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236218+0000","last_change":"2024-09-14T11:17:27.636107+0000","last_active":"2024-09-14T12:15:48.236218+0000","last_peered":"2024-09-14T12:15:48.236218+0000","last_clean":"2024-09-14T12:15:48.236218+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:15:48.236218+0000","last_undegraded":"2024-09-14T12:15:48.236218+0000","last_fullsized":"2024-09-14T12:15:48.236218+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:04.296570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1069,"num_write":430,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453820+0000","last_change":"2024-09-14T11:17:29.643307+0000","last_active":"2024-09-14T12:13:33.453820+0000","last_peered":"2024-09-14T12:13:33.453820+0000","last_clean":"2024-09-14T12:13:33.453820+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:13:33.453820+0000","last_undegraded":"2024-09-14T12:13:33.453820+0000","last_fullsized":"2024-09-14T12:13:33.453820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:35.656780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.811510+0000","last_change":"2024-09-14T11:17:31.659547+0000","last_active":"2024-09-14T12:13:42.811510+0000","last_peered":"2024-09-14T12:13:42.811510+0000","last_clean":"2024-09-14T12:13:42.811510+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:13:42.811510+0000","last_undegraded":"2024-09-14T12:13:42.811510+0000","last_fullsized":"2024-09-14T12:13:42.811510+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:01.530736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'927","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208965+0000","last_change":"2024-09-14T11:17:23.598429+0000","last_active":"2024-09-14T12:14:31.208965+0000","last_peered":"2024-09-14T12:14:31.208965+0000","last_clean":"2024-09-14T12:14:31.208965+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:14:31.208965+0000","last_undegraded":"2024-09-14T12:14:31.208965+0000","last_fullsized":"2024-09-14T12:14:31.208965+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.669362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'282","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.849222+0000","last_change":"2024-09-14T11:17:21.587300+0000","last_active":"2024-09-14T12:14:28.849222+0000","last_peered":"2024-09-14T12:14:28.849222+0000","last_clean":"2024-09-14T12:14:28.849222+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:14:28.849222+0000","last_undegraded":"2024-09-14T12:14:28.849222+0000","last_fullsized":"2024-09-14T12:14:28.849222+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:29.886995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7128357,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":600,"num_read_kb":18788,"num_write":1048,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453138+0000","last_change":"2024-09-14T11:17:25.614842+0000","last_active":"2024-09-14T12:13:28.453138+0000","last_peered":"2024-09-14T12:13:28.453138+0000","last_clean":"2024-09-14T12:13:28.453138+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:13:28.453138+0000","last_undegraded":"2024-09-14T12:13:28.453138+0000","last_fullsized":"2024-09-14T12:13:28.453138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:42.011559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'298","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.488988+0000","last_change":"2024-09-14T11:17:27.628464+0000","last_active":"2024-09-14T12:15:48.488988+0000","last_peered":"2024-09-14T12:15:48.488988+0000","last_clean":"2024-09-14T12:15:48.488988+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:15:48.488988+0000","last_undegraded":"2024-09-14T12:15:48.488988+0000","last_fullsized":"2024-09-14T12:15:48.488988+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.155512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":1097,"num_write":412,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453988+0000","last_change":"2024-09-14T11:17:29.647028+0000","last_active":"2024-09-14T12:13:30.453988+0000","last_peered":"2024-09-14T12:13:30.453988+0000","last_clean":"2024-09-14T12:13:30.453988+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:13:30.453988+0000","last_undegraded":"2024-09-14T12:13:30.453988+0000","last_fullsized":"2024-09-14T12:13:30.453988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:25.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'446","reported_seq":2072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208631+0000","last_change":"2024-09-14T11:17:23.593931+0000","last_active":"2024-09-14T12:14:31.208631+0000","last_peered":"2024-09-14T12:14:31.208631+0000","last_clean":"2024-09-14T12:14:31.208631+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:14:31.208631+0000","last_undegraded":"2024-09-14T12:14:31.208631+0000","last_fullsized":"2024-09-14T12:14:31.208631+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:31.575674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'271","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213772+0000","last_change":"2024-09-14T11:17:21.580778+0000","last_active":"2024-09-14T12:12:58.213772+0000","last_peered":"2024-09-14T12:12:58.213772+0000","last_clean":"2024-09-14T12:12:58.213772+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:12:58.213772+0000","last_undegraded":"2024-09-14T12:12:58.213772+0000","last_fullsized":"2024-09-14T12:12:58.213772+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.109271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11405599,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":713,"num_read_kb":38674,"num_write":1003,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454040+0000","last_change":"2024-09-14T11:17:25.616189+0000","last_active":"2024-09-14T12:13:30.454040+0000","last_peered":"2024-09-14T12:13:30.454040+0000","last_clean":"2024-09-14T12:13:30.454040+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:13:30.454040+0000","last_undegraded":"2024-09-14T12:13:30.454040+0000","last_fullsized":"2024-09-14T12:13:30.454040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:01.244165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'482","reported_seq":1102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.211205+0000","last_change":"2024-09-14T11:17:27.633619+0000","last_active":"2024-09-14T12:15:49.211205+0000","last_peered":"2024-09-14T12:15:49.211205+0000","last_clean":"2024-09-14T12:15:49.211205+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:15:49.211205+0000","last_undegraded":"2024-09-14T12:15:49.211205+0000","last_fullsized":"2024-09-14T12:15:49.211205+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:36.703508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117393,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":852,"num_read_kb":1825,"num_write":744,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213328+0000","last_change":"2024-09-14T11:17:29.645579+0000","last_active":"2024-09-14T12:12:33.213328+0000","last_peered":"2024-09-14T12:12:33.213328+0000","last_clean":"2024-09-14T12:12:33.213328+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:12:33.213328+0000","last_undegraded":"2024-09-14T12:12:33.213328+0000","last_fullsized":"2024-09-14T12:12:33.213328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:26.891079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'838","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208276+0000","last_change":"2024-09-14T11:17:23.595214+0000","last_active":"2024-09-14T12:14:31.208276+0000","last_peered":"2024-09-14T12:14:31.208276+0000","last_clean":"2024-09-14T12:14:31.208276+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:14:31.208276+0000","last_undegraded":"2024-09-14T12:14:31.208276+0000","last_fullsized":"2024-09-14T12:14:31.208276+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:09.844778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'324","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:32.453765+0000","last_change":"2024-09-14T11:17:21.579786+0000","last_active":"2024-09-14T12:13:32.453765+0000","last_peered":"2024-09-14T12:13:32.453765+0000","last_clean":"2024-09-14T12:13:32.453765+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:13:32.453765+0000","last_undegraded":"2024-09-14T12:13:32.453765+0000","last_fullsized":"2024-09-14T12:13:32.453765+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5733331,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":565,"num_read_kb":5748,"num_write":1181,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455241+0000","last_change":"2024-09-14T11:17:25.616062+0000","last_active":"2024-09-14T12:13:43.455241+0000","last_peered":"2024-09-14T12:13:43.455241+0000","last_clean":"2024-09-14T12:13:43.455241+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:13:43.455241+0000","last_undegraded":"2024-09-14T12:13:43.455241+0000","last_fullsized":"2024-09-14T12:13:43.455241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.590638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'308","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.481804+0000","last_change":"2024-09-14T11:17:27.631864+0000","last_active":"2024-09-14T12:14:58.481804+0000","last_peered":"2024-09-14T12:14:58.481804+0000","last_clean":"2024-09-14T12:14:58.481804+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:14:58.481804+0000","last_undegraded":"2024-09-14T12:14:58.481804+0000","last_fullsized":"2024-09-14T12:14:58.481804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.144668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":978,"num_write":424,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201536+0000","last_change":"2024-09-14T11:17:29.640091+0000","last_active":"2024-09-14T12:12:33.201536+0000","last_peered":"2024-09-14T12:12:33.201536+0000","last_clean":"2024-09-14T12:12:33.201536+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:12:33.201536+0000","last_undegraded":"2024-09-14T12:12:33.201536+0000","last_fullsized":"2024-09-14T12:12:33.201536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:15.297752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'201","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.078225+0000","last_change":"2024-09-14T11:17:31.654553+0000","last_active":"2024-09-14T12:14:32.078225+0000","last_peered":"2024-09-14T12:14:32.078225+0000","last_clean":"2024-09-14T12:14:32.078225+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:14:32.078225+0000","last_undegraded":"2024-09-14T12:14:32.078225+0000","last_fullsized":"2024-09-14T12:14:32.078225+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:30.957381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'415","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208752+0000","last_change":"2024-09-14T11:17:23.597737+0000","last_active":"2024-09-14T12:14:31.208752+0000","last_peered":"2024-09-14T12:14:31.208752+0000","last_clean":"2024-09-14T12:14:31.208752+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:14:31.208752+0000","last_undegraded":"2024-09-14T12:14:31.208752+0000","last_fullsized":"2024-09-14T12:14:31.208752+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.853930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'308","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:24.386036+0000","last_change":"2024-09-14T11:17:21.572704+0000","last_active":"2024-09-14T12:12:24.386036+0000","last_peered":"2024-09-14T12:12:24.386036+0000","last_clean":"2024-09-14T12:12:24.386036+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:12:24.386036+0000","last_undegraded":"2024-09-14T12:12:24.386036+0000","last_fullsized":"2024-09-14T12:12:24.386036+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:48.097453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13018890,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":718,"num_read_kb":55641,"num_write":1232,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.327534+0000","last_change":"2024-09-14T11:17:25.615822+0000","last_active":"2024-09-14T12:12:28.327534+0000","last_peered":"2024-09-14T12:12:28.327534+0000","last_clean":"2024-09-14T12:12:28.327534+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:12:28.327534+0000","last_undegraded":"2024-09-14T12:12:28.327534+0000","last_fullsized":"2024-09-14T12:12:28.327534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:36.413046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'297","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.236297+0000","last_change":"2024-09-14T11:17:27.632371+0000","last_active":"2024-09-14T12:15:48.236297+0000","last_peered":"2024-09-14T12:15:48.236297+0000","last_clean":"2024-09-14T12:15:48.236297+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:15:48.236297+0000","last_undegraded":"2024-09-14T12:15:48.236297+0000","last_fullsized":"2024-09-14T12:15:48.236297+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:48.220034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64399,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1008,"num_write":400,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209176+0000","last_change":"2024-09-14T11:17:29.643082+0000","last_active":"2024-09-14T12:13:43.209176+0000","last_peered":"2024-09-14T12:13:43.209176+0000","last_clean":"2024-09-14T12:13:43.209176+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:13:43.209176+0000","last_undegraded":"2024-09-14T12:13:43.209176+0000","last_fullsized":"2024-09-14T12:13:43.209176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:03.359386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'100","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.251218+0000","last_change":"2024-09-14T11:17:31.657761+0000","last_active":"2024-09-14T12:15:49.251218+0000","last_peered":"2024-09-14T12:15:49.251218+0000","last_clean":"2024-09-14T12:15:49.251218+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:15:49.251218+0000","last_undegraded":"2024-09-14T12:15:49.251218+0000","last_fullsized":"2024-09-14T12:15:49.251218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.568137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'483","reported_seq":2020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869633+0000","last_change":"2024-09-14T11:17:23.594002+0000","last_active":"2024-09-14T12:13:31.869633+0000","last_peered":"2024-09-14T12:13:31.869633+0000","last_clean":"2024-09-14T12:13:31.869633+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:13:31.869633+0000","last_undegraded":"2024-09-14T12:13:31.869633+0000","last_fullsized":"2024-09-14T12:13:31.869633+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:29.422949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'375","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:25.446252+0000","last_change":"2024-09-14T11:17:21.582882+0000","last_active":"2024-09-14T12:12:25.446252+0000","last_peered":"2024-09-14T12:12:25.446252+0000","last_clean":"2024-09-14T12:12:25.446252+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:12:25.446252+0000","last_undegraded":"2024-09-14T12:12:25.446252+0000","last_fullsized":"2024-09-14T12:12:25.446252+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:26.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250648,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1125,"num_read_kb":773,"num_write":1245,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.200982+0000","last_change":"2024-09-14T11:17:25.606521+0000","last_active":"2024-09-14T12:12:28.200982+0000","last_peered":"2024-09-14T12:12:28.200982+0000","last_clean":"2024-09-14T12:12:28.200982+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:12:28.200982+0000","last_undegraded":"2024-09-14T12:12:28.200982+0000","last_fullsized":"2024-09-14T12:12:28.200982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.190615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.336647+0000","last_change":"2024-09-14T11:17:27.625718+0000","last_active":"2024-09-14T12:13:33.336647+0000","last_peered":"2024-09-14T12:13:33.336647+0000","last_clean":"2024-09-14T12:13:33.336647+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:13:33.336647+0000","last_undegraded":"2024-09-14T12:13:33.336647+0000","last_fullsized":"2024-09-14T12:13:33.336647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:13.564944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'778","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:52.483250+0000","last_change":"2024-09-14T11:17:29.641638+0000","last_active":"2024-09-14T12:15:52.483250+0000","last_peered":"2024-09-14T12:15:52.483250+0000","last_clean":"2024-09-14T12:15:52.483250+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:15:52.483250+0000","last_undegraded":"2024-09-14T12:15:52.483250+0000","last_fullsized":"2024-09-14T12:15:52.483250+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:54.865127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'126","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.517595+0000","last_change":"2024-09-14T11:17:31.654896+0000","last_active":"2024-09-14T12:13:48.517595+0000","last_peered":"2024-09-14T12:13:48.517595+0000","last_clean":"2024-09-14T12:13:48.517595+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:13:48.517595+0000","last_undegraded":"2024-09-14T12:13:48.517595+0000","last_fullsized":"2024-09-14T12:13:48.517595+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:18.947558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'482","reported_seq":2002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606832+0000","last_change":"2024-09-14T11:17:23.603409+0000","last_active":"2024-09-14T12:14:34.606832+0000","last_peered":"2024-09-14T12:14:34.606832+0000","last_clean":"2024-09-14T12:14:34.606832+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:14:34.606832+0000","last_undegraded":"2024-09-14T12:14:34.606832+0000","last_fullsized":"2024-09-14T12:14:34.606832+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:58.876757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'299","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:23.330319+0000","last_change":"2024-09-14T11:17:21.584853+0000","last_active":"2024-09-14T12:12:23.330319+0000","last_peered":"2024-09-14T12:12:23.330319+0000","last_clean":"2024-09-14T12:12:23.330319+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:12:23.330319+0000","last_undegraded":"2024-09-14T12:12:23.330319+0000","last_fullsized":"2024-09-14T12:12:23.330319+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:42.636525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14722428,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":599,"num_read_kb":45610,"num_write":977,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.456732+0000","last_change":"2024-09-14T11:17:25.618200+0000","last_active":"2024-09-14T12:12:28.456732+0000","last_peered":"2024-09-14T12:12:28.456732+0000","last_clean":"2024-09-14T12:12:28.456732+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:12:28.456732+0000","last_undegraded":"2024-09-14T12:12:28.456732+0000","last_fullsized":"2024-09-14T12:12:28.456732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:36.032390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'312","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.241335+0000","last_change":"2024-09-14T11:17:27.632003+0000","last_active":"2024-09-14T12:15:43.241335+0000","last_peered":"2024-09-14T12:15:43.241335+0000","last_clean":"2024-09-14T12:15:43.241335+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:15:43.241335+0000","last_undegraded":"2024-09-14T12:15:43.241335+0000","last_fullsized":"2024-09-14T12:15:43.241335+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50001,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":468,"num_read_kb":888,"num_write":376,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:05.450810+0000","last_change":"2024-09-14T11:17:29.642860+0000","last_active":"2024-09-14T12:13:05.450810+0000","last_peered":"2024-09-14T12:13:05.450810+0000","last_clean":"2024-09-14T12:13:05.450810+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:13:05.450810+0000","last_undegraded":"2024-09-14T12:13:05.450810+0000","last_fullsized":"2024-09-14T12:13:05.450810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:49.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'163","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.740671+0000","last_change":"2024-09-14T11:17:31.659537+0000","last_active":"2024-09-14T12:14:31.740671+0000","last_peered":"2024-09-14T12:14:31.740671+0000","last_clean":"2024-09-14T12:14:31.740671+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:14:31.740671+0000","last_undegraded":"2024-09-14T12:14:31.740671+0000","last_fullsized":"2024-09-14T12:14:31.740671+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:58.564304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'823","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.532267+0000","last_change":"2024-09-14T11:17:23.603348+0000","last_active":"2024-09-14T12:13:48.532267+0000","last_peered":"2024-09-14T12:13:48.532267+0000","last_clean":"2024-09-14T12:13:48.532267+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:13:48.532267+0000","last_undegraded":"2024-09-14T12:13:48.532267+0000","last_fullsized":"2024-09-14T12:13:48.532267+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.172017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'333","reported_seq":1190,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.301913+0000","last_change":"2024-09-14T11:17:21.586488+0000","last_active":"2024-09-14T12:14:02.301913+0000","last_peered":"2024-09-14T12:14:02.301913+0000","last_clean":"2024-09-14T12:14:02.301913+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:14:02.301913+0000","last_undegraded":"2024-09-14T12:14:02.301913+0000","last_fullsized":"2024-09-14T12:14:02.301913+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:17.459649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3993460,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":1259,"num_read_kb":37456,"num_write":1235,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331124+0000","last_change":"2024-09-14T11:17:25.617051+0000","last_active":"2024-09-14T12:12:28.331124+0000","last_peered":"2024-09-14T12:12:28.331124+0000","last_clean":"2024-09-14T12:12:28.331124+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:12:28.331124+0000","last_undegraded":"2024-09-14T12:12:28.331124+0000","last_fullsized":"2024-09-14T12:12:28.331124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:24.207846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'275","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.736743+0000","last_change":"2024-09-14T11:17:27.635755+0000","last_active":"2024-09-14T12:15:43.736743+0000","last_peered":"2024-09-14T12:15:43.736743+0000","last_clean":"2024-09-14T12:15:43.736743+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:15:43.736743+0000","last_undegraded":"2024-09-14T12:15:43.736743+0000","last_fullsized":"2024-09-14T12:15:43.736743+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":444,"num_read_kb":933,"num_write":370,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.450854+0000","last_change":"2024-09-14T11:17:29.642662+0000","last_active":"2024-09-14T12:13:13.450854+0000","last_peered":"2024-09-14T12:13:13.450854+0000","last_clean":"2024-09-14T12:13:13.450854+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:13:13.450854+0000","last_undegraded":"2024-09-14T12:13:13.450854+0000","last_fullsized":"2024-09-14T12:13:13.450854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:37.438168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'101","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:52.066499+0000","last_change":"2024-09-14T11:17:31.653130+0000","last_active":"2024-09-14T12:13:52.066499+0000","last_peered":"2024-09-14T12:13:52.066499+0000","last_clean":"2024-09-14T12:13:52.066499+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:13:52.066499+0000","last_undegraded":"2024-09-14T12:13:52.066499+0000","last_fullsized":"2024-09-14T12:13:52.066499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:01.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'466","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.118951+0000","last_change":"2024-09-14T11:17:23.598902+0000","last_active":"2024-09-14T12:15:48.118951+0000","last_peered":"2024-09-14T12:15:48.118951+0000","last_clean":"2024-09-14T12:15:48.118951+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:15:48.118951+0000","last_undegraded":"2024-09-14T12:15:48.118951+0000","last_fullsized":"2024-09-14T12:15:48.118951+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:31.355611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'302","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218830+0000","last_change":"2024-09-14T11:17:21.589014+0000","last_active":"2024-09-14T12:13:38.218830+0000","last_peered":"2024-09-14T12:13:38.218830+0000","last_clean":"2024-09-14T12:13:38.218830+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:13:38.218830+0000","last_undegraded":"2024-09-14T12:13:38.218830+0000","last_fullsized":"2024-09-14T12:13:38.218830+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:25.221696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054523,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":529,"num_read_kb":9738,"num_write":1104,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332528+0000","last_change":"2024-09-14T11:17:25.610612+0000","last_active":"2024-09-14T12:13:03.332528+0000","last_peered":"2024-09-14T12:13:03.332528+0000","last_clean":"2024-09-14T12:13:03.332528+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:13:03.332528+0000","last_undegraded":"2024-09-14T12:13:03.332528+0000","last_fullsized":"2024-09-14T12:13:03.332528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:48.115678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'251","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.229206+0000","last_change":"2024-09-14T11:17:27.631891+0000","last_active":"2024-09-14T12:14:58.229206+0000","last_peered":"2024-09-14T12:14:58.229206+0000","last_clean":"2024-09-14T12:14:58.229206+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:14:58.229206+0000","last_undegraded":"2024-09-14T12:14:58.229206+0000","last_fullsized":"2024-09-14T12:14:58.229206+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:44.534516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":945,"num_write":360,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328284+0000","last_change":"2024-09-14T11:17:29.643072+0000","last_active":"2024-09-14T12:12:33.328284+0000","last_peered":"2024-09-14T12:12:33.328284+0000","last_clean":"2024-09-14T12:12:33.328284+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:12:33.328284+0000","last_undegraded":"2024-09-14T12:12:33.328284+0000","last_fullsized":"2024-09-14T12:12:33.328284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:34.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'185","reported_seq":1645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.716019+0000","last_change":"2024-09-14T11:17:31.657886+0000","last_active":"2024-09-14T12:14:31.716019+0000","last_peered":"2024-09-14T12:14:31.716019+0000","last_clean":"2024-09-14T12:14:31.716019+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:14:31.716019+0000","last_undegraded":"2024-09-14T12:14:31.716019+0000","last_fullsized":"2024-09-14T12:14:31.716019+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:25.875385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'587","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619382+0000","last_change":"2024-09-14T11:17:23.593981+0000","last_active":"2024-09-14T12:13:57.619382+0000","last_peered":"2024-09-14T12:13:57.619382+0000","last_clean":"2024-09-14T12:13:57.619382+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:13:57.619382+0000","last_undegraded":"2024-09-14T12:13:57.619382+0000","last_fullsized":"2024-09-14T12:13:57.619382+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:57.500739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'285","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.894234+0000","last_change":"2024-09-14T11:17:55.706003+0000","last_active":"2024-09-14T12:14:28.894234+0000","last_peered":"2024-09-14T12:14:28.894234+0000","last_clean":"2024-09-14T12:14:28.894234+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:14:28.894234+0000","last_undegraded":"2024-09-14T12:14:28.894234+0000","last_fullsized":"2024-09-14T12:14:28.894234+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.137533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6358364,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1129,"num_read_kb":9181,"num_write":1079,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205682+0000","last_change":"2024-09-14T11:17:25.611418+0000","last_active":"2024-09-14T12:13:13.205682+0000","last_peered":"2024-09-14T12:13:13.205682+0000","last_clean":"2024-09-14T12:13:13.205682+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:13:13.205682+0000","last_undegraded":"2024-09-14T12:13:13.205682+0000","last_fullsized":"2024-09-14T12:13:13.205682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.637349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'323","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:58.348967+0000","last_change":"2024-09-14T11:17:27.631558+0000","last_active":"2024-09-14T12:14:58.348967+0000","last_peered":"2024-09-14T12:14:58.348967+0000","last_clean":"2024-09-14T12:14:58.348967+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:14:58.348967+0000","last_undegraded":"2024-09-14T12:14:58.348967+0000","last_fullsized":"2024-09-14T12:14:58.348967+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:57.236491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65978,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1084,"num_write":436,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446967+0000","last_change":"2024-09-14T11:17:29.643690+0000","last_active":"2024-09-14T12:12:30.446967+0000","last_peered":"2024-09-14T12:12:30.446967+0000","last_clean":"2024-09-14T12:12:30.446967+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:12:30.446967+0000","last_undegraded":"2024-09-14T12:12:30.446967+0000","last_fullsized":"2024-09-14T12:12:30.446967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:41.882853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'98","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.149653+0000","last_change":"2024-09-14T11:17:31.656443+0000","last_active":"2024-09-14T12:15:48.149653+0000","last_peered":"2024-09-14T12:15:48.149653+0000","last_clean":"2024-09-14T12:15:48.149653+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:15:48.149653+0000","last_undegraded":"2024-09-14T12:15:48.149653+0000","last_fullsized":"2024-09-14T12:15:48.149653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:42.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'539","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.591433+0000","last_change":"2024-09-14T11:17:23.600867+0000","last_active":"2024-09-14T12:14:01.591433+0000","last_peered":"2024-09-14T12:14:01.591433+0000","last_clean":"2024-09-14T12:14:01.591433+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:14:01.591433+0000","last_undegraded":"2024-09-14T12:14:01.591433+0000","last_fullsized":"2024-09-14T12:14:01.591433+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:37.601941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'338","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.454382+0000","last_change":"2024-09-14T11:17:21.582606+0000","last_active":"2024-09-14T12:13:38.454382+0000","last_peered":"2024-09-14T12:13:38.454382+0000","last_clean":"2024-09-14T12:13:38.454382+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:13:38.454382+0000","last_undegraded":"2024-09-14T12:13:38.454382+0000","last_fullsized":"2024-09-14T12:13:38.454382+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.655925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437957,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":598,"num_read_kb":34320,"num_write":1205,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'835","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.500767+0000","last_change":"2024-09-14T11:17:23.593094+0000","last_active":"2024-09-14T12:15:18.500767+0000","last_peered":"2024-09-14T12:15:18.500767+0000","last_clean":"2024-09-14T12:15:18.500767+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:15:18.500767+0000","last_undegraded":"2024-09-14T12:15:18.500767+0000","last_fullsized":"2024-09-14T12:15:18.500767+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:00.728519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'370","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671665+0000","last_change":"2024-09-14T11:17:21.587023+0000","last_active":"2024-09-14T12:14:17.671665+0000","last_peered":"2024-09-14T12:14:17.671665+0000","last_clean":"2024-09-14T12:14:17.671665+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:14:17.671665+0000","last_undegraded":"2024-09-14T12:14:17.671665+0000","last_fullsized":"2024-09-14T12:14:17.671665+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:28.536485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23470781,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":689,"num_read_kb":108288,"num_write":1311,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'490","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.751737+0000","last_change":"2024-09-14T11:17:23.594077+0000","last_active":"2024-09-14T12:14:02.751737+0000","last_peered":"2024-09-14T12:14:02.751737+0000","last_clean":"2024-09-14T12:14:02.751737+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:14:02.751737+0000","last_undegraded":"2024-09-14T12:14:02.751737+0000","last_fullsized":"2024-09-14T12:14:02.751737+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:09.993223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'276","reported_seq":909,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223288+0000","last_change":"2024-09-14T11:17:21.586835+0000","last_active":"2024-09-14T12:13:38.223288+0000","last_peered":"2024-09-14T12:13:38.223288+0000","last_clean":"2024-09-14T12:13:38.223288+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:13:38.223288+0000","last_undegraded":"2024-09-14T12:13:38.223288+0000","last_fullsized":"2024-09-14T12:13:38.223288+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:19.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8420620,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":518,"num_read_kb":31259,"num_write":1040,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1198","reported_seq":2729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210733+0000","last_change":"2024-09-14T11:17:23.592819+0000","last_active":"2024-09-14T12:14:31.210733+0000","last_peered":"2024-09-14T12:14:31.210733+0000","last_clean":"2024-09-14T12:14:31.210733+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:14:31.210733+0000","last_undegraded":"2024-09-14T12:14:31.210733+0000","last_fullsized":"2024-09-14T12:14:31.210733+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:27.543641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'310","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455745+0000","last_change":"2024-09-14T11:17:21.585188+0000","last_active":"2024-09-14T12:13:45.455745+0000","last_peered":"2024-09-14T12:13:45.455745+0000","last_clean":"2024-09-14T12:13:45.455745+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:13:45.455745+0000","last_undegraded":"2024-09-14T12:13:45.455745+0000","last_fullsized":"2024-09-14T12:13:45.455745+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:07.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5290954,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":15201,"num_write":1236,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'918","reported_seq":2573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.502687+0000","last_change":"2024-09-14T11:17:23.601191+0000","last_active":"2024-09-14T12:15:18.502687+0000","last_peered":"2024-09-14T12:15:18.502687+0000","last_clean":"2024-09-14T12:15:18.502687+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:15:18.502687+0000","last_undegraded":"2024-09-14T12:15:18.502687+0000","last_fullsized":"2024-09-14T12:15:18.502687+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:39.840105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'250","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:51.613284+0000","last_change":"2024-09-14T11:17:21.584208+0000","last_active":"2024-09-14T12:13:51.613284+0000","last_peered":"2024-09-14T12:13:51.613284+0000","last_clean":"2024-09-14T12:13:51.613284+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:13:51.613284+0000","last_undegraded":"2024-09-14T12:13:51.613284+0000","last_fullsized":"2024-09-14T12:13:51.613284+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5737636,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":491,"num_read_kb":7710,"num_write":891,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'501","reported_seq":2112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.120303+0000","last_change":"2024-09-14T11:17:23.594912+0000","last_active":"2024-09-14T12:15:48.120303+0000","last_peered":"2024-09-14T12:15:48.120303+0000","last_clean":"2024-09-14T12:15:48.120303+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:15:48.120303+0000","last_undegraded":"2024-09-14T12:15:48.120303+0000","last_fullsized":"2024-09-14T12:15:48.120303+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:05.056139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'342","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209162+0000","last_change":"2024-09-14T11:17:21.579512+0000","last_active":"2024-09-14T12:13:43.209162+0000","last_peered":"2024-09-14T12:13:43.209162+0000","last_clean":"2024-09-14T12:13:43.209162+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:13:43.209162+0000","last_undegraded":"2024-09-14T12:13:43.209162+0000","last_fullsized":"2024-09-14T12:13:43.209162+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:50.912297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12577240,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":612,"num_read_kb":78819,"num_write":1193,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'832","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.122782+0000","last_change":"2024-09-14T11:17:23.602134+0000","last_active":"2024-09-14T12:15:48.122782+0000","last_peered":"2024-09-14T12:15:48.122782+0000","last_clean":"2024-09-14T12:15:48.122782+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:15:48.122782+0000","last_undegraded":"2024-09-14T12:15:48.122782+0000","last_fullsized":"2024-09-14T12:15:48.122782+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:55.121466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'379","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.864741+0000","last_change":"2024-09-14T11:17:21.587871+0000","last_active":"2024-09-14T12:15:38.864741+0000","last_peered":"2024-09-14T12:15:38.864741+0000","last_clean":"2024-09-14T12:15:38.864741+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:15:38.864741+0000","last_undegraded":"2024-09-14T12:15:38.864741+0000","last_fullsized":"2024-09-14T12:15:38.864741+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:00.375845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3958235,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":797,"num_read_kb":42745,"num_write":1534,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771846+0000","last_change":"2024-09-14T11:17:23.596351+0000","last_active":"2024-09-14T12:14:33.771846+0000","last_peered":"2024-09-14T12:14:33.771846+0000","last_clean":"2024-09-14T12:14:33.771846+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:14:33.771846+0000","last_undegraded":"2024-09-14T12:14:33.771846+0000","last_fullsized":"2024-09-14T12:14:33.771846+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'294","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:47.252551+0000","last_change":"2024-09-14T11:17:21.583193+0000","last_active":"2024-09-14T12:15:47.252551+0000","last_peered":"2024-09-14T12:15:47.252551+0000","last_clean":"2024-09-14T12:15:47.252551+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:15:47.252551+0000","last_undegraded":"2024-09-14T12:15:47.252551+0000","last_fullsized":"2024-09-14T12:15:47.252551+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:06.631109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5913903,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":660,"num_read_kb":25683,"num_write":1142,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'724","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.121608+0000","last_change":"2024-09-14T11:17:23.604245+0000","last_active":"2024-09-14T12:15:48.121608+0000","last_peered":"2024-09-14T12:15:48.121608+0000","last_clean":"2024-09-14T12:15:48.121608+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:15:48.121608+0000","last_undegraded":"2024-09-14T12:15:48.121608+0000","last_fullsized":"2024-09-14T12:15:48.121608+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:40.467603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'255","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.226111+0000","last_change":"2024-09-14T11:17:21.580614+0000","last_active":"2024-09-14T12:13:58.226111+0000","last_peered":"2024-09-14T12:13:58.226111+0000","last_clean":"2024-09-14T12:13:58.226111+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:13:58.226111+0000","last_undegraded":"2024-09-14T12:13:58.226111+0000","last_fullsized":"2024-09-14T12:13:58.226111+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:49.477505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521661,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":473,"num_read_kb":13775,"num_write":915,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'542","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755084+0000","last_change":"2024-09-14T11:17:23.597056+0000","last_active":"2024-09-14T12:14:02.755084+0000","last_peered":"2024-09-14T12:14:02.755084+0000","last_clean":"2024-09-14T12:14:02.755084+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:14:02.755084+0000","last_undegraded":"2024-09-14T12:14:02.755084+0000","last_fullsized":"2024-09-14T12:14:02.755084+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:25.820590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'302","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.673579+0000","last_change":"2024-09-14T11:17:21.583089+0000","last_active":"2024-09-14T12:14:17.673579+0000","last_peered":"2024-09-14T12:14:17.673579+0000","last_clean":"2024-09-14T12:14:17.673579+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:14:17.673579+0000","last_undegraded":"2024-09-14T12:14:17.673579+0000","last_fullsized":"2024-09-14T12:14:17.673579+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10140678,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":542,"num_read_kb":24861,"num_write":1084,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'886","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.506780+0000","last_change":"2024-09-14T11:17:23.590933+0000","last_active":"2024-09-14T12:15:18.506780+0000","last_peered":"2024-09-14T12:15:18.506780+0000","last_clean":"2024-09-14T12:15:18.506780+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:15:18.506780+0000","last_undegraded":"2024-09-14T12:15:18.506780+0000","last_fullsized":"2024-09-14T12:15:18.506780+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.559604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'314","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.066911+0000","last_change":"2024-09-14T11:17:21.589675+0000","last_active":"2024-09-14T12:14:31.066911+0000","last_peered":"2024-09-14T12:14:31.066911+0000","last_clean":"2024-09-14T12:14:31.066911+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:14:31.066911+0000","last_undegraded":"2024-09-14T12:14:31.066911+0000","last_fullsized":"2024-09-14T12:14:31.066911+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:06.262409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8888920,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":612,"num_read_kb":50704,"num_write":1163,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'681","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606396+0000","last_change":"2024-09-14T11:17:23.595898+0000","last_active":"2024-09-14T12:14:34.606396+0000","last_peered":"2024-09-14T12:14:34.606396+0000","last_clean":"2024-09-14T12:14:34.606396+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:14:34.606396+0000","last_undegraded":"2024-09-14T12:14:34.606396+0000","last_fullsized":"2024-09-14T12:14:34.606396+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:45.372928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'277","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455187+0000","last_change":"2024-09-14T11:17:21.589111+0000","last_active":"2024-09-14T12:13:40.455187+0000","last_peered":"2024-09-14T12:13:40.455187+0000","last_clean":"2024-09-14T12:13:40.455187+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:13:40.455187+0000","last_undegraded":"2024-09-14T12:13:40.455187+0000","last_fullsized":"2024-09-14T12:13:40.455187+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:16.334007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1442947,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":562,"num_read_kb":2144,"num_write":981,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'754","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.576424+0000","last_change":"2024-09-14T11:17:55.700734+0000","last_active":"2024-09-14T12:13:55.576424+0000","last_peered":"2024-09-14T12:13:55.576424+0000","last_clean":"2024-09-14T12:13:55.576424+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:13:55.576424+0000","last_undegraded":"2024-09-14T12:13:55.576424+0000","last_fullsized":"2024-09-14T12:13:55.576424+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.642169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'261","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:40.731776+0000","last_change":"2024-09-14T11:17:21.582462+0000","last_active":"2024-09-14T12:15:40.731776+0000","last_peered":"2024-09-14T12:15:40.731776+0000","last_clean":"2024-09-14T12:15:40.731776+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:15:40.731776+0000","last_undegraded":"2024-09-14T12:15:40.731776+0000","last_fullsized":"2024-09-14T12:15:40.731776+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.146715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9504952,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":46679,"num_write":889,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'468","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.507172+0000","last_change":"2024-09-14T11:17:23.606550+0000","last_active":"2024-09-14T12:15:18.507172+0000","last_peered":"2024-09-14T12:15:18.507172+0000","last_clean":"2024-09-14T12:15:18.507172+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:15:18.507172+0000","last_undegraded":"2024-09-14T12:15:18.507172+0000","last_fullsized":"2024-09-14T12:15:18.507172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:25.294313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'278","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:23.213600+0000","last_change":"2024-09-14T11:17:55.703532+0000","last_active":"2024-09-14T12:14:23.213600+0000","last_peered":"2024-09-14T12:14:23.213600+0000","last_clean":"2024-09-14T12:14:23.213600+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:14:23.213600+0000","last_undegraded":"2024-09-14T12:14:23.213600+0000","last_fullsized":"2024-09-14T12:14:23.213600+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:23.137411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6360112,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":845,"num_read_kb":19019,"num_write":949,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'441","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.819923+0000","last_change":"2024-09-14T11:17:23.602231+0000","last_active":"2024-09-14T12:13:42.819923+0000","last_peered":"2024-09-14T12:13:42.819923+0000","last_clean":"2024-09-14T12:13:42.819923+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:13:42.819923+0000","last_undegraded":"2024-09-14T12:13:42.819923+0000","last_fullsized":"2024-09-14T12:13:42.819923+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:53.898892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'341","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.325603+0000","last_change":"2024-09-14T11:17:21.578753+0000","last_active":"2024-09-14T12:15:43.325603+0000","last_peered":"2024-09-14T12:15:43.325603+0000","last_clean":"2024-09-14T12:15:43.325603+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:15:43.325603+0000","last_undegraded":"2024-09-14T12:15:43.325603+0000","last_fullsized":"2024-09-14T12:15:43.325603+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:48.907563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8442947,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":685,"num_read_kb":76781,"num_write":1218,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755681+0000","last_change":"2024-09-14T11:17:23.603778+0000","last_active":"2024-09-14T12:14:02.755681+0000","last_peered":"2024-09-14T12:14:02.755681+0000","last_clean":"2024-09-14T12:14:02.755681+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:14:02.755681+0000","last_undegraded":"2024-09-14T12:14:02.755681+0000","last_fullsized":"2024-09-14T12:14:02.755681+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:48.188661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'309","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.221072+0000","last_change":"2024-09-14T11:17:21.587433+0000","last_active":"2024-09-14T12:13:23.221072+0000","last_peered":"2024-09-14T12:13:23.221072+0000","last_clean":"2024-09-14T12:13:23.221072+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:13:23.221072+0000","last_undegraded":"2024-09-14T12:13:23.221072+0000","last_fullsized":"2024-09-14T12:13:23.221072+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:02.070789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5236306,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":506,"num_read_kb":6454,"num_write":1149,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'263","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:23.220982+0000","last_change":"2024-09-14T11:17:21.583452+0000","last_active":"2024-09-14T12:13:23.220982+0000","last_peered":"2024-09-14T12:13:23.220982+0000","last_clean":"2024-09-14T12:13:23.220982+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:13:23.220982+0000","last_undegraded":"2024-09-14T12:13:23.220982+0000","last_fullsized":"2024-09-14T12:13:23.220982+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:53.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116338,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":597,"num_read_kb":1699,"num_write":972,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'562","reported_seq":2258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.111067+0000","last_change":"2024-09-14T11:17:23.605011+0000","last_active":"2024-09-14T12:15:48.111067+0000","last_peered":"2024-09-14T12:15:48.111067+0000","last_clean":"2024-09-14T12:15:48.111067+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:15:48.111067+0000","last_undegraded":"2024-09-14T12:15:48.111067+0000","last_fullsized":"2024-09-14T12:15:48.111067+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:39.124367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'330","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:17.671862+0000","last_change":"2024-09-14T11:17:21.571626+0000","last_active":"2024-09-14T12:14:17.671862+0000","last_peered":"2024-09-14T12:14:17.671862+0000","last_clean":"2024-09-14T12:14:17.671862+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:14:17.671862+0000","last_undegraded":"2024-09-14T12:14:17.671862+0000","last_fullsized":"2024-09-14T12:14:17.671862+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:58.165741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9786636,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":658,"num_read_kb":16752,"num_write":1197,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'915","reported_seq":2580,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605275+0000","last_change":"2024-09-14T11:17:23.597555+0000","last_active":"2024-09-14T12:14:34.605275+0000","last_peered":"2024-09-14T12:14:34.605275+0000","last_clean":"2024-09-14T12:14:34.605275+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:14:34.605275+0000","last_undegraded":"2024-09-14T12:14:34.605275+0000","last_fullsized":"2024-09-14T12:14:34.605275+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:39.353271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1791,"ondisk_log_size":1791,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":651,"ondisk_log_size":651,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2027907,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":17668,"num_read_kb":33740,"num_write":15057,"num_write_kb":12005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3350528,"data_stored":2810770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2142,"ondisk_log_size":2142,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2865,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":494933887,"num_objects":4404,"num_object_clones":0,"num_object_copies":8808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4404,"num_whiteouts":0,"num_read":40342,"num_read_kb":1801257,"num_write":69776,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1022427136,"data_stored":989867774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4397,"ondisk_log_size":4397,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":145,"num_read_kb":187942,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64256506,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":143,"num_read_kb":186673,"num_write":160,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128524288,"data_stored":128513012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510155,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421560,"kb_used_data":159912,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":93950280,"statfs":{"total":96636764160,"available":96205086720,"internally_reserved":0,"allocated":163749888,"data_stored":157535924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374332,"kb_used_data":118252,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93997508,"statfs":{"total":96636764160,"available":96253448192,"internally_reserved":0,"allocated":121090048,"data_stored":116618273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510156,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296908,"kb_used_data":197756,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94074932,"statfs":{"total":96636764160,"available":96332730368,"internally_reserved":0,"allocated":202502144,"data_stored":196273581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510155,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248320,"kb_used_data":181040,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94123520,"statfs":{"total":96636764160,"available":96382484480,"internally_reserved":0,"allocated":185384960,"data_stored":179412959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510154,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433644,"kb_used_data":177564,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93938196,"statfs":{"total":96636764160,"available":96192712704,"internally_reserved":0,"allocated":181825536,"data_stored":175371481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510155,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221540,"kb_used_data":140436,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94150300,"statfs":{"total":96636764160,"available":96409907200,"internally_reserved":0,"allocated":143806464,"data_stored":139473832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510154,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309052,"kb_used_data":157164,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94062788,"statfs":{"total":96636764160,"available":96320294912,"internally_reserved":0,"allocated":160935936,"data_stored":156075796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575563,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401828,"kb_used_data":149972,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93970012,"statfs":{"total":96636764160,"available":96225292288,"internally_reserved":0,"allocated":153571328,"data_stored":147213572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":124071936,"data_stored":119267109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102313984,"data_stored":98986895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110706688,"data_stored":107837006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143204352,"data_stored":138319362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":160452608,"data_stored":155963525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":158273536,"data_stored":153676881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":88297472,"data_stored":85327626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135106560,"data_stored":130489370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":348052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":386430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":141601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":486522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":89696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":569254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":256178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":533037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10194944,"data_stored":10191554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33595392,"data_stored":33594577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6877184,"data_stored":6875819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27557888,"data_stored":27553133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10158080,"data_stored":10154622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13672448,"data_stored":13671633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11075584,"data_stored":11073336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:16:16.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T12:16:16.965 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:16.965 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":263,"fsid":"9ea4f55e-d790-4296-a9e1-7e935db87a03","created":"2024-09-14T11:16:49.771518+0000","modified":"2024-09-14T11:51:08.013940+0000","last_up_change":"2024-09-14T11:17:02.757629+0000","last_in_change":"2024-09-14T11:16:52.978559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:17:04.015301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:17:08.891946+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:17:19.909922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:17:21.900754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:17:23.735423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:17:25.666529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:17:27.633058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:17:29.716192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:31:45.933153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:34:59.215139+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:35:02.136885+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:51:05.812671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5a379627-1eb6-4938-86c2-3f6af8970961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6819","nonce":834372472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6821","nonce":834372472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6825","nonce":834372472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":834372472},{"type":"v1","addr":"172.21.15.116:6823","nonce":834372472}]},"public_addr":"172.21.15.116:6819/834372472","cluster_addr":"172.21.15.116:6821/834372472","heartbeat_back_addr":"172.21.15.116:6825/834372472","heartbeat_front_addr":"172.21.15.116:6823/834372472","state":["exists","up"]},{"osd":1,"uuid":"f7257bc2-c8fe-4d5c-85c5-9614fdc5c376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6803","nonce":3246304000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6805","nonce":3246304000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6809","nonce":3246304000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":3246304000},{"type":"v1","addr":"172.21.15.116:6807","nonce":3246304000}]},"public_addr":"172.21.15.116:6803/3246304000","cluster_addr":"172.21.15.116:6805/3246304000","heartbeat_back_addr":"172.21.15.116:6809/3246304000","heartbeat_front_addr":"172.21.15.116:6807/3246304000","state":["exists","up"]},{"osd":2,"uuid":"73958567-8e54-4d9e-a4a5-1f4e59c56dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6827","nonce":1774573854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6829","nonce":1774573854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6833","nonce":1774573854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":1774573854},{"type":"v1","addr":"172.21.15.116:6831","nonce":1774573854}]},"public_addr":"172.21.15.116:6827/1774573854","cluster_addr":"172.21.15.116:6829/1774573854","heartbeat_back_addr":"172.21.15.116:6833/1774573854","heartbeat_front_addr":"172.21.15.116:6831/1774573854","state":["exists","up"]},{"osd":3,"uuid":"e2e04359-e38e-4b32-b612-98975e4a6de2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6811","nonce":4152832586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6813","nonce":4152832586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6817","nonce":4152832586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":4152832586},{"type":"v1","addr":"172.21.15.116:6815","nonce":4152832586}]},"public_addr":"172.21.15.116:6811/4152832586","cluster_addr":"172.21.15.116:6813/4152832586","heartbeat_back_addr":"172.21.15.116:6817/4152832586","heartbeat_front_addr":"172.21.15.116:6815/4152832586","state":["exists","up"]},{"osd":4,"uuid":"d12c1f68-d722-4bb5-9b41-d6d0c01023d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6809","nonce":1086332038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6811","nonce":1086332038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6815","nonce":1086332038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":1086332038},{"type":"v1","addr":"172.21.15.164:6813","nonce":1086332038}]},"public_addr":"172.21.15.164:6809/1086332038","cluster_addr":"172.21.15.164:6811/1086332038","heartbeat_back_addr":"172.21.15.164:6815/1086332038","heartbeat_front_addr":"172.21.15.164:6813/1086332038","state":["exists","up"]},{"osd":5,"uuid":"db13233b-567b-4f7d-957d-8d18f3851184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6801","nonce":3190735033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6803","nonce":3190735033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6807","nonce":3190735033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3190735033},{"type":"v1","addr":"172.21.15.164:6805","nonce":3190735033}]},"public_addr":"172.21.15.164:6801/3190735033","cluster_addr":"172.21.15.164:6803/3190735033","heartbeat_back_addr":"172.21.15.164:6807/3190735033","heartbeat_front_addr":"172.21.15.164:6805/3190735033","state":["exists","up"]},{"osd":6,"uuid":"a35a6e30-031c-4934-a3e2-f790d1a776cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6825","nonce":3391939760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6827","nonce":3391939760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6831","nonce":3391939760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":3391939760},{"type":"v1","addr":"172.21.15.164:6829","nonce":3391939760}]},"public_addr":"172.21.15.164:6825/3391939760","cluster_addr":"172.21.15.164:6827/3391939760","heartbeat_back_addr":"172.21.15.164:6831/3391939760","heartbeat_front_addr":"172.21.15.164:6829/3391939760","state":["exists","up"]},{"osd":7,"uuid":"10f8a7ac-c6cd-4718-8e18-d869ffc93351","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6817","nonce":4224008643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6819","nonce":4224008643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6823","nonce":4224008643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":4224008643},{"type":"v1","addr":"172.21.15.164:6821","nonce":4224008643}]},"public_addr":"172.21.15.164:6817/4224008643","cluster_addr":"172.21.15.164:6819/4224008643","heartbeat_back_addr":"172.21.15.164:6823/4224008643","heartbeat_front_addr":"172.21.15.164:6821/4224008643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.018027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.346574+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.610069+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.221144+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.477303+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.251615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595959+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:16:59.595140+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2},{"from":5,"to":1}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T12:16:17.979 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T12:16:17.980 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:18.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T12:16:18.441 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T12:16:18.455 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T12:16:18.455 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:18.590 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:18.590 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:18.590 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:18.601 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T12:16:18.900 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T12:16:18.913 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T12:16:18.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:19.050 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:19.050 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:19.050 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:19.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T12:16:19.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-14T12:16:19.360 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T12:16:19.373 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T12:16:19.374 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:19.511 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:19.511 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:19.511 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:19.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T12:16:19.821 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T12:16:19.834 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T12:16:19.834 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:19.971 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:19.971 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:19.971 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:19.982 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T12:16:20.286 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T12:16:20.299 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T12:16:20.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:20.437 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:20.438 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:20.438 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:20.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T12:16:20.750 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T12:16:20.763 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T12:16:20.763 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:20.903 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:20.903 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:20.903 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:20.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T12:16:21.214 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T12:16:21.227 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T12:16:21.227 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:16:21.366 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T12:16:21.366 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:16:21.366 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T12:16:21.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T12:16:21.678 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T12:16:21.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:16:22.007 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:22.018 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:16:22.020 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2036,"stamp":"2024-09-14T12:16:21.256799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24474050,"num_objects":732,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":313127,"num_read_kb":2443510,"num_write":166195,"num_write_kb":2394098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13588,"ondisk_log_size":13588,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1515336,"kb_used_data":73824,"kb_used_omap":12,"kb_used_meta":1440243,"kb_avail":753459384,"statfs":{"total":773094113280,"available":771542409216,"internally_reserved":0,"allocated":75595776,"data_stored":62600240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1474809395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-601608017,"num_objects":-4179,"num_object_clones":0,"num_object_copies":-8358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4179,"num_whiteouts":0,"num_read":4667,"num_read_kb":4190,"num_write":4430,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005471"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.235486+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:15:03.235486+0000","last_peered":"2024-09-14T12:15:03.235486+0000","last_clean":"2024-09-14T12:15:03.235486+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:15:03.235486+0000","last_undegraded":"2024-09-14T12:15:03.235486+0000","last_fullsized":"2024-09-14T12:15:03.235486+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311879+0000","last_change":"2024-09-14T11:51:07.025774+0000","last_active":"2024-09-14T12:13:38.311879+0000","last_peered":"2024-09-14T12:13:38.311879+0000","last_clean":"2024-09-14T12:13:38.311879+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:13:38.311879+0000","last_undegraded":"2024-09-14T12:13:38.311879+0000","last_fullsized":"2024-09-14T12:13:38.311879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.449121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.561956+0000","last_change":"2024-09-14T11:35:00.449276+0000","last_active":"2024-09-14T12:16:14.561956+0000","last_peered":"2024-09-14T12:16:14.561956+0000","last_clean":"2024-09-14T12:16:14.561956+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:16:14.561956+0000","last_undegraded":"2024-09-14T12:16:14.561956+0000","last_fullsized":"2024-09-14T12:16:14.561956+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:28.070565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313986+0000","last_change":"2024-09-14T11:31:47.462526+0000","last_active":"2024-09-14T12:13:58.313986+0000","last_peered":"2024-09-14T12:13:58.313986+0000","last_clean":"2024-09-14T12:13:58.313986+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:13:58.313986+0000","last_undegraded":"2024-09-14T12:13:58.313986+0000","last_fullsized":"2024-09-14T12:13:58.313986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:37.396723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.448111+0000","last_change":"2024-09-14T11:51:07.028080+0000","last_active":"2024-09-14T12:12:53.448111+0000","last_peered":"2024-09-14T12:12:53.448111+0000","last_clean":"2024-09-14T12:12:53.448111+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:12:53.448111+0000","last_undegraded":"2024-09-14T12:12:53.448111+0000","last_fullsized":"2024-09-14T12:12:53.448111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.359237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255665+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:16:15.255665+0000","last_peered":"2024-09-14T12:16:15.255665+0000","last_clean":"2024-09-14T12:16:15.255665+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:16:15.255665+0000","last_undegraded":"2024-09-14T12:16:15.255665+0000","last_fullsized":"2024-09-14T12:16:15.255665+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:50.280918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.322144+0000","last_change":"2024-09-14T11:35:00.438757+0000","last_active":"2024-09-14T12:15:13.322144+0000","last_peered":"2024-09-14T12:15:13.322144+0000","last_clean":"2024-09-14T12:15:13.322144+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:15:13.322144+0000","last_undegraded":"2024-09-14T12:15:13.322144+0000","last_fullsized":"2024-09-14T12:15:13.322144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:50.182947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:50.442209+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:11:50.442209+0000","last_peered":"2024-09-14T12:11:50.442209+0000","last_clean":"2024-09-14T12:11:50.442209+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:11:50.442209+0000","last_undegraded":"2024-09-14T12:11:50.442209+0000","last_fullsized":"2024-09-14T12:11:50.442209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:01.804143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.231335+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:15:13.231335+0000","last_peered":"2024-09-14T12:15:13.231335+0000","last_clean":"2024-09-14T12:15:13.231335+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:15:13.231335+0000","last_undegraded":"2024-09-14T12:15:13.231335+0000","last_fullsized":"2024-09-14T12:15:13.231335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.346085+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:14:38.346085+0000","last_peered":"2024-09-14T12:14:38.346085+0000","last_clean":"2024-09-14T12:14:38.346085+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:14:38.346085+0000","last_undegraded":"2024-09-14T12:14:38.346085+0000","last_fullsized":"2024-09-14T12:14:38.346085+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.966334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205890+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:11:48.205890+0000","last_peered":"2024-09-14T12:11:48.205890+0000","last_clean":"2024-09-14T12:11:48.205890+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:11:48.205890+0000","last_undegraded":"2024-09-14T12:11:48.205890+0000","last_fullsized":"2024-09-14T12:11:48.205890+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:51.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.906271+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:16:14.906271+0000","last_peered":"2024-09-14T12:16:14.906271+0000","last_clean":"2024-09-14T12:16:14.906271+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:16:14.906271+0000","last_undegraded":"2024-09-14T12:16:14.906271+0000","last_fullsized":"2024-09-14T12:16:14.906271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4136,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205846+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:11:48.205846+0000","last_peered":"2024-09-14T12:11:48.205846+0000","last_clean":"2024-09-14T12:11:48.205846+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:11:48.205846+0000","last_undegraded":"2024-09-14T12:11:48.205846+0000","last_fullsized":"2024-09-14T12:11:48.205846+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211503+0000","last_change":"2024-09-14T11:51:07.022651+0000","last_active":"2024-09-14T12:14:03.211503+0000","last_peered":"2024-09-14T12:14:03.211503+0000","last_clean":"2024-09-14T12:14:03.211503+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:14:03.211503+0000","last_undegraded":"2024-09-14T12:14:03.211503+0000","last_fullsized":"2024-09-14T12:14:03.211503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:59.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455134+0000","last_change":"2024-09-14T11:35:03.472494+0000","last_active":"2024-09-14T12:13:43.455134+0000","last_peered":"2024-09-14T12:13:43.455134+0000","last_clean":"2024-09-14T12:13:43.455134+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:13:43.455134+0000","last_undegraded":"2024-09-14T12:13:43.455134+0000","last_fullsized":"2024-09-14T12:13:43.455134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:49.051891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339062+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:13:48.339062+0000","last_peered":"2024-09-14T12:13:48.339062+0000","last_clean":"2024-09-14T12:13:48.339062+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:13:48.339062+0000","last_undegraded":"2024-09-14T12:13:48.339062+0000","last_fullsized":"2024-09-14T12:13:48.339062+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.439584+0000","last_change":"2024-09-14T11:31:47.462449+0000","last_active":"2024-09-14T12:11:48.439584+0000","last_peered":"2024-09-14T12:11:48.439584+0000","last_clean":"2024-09-14T12:11:48.439584+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:11:48.439584+0000","last_undegraded":"2024-09-14T12:11:48.439584+0000","last_fullsized":"2024-09-14T12:11:48.439584+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:14.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.354760+0000","last_change":"2024-09-14T11:35:03.473587+0000","last_active":"2024-09-14T12:15:03.354760+0000","last_peered":"2024-09-14T12:15:03.354760+0000","last_clean":"2024-09-14T12:15:03.354760+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:15:03.354760+0000","last_undegraded":"2024-09-14T12:15:03.354760+0000","last_fullsized":"2024-09-14T12:15:03.354760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.755910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'14","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.229789+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:15:03.229789+0000","last_peered":"2024-09-14T12:15:03.229789+0000","last_clean":"2024-09-14T12:15:03.229789+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:15:03.229789+0000","last_undegraded":"2024-09-14T12:15:03.229789+0000","last_fullsized":"2024-09-14T12:15:03.229789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17412,"num_write":24,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.203551+0000","last_change":"2024-09-14T11:31:47.457527+0000","last_active":"2024-09-14T12:12:53.203551+0000","last_peered":"2024-09-14T12:12:53.203551+0000","last_clean":"2024-09-14T12:12:53.203551+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:12:53.203551+0000","last_undegraded":"2024-09-14T12:12:53.203551+0000","last_fullsized":"2024-09-14T12:12:53.203551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:10.893316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.198600+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:12:08.198600+0000","last_peered":"2024-09-14T12:12:08.198600+0000","last_clean":"2024-09-14T12:12:08.198600+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:12:08.198600+0000","last_undegraded":"2024-09-14T12:12:08.198600+0000","last_fullsized":"2024-09-14T12:12:08.198600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:27.310781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454746+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:16:14.454746+0000","last_peered":"2024-09-14T12:16:14.454746+0000","last_clean":"2024-09-14T12:16:14.454746+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:16:14.454746+0000","last_undegraded":"2024-09-14T12:16:14.454746+0000","last_fullsized":"2024-09-14T12:16:14.454746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6146,"num_write":6,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.302497+0000","last_change":"2024-09-14T11:51:07.028060+0000","last_active":"2024-09-14T12:12:08.302497+0000","last_peered":"2024-09-14T12:12:08.302497+0000","last_clean":"2024-09-14T12:12:08.302497+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:12:08.302497+0000","last_undegraded":"2024-09-14T12:12:08.302497+0000","last_fullsized":"2024-09-14T12:12:08.302497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.552311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.453694+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:12:08.453694+0000","last_peered":"2024-09-14T12:12:08.453694+0000","last_clean":"2024-09-14T12:12:08.453694+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:12:08.453694+0000","last_undegraded":"2024-09-14T12:12:08.453694+0000","last_fullsized":"2024-09-14T12:12:08.453694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:12.592203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.239491+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:16:08.239491+0000","last_peered":"2024-09-14T12:16:08.239491+0000","last_clean":"2024-09-14T12:16:08.239491+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:16:08.239491+0000","last_undegraded":"2024-09-14T12:16:08.239491+0000","last_fullsized":"2024-09-14T12:16:08.239491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":14,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312475+0000","last_change":"2024-09-14T11:35:00.443367+0000","last_active":"2024-09-14T12:13:43.312475+0000","last_peered":"2024-09-14T12:13:43.312475+0000","last_clean":"2024-09-14T12:13:43.312475+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:13:43.312475+0000","last_undegraded":"2024-09-14T12:13:43.312475+0000","last_fullsized":"2024-09-14T12:13:43.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:39.932103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.307053+0000","last_change":"2024-09-14T11:31:47.459863+0000","last_active":"2024-09-14T12:12:53.307053+0000","last_peered":"2024-09-14T12:12:53.307053+0000","last_clean":"2024-09-14T12:12:53.307053+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:12:53.307053+0000","last_undegraded":"2024-09-14T12:12:53.307053+0000","last_fullsized":"2024-09-14T12:12:53.307053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.115513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.328248+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:12:08.328248+0000","last_peered":"2024-09-14T12:12:08.328248+0000","last_clean":"2024-09-14T12:12:08.328248+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:12:08.328248+0000","last_undegraded":"2024-09-14T12:12:08.328248+0000","last_fullsized":"2024-09-14T12:12:08.328248+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:28.383593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.237216+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:16:08.237216+0000","last_peered":"2024-09-14T12:16:08.237216+0000","last_clean":"2024-09-14T12:16:08.237216+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:16:08.237216+0000","last_undegraded":"2024-09-14T12:16:08.237216+0000","last_fullsized":"2024-09-14T12:16:08.237216+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211827+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:16:14.211827+0000","last_peered":"2024-09-14T12:16:14.211827+0000","last_clean":"2024-09-14T12:16:14.211827+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:16:14.211827+0000","last_undegraded":"2024-09-14T12:16:14.211827+0000","last_fullsized":"2024-09-14T12:16:14.211827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.346671+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:14:43.346671+0000","last_peered":"2024-09-14T12:14:43.346671+0000","last_clean":"2024-09-14T12:14:43.346671+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:14:43.346671+0000","last_undegraded":"2024-09-14T12:14:43.346671+0000","last_fullsized":"2024-09-14T12:14:43.346671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.216054+0000","last_change":"2024-09-14T11:35:03.476474+0000","last_active":"2024-09-14T12:14:43.216054+0000","last_peered":"2024-09-14T12:14:43.216054+0000","last_clean":"2024-09-14T12:14:43.216054+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:14:43.216054+0000","last_undegraded":"2024-09-14T12:14:43.216054+0000","last_fullsized":"2024-09-14T12:14:43.216054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:43.941080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'9","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211522+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:16:14.211522+0000","last_peered":"2024-09-14T12:16:14.211522+0000","last_clean":"2024-09-14T12:16:14.211522+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:16:14.211522+0000","last_undegraded":"2024-09-14T12:16:14.211522+0000","last_fullsized":"2024-09-14T12:16:14.211522+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:15.445086+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:12:15.445086+0000","last_peered":"2024-09-14T12:12:15.445086+0000","last_clean":"2024-09-14T12:12:15.445086+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:12:15.445086+0000","last_undegraded":"2024-09-14T12:12:15.445086+0000","last_fullsized":"2024-09-14T12:12:15.445086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:16.454913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.945221+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:16:14.945221+0000","last_peered":"2024-09-14T12:16:14.945221+0000","last_clean":"2024-09-14T12:16:14.945221+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:16:14.945221+0000","last_undegraded":"2024-09-14T12:16:14.945221+0000","last_fullsized":"2024-09-14T12:16:14.945221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7286,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'13","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454552+0000","last_change":"2024-09-14T11:35:00.447506+0000","last_active":"2024-09-14T12:16:14.454552+0000","last_peered":"2024-09-14T12:16:14.454552+0000","last_clean":"2024-09-14T12:16:14.454552+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:16:14.454552+0000","last_undegraded":"2024-09-14T12:16:14.454552+0000","last_fullsized":"2024-09-14T12:16:14.454552+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:00.533644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16386,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.351850+0000","last_change":"2024-09-14T11:35:03.480075+0000","last_active":"2024-09-14T12:14:43.351850+0000","last_peered":"2024-09-14T12:14:43.351850+0000","last_clean":"2024-09-14T12:14:43.351850+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:14:43.351850+0000","last_undegraded":"2024-09-14T12:14:43.351850+0000","last_fullsized":"2024-09-14T12:14:43.351850+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:33.496292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'8","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.423979+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:16:14.423979+0000","last_peered":"2024-09-14T12:16:14.423979+0000","last_clean":"2024-09-14T12:16:14.423979+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:16:14.423979+0000","last_undegraded":"2024-09-14T12:16:14.423979+0000","last_fullsized":"2024-09-14T12:16:14.423979+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.306990+0000","last_change":"2024-09-14T11:51:07.027822+0000","last_active":"2024-09-14T12:12:53.306990+0000","last_peered":"2024-09-14T12:12:53.306990+0000","last_clean":"2024-09-14T12:12:53.306990+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:12:53.306990+0000","last_undegraded":"2024-09-14T12:12:53.306990+0000","last_fullsized":"2024-09-14T12:12:53.306990+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:23.309895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:33.234122+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:15:33.234122+0000","last_peered":"2024-09-14T12:15:33.234122+0000","last_clean":"2024-09-14T12:15:33.234122+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:15:33.234122+0000","last_undegraded":"2024-09-14T12:15:33.234122+0000","last_fullsized":"2024-09-14T12:15:33.234122+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.309609+0000","last_change":"2024-09-14T11:35:00.448968+0000","last_active":"2024-09-14T12:13:18.309609+0000","last_peered":"2024-09-14T12:13:18.309609+0000","last_clean":"2024-09-14T12:13:18.309609+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:13:18.309609+0000","last_undegraded":"2024-09-14T12:13:18.309609+0000","last_fullsized":"2024-09-14T12:13:18.309609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.693742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.329763+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:12:18.329763+0000","last_peered":"2024-09-14T12:12:18.329763+0000","last_clean":"2024-09-14T12:12:18.329763+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:12:18.329763+0000","last_undegraded":"2024-09-14T12:12:18.329763+0000","last_fullsized":"2024-09-14T12:12:18.329763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:10.558327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.447497+0000","last_change":"2024-09-14T11:51:07.027403+0000","last_active":"2024-09-14T12:12:48.447497+0000","last_peered":"2024-09-14T12:12:48.447497+0000","last_clean":"2024-09-14T12:12:48.447497+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:12:48.447497+0000","last_undegraded":"2024-09-14T12:12:48.447497+0000","last_fullsized":"2024-09-14T12:12:48.447497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:41.431415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207455+0000","last_change":"2024-09-14T11:35:03.477782+0000","last_active":"2024-09-14T12:13:28.207455+0000","last_peered":"2024-09-14T12:13:28.207455+0000","last_clean":"2024-09-14T12:13:28.207455+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:13:28.207455+0000","last_undegraded":"2024-09-14T12:13:28.207455+0000","last_fullsized":"2024-09-14T12:13:28.207455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:40.078111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.443370+0000","last_change":"2024-09-14T11:31:47.459051+0000","last_active":"2024-09-14T12:12:18.443370+0000","last_peered":"2024-09-14T12:12:18.443370+0000","last_clean":"2024-09-14T12:12:18.443370+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:12:18.443370+0000","last_undegraded":"2024-09-14T12:12:18.443370+0000","last_fullsized":"2024-09-14T12:12:18.443370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:51.494106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.223397+0000","last_change":"2024-09-14T11:35:00.446767+0000","last_active":"2024-09-14T12:15:43.223397+0000","last_peered":"2024-09-14T12:15:43.223397+0000","last_clean":"2024-09-14T12:15:43.223397+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:15:43.223397+0000","last_undegraded":"2024-09-14T12:15:43.223397+0000","last_fullsized":"2024-09-14T12:15:43.223397+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:07.682575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.303508+0000","last_change":"2024-09-14T11:31:47.461172+0000","last_active":"2024-09-14T12:12:18.303508+0000","last_peered":"2024-09-14T12:12:18.303508+0000","last_clean":"2024-09-14T12:12:18.303508+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:12:18.303508+0000","last_undegraded":"2024-09-14T12:12:18.303508+0000","last_fullsized":"2024-09-14T12:12:18.303508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:24.137730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255791+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:16:15.255791+0000","last_peered":"2024-09-14T12:16:15.255791+0000","last_clean":"2024-09-14T12:16:15.255791+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:16:15.255791+0000","last_undegraded":"2024-09-14T12:16:15.255791+0000","last_fullsized":"2024-09-14T12:16:15.255791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9588,"num_write":6,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.210185+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:16:14.210185+0000","last_peered":"2024-09-14T12:16:14.210185+0000","last_clean":"2024-09-14T12:16:14.210185+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:16:14.210185+0000","last_undegraded":"2024-09-14T12:16:14.210185+0000","last_fullsized":"2024-09-14T12:16:14.210185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:20.445608+0000","last_change":"2024-09-14T11:31:47.455100+0000","last_active":"2024-09-14T12:12:20.445608+0000","last_peered":"2024-09-14T12:12:20.445608+0000","last_clean":"2024-09-14T12:12:20.445608+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:12:20.445608+0000","last_undegraded":"2024-09-14T12:12:20.445608+0000","last_fullsized":"2024-09-14T12:12:20.445608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:09.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.227718+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:16:13.227718+0000","last_peered":"2024-09-14T12:16:13.227718+0000","last_clean":"2024-09-14T12:16:13.227718+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:16:13.227718+0000","last_undegraded":"2024-09-14T12:16:13.227718+0000","last_fullsized":"2024-09-14T12:16:13.227718+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464147+0000","last_change":"2024-09-14T11:31:47.454175+0000","last_active":"2024-09-14T12:13:03.464147+0000","last_peered":"2024-09-14T12:13:03.464147+0000","last_clean":"2024-09-14T12:13:03.464147+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:13:03.464147+0000","last_undegraded":"2024-09-14T12:13:03.464147+0000","last_fullsized":"2024-09-14T12:13:03.464147+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.297114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.206264+0000","last_change":"2024-09-14T11:35:03.477505+0000","last_active":"2024-09-14T12:13:18.206264+0000","last_peered":"2024-09-14T12:13:18.206264+0000","last_clean":"2024-09-14T12:13:18.206264+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:13:18.206264+0000","last_undegraded":"2024-09-14T12:13:18.206264+0000","last_fullsized":"2024-09-14T12:13:18.206264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:56.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458103+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:14:05.458103+0000","last_peered":"2024-09-14T12:14:05.458103+0000","last_clean":"2024-09-14T12:14:05.458103+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:14:05.458103+0000","last_undegraded":"2024-09-14T12:14:05.458103+0000","last_fullsized":"2024-09-14T12:14:05.458103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.290329+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:16:15.290329+0000","last_peered":"2024-09-14T12:16:15.290329+0000","last_clean":"2024-09-14T12:16:15.290329+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:16:15.290329+0000","last_undegraded":"2024-09-14T12:16:15.290329+0000","last_fullsized":"2024-09-14T12:16:15.290329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:33.231573+0000","last_change":"2024-09-14T11:35:00.437763+0000","last_active":"2024-09-14T12:15:33.231573+0000","last_peered":"2024-09-14T12:15:33.231573+0000","last_clean":"2024-09-14T12:15:33.231573+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:15:33.231573+0000","last_undegraded":"2024-09-14T12:15:33.231573+0000","last_fullsized":"2024-09-14T12:15:33.231573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:10.195413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448816+0000","last_change":"2024-09-14T11:31:47.455016+0000","last_active":"2024-09-14T12:12:58.448816+0000","last_peered":"2024-09-14T12:12:58.448816+0000","last_clean":"2024-09-14T12:12:58.448816+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:12:58.448816+0000","last_undegraded":"2024-09-14T12:12:58.448816+0000","last_fullsized":"2024-09-14T12:12:58.448816+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:05.916872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:40.448133+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:12:40.448133+0000","last_peered":"2024-09-14T12:12:40.448133+0000","last_clean":"2024-09-14T12:12:40.448133+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:12:40.448133+0000","last_undegraded":"2024-09-14T12:12:40.448133+0000","last_fullsized":"2024-09-14T12:12:40.448133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:19.901941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.665782+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:16:14.665782+0000","last_peered":"2024-09-14T12:16:14.665782+0000","last_clean":"2024-09-14T12:16:14.665782+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:16:14.665782+0000","last_undegraded":"2024-09-14T12:16:14.665782+0000","last_fullsized":"2024-09-14T12:16:14.665782+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:41.032154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12294,"num_write":18,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450330+0000","last_change":"2024-09-14T11:31:47.456677+0000","last_active":"2024-09-14T12:13:00.450330+0000","last_peered":"2024-09-14T12:13:00.450330+0000","last_clean":"2024-09-14T12:13:00.450330+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:13:00.450330+0000","last_undegraded":"2024-09-14T12:13:00.450330+0000","last_fullsized":"2024-09-14T12:13:00.450330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.544493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447594+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:12:35.447594+0000","last_peered":"2024-09-14T12:12:35.447594+0000","last_clean":"2024-09-14T12:12:35.447594+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:12:35.447594+0000","last_undegraded":"2024-09-14T12:12:35.447594+0000","last_fullsized":"2024-09-14T12:12:35.447594+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:39.273428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:48.319648+0000","last_change":"2024-09-14T11:35:00.449492+0000","last_active":"2024-09-14T12:14:48.319648+0000","last_peered":"2024-09-14T12:14:48.319648+0000","last_clean":"2024-09-14T12:14:48.319648+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:14:48.319648+0000","last_undegraded":"2024-09-14T12:14:48.319648+0000","last_fullsized":"2024-09-14T12:14:48.319648+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:07.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448902+0000","last_change":"2024-09-14T11:31:47.458093+0000","last_active":"2024-09-14T12:12:58.448902+0000","last_peered":"2024-09-14T12:12:58.448902+0000","last_clean":"2024-09-14T12:12:58.448902+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:12:58.448902+0000","last_undegraded":"2024-09-14T12:12:58.448902+0000","last_fullsized":"2024-09-14T12:12:58.448902+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:32.003627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.493311+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:16:13.493311+0000","last_peered":"2024-09-14T12:16:13.493311+0000","last_clean":"2024-09-14T12:16:13.493311+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:16:13.493311+0000","last_undegraded":"2024-09-14T12:16:13.493311+0000","last_fullsized":"2024-09-14T12:16:13.493311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468672+0000","last_change":"2024-09-14T11:31:47.461691+0000","last_active":"2024-09-14T12:13:33.468672+0000","last_peered":"2024-09-14T12:13:33.468672+0000","last_clean":"2024-09-14T12:13:33.468672+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:13:33.468672+0000","last_undegraded":"2024-09-14T12:13:33.468672+0000","last_fullsized":"2024-09-14T12:13:33.468672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:28.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207399+0000","last_change":"2024-09-14T11:31:47.462125+0000","last_active":"2024-09-14T12:13:28.207399+0000","last_peered":"2024-09-14T12:13:28.207399+0000","last_clean":"2024-09-14T12:13:28.207399+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:13:28.207399+0000","last_undegraded":"2024-09-14T12:13:28.207399+0000","last_fullsized":"2024-09-14T12:13:28.207399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:55.114065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.306468+0000","last_change":"2024-09-14T11:51:07.031655+0000","last_active":"2024-09-14T12:12:48.306468+0000","last_peered":"2024-09-14T12:12:48.306468+0000","last_clean":"2024-09-14T12:12:48.306468+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:12:48.306468+0000","last_undegraded":"2024-09-14T12:12:48.306468+0000","last_fullsized":"2024-09-14T12:12:48.306468+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:23.951366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.215366+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:14:38.215366+0000","last_peered":"2024-09-14T12:14:38.215366+0000","last_clean":"2024-09-14T12:14:38.215366+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:14:38.215366+0000","last_undegraded":"2024-09-14T12:14:38.215366+0000","last_fullsized":"2024-09-14T12:14:38.215366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:50.359964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:08.483121+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:15:08.483121+0000","last_peered":"2024-09-14T12:15:08.483121+0000","last_clean":"2024-09-14T12:15:08.483121+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:15:08.483121+0000","last_undegraded":"2024-09-14T12:15:08.483121+0000","last_fullsized":"2024-09-14T12:15:08.483121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221763+0000","last_change":"2024-09-14T11:31:47.454368+0000","last_active":"2024-09-14T12:13:28.221763+0000","last_peered":"2024-09-14T12:13:28.221763+0000","last_clean":"2024-09-14T12:13:28.221763+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:13:28.221763+0000","last_undegraded":"2024-09-14T12:13:28.221763+0000","last_fullsized":"2024-09-14T12:13:28.221763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:49.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457485+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:12:33.457485+0000","last_peered":"2024-09-14T12:12:33.457485+0000","last_clean":"2024-09-14T12:12:33.457485+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:12:33.457485+0000","last_undegraded":"2024-09-14T12:12:33.457485+0000","last_fullsized":"2024-09-14T12:12:33.457485+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:14.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.335995+0000","last_change":"2024-09-14T11:31:47.458566+0000","last_active":"2024-09-14T12:13:28.335995+0000","last_peered":"2024-09-14T12:13:28.335995+0000","last_clean":"2024-09-14T12:13:28.335995+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:13:28.335995+0000","last_undegraded":"2024-09-14T12:13:28.335995+0000","last_fullsized":"2024-09-14T12:13:28.335995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:16.885698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445234+0000","last_change":"2024-09-14T11:35:03.475098+0000","last_active":"2024-09-14T12:12:33.445234+0000","last_peered":"2024-09-14T12:12:33.445234+0000","last_clean":"2024-09-14T12:12:33.445234+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:12:33.445234+0000","last_undegraded":"2024-09-14T12:12:33.445234+0000","last_fullsized":"2024-09-14T12:12:33.445234+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:47.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.215423+0000","last_change":"2024-09-14T11:35:00.441606+0000","last_active":"2024-09-14T12:14:38.215423+0000","last_peered":"2024-09-14T12:14:38.215423+0000","last_clean":"2024-09-14T12:14:38.215423+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:14:38.215423+0000","last_undegraded":"2024-09-14T12:14:38.215423+0000","last_fullsized":"2024-09-14T12:14:38.215423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.099191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453081+0000","last_change":"2024-09-14T11:31:47.457442+0000","last_active":"2024-09-14T12:13:28.453081+0000","last_peered":"2024-09-14T12:13:28.453081+0000","last_clean":"2024-09-14T12:13:28.453081+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:13:28.453081+0000","last_undegraded":"2024-09-14T12:13:28.453081+0000","last_fullsized":"2024-09-14T12:13:28.453081+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.421189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328235+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:12:33.328235+0000","last_peered":"2024-09-14T12:12:33.328235+0000","last_clean":"2024-09-14T12:12:33.328235+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:12:33.328235+0000","last_undegraded":"2024-09-14T12:12:33.328235+0000","last_fullsized":"2024-09-14T12:12:33.328235+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.691369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445253+0000","last_change":"2024-09-14T11:35:00.438555+0000","last_active":"2024-09-14T12:12:33.445253+0000","last_peered":"2024-09-14T12:12:33.445253+0000","last_clean":"2024-09-14T12:12:33.445253+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:12:33.445253+0000","last_undegraded":"2024-09-14T12:12:33.445253+0000","last_fullsized":"2024-09-14T12:12:33.445253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:40.844681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471478+0000","last_change":"2024-09-14T11:31:47.457290+0000","last_active":"2024-09-14T12:13:53.471478+0000","last_peered":"2024-09-14T12:13:53.471478+0000","last_clean":"2024-09-14T12:13:53.471478+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:13:53.471478+0000","last_undegraded":"2024-09-14T12:13:53.471478+0000","last_fullsized":"2024-09-14T12:13:53.471478+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:56.244895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'372","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.455472+0000","last_change":"2024-09-14T11:17:21.587746+0000","last_active":"2024-09-14T12:16:15.455472+0000","last_peered":"2024-09-14T12:16:15.455472+0000","last_clean":"2024-09-14T12:16:15.455472+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:16:15.455472+0000","last_undegraded":"2024-09-14T12:16:15.455472+0000","last_fullsized":"2024-09-14T12:16:15.455472+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:26.043334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":629,"num_read_kb":9737,"num_write":1248,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'480","reported_seq":1926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869433+0000","last_change":"2024-09-14T11:17:23.596289+0000","last_active":"2024-09-14T12:13:31.869433+0000","last_peered":"2024-09-14T12:13:31.869433+0000","last_clean":"2024-09-14T12:13:31.869433+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:13:31.869433+0000","last_undegraded":"2024-09-14T12:13:31.869433+0000","last_fullsized":"2024-09-14T12:13:31.869433+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:52.016139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'336","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.485618+0000","last_change":"2024-09-14T11:17:21.584104+0000","last_active":"2024-09-14T12:16:15.485618+0000","last_peered":"2024-09-14T12:16:15.485618+0000","last_clean":"2024-09-14T12:16:15.485618+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:16:15.485618+0000","last_undegraded":"2024-09-14T12:16:15.485618+0000","last_fullsized":"2024-09-14T12:16:15.485618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:46.479650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":22753,"num_write":1016,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'451","reported_seq":2069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.480890+0000","last_change":"2024-09-14T11:17:23.592564+0000","last_active":"2024-09-14T12:14:53.480890+0000","last_peered":"2024-09-14T12:14:53.480890+0000","last_clean":"2024-09-14T12:14:53.480890+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:14:53.480890+0000","last_undegraded":"2024-09-14T12:14:53.480890+0000","last_fullsized":"2024-09-14T12:14:53.480890+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:08.504401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'368","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.482455+0000","last_change":"2024-09-14T11:17:21.580337+0000","last_active":"2024-09-14T12:16:15.482455+0000","last_peered":"2024-09-14T12:16:15.482455+0000","last_clean":"2024-09-14T12:16:15.482455+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:16:15.482455+0000","last_undegraded":"2024-09-14T12:16:15.482455+0000","last_fullsized":"2024-09-14T12:16:15.482455+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:44.574988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":8099,"num_write":1164,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'828","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.348237+0000","last_change":"2024-09-14T11:17:23.599492+0000","last_active":"2024-09-14T12:14:53.348237+0000","last_peered":"2024-09-14T12:14:53.348237+0000","last_clean":"2024-09-14T12:14:53.348237+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:14:53.348237+0000","last_undegraded":"2024-09-14T12:14:53.348237+0000","last_fullsized":"2024-09-14T12:14:53.348237+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:31.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'391","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.484981+0000","last_change":"2024-09-14T11:17:21.587518+0000","last_active":"2024-09-14T12:16:15.484981+0000","last_peered":"2024-09-14T12:16:15.484981+0000","last_clean":"2024-09-14T12:16:15.484981+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:16:15.484981+0000","last_undegraded":"2024-09-14T12:16:15.484981+0000","last_fullsized":"2024-09-14T12:16:15.484981+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.780145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":69334,"num_write":1242,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'478","reported_seq":2201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:55.464747+0000","last_change":"2024-09-14T11:17:23.604953+0000","last_active":"2024-09-14T12:14:55.464747+0000","last_peered":"2024-09-14T12:14:55.464747+0000","last_clean":"2024-09-14T12:14:55.464747+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:14:55.464747+0000","last_undegraded":"2024-09-14T12:14:55.464747+0000","last_fullsized":"2024-09-14T12:14:55.464747+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.132184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'340","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.464326+0000","last_change":"2024-09-14T11:17:21.585772+0000","last_active":"2024-09-14T12:16:15.464326+0000","last_peered":"2024-09-14T12:16:15.464326+0000","last_clean":"2024-09-14T12:16:15.464326+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:16:15.464326+0000","last_undegraded":"2024-09-14T12:16:15.464326+0000","last_fullsized":"2024-09-14T12:16:15.464326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:30.264733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8504,"num_write":1105,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'928","reported_seq":2495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.884819+0000","last_change":"2024-09-14T11:17:23.598765+0000","last_active":"2024-09-14T12:13:38.884819+0000","last_peered":"2024-09-14T12:13:38.884819+0000","last_clean":"2024-09-14T12:13:38.884819+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:13:38.884819+0000","last_undegraded":"2024-09-14T12:13:38.884819+0000","last_fullsized":"2024-09-14T12:13:38.884819+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:07.244374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'336","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.473276+0000","last_change":"2024-09-14T11:17:21.586031+0000","last_active":"2024-09-14T12:16:15.473276+0000","last_peered":"2024-09-14T12:16:15.473276+0000","last_clean":"2024-09-14T12:16:15.473276+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:16:15.473276+0000","last_undegraded":"2024-09-14T12:16:15.473276+0000","last_fullsized":"2024-09-14T12:16:15.473276+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:35.597137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":13223,"num_write":1062,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'322","reported_seq":1677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.773491+0000","last_change":"2024-09-14T11:17:23.598233+0000","last_active":"2024-09-14T12:14:33.773491+0000","last_peered":"2024-09-14T12:14:33.773491+0000","last_clean":"2024-09-14T12:14:33.773491+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:14:33.773491+0000","last_undegraded":"2024-09-14T12:14:33.773491+0000","last_fullsized":"2024-09-14T12:14:33.773491+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:42.186568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'332","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.429704+0000","last_change":"2024-09-14T11:17:21.583061+0000","last_active":"2024-09-14T12:16:15.429704+0000","last_peered":"2024-09-14T12:16:15.429704+0000","last_clean":"2024-09-14T12:16:15.429704+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:16:15.429704+0000","last_undegraded":"2024-09-14T12:16:15.429704+0000","last_fullsized":"2024-09-14T12:16:15.429704+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:35.390163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":13115,"num_write":1013,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'406","reported_seq":1944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.589436+0000","last_change":"2024-09-14T11:17:23.595095+0000","last_active":"2024-09-14T12:14:01.589436+0000","last_peered":"2024-09-14T12:14:01.589436+0000","last_clean":"2024-09-14T12:14:01.589436+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:14:01.589436+0000","last_undegraded":"2024-09-14T12:14:01.589436+0000","last_fullsized":"2024-09-14T12:14:01.589436+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:51.571958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'357","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.462160+0000","last_change":"2024-09-14T11:17:55.703681+0000","last_active":"2024-09-14T12:16:15.462160+0000","last_peered":"2024-09-14T12:16:15.462160+0000","last_clean":"2024-09-14T12:16:15.462160+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:16:15.462160+0000","last_undegraded":"2024-09-14T12:16:15.462160+0000","last_fullsized":"2024-09-14T12:16:15.462160+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:43.991223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":594,"num_read_kb":3517,"num_write":1114,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'928","reported_seq":2496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.115259+0000","last_change":"2024-09-14T11:17:23.602237+0000","last_active":"2024-09-14T12:15:48.115259+0000","last_peered":"2024-09-14T12:15:48.115259+0000","last_clean":"2024-09-14T12:15:48.115259+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:15:48.115259+0000","last_undegraded":"2024-09-14T12:15:48.115259+0000","last_fullsized":"2024-09-14T12:15:48.115259+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:07.202617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'883","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606712+0000","last_change":"2024-09-14T11:17:23.599033+0000","last_active":"2024-09-14T12:14:34.606712+0000","last_peered":"2024-09-14T12:14:34.606712+0000","last_clean":"2024-09-14T12:14:34.606712+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:14:34.606712+0000","last_undegraded":"2024-09-14T12:14:34.606712+0000","last_fullsized":"2024-09-14T12:14:34.606712+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:02.965131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'372","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.480103+0000","last_change":"2024-09-14T11:17:21.590951+0000","last_active":"2024-09-14T12:16:15.480103+0000","last_peered":"2024-09-14T12:16:15.480103+0000","last_clean":"2024-09-14T12:16:15.480103+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:16:15.480103+0000","last_undegraded":"2024-09-14T12:16:15.480103+0000","last_fullsized":"2024-09-14T12:16:15.480103+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:04.497926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":33506,"num_write":1216,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'723","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.112494+0000","last_change":"2024-09-14T11:17:55.874871+0000","last_active":"2024-09-14T12:15:48.112494+0000","last_peered":"2024-09-14T12:15:48.112494+0000","last_clean":"2024-09-14T12:15:48.112494+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:15:48.112494+0000","last_undegraded":"2024-09-14T12:15:48.112494+0000","last_fullsized":"2024-09-14T12:15:48.112494+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:09.467887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'475","reported_seq":1143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.473356+0000","last_change":"2024-09-14T11:17:21.591292+0000","last_active":"2024-09-14T12:16:15.473356+0000","last_peered":"2024-09-14T12:16:15.473356+0000","last_clean":"2024-09-14T12:16:15.473356+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:16:15.473356+0000","last_undegraded":"2024-09-14T12:16:15.473356+0000","last_fullsized":"2024-09-14T12:16:15.473356+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.290528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":934,"num_read_kb":10641,"num_write":1221,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'766","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.137705+0000","last_change":"2024-09-14T11:17:23.599028+0000","last_active":"2024-09-14T12:15:48.137705+0000","last_peered":"2024-09-14T12:15:48.137705+0000","last_clean":"2024-09-14T12:15:48.137705+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:15:48.137705+0000","last_undegraded":"2024-09-14T12:15:48.137705+0000","last_fullsized":"2024-09-14T12:15:48.137705+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:17.702836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'392","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.480700+0000","last_change":"2024-09-14T11:17:21.590804+0000","last_active":"2024-09-14T12:16:15.480700+0000","last_peered":"2024-09-14T12:16:15.480700+0000","last_clean":"2024-09-14T12:16:15.480700+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:16:15.480700+0000","last_undegraded":"2024-09-14T12:16:15.480700+0000","last_fullsized":"2024-09-14T12:16:15.480700+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:31.068330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":671,"num_read_kb":6370,"num_write":1079,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.113932+0000","last_change":"2024-09-14T11:17:23.602214+0000","last_active":"2024-09-14T12:15:48.113932+0000","last_peered":"2024-09-14T12:15:48.113932+0000","last_clean":"2024-09-14T12:15:48.113932+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:15:48.113932+0000","last_undegraded":"2024-09-14T12:15:48.113932+0000","last_fullsized":"2024-09-14T12:15:48.113932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:16.076422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'323","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.459807+0000","last_change":"2024-09-14T11:17:21.580921+0000","last_active":"2024-09-14T12:16:15.459807+0000","last_peered":"2024-09-14T12:16:15.459807+0000","last_clean":"2024-09-14T12:16:15.459807+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:16:15.459807+0000","last_undegraded":"2024-09-14T12:16:15.459807+0000","last_fullsized":"2024-09-14T12:16:15.459807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.868639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":17017,"num_write":957,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'903","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.117762+0000","last_change":"2024-09-14T11:17:23.599615+0000","last_active":"2024-09-14T12:15:48.117762+0000","last_peered":"2024-09-14T12:15:48.117762+0000","last_clean":"2024-09-14T12:15:48.117762+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:15:48.117762+0000","last_undegraded":"2024-09-14T12:15:48.117762+0000","last_fullsized":"2024-09-14T12:15:48.117762+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:54.414087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'302","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.456143+0000","last_change":"2024-09-14T11:17:21.586068+0000","last_active":"2024-09-14T12:16:15.456143+0000","last_peered":"2024-09-14T12:16:15.456143+0000","last_clean":"2024-09-14T12:16:15.456143+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:16:15.456143+0000","last_undegraded":"2024-09-14T12:16:15.456143+0000","last_fullsized":"2024-09-14T12:16:15.456143+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.111859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":19406,"num_write":864,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1142","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503777+0000","last_change":"2024-09-14T11:17:23.592841+0000","last_active":"2024-09-14T12:15:18.503777+0000","last_peered":"2024-09-14T12:15:18.503777+0000","last_clean":"2024-09-14T12:15:18.503777+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:15:18.503777+0000","last_undegraded":"2024-09-14T12:15:18.503777+0000","last_fullsized":"2024-09-14T12:15:18.503777+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:33.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'338","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.429987+0000","last_change":"2024-09-14T11:17:21.581385+0000","last_active":"2024-09-14T12:16:15.429987+0000","last_peered":"2024-09-14T12:16:15.429987+0000","last_clean":"2024-09-14T12:16:15.429987+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:16:15.429987+0000","last_undegraded":"2024-09-14T12:16:15.429987+0000","last_fullsized":"2024-09-14T12:16:15.429987+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:13.497850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":705,"num_read_kb":10760,"num_write":996,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'124","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.745040+0000","last_change":"2024-09-14T11:17:31.654831+0000","last_active":"2024-09-14T12:14:34.745040+0000","last_peered":"2024-09-14T12:14:34.745040+0000","last_clean":"2024-09-14T12:14:34.745040+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:14:34.745040+0000","last_undegraded":"2024-09-14T12:14:34.745040+0000","last_fullsized":"2024-09-14T12:14:34.745040+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:31.244666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'519","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.588328+0000","last_change":"2024-09-14T11:17:23.599731+0000","last_active":"2024-09-14T12:14:01.588328+0000","last_peered":"2024-09-14T12:14:01.588328+0000","last_clean":"2024-09-14T12:14:01.588328+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:14:01.588328+0000","last_undegraded":"2024-09-14T12:14:01.588328+0000","last_fullsized":"2024-09-14T12:14:01.588328+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:06.544330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'288","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.427395+0000","last_change":"2024-09-14T11:17:21.582288+0000","last_active":"2024-09-14T12:16:15.427395+0000","last_peered":"2024-09-14T12:16:15.427395+0000","last_clean":"2024-09-14T12:16:15.427395+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:16:15.427395+0000","last_undegraded":"2024-09-14T12:16:15.427395+0000","last_fullsized":"2024-09-14T12:16:15.427395+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:12.066003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":3402,"num_write":873,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217819+0000","last_change":"2024-09-14T11:17:25.615823+0000","last_active":"2024-09-14T12:13:03.217819+0000","last_peered":"2024-09-14T12:13:03.217819+0000","last_clean":"2024-09-14T12:13:03.217819+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:13:03.217819+0000","last_undegraded":"2024-09-14T12:13:03.217819+0000","last_fullsized":"2024-09-14T12:13:03.217819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:11.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'346","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.485891+0000","last_change":"2024-09-14T11:17:27.635100+0000","last_active":"2024-09-14T12:16:14.485891+0000","last_peered":"2024-09-14T12:16:14.485891+0000","last_clean":"2024-09-14T12:16:14.485891+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:16:14.485891+0000","last_undegraded":"2024-09-14T12:16:14.485891+0000","last_fullsized":"2024-09-14T12:16:14.485891+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:40.414857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":1214,"num_write":454,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.465023+0000","last_change":"2024-09-14T11:17:29.648345+0000","last_active":"2024-09-14T12:13:08.465023+0000","last_peered":"2024-09-14T12:13:08.465023+0000","last_clean":"2024-09-14T12:13:08.465023+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:13:08.465023+0000","last_undegraded":"2024-09-14T12:13:08.465023+0000","last_fullsized":"2024-09-14T12:13:08.465023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:26.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'125","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.666407+0000","last_change":"2024-09-14T11:17:31.655931+0000","last_active":"2024-09-14T12:14:32.666407+0000","last_peered":"2024-09-14T12:14:32.666407+0000","last_clean":"2024-09-14T12:14:32.666407+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:14:32.666407+0000","last_undegraded":"2024-09-14T12:14:32.666407+0000","last_fullsized":"2024-09-14T12:14:32.666407+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.187962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'403","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605468+0000","last_change":"2024-09-14T11:17:23.593797+0000","last_active":"2024-09-14T12:14:34.605468+0000","last_peered":"2024-09-14T12:14:34.605468+0000","last_clean":"2024-09-14T12:14:34.605468+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:14:34.605468+0000","last_undegraded":"2024-09-14T12:14:34.605468+0000","last_fullsized":"2024-09-14T12:14:34.605468+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:55.871343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'384","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:18.857599+0000","last_change":"2024-09-14T12:16:18.857599+0000","last_active":"2024-09-14T12:16:18.857599+0000","last_peered":"2024-09-14T12:16:18.857599+0000","last_clean":"2024-09-14T12:16:18.857599+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:16:18.857599+0000","last_undegraded":"2024-09-14T12:16:18.857599+0000","last_fullsized":"2024-09-14T12:16:18.857599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_clean_scrub_stamp":"2024-09-14T12:16:18.857499+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:10.889774+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":9438,"num_write":1138,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219417+0000","last_change":"2024-09-14T11:17:25.616433+0000","last_active":"2024-09-14T12:13:43.219417+0000","last_peered":"2024-09-14T12:13:43.219417+0000","last_clean":"2024-09-14T12:13:43.219417+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:13:43.219417+0000","last_undegraded":"2024-09-14T12:13:43.219417+0000","last_fullsized":"2024-09-14T12:13:43.219417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:30.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332635+0000","last_change":"2024-09-14T11:17:27.625733+0000","last_active":"2024-09-14T12:13:03.332635+0000","last_peered":"2024-09-14T12:13:03.332635+0000","last_clean":"2024-09-14T12:13:03.332635+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:13:03.332635+0000","last_undegraded":"2024-09-14T12:13:03.332635+0000","last_fullsized":"2024-09-14T12:13:03.332635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.964076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.333430+0000","last_change":"2024-09-14T11:17:29.644069+0000","last_active":"2024-09-14T12:13:08.333430+0000","last_peered":"2024-09-14T12:13:08.333430+0000","last_clean":"2024-09-14T12:13:08.333430+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:13:08.333430+0000","last_undegraded":"2024-09-14T12:13:08.333430+0000","last_fullsized":"2024-09-14T12:13:08.333430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:57.125690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'115","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447544+0000","last_change":"2024-09-14T11:17:31.656073+0000","last_active":"2024-09-14T12:12:35.447544+0000","last_peered":"2024-09-14T12:12:35.447544+0000","last_clean":"2024-09-14T12:12:35.447544+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:12:35.447544+0000","last_undegraded":"2024-09-14T12:12:35.447544+0000","last_fullsized":"2024-09-14T12:12:35.447544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.047265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'515","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.577498+0000","last_change":"2024-09-14T11:17:23.603416+0000","last_active":"2024-09-14T12:13:55.577498+0000","last_peered":"2024-09-14T12:13:55.577498+0000","last_clean":"2024-09-14T12:13:55.577498+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:13:55.577498+0000","last_undegraded":"2024-09-14T12:13:55.577498+0000","last_fullsized":"2024-09-14T12:13:55.577498+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:40.391533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'447","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.468632+0000","last_change":"2024-09-14T11:17:21.581059+0000","last_active":"2024-09-14T12:16:15.468632+0000","last_peered":"2024-09-14T12:16:15.468632+0000","last_clean":"2024-09-14T12:16:15.468632+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:16:15.468632+0000","last_undegraded":"2024-09-14T12:16:15.468632+0000","last_fullsized":"2024-09-14T12:16:15.468632+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:45.085082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1029,"num_read_kb":13380,"num_write":1416,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.214581+0000","last_change":"2024-09-14T11:17:25.616302+0000","last_active":"2024-09-14T12:13:03.214581+0000","last_peered":"2024-09-14T12:13:03.214581+0000","last_clean":"2024-09-14T12:13:03.214581+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:13:03.214581+0000","last_undegraded":"2024-09-14T12:13:03.214581+0000","last_fullsized":"2024-09-14T12:13:03.214581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:14.747448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'114","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311910+0000","last_change":"2024-09-14T11:17:27.629551+0000","last_active":"2024-09-14T12:13:38.311910+0000","last_peered":"2024-09-14T12:13:38.311910+0000","last_clean":"2024-09-14T12:13:38.311910+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:13:38.311910+0000","last_undegraded":"2024-09-14T12:13:38.311910+0000","last_fullsized":"2024-09-14T12:13:38.311910+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:42.613696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'763","reported_seq":2260,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.119202+0000","last_change":"2024-09-14T11:17:29.644411+0000","last_active":"2024-09-14T12:16:14.119202+0000","last_peered":"2024-09-14T12:16:14.119202+0000","last_clean":"2024-09-14T12:16:14.119202+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:16:14.119202+0000","last_undegraded":"2024-09-14T12:16:14.119202+0000","last_fullsized":"2024-09-14T12:16:14.119202+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:09.032379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.802436+0000","last_change":"2024-09-14T11:17:31.653029+0000","last_active":"2024-09-14T12:14:34.802436+0000","last_peered":"2024-09-14T12:14:34.802436+0000","last_clean":"2024-09-14T12:14:34.802436+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:14:34.802436+0000","last_undegraded":"2024-09-14T12:14:34.802436+0000","last_fullsized":"2024-09-14T12:14:34.802436+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.378206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1034","reported_seq":2653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208892+0000","last_change":"2024-09-14T11:17:23.595010+0000","last_active":"2024-09-14T12:14:31.208892+0000","last_peered":"2024-09-14T12:14:31.208892+0000","last_clean":"2024-09-14T12:14:31.208892+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:14:31.208892+0000","last_undegraded":"2024-09-14T12:14:31.208892+0000","last_fullsized":"2024-09-14T12:14:31.208892+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.708748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'347","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.407565+0000","last_change":"2024-09-14T11:17:21.584036+0000","last_active":"2024-09-14T12:16:15.407565+0000","last_peered":"2024-09-14T12:16:15.407565+0000","last_clean":"2024-09-14T12:16:15.407565+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:16:15.407565+0000","last_undegraded":"2024-09-14T12:16:15.407565+0000","last_fullsized":"2024-09-14T12:16:15.407565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:15.378108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":31887,"num_write":1106,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217853+0000","last_change":"2024-09-14T11:17:25.618783+0000","last_active":"2024-09-14T12:13:03.217853+0000","last_peered":"2024-09-14T12:13:03.217853+0000","last_clean":"2024-09-14T12:13:03.217853+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:13:03.217853+0000","last_undegraded":"2024-09-14T12:13:03.217853+0000","last_fullsized":"2024-09-14T12:13:03.217853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:17.470265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'271","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.320031+0000","last_change":"2024-09-14T11:17:27.633216+0000","last_active":"2024-09-14T12:16:14.320031+0000","last_peered":"2024-09-14T12:16:14.320031+0000","last_clean":"2024-09-14T12:16:14.320031+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:16:14.320031+0000","last_undegraded":"2024-09-14T12:16:14.320031+0000","last_fullsized":"2024-09-14T12:16:14.320031+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.992449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1100,"num_write":378,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'803","reported_seq":2956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.257878+0000","last_change":"2024-09-14T11:17:29.645452+0000","last_active":"2024-09-14T12:16:15.257878+0000","last_peered":"2024-09-14T12:16:15.257878+0000","last_clean":"2024-09-14T12:16:15.257878+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:16:15.257878+0000","last_undegraded":"2024-09-14T12:16:15.257878+0000","last_fullsized":"2024-09-14T12:16:15.257878+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:20.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'781","reported_seq":2531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.772745+0000","last_change":"2024-09-14T11:17:23.592552+0000","last_active":"2024-09-14T12:14:33.772745+0000","last_peered":"2024-09-14T12:14:33.772745+0000","last_clean":"2024-09-14T12:14:33.772745+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:14:33.772745+0000","last_undegraded":"2024-09-14T12:14:33.772745+0000","last_fullsized":"2024-09-14T12:14:33.772745+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.626824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'395","reported_seq":1056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.469537+0000","last_change":"2024-09-14T11:17:21.585562+0000","last_active":"2024-09-14T12:16:15.469537+0000","last_peered":"2024-09-14T12:16:15.469537+0000","last_clean":"2024-09-14T12:16:15.469537+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:16:15.469537+0000","last_undegraded":"2024-09-14T12:16:15.469537+0000","last_fullsized":"2024-09-14T12:16:15.469537+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:32.839861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":683,"num_read_kb":56115,"num_write":1123,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470857+0000","last_change":"2024-09-14T11:17:25.612123+0000","last_active":"2024-09-14T12:13:48.470857+0000","last_peered":"2024-09-14T12:13:48.470857+0000","last_clean":"2024-09-14T12:13:48.470857+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:13:48.470857+0000","last_undegraded":"2024-09-14T12:13:48.470857+0000","last_fullsized":"2024-09-14T12:13:48.470857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.389407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'354","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.626512+0000","last_change":"2024-09-14T11:17:27.632368+0000","last_active":"2024-09-14T12:16:14.626512+0000","last_peered":"2024-09-14T12:16:14.626512+0000","last_clean":"2024-09-14T12:16:14.626512+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:16:14.626512+0000","last_undegraded":"2024-09-14T12:16:14.626512+0000","last_fullsized":"2024-09-14T12:16:14.626512+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.760176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":1208,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.209730+0000","last_change":"2024-09-14T11:17:29.646397+0000","last_active":"2024-09-14T12:13:48.209730+0000","last_peered":"2024-09-14T12:13:48.209730+0000","last_clean":"2024-09-14T12:13:48.209730+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:13:48.209730+0000","last_undegraded":"2024-09-14T12:13:48.209730+0000","last_fullsized":"2024-09-14T12:13:48.209730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.686669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'546","reported_seq":1351,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.248613+0000","last_change":"2024-09-14T11:17:31.656988+0000","last_active":"2024-09-14T12:15:49.248613+0000","last_peered":"2024-09-14T12:15:49.248613+0000","last_clean":"2024-09-14T12:15:49.248613+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:15:49.248613+0000","last_undegraded":"2024-09-14T12:15:49.248613+0000","last_fullsized":"2024-09-14T12:15:49.248613+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:43.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'387","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338146+0000","last_change":"2024-09-14T11:17:23.594471+0000","last_active":"2024-09-14T12:13:43.338146+0000","last_peered":"2024-09-14T12:13:43.338146+0000","last_clean":"2024-09-14T12:13:43.338146+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:13:43.338146+0000","last_undegraded":"2024-09-14T12:13:43.338146+0000","last_fullsized":"2024-09-14T12:13:43.338146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:33.360740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'385","reported_seq":1141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.464477+0000","last_change":"2024-09-14T11:17:21.582857+0000","last_active":"2024-09-14T12:16:15.464477+0000","last_peered":"2024-09-14T12:16:15.464477+0000","last_clean":"2024-09-14T12:16:15.464477+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:16:15.464477+0000","last_undegraded":"2024-09-14T12:16:15.464477+0000","last_fullsized":"2024-09-14T12:16:15.464477+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:31.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079941,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1043,"num_read_kb":12713,"num_write":1259,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312912+0000","last_change":"2024-09-14T11:17:25.611404+0000","last_active":"2024-09-14T12:13:48.312912+0000","last_peered":"2024-09-14T12:13:48.312912+0000","last_clean":"2024-09-14T12:13:48.312912+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:13:48.312912+0000","last_undegraded":"2024-09-14T12:13:48.312912+0000","last_fullsized":"2024-09-14T12:13:48.312912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:08.120072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'252","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.284682+0000","last_change":"2024-09-14T11:17:27.631285+0000","last_active":"2024-09-14T12:16:15.284682+0000","last_peered":"2024-09-14T12:16:15.284682+0000","last_clean":"2024-09-14T12:16:15.284682+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:16:15.284682+0000","last_undegraded":"2024-09-14T12:16:15.284682+0000","last_fullsized":"2024-09-14T12:16:15.284682+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:15.793000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":973,"num_write":336,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:08.222209+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:14:08.222209+0000","last_peered":"2024-09-14T12:14:08.222209+0000","last_clean":"2024-09-14T12:14:08.222209+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:14:08.222209+0000","last_undegraded":"2024-09-14T12:14:08.222209+0000","last_fullsized":"2024-09-14T12:14:08.222209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2525","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.132063+0000","last_change":"2024-09-14T11:17:31.655728+0000","last_active":"2024-09-14T12:15:48.132063+0000","last_peered":"2024-09-14T12:15:48.132063+0000","last_clean":"2024-09-14T12:15:48.132063+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:15:48.132063+0000","last_undegraded":"2024-09-14T12:15:48.132063+0000","last_fullsized":"2024-09-14T12:15:48.132063+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:25.453442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1156","reported_seq":2790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344423+0000","last_change":"2024-09-14T11:17:23.605410+0000","last_active":"2024-09-14T12:13:53.344423+0000","last_peered":"2024-09-14T12:13:53.344423+0000","last_clean":"2024-09-14T12:13:53.344423+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:13:53.344423+0000","last_undegraded":"2024-09-14T12:13:53.344423+0000","last_fullsized":"2024-09-14T12:13:53.344423+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:20.036802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'376","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.466075+0000","last_change":"2024-09-14T11:17:21.589280+0000","last_active":"2024-09-14T12:16:15.466075+0000","last_peered":"2024-09-14T12:16:15.466075+0000","last_clean":"2024-09-14T12:16:15.466075+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:16:15.466075+0000","last_undegraded":"2024-09-14T12:16:15.466075+0000","last_fullsized":"2024-09-14T12:16:15.466075+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.602370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":648,"num_read_kb":71361,"num_write":1111,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312428+0000","last_change":"2024-09-14T11:17:25.610821+0000","last_active":"2024-09-14T12:13:43.312428+0000","last_peered":"2024-09-14T12:13:43.312428+0000","last_clean":"2024-09-14T12:13:43.312428+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:13:43.312428+0000","last_undegraded":"2024-09-14T12:13:43.312428+0000","last_fullsized":"2024-09-14T12:13:43.312428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:02.190026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'308","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.899707+0000","last_change":"2024-09-14T11:17:27.635877+0000","last_active":"2024-09-14T12:16:14.899707+0000","last_peered":"2024-09-14T12:16:14.899707+0000","last_clean":"2024-09-14T12:16:14.899707+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:16:14.899707+0000","last_undegraded":"2024-09-14T12:16:14.899707+0000","last_fullsized":"2024-09-14T12:16:14.899707+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:09.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":517,"num_read_kb":1149,"num_write":414,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.124558+0000","last_change":"2024-09-14T11:17:29.645441+0000","last_active":"2024-09-14T12:16:14.124558+0000","last_peered":"2024-09-14T12:16:14.124558+0000","last_clean":"2024-09-14T12:16:14.124558+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:16:14.124558+0000","last_undegraded":"2024-09-14T12:16:14.124558+0000","last_fullsized":"2024-09-14T12:16:14.124558+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":701,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.991498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.126444+0000","last_change":"2024-09-14T11:17:31.657084+0000","last_active":"2024-09-14T12:15:48.126444+0000","last_peered":"2024-09-14T12:15:48.126444+0000","last_clean":"2024-09-14T12:15:48.126444+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:15:48.126444+0000","last_undegraded":"2024-09-14T12:15:48.126444+0000","last_fullsized":"2024-09-14T12:15:48.126444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:26.090131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'579","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606091+0000","last_change":"2024-09-14T11:17:23.600240+0000","last_active":"2024-09-14T12:14:34.606091+0000","last_peered":"2024-09-14T12:14:34.606091+0000","last_clean":"2024-09-14T12:14:34.606091+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:14:34.606091+0000","last_undegraded":"2024-09-14T12:14:34.606091+0000","last_fullsized":"2024-09-14T12:14:34.606091+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:34.546153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'422","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.468093+0000","last_change":"2024-09-14T11:17:55.874169+0000","last_active":"2024-09-14T12:16:15.468093+0000","last_peered":"2024-09-14T12:16:15.468093+0000","last_clean":"2024-09-14T12:16:15.468093+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:16:15.468093+0000","last_undegraded":"2024-09-14T12:16:15.468093+0000","last_fullsized":"2024-09-14T12:16:15.468093+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:24.787464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":58896,"num_write":1397,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313940+0000","last_change":"2024-09-14T11:17:25.606685+0000","last_active":"2024-09-14T12:13:58.313940+0000","last_peered":"2024-09-14T12:13:58.313940+0000","last_clean":"2024-09-14T12:13:58.313940+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:13:58.313940+0000","last_undegraded":"2024-09-14T12:13:58.313940+0000","last_fullsized":"2024-09-14T12:13:58.313940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:26.184797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'489","reported_seq":1125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.385023+0000","last_change":"2024-09-14T11:17:27.632963+0000","last_active":"2024-09-14T12:16:15.385023+0000","last_peered":"2024-09-14T12:16:15.385023+0000","last_clean":"2024-09-14T12:16:15.385023+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:16:15.385023+0000","last_undegraded":"2024-09-14T12:16:15.385023+0000","last_fullsized":"2024-09-14T12:16:15.385023+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:19.107003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94670,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":854,"num_read_kb":2046,"num_write":706,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.313426+0000","last_change":"2024-09-14T11:17:29.642604+0000","last_active":"2024-09-14T12:13:53.313426+0000","last_peered":"2024-09-14T12:13:53.313426+0000","last_clean":"2024-09-14T12:13:53.313426+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:13:53.313426+0000","last_undegraded":"2024-09-14T12:13:53.313426+0000","last_fullsized":"2024-09-14T12:13:53.313426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:39.976613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.210299+0000","last_change":"2024-09-14T11:17:31.660313+0000","last_active":"2024-09-14T12:13:53.210299+0000","last_peered":"2024-09-14T12:13:53.210299+0000","last_clean":"2024-09-14T12:13:53.210299+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:13:53.210299+0000","last_undegraded":"2024-09-14T12:13:53.210299+0000","last_fullsized":"2024-09-14T12:13:53.210299+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:47.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'491","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337413+0000","last_change":"2024-09-14T11:17:23.603415+0000","last_active":"2024-09-14T12:13:38.337413+0000","last_peered":"2024-09-14T12:13:38.337413+0000","last_clean":"2024-09-14T12:13:38.337413+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:13:38.337413+0000","last_undegraded":"2024-09-14T12:13:38.337413+0000","last_fullsized":"2024-09-14T12:13:38.337413+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.406649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'352","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.463011+0000","last_change":"2024-09-14T11:17:21.580769+0000","last_active":"2024-09-14T12:16:15.463011+0000","last_peered":"2024-09-14T12:16:15.463011+0000","last_clean":"2024-09-14T12:16:15.463011+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:16:15.463011+0000","last_undegraded":"2024-09-14T12:16:15.463011+0000","last_fullsized":"2024-09-14T12:16:15.463011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:27.335044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":23428,"num_write":1121,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312463+0000","last_change":"2024-09-14T11:17:25.615155+0000","last_active":"2024-09-14T12:13:43.312463+0000","last_peered":"2024-09-14T12:13:43.312463+0000","last_clean":"2024-09-14T12:13:43.312463+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:13:43.312463+0000","last_undegraded":"2024-09-14T12:13:43.312463+0000","last_fullsized":"2024-09-14T12:13:43.312463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:12.760805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'288","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.417846+0000","last_change":"2024-09-14T11:17:27.634022+0000","last_active":"2024-09-14T12:16:15.417846+0000","last_peered":"2024-09-14T12:16:15.417846+0000","last_clean":"2024-09-14T12:16:15.417846+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:16:15.417846+0000","last_undegraded":"2024-09-14T12:16:15.417846+0000","last_fullsized":"2024-09-14T12:16:15.417846+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:42.665521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53607,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":516,"num_read_kb":1139,"num_write":462,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456437+0000","last_change":"2024-09-14T11:17:29.647566+0000","last_active":"2024-09-14T12:13:50.456437+0000","last_peered":"2024-09-14T12:13:50.456437+0000","last_clean":"2024-09-14T12:13:50.456437+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:13:50.456437+0000","last_undegraded":"2024-09-14T12:13:50.456437+0000","last_fullsized":"2024-09-14T12:13:50.456437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:15.794875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'110","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.479972+0000","last_change":"2024-09-14T11:17:31.655541+0000","last_active":"2024-09-14T12:15:38.479972+0000","last_peered":"2024-09-14T12:15:38.479972+0000","last_clean":"2024-09-14T12:15:38.479972+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:15:38.479972+0000","last_undegraded":"2024-09-14T12:15:38.479972+0000","last_fullsized":"2024-09-14T12:15:38.479972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:33.617603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'541","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755553+0000","last_change":"2024-09-14T11:17:23.599981+0000","last_active":"2024-09-14T12:14:02.755553+0000","last_peered":"2024-09-14T12:14:02.755553+0000","last_clean":"2024-09-14T12:14:02.755553+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:14:02.755553+0000","last_undegraded":"2024-09-14T12:14:02.755553+0000","last_fullsized":"2024-09-14T12:14:02.755553+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:03.188860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'406","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.468824+0000","last_change":"2024-09-14T11:17:21.582543+0000","last_active":"2024-09-14T12:16:15.468824+0000","last_peered":"2024-09-14T12:16:15.468824+0000","last_clean":"2024-09-14T12:16:15.468824+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:16:15.468824+0000","last_undegraded":"2024-09-14T12:16:15.468824+0000","last_fullsized":"2024-09-14T12:16:15.468824+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:42.560672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":761,"num_read_kb":21492,"num_write":1380,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209141+0000","last_change":"2024-09-14T11:17:25.605008+0000","last_active":"2024-09-14T12:13:43.209141+0000","last_peered":"2024-09-14T12:13:43.209141+0000","last_clean":"2024-09-14T12:13:43.209141+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:13:43.209141+0000","last_undegraded":"2024-09-14T12:13:43.209141+0000","last_fullsized":"2024-09-14T12:13:43.209141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:21.712998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'306","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.183230+0000","last_change":"2024-09-14T11:17:27.627740+0000","last_active":"2024-09-14T12:16:15.183230+0000","last_peered":"2024-09-14T12:16:15.183230+0000","last_clean":"2024-09-14T12:16:15.183230+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:16:15.183230+0000","last_undegraded":"2024-09-14T12:16:15.183230+0000","last_fullsized":"2024-09-14T12:16:15.183230+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:01.987766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":1085,"num_write":392,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'748","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.254178+0000","last_change":"2024-09-14T11:17:29.638832+0000","last_active":"2024-09-14T12:16:14.254178+0000","last_peered":"2024-09-14T12:16:14.254178+0000","last_clean":"2024-09-14T12:16:14.254178+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:16:14.254178+0000","last_undegraded":"2024-09-14T12:16:14.254178+0000","last_fullsized":"2024-09-14T12:16:14.254178+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":701,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:59.704823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'183","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.243227+0000","last_change":"2024-09-14T11:17:31.656014+0000","last_active":"2024-09-14T12:15:49.243227+0000","last_peered":"2024-09-14T12:15:49.243227+0000","last_clean":"2024-09-14T12:15:49.243227+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:15:49.243227+0000","last_undegraded":"2024-09-14T12:15:49.243227+0000","last_fullsized":"2024-09-14T12:15:49.243227+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:31.925155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'786","reported_seq":2317,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.337480+0000","last_change":"2024-09-14T11:17:23.594812+0000","last_active":"2024-09-14T12:13:38.337480+0000","last_peered":"2024-09-14T12:13:38.337480+0000","last_clean":"2024-09-14T12:13:38.337480+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:13:38.337480+0000","last_undegraded":"2024-09-14T12:13:38.337480+0000","last_fullsized":"2024-09-14T12:13:38.337480+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:20.279963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'337","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.427582+0000","last_change":"2024-09-14T11:17:21.572083+0000","last_active":"2024-09-14T12:16:15.427582+0000","last_peered":"2024-09-14T12:16:15.427582+0000","last_clean":"2024-09-14T12:16:15.427582+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:16:15.427582+0000","last_undegraded":"2024-09-14T12:16:15.427582+0000","last_fullsized":"2024-09-14T12:16:15.427582+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:13.146982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":54223,"num_write":971,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.100610+0000","last_change":"2024-09-14T11:17:25.619652+0000","last_active":"2024-09-14T12:16:14.100610+0000","last_peered":"2024-09-14T12:16:14.100610+0000","last_clean":"2024-09-14T12:16:14.100610+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:16:14.100610+0000","last_undegraded":"2024-09-14T12:16:14.100610+0000","last_fullsized":"2024-09-14T12:16:14.100610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:20.219288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219434+0000","last_change":"2024-09-14T11:17:27.632484+0000","last_active":"2024-09-14T12:13:43.219434+0000","last_peered":"2024-09-14T12:13:43.219434+0000","last_clean":"2024-09-14T12:13:43.219434+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:13:43.219434+0000","last_undegraded":"2024-09-14T12:13:43.219434+0000","last_fullsized":"2024-09-14T12:13:43.219434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'782","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.121422+0000","last_change":"2024-09-14T11:17:29.640978+0000","last_active":"2024-09-14T12:16:14.121422+0000","last_peered":"2024-09-14T12:16:14.121422+0000","last_clean":"2024-09-14T12:16:14.121422+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:16:14.121422+0000","last_undegraded":"2024-09-14T12:16:14.121422+0000","last_fullsized":"2024-09-14T12:16:14.121422+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":702,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.396632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.764408+0000","last_change":"2024-09-14T11:17:31.656199+0000","last_active":"2024-09-14T12:14:33.764408+0000","last_peered":"2024-09-14T12:14:33.764408+0000","last_clean":"2024-09-14T12:14:33.764408+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:14:33.764408+0000","last_undegraded":"2024-09-14T12:14:33.764408+0000","last_fullsized":"2024-09-14T12:14:33.764408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:30.802461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'446","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210300+0000","last_change":"2024-09-14T11:17:23.603828+0000","last_active":"2024-09-14T12:14:31.210300+0000","last_peered":"2024-09-14T12:14:31.210300+0000","last_clean":"2024-09-14T12:14:31.210300+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:14:31.210300+0000","last_undegraded":"2024-09-14T12:14:31.210300+0000","last_fullsized":"2024-09-14T12:14:31.210300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:37.153834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'330","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.437836+0000","last_change":"2024-09-14T11:17:21.585341+0000","last_active":"2024-09-14T12:16:15.437836+0000","last_peered":"2024-09-14T12:16:15.437836+0000","last_clean":"2024-09-14T12:16:15.437836+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:16:15.437836+0000","last_undegraded":"2024-09-14T12:16:15.437836+0000","last_fullsized":"2024-09-14T12:16:15.437836+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:02.471712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254166,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":11146,"num_write":1071,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338261+0000","last_change":"2024-09-14T11:17:25.616843+0000","last_active":"2024-09-14T12:13:43.338261+0000","last_peered":"2024-09-14T12:13:43.338261+0000","last_clean":"2024-09-14T12:13:43.338261+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:13:43.338261+0000","last_undegraded":"2024-09-14T12:13:43.338261+0000","last_fullsized":"2024-09-14T12:13:43.338261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:24.981755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'364","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.522185+0000","last_change":"2024-09-14T11:17:27.635744+0000","last_active":"2024-09-14T12:16:14.522185+0000","last_peered":"2024-09-14T12:16:14.522185+0000","last_clean":"2024-09-14T12:16:14.522185+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:16:14.522185+0000","last_undegraded":"2024-09-14T12:16:14.522185+0000","last_fullsized":"2024-09-14T12:16:14.522185+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:39.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":1225,"num_write":466,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.343756+0000","last_change":"2024-09-14T11:17:29.646394+0000","last_active":"2024-09-14T12:13:48.343756+0000","last_peered":"2024-09-14T12:13:48.343756+0000","last_clean":"2024-09-14T12:13:48.343756+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:13:48.343756+0000","last_undegraded":"2024-09-14T12:13:48.343756+0000","last_fullsized":"2024-09-14T12:13:48.343756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:23.198544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'153","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.201239+0000","last_change":"2024-09-14T11:17:31.657114+0000","last_active":"2024-09-14T12:14:31.201239+0000","last_peered":"2024-09-14T12:14:31.201239+0000","last_clean":"2024-09-14T12:14:31.201239+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:14:31.201239+0000","last_undegraded":"2024-09-14T12:14:31.201239+0000","last_fullsized":"2024-09-14T12:14:31.201239+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:58.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'834","reported_seq":2361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.529186+0000","last_change":"2024-09-14T11:17:23.599852+0000","last_active":"2024-09-14T12:13:48.529186+0000","last_peered":"2024-09-14T12:13:48.529186+0000","last_clean":"2024-09-14T12:13:48.529186+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:13:48.529186+0000","last_undegraded":"2024-09-14T12:13:48.529186+0000","last_fullsized":"2024-09-14T12:13:48.529186+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:20.678363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.465508+0000","last_change":"2024-09-14T11:17:05.878385+0000","last_active":"2024-09-14T12:13:13.465508+0000","last_peered":"2024-09-14T12:13:13.465508+0000","last_clean":"2024-09-14T12:13:13.465508+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:13:13.465508+0000","last_undegraded":"2024-09-14T12:13:13.465508+0000","last_fullsized":"2024-09-14T12:13:13.465508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:04.861621+0000","last_clean_scrub_stamp":"2024-09-14T11:17:04.861621+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:43.877017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221784+0000","last_change":"2024-09-14T11:17:12.933819+0000","last_active":"2024-09-14T12:13:28.221784+0000","last_peered":"2024-09-14T12:13:28.221784+0000","last_clean":"2024-09-14T12:13:28.221784+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:13:28.221784+0000","last_undegraded":"2024-09-14T12:13:28.221784+0000","last_fullsized":"2024-09-14T12:13:28.221784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:40.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'356","reported_seq":1010,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.467315+0000","last_change":"2024-09-14T11:17:21.591302+0000","last_active":"2024-09-14T12:16:15.467315+0000","last_peered":"2024-09-14T12:16:15.467315+0000","last_clean":"2024-09-14T12:16:15.467315+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:16:15.467315+0000","last_undegraded":"2024-09-14T12:16:15.467315+0000","last_fullsized":"2024-09-14T12:16:15.467315+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:29.565797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":16922,"num_write":1091,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470216+0000","last_change":"2024-09-14T11:17:25.613638+0000","last_active":"2024-09-14T12:13:43.470216+0000","last_peered":"2024-09-14T12:13:43.470216+0000","last_clean":"2024-09-14T12:13:43.470216+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:13:43.470216+0000","last_undegraded":"2024-09-14T12:13:43.470216+0000","last_fullsized":"2024-09-14T12:13:43.470216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:59.751658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'762","reported_seq":1463,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.114733+0000","last_change":"2024-09-14T11:17:27.633577+0000","last_active":"2024-09-14T12:16:15.114733+0000","last_peered":"2024-09-14T12:16:15.114733+0000","last_clean":"2024-09-14T12:16:15.114733+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:16:15.114733+0000","last_undegraded":"2024-09-14T12:16:15.114733+0000","last_fullsized":"2024-09-14T12:16:15.114733+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.125363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143710,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1487,"num_read_kb":3441,"num_write":1400,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456404+0000","last_change":"2024-09-14T11:17:29.646281+0000","last_active":"2024-09-14T12:13:50.456404+0000","last_peered":"2024-09-14T12:13:50.456404+0000","last_clean":"2024-09-14T12:13:50.456404+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:13:50.456404+0000","last_undegraded":"2024-09-14T12:13:50.456404+0000","last_fullsized":"2024-09-14T12:13:50.456404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:03.727278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'170","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.634305+0000","last_change":"2024-09-14T11:17:31.655031+0000","last_active":"2024-09-14T12:14:34.634305+0000","last_peered":"2024-09-14T12:14:34.634305+0000","last_clean":"2024-09-14T12:14:34.634305+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:14:34.634305+0000","last_undegraded":"2024-09-14T12:14:34.634305+0000","last_fullsized":"2024-09-14T12:14:34.634305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:19.605574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'459","reported_seq":2050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208300+0000","last_change":"2024-09-14T11:17:23.599920+0000","last_active":"2024-09-14T12:14:31.208300+0000","last_peered":"2024-09-14T12:14:31.208300+0000","last_clean":"2024-09-14T12:14:31.208300+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:14:31.208300+0000","last_undegraded":"2024-09-14T12:14:31.208300+0000","last_fullsized":"2024-09-14T12:14:31.208300+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:33.295650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466357+0000","last_change":"2024-09-14T11:17:13.098465+0000","last_active":"2024-09-14T12:13:18.466357+0000","last_peered":"2024-09-14T12:13:18.466357+0000","last_clean":"2024-09-14T12:13:18.466357+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:13:18.466357+0000","last_undegraded":"2024-09-14T12:13:18.466357+0000","last_fullsized":"2024-09-14T12:13:18.466357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:36.824231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'385","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.868893+0000","last_change":"2024-09-14T12:16:19.868893+0000","last_active":"2024-09-14T12:16:19.868893+0000","last_peered":"2024-09-14T12:16:19.868893+0000","last_clean":"2024-09-14T12:16:19.868893+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:16:19.868893+0000","last_undegraded":"2024-09-14T12:16:19.868893+0000","last_fullsized":"2024-09-14T12:16:19.868893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.868790+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.225391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":9086,"num_write":1281,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.224869+0000","last_change":"2024-09-14T11:17:25.617276+0000","last_active":"2024-09-14T12:13:48.224869+0000","last_peered":"2024-09-14T12:13:48.224869+0000","last_clean":"2024-09-14T12:13:48.224869+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:13:48.224869+0000","last_undegraded":"2024-09-14T12:13:48.224869+0000","last_fullsized":"2024-09-14T12:13:48.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:50.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1305","reported_seq":2943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.319903+0000","last_change":"2024-09-14T11:17:27.631903+0000","last_active":"2024-09-14T12:16:15.319903+0000","last_peered":"2024-09-14T12:16:15.319903+0000","last_clean":"2024-09-14T12:16:15.319903+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:15.319903+0000","last_undegraded":"2024-09-14T12:16:15.319903+0000","last_fullsized":"2024-09-14T12:16:15.319903+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:33.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235088,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2047,"num_read_kb":3984,"num_write":1154,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471608+0000","last_change":"2024-09-14T11:17:29.645394+0000","last_active":"2024-09-14T12:13:53.471608+0000","last_peered":"2024-09-14T12:13:53.471608+0000","last_clean":"2024-09-14T12:13:53.471608+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:13:53.471608+0000","last_undegraded":"2024-09-14T12:13:53.471608+0000","last_fullsized":"2024-09-14T12:13:53.471608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:49.499047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211448+0000","last_change":"2024-09-14T11:17:31.658892+0000","last_active":"2024-09-14T12:14:03.211448+0000","last_peered":"2024-09-14T12:14:03.211448+0000","last_clean":"2024-09-14T12:14:03.211448+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:14:03.211448+0000","last_undegraded":"2024-09-14T12:14:03.211448+0000","last_fullsized":"2024-09-14T12:14:03.211448+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:34.868207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'656","reported_seq":2304,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606004+0000","last_change":"2024-09-14T11:17:23.597525+0000","last_active":"2024-09-14T12:14:34.606004+0000","last_peered":"2024-09-14T12:14:34.606004+0000","last_clean":"2024-09-14T12:14:34.606004+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:14:34.606004+0000","last_undegraded":"2024-09-14T12:14:34.606004+0000","last_fullsized":"2024-09-14T12:14:34.606004+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:35.708015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.310703+0000","last_change":"2024-09-14T11:17:13.098577+0000","last_active":"2024-09-14T12:13:28.310703+0000","last_peered":"2024-09-14T12:13:28.310703+0000","last_clean":"2024-09-14T12:13:28.310703+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:13:28.310703+0000","last_undegraded":"2024-09-14T12:13:28.310703+0000","last_fullsized":"2024-09-14T12:13:28.310703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:11.886979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'366","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.468832+0000","last_change":"2024-09-14T11:17:21.573767+0000","last_active":"2024-09-14T12:16:15.468832+0000","last_peered":"2024-09-14T12:16:15.468832+0000","last_clean":"2024-09-14T12:16:15.468832+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:16:15.468832+0000","last_undegraded":"2024-09-14T12:16:15.468832+0000","last_fullsized":"2024-09-14T12:16:15.468832+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:55.914740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":678,"num_read_kb":56413,"num_write":1142,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.312976+0000","last_change":"2024-09-14T11:17:25.616518+0000","last_active":"2024-09-14T12:13:48.312976+0000","last_peered":"2024-09-14T12:13:48.312976+0000","last_clean":"2024-09-14T12:13:48.312976+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:13:48.312976+0000","last_undegraded":"2024-09-14T12:13:48.312976+0000","last_fullsized":"2024-09-14T12:13:48.312976+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:31.140976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'258","reported_seq":1503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.376331+0000","last_change":"2024-09-14T11:17:27.633187+0000","last_active":"2024-09-14T12:15:49.376331+0000","last_peered":"2024-09-14T12:15:49.376331+0000","last_clean":"2024-09-14T12:15:49.376331+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:15:49.376331+0000","last_undegraded":"2024-09-14T12:15:49.376331+0000","last_fullsized":"2024-09-14T12:15:49.376331+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.161248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455781+0000","last_change":"2024-09-14T11:17:29.647473+0000","last_active":"2024-09-14T12:13:45.455781+0000","last_peered":"2024-09-14T12:13:45.455781+0000","last_clean":"2024-09-14T12:13:45.455781+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:13:45.455781+0000","last_undegraded":"2024-09-14T12:13:45.455781+0000","last_fullsized":"2024-09-14T12:13:45.455781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:28.646908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'797","reported_seq":2323,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.930217+0000","last_change":"2024-09-14T11:17:23.593249+0000","last_active":"2024-09-14T12:13:46.930217+0000","last_peered":"2024-09-14T12:13:46.930217+0000","last_clean":"2024-09-14T12:13:46.930217+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:13:46.930217+0000","last_undegraded":"2024-09-14T12:13:46.930217+0000","last_fullsized":"2024-09-14T12:13:46.930217+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:29.005386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221722+0000","last_change":"2024-09-14T11:17:12.934402+0000","last_active":"2024-09-14T12:13:28.221722+0000","last_peered":"2024-09-14T12:13:28.221722+0000","last_clean":"2024-09-14T12:13:28.221722+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:13:28.221722+0000","last_undegraded":"2024-09-14T12:13:28.221722+0000","last_fullsized":"2024-09-14T12:13:28.221722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:57.759758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'424","reported_seq":1087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.471051+0000","last_change":"2024-09-14T11:17:55.703523+0000","last_active":"2024-09-14T12:16:15.471051+0000","last_peered":"2024-09-14T12:16:15.471051+0000","last_clean":"2024-09-14T12:16:15.471051+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:16:15.471051+0000","last_undegraded":"2024-09-14T12:16:15.471051+0000","last_fullsized":"2024-09-14T12:16:15.471051+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.352121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":100618,"num_write":1363,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.090053+0000","last_change":"2024-09-14T11:17:25.612572+0000","last_active":"2024-09-14T12:16:14.090053+0000","last_peered":"2024-09-14T12:16:14.090053+0000","last_clean":"2024-09-14T12:16:14.090053+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:16:14.090053+0000","last_undegraded":"2024-09-14T12:16:14.090053+0000","last_fullsized":"2024-09-14T12:16:14.090053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:50.762349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":727,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'141","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.389956+0000","last_change":"2024-09-14T11:17:27.629622+0000","last_active":"2024-09-14T12:15:49.389956+0000","last_peered":"2024-09-14T12:15:49.389956+0000","last_clean":"2024-09-14T12:15:49.389956+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:15:49.389956+0000","last_undegraded":"2024-09-14T12:15:49.389956+0000","last_fullsized":"2024-09-14T12:15:49.389956+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:36.891527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.344480+0000","last_change":"2024-09-14T11:17:29.643346+0000","last_active":"2024-09-14T12:13:53.344480+0000","last_peered":"2024-09-14T12:13:53.344480+0000","last_clean":"2024-09-14T12:13:53.344480+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:13:53.344480+0000","last_undegraded":"2024-09-14T12:13:53.344480+0000","last_fullsized":"2024-09-14T12:13:53.344480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:54.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'152","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225431+0000","last_change":"2024-09-14T11:17:31.658341+0000","last_active":"2024-09-14T12:13:53.225431+0000","last_peered":"2024-09-14T12:13:53.225431+0000","last_clean":"2024-09-14T12:13:53.225431+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:13:53.225431+0000","last_undegraded":"2024-09-14T12:13:53.225431+0000","last_fullsized":"2024-09-14T12:13:53.225431+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:31.293556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'538","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771726+0000","last_change":"2024-09-14T11:17:23.595767+0000","last_active":"2024-09-14T12:14:33.771726+0000","last_peered":"2024-09-14T12:14:33.771726+0000","last_clean":"2024-09-14T12:14:33.771726+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:14:33.771726+0000","last_undegraded":"2024-09-14T12:14:33.771726+0000","last_fullsized":"2024-09-14T12:14:33.771726+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:17.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'372","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.423692+0000","last_change":"2024-09-14T11:17:21.587230+0000","last_active":"2024-09-14T12:16:15.423692+0000","last_peered":"2024-09-14T12:16:15.423692+0000","last_clean":"2024-09-14T12:16:15.423692+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:16:15.423692+0000","last_undegraded":"2024-09-14T12:16:15.423692+0000","last_fullsized":"2024-09-14T12:16:15.423692+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:54.075546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":15898,"num_write":1178,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207418+0000","last_change":"2024-09-14T11:17:12.935986+0000","last_active":"2024-09-14T12:13:28.207418+0000","last_peered":"2024-09-14T12:13:28.207418+0000","last_clean":"2024-09-14T12:13:28.207418+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:13:28.207418+0000","last_undegraded":"2024-09-14T12:13:28.207418+0000","last_fullsized":"2024-09-14T12:13:28.207418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:05.428106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455178+0000","last_change":"2024-09-14T11:17:25.613788+0000","last_active":"2024-09-14T12:13:40.455178+0000","last_peered":"2024-09-14T12:13:40.455178+0000","last_clean":"2024-09-14T12:13:40.455178+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:13:40.455178+0000","last_undegraded":"2024-09-14T12:13:40.455178+0000","last_fullsized":"2024-09-14T12:13:40.455178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:16.381616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'596","reported_seq":1268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.147113+0000","last_change":"2024-09-14T11:17:27.638848+0000","last_active":"2024-09-14T12:16:15.147113+0000","last_peered":"2024-09-14T12:16:15.147113+0000","last_clean":"2024-09-14T12:16:15.147113+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:16:15.147113+0000","last_undegraded":"2024-09-14T12:16:15.147113+0000","last_fullsized":"2024-09-14T12:16:15.147113+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.865878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94377,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1665,"num_read_kb":2783,"num_write":2218,"num_write_kb":2033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339077+0000","last_change":"2024-09-14T11:17:29.647531+0000","last_active":"2024-09-14T12:13:48.339077+0000","last_peered":"2024-09-14T12:13:48.339077+0000","last_clean":"2024-09-14T12:13:48.339077+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:13:48.339077+0000","last_undegraded":"2024-09-14T12:13:48.339077+0000","last_fullsized":"2024-09-14T12:13:48.339077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:29.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.737717+0000","last_change":"2024-09-14T11:17:31.650597+0000","last_active":"2024-09-14T12:14:31.737717+0000","last_peered":"2024-09-14T12:14:31.737717+0000","last_clean":"2024-09-14T12:14:31.737717+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:14:31.737717+0000","last_undegraded":"2024-09-14T12:14:31.737717+0000","last_fullsized":"2024-09-14T12:14:31.737717+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:24.077884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'812","reported_seq":2368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.503663+0000","last_change":"2024-09-14T11:17:23.597119+0000","last_active":"2024-09-14T12:15:18.503663+0000","last_peered":"2024-09-14T12:15:18.503663+0000","last_clean":"2024-09-14T12:15:18.503663+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:15:18.503663+0000","last_undegraded":"2024-09-14T12:15:18.503663+0000","last_fullsized":"2024-09-14T12:15:18.503663+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:41.357900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'361","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.431443+0000","last_change":"2024-09-14T11:17:21.572174+0000","last_active":"2024-09-14T12:16:15.431443+0000","last_peered":"2024-09-14T12:16:15.431443+0000","last_clean":"2024-09-14T12:16:15.431443+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:16:15.431443+0000","last_undegraded":"2024-09-14T12:16:15.431443+0000","last_fullsized":"2024-09-14T12:16:15.431443+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:44.158752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159837,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":790,"num_read_kb":26393,"num_write":1261,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468686+0000","last_change":"2024-09-14T11:17:13.098634+0000","last_active":"2024-09-14T12:13:33.468686+0000","last_peered":"2024-09-14T12:13:33.468686+0000","last_clean":"2024-09-14T12:13:33.468686+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:13:33.468686+0000","last_undegraded":"2024-09-14T12:13:33.468686+0000","last_fullsized":"2024-09-14T12:13:33.468686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:36.021911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455177+0000","last_change":"2024-09-14T11:17:25.613944+0000","last_active":"2024-09-14T12:13:43.455177+0000","last_peered":"2024-09-14T12:13:43.455177+0000","last_clean":"2024-09-14T12:13:43.455177+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:13:43.455177+0000","last_undegraded":"2024-09-14T12:13:43.455177+0000","last_fullsized":"2024-09-14T12:13:43.455177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:03.613451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.612668+0000","last_change":"2024-09-14T11:17:27.630067+0000","last_active":"2024-09-14T12:14:34.612668+0000","last_peered":"2024-09-14T12:14:34.612668+0000","last_clean":"2024-09-14T12:14:34.612668+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:14:34.612668+0000","last_undegraded":"2024-09-14T12:14:34.612668+0000","last_fullsized":"2024-09-14T12:14:34.612668+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:12.127579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'813","reported_seq":6811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.224377+0000","last_change":"2024-09-14T11:17:29.642605+0000","last_active":"2024-09-14T12:16:15.224377+0000","last_peered":"2024-09-14T12:16:15.224377+0000","last_clean":"2024-09-14T12:16:15.224377+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:16:15.224377+0000","last_undegraded":"2024-09-14T12:16:15.224377+0000","last_fullsized":"2024-09-14T12:16:15.224377+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:10.588277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'138","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.245879+0000","last_change":"2024-09-14T11:17:31.658974+0000","last_active":"2024-09-14T12:15:49.245879+0000","last_peered":"2024-09-14T12:15:49.245879+0000","last_clean":"2024-09-14T12:15:49.245879+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:15:49.245879+0000","last_undegraded":"2024-09-14T12:15:49.245879+0000","last_fullsized":"2024-09-14T12:15:49.245879+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:06.184401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1159","reported_seq":2655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.578456+0000","last_change":"2024-09-14T11:17:23.594825+0000","last_active":"2024-09-14T12:13:55.578456+0000","last_peered":"2024-09-14T12:13:55.578456+0000","last_clean":"2024-09-14T12:13:55.578456+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:13:55.578456+0000","last_undegraded":"2024-09-14T12:13:55.578456+0000","last_fullsized":"2024-09-14T12:13:55.578456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":1100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:08.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'308","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.468838+0000","last_change":"2024-09-14T11:17:21.588659+0000","last_active":"2024-09-14T12:16:15.468838+0000","last_peered":"2024-09-14T12:16:15.468838+0000","last_clean":"2024-09-14T12:16:15.468838+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:16:15.468838+0000","last_undegraded":"2024-09-14T12:16:15.468838+0000","last_fullsized":"2024-09-14T12:16:15.468838+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:03.346229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":24953,"num_write":917,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.208010+0000","last_change":"2024-09-14T11:17:12.935913+0000","last_active":"2024-09-14T12:13:33.208010+0000","last_peered":"2024-09-14T12:13:33.208010+0000","last_clean":"2024-09-14T12:13:33.208010+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:13:33.208010+0000","last_undegraded":"2024-09-14T12:13:33.208010+0000","last_fullsized":"2024-09-14T12:13:33.208010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:56.083753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338159+0000","last_change":"2024-09-14T11:17:25.612971+0000","last_active":"2024-09-14T12:13:43.338159+0000","last_peered":"2024-09-14T12:13:43.338159+0000","last_clean":"2024-09-14T12:13:43.338159+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:13:43.338159+0000","last_undegraded":"2024-09-14T12:13:43.338159+0000","last_fullsized":"2024-09-14T12:13:43.338159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:01.406616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'112","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338189+0000","last_change":"2024-09-14T11:17:27.630261+0000","last_active":"2024-09-14T12:13:43.338189+0000","last_peered":"2024-09-14T12:13:43.338189+0000","last_clean":"2024-09-14T12:13:43.338189+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:13:43.338189+0000","last_undegraded":"2024-09-14T12:13:43.338189+0000","last_fullsized":"2024-09-14T12:13:43.338189+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:38.765597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'804","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.257712+0000","last_change":"2024-09-14T11:17:29.646106+0000","last_active":"2024-09-14T12:16:15.257712+0000","last_peered":"2024-09-14T12:16:15.257712+0000","last_clean":"2024-09-14T12:16:15.257712+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:16:15.257712+0000","last_undegraded":"2024-09-14T12:16:15.257712+0000","last_fullsized":"2024-09-14T12:16:15.257712+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.541372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'195","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.076897+0000","last_change":"2024-09-14T11:17:31.656972+0000","last_active":"2024-09-14T12:14:33.076897+0000","last_peered":"2024-09-14T12:14:33.076897+0000","last_clean":"2024-09-14T12:14:33.076897+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:14:33.076897+0000","last_undegraded":"2024-09-14T12:14:33.076897+0000","last_fullsized":"2024-09-14T12:14:33.076897+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:57.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619317+0000","last_change":"2024-09-14T11:17:23.593644+0000","last_active":"2024-09-14T12:13:57.619317+0000","last_peered":"2024-09-14T12:13:57.619317+0000","last_clean":"2024-09-14T12:13:57.619317+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:13:57.619317+0000","last_undegraded":"2024-09-14T12:13:57.619317+0000","last_fullsized":"2024-09-14T12:13:57.619317+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:42.299861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'403","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.485175+0000","last_change":"2024-09-14T11:17:21.581527+0000","last_active":"2024-09-14T12:16:15.485175+0000","last_peered":"2024-09-14T12:16:15.485175+0000","last_clean":"2024-09-14T12:16:15.485175+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:16:15.485175+0000","last_undegraded":"2024-09-14T12:16:15.485175+0000","last_fullsized":"2024-09-14T12:16:15.485175+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:36.511139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":7690,"num_write":1106,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453887+0000","last_change":"2024-09-14T11:17:13.098327+0000","last_active":"2024-09-14T12:13:33.453887+0000","last_peered":"2024-09-14T12:13:33.453887+0000","last_clean":"2024-09-14T12:13:33.453887+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:13:33.453887+0000","last_undegraded":"2024-09-14T12:13:33.453887+0000","last_fullsized":"2024-09-14T12:13:33.453887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:09.889220+0000","last_clean_scrub_stamp":"2024-09-14T11:17:09.889220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:49.452332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219350+0000","last_change":"2024-09-14T11:17:25.617838+0000","last_active":"2024-09-14T12:13:43.219350+0000","last_peered":"2024-09-14T12:13:43.219350+0000","last_clean":"2024-09-14T12:13:43.219350+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:13:43.219350+0000","last_undegraded":"2024-09-14T12:13:43.219350+0000","last_fullsized":"2024-09-14T12:13:43.219350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.722602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'719","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.349407+0000","last_change":"2024-09-14T11:17:27.628721+0000","last_active":"2024-09-14T12:16:15.349407+0000","last_peered":"2024-09-14T12:16:15.349407+0000","last_clean":"2024-09-14T12:16:15.349407+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:16:15.349407+0000","last_undegraded":"2024-09-14T12:16:15.349407+0000","last_fullsized":"2024-09-14T12:16:15.349407+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:43.091580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149203,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1276,"num_read_kb":2979,"num_write":1030,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219994+0000","last_change":"2024-09-14T11:17:29.643858+0000","last_active":"2024-09-14T12:13:48.219994+0000","last_peered":"2024-09-14T12:13:48.219994+0000","last_clean":"2024-09-14T12:13:48.219994+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:13:48.219994+0000","last_undegraded":"2024-09-14T12:13:48.219994+0000","last_fullsized":"2024-09-14T12:13:48.219994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.290912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'112","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.590948+0000","last_change":"2024-09-14T11:17:31.659136+0000","last_active":"2024-09-14T12:14:34.590948+0000","last_peered":"2024-09-14T12:14:34.590948+0000","last_clean":"2024-09-14T12:14:34.590948+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:14:34.590948+0000","last_undegraded":"2024-09-14T12:14:34.590948+0000","last_fullsized":"2024-09-14T12:14:34.590948+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:30.679212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'154","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.818840+0000","last_change":"2024-09-14T11:17:31.657903+0000","last_active":"2024-09-14T12:14:34.818840+0000","last_peered":"2024-09-14T12:14:34.818840+0000","last_clean":"2024-09-14T12:14:34.818840+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:14:34.818840+0000","last_undegraded":"2024-09-14T12:14:34.818840+0000","last_fullsized":"2024-09-14T12:14:34.818840+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:29.439862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'376","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.886093+0000","last_change":"2024-09-14T11:17:23.593275+0000","last_active":"2024-09-14T12:13:38.886093+0000","last_peered":"2024-09-14T12:13:38.886093+0000","last_clean":"2024-09-14T12:13:38.886093+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:13:38.886093+0000","last_undegraded":"2024-09-14T12:13:38.886093+0000","last_fullsized":"2024-09-14T12:13:38.886093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:51.712720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'333","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.445584+0000","last_change":"2024-09-14T11:17:21.585438+0000","last_active":"2024-09-14T12:16:15.445584+0000","last_peered":"2024-09-14T12:16:15.445584+0000","last_clean":"2024-09-14T12:16:15.445584+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:16:15.445584+0000","last_undegraded":"2024-09-14T12:16:15.445584+0000","last_fullsized":"2024-09-14T12:16:15.445584+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:54.991062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":681,"num_read_kb":30194,"num_write":1111,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.089131+0000","last_change":"2024-09-14T11:17:25.614818+0000","last_active":"2024-09-14T12:16:14.089131+0000","last_peered":"2024-09-14T12:16:14.089131+0000","last_clean":"2024-09-14T12:16:14.089131+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:16:14.089131+0000","last_undegraded":"2024-09-14T12:16:14.089131+0000","last_fullsized":"2024-09-14T12:16:14.089131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:14.190710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'299","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.659689+0000","last_change":"2024-09-14T11:17:27.630446+0000","last_active":"2024-09-14T12:16:14.659689+0000","last_peered":"2024-09-14T12:16:14.659689+0000","last_clean":"2024-09-14T12:16:14.659689+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:16:14.659689+0000","last_undegraded":"2024-09-14T12:16:14.659689+0000","last_fullsized":"2024-09-14T12:16:14.659689+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:50.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55106,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1151,"num_write":410,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.218125+0000","last_change":"2024-09-14T11:17:29.645258+0000","last_active":"2024-09-14T12:13:33.218125+0000","last_peered":"2024-09-14T12:13:33.218125+0000","last_clean":"2024-09-14T12:13:33.218125+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:13:33.218125+0000","last_undegraded":"2024-09-14T12:13:33.218125+0000","last_fullsized":"2024-09-14T12:13:33.218125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:46.921971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'432","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605972+0000","last_change":"2024-09-14T11:17:23.600768+0000","last_active":"2024-09-14T12:14:34.605972+0000","last_peered":"2024-09-14T12:14:34.605972+0000","last_clean":"2024-09-14T12:14:34.605972+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:14:34.605972+0000","last_undegraded":"2024-09-14T12:14:34.605972+0000","last_fullsized":"2024-09-14T12:14:34.605972+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:12.282064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'397","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.479743+0000","last_change":"2024-09-14T11:17:21.581055+0000","last_active":"2024-09-14T12:16:15.479743+0000","last_peered":"2024-09-14T12:16:15.479743+0000","last_clean":"2024-09-14T12:16:15.479743+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:16:15.479743+0000","last_undegraded":"2024-09-14T12:16:15.479743+0000","last_fullsized":"2024-09-14T12:16:15.479743+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.405999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":23223,"num_write":1213,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.217660+0000","last_change":"2024-09-14T11:17:25.615312+0000","last_active":"2024-09-14T12:13:28.217660+0000","last_peered":"2024-09-14T12:13:28.217660+0000","last_clean":"2024-09-14T12:13:28.217660+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:13:28.217660+0000","last_undegraded":"2024-09-14T12:13:28.217660+0000","last_fullsized":"2024-09-14T12:13:28.217660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:18.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.936226+0000","last_change":"2024-09-14T11:17:27.636113+0000","last_active":"2024-09-14T12:13:46.936226+0000","last_peered":"2024-09-14T12:13:46.936226+0000","last_clean":"2024-09-14T12:13:46.936226+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:13:46.936226+0000","last_undegraded":"2024-09-14T12:13:46.936226+0000","last_fullsized":"2024-09-14T12:13:46.936226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:28.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468624+0000","last_change":"2024-09-14T11:17:29.642497+0000","last_active":"2024-09-14T12:13:33.468624+0000","last_peered":"2024-09-14T12:13:33.468624+0000","last_clean":"2024-09-14T12:13:33.468624+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:13:33.468624+0000","last_undegraded":"2024-09-14T12:13:33.468624+0000","last_fullsized":"2024-09-14T12:13:33.468624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:18.572740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.825413+0000","last_change":"2024-09-14T11:17:31.655716+0000","last_active":"2024-09-14T12:14:33.825413+0000","last_peered":"2024-09-14T12:14:33.825413+0000","last_clean":"2024-09-14T12:14:33.825413+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:14:33.825413+0000","last_undegraded":"2024-09-14T12:14:33.825413+0000","last_fullsized":"2024-09-14T12:14:33.825413+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:00.360800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'491","reported_seq":2240,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.116559+0000","last_change":"2024-09-14T11:17:23.601965+0000","last_active":"2024-09-14T12:15:48.116559+0000","last_peered":"2024-09-14T12:15:48.116559+0000","last_clean":"2024-09-14T12:15:48.116559+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:15:48.116559+0000","last_undegraded":"2024-09-14T12:15:48.116559+0000","last_fullsized":"2024-09-14T12:15:48.116559+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:59.504121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'364","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.432154+0000","last_change":"2024-09-14T11:17:21.589616+0000","last_active":"2024-09-14T12:16:15.432154+0000","last_peered":"2024-09-14T12:16:15.432154+0000","last_clean":"2024-09-14T12:16:15.432154+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:16:15.432154+0000","last_undegraded":"2024-09-14T12:16:15.432154+0000","last_fullsized":"2024-09-14T12:16:15.432154+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:27.751657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":658,"num_read_kb":51938,"num_write":1111,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.467979+0000","last_change":"2024-09-14T11:17:25.617478+0000","last_active":"2024-09-14T12:13:28.467979+0000","last_peered":"2024-09-14T12:13:28.467979+0000","last_clean":"2024-09-14T12:13:28.467979+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:13:28.467979+0000","last_undegraded":"2024-09-14T12:13:28.467979+0000","last_fullsized":"2024-09-14T12:13:28.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:19.271955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.281671+0000","last_change":"2024-09-14T11:17:27.636107+0000","last_active":"2024-09-14T12:16:14.281671+0000","last_peered":"2024-09-14T12:16:14.281671+0000","last_clean":"2024-09-14T12:16:14.281671+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:16:14.281671+0000","last_undegraded":"2024-09-14T12:16:14.281671+0000","last_fullsized":"2024-09-14T12:16:14.281671+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:04.296570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51654,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1212,"num_write":436,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453820+0000","last_change":"2024-09-14T11:17:29.643307+0000","last_active":"2024-09-14T12:13:33.453820+0000","last_peered":"2024-09-14T12:13:33.453820+0000","last_clean":"2024-09-14T12:13:33.453820+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:13:33.453820+0000","last_undegraded":"2024-09-14T12:13:33.453820+0000","last_fullsized":"2024-09-14T12:13:33.453820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:35.656780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.811510+0000","last_change":"2024-09-14T11:17:31.659547+0000","last_active":"2024-09-14T12:13:42.811510+0000","last_peered":"2024-09-14T12:13:42.811510+0000","last_clean":"2024-09-14T12:13:42.811510+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:13:42.811510+0000","last_undegraded":"2024-09-14T12:13:42.811510+0000","last_fullsized":"2024-09-14T12:13:42.811510+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:01.530736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'927","reported_seq":2570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208965+0000","last_change":"2024-09-14T11:17:23.598429+0000","last_active":"2024-09-14T12:14:31.208965+0000","last_peered":"2024-09-14T12:14:31.208965+0000","last_clean":"2024-09-14T12:14:31.208965+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:14:31.208965+0000","last_undegraded":"2024-09-14T12:14:31.208965+0000","last_fullsized":"2024-09-14T12:14:31.208965+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:15.669362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'343","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.473807+0000","last_change":"2024-09-14T11:17:21.587300+0000","last_active":"2024-09-14T12:16:15.473807+0000","last_peered":"2024-09-14T12:16:15.473807+0000","last_clean":"2024-09-14T12:16:15.473807+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:16:15.473807+0000","last_undegraded":"2024-09-14T12:16:15.473807+0000","last_fullsized":"2024-09-14T12:16:15.473807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:29.886995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":18794,"num_write":1109,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453138+0000","last_change":"2024-09-14T11:17:25.614842+0000","last_active":"2024-09-14T12:13:28.453138+0000","last_peered":"2024-09-14T12:13:28.453138+0000","last_clean":"2024-09-14T12:13:28.453138+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:13:28.453138+0000","last_undegraded":"2024-09-14T12:13:28.453138+0000","last_fullsized":"2024-09-14T12:13:28.453138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:42.011559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'303","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.489645+0000","last_change":"2024-09-14T11:17:27.628464+0000","last_active":"2024-09-14T12:16:15.489645+0000","last_peered":"2024-09-14T12:16:15.489645+0000","last_clean":"2024-09-14T12:16:15.489645+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:16:15.489645+0000","last_undegraded":"2024-09-14T12:16:15.489645+0000","last_fullsized":"2024-09-14T12:16:15.489645+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.155512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1246,"num_write":418,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453988+0000","last_change":"2024-09-14T11:17:29.647028+0000","last_active":"2024-09-14T12:13:30.453988+0000","last_peered":"2024-09-14T12:13:30.453988+0000","last_clean":"2024-09-14T12:13:30.453988+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:13:30.453988+0000","last_undegraded":"2024-09-14T12:13:30.453988+0000","last_fullsized":"2024-09-14T12:13:30.453988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:25.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'446","reported_seq":2072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208631+0000","last_change":"2024-09-14T11:17:23.593931+0000","last_active":"2024-09-14T12:14:31.208631+0000","last_peered":"2024-09-14T12:14:31.208631+0000","last_clean":"2024-09-14T12:14:31.208631+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:14:31.208631+0000","last_undegraded":"2024-09-14T12:14:31.208631+0000","last_fullsized":"2024-09-14T12:14:31.208631+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:31.575674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'335","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.460080+0000","last_change":"2024-09-14T11:17:21.580778+0000","last_active":"2024-09-14T12:16:15.460080+0000","last_peered":"2024-09-14T12:16:15.460080+0000","last_clean":"2024-09-14T12:16:15.460080+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:16:15.460080+0000","last_undegraded":"2024-09-14T12:16:15.460080+0000","last_fullsized":"2024-09-14T12:16:15.460080+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:51.109271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":38674,"num_write":1067,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454040+0000","last_change":"2024-09-14T11:17:25.616189+0000","last_active":"2024-09-14T12:13:30.454040+0000","last_peered":"2024-09-14T12:13:30.454040+0000","last_clean":"2024-09-14T12:13:30.454040+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:13:30.454040+0000","last_undegraded":"2024-09-14T12:13:30.454040+0000","last_fullsized":"2024-09-14T12:13:30.454040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:01.244165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'492","reported_seq":1122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.449310+0000","last_change":"2024-09-14T11:17:27.633619+0000","last_active":"2024-09-14T12:16:15.449310+0000","last_peered":"2024-09-14T12:16:15.449310+0000","last_clean":"2024-09-14T12:16:15.449310+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:16:15.449310+0000","last_undegraded":"2024-09-14T12:16:15.449310+0000","last_fullsized":"2024-09-14T12:16:15.449310+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:36.703508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":2075,"num_write":756,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213328+0000","last_change":"2024-09-14T11:17:29.645579+0000","last_active":"2024-09-14T12:12:33.213328+0000","last_peered":"2024-09-14T12:12:33.213328+0000","last_clean":"2024-09-14T12:12:33.213328+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:12:33.213328+0000","last_undegraded":"2024-09-14T12:12:33.213328+0000","last_fullsized":"2024-09-14T12:12:33.213328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:26.891079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'838","reported_seq":2534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208276+0000","last_change":"2024-09-14T11:17:23.595214+0000","last_active":"2024-09-14T12:14:31.208276+0000","last_peered":"2024-09-14T12:14:31.208276+0000","last_clean":"2024-09-14T12:14:31.208276+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:14:31.208276+0000","last_undegraded":"2024-09-14T12:14:31.208276+0000","last_fullsized":"2024-09-14T12:14:31.208276+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:09.844778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'399","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.485331+0000","last_change":"2024-09-14T11:17:21.579786+0000","last_active":"2024-09-14T12:16:15.485331+0000","last_peered":"2024-09-14T12:16:15.485331+0000","last_clean":"2024-09-14T12:16:15.485331+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:16:15.485331+0000","last_undegraded":"2024-09-14T12:16:15.485331+0000","last_fullsized":"2024-09-14T12:16:15.485331+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.971306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":5750,"num_write":1256,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455241+0000","last_change":"2024-09-14T11:17:25.616062+0000","last_active":"2024-09-14T12:13:43.455241+0000","last_peered":"2024-09-14T12:13:43.455241+0000","last_clean":"2024-09-14T12:13:43.455241+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:13:43.455241+0000","last_undegraded":"2024-09-14T12:13:43.455241+0000","last_fullsized":"2024-09-14T12:13:43.455241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.590638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'313","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.204362+0000","last_change":"2024-09-14T11:17:27.631864+0000","last_active":"2024-09-14T12:16:14.204362+0000","last_peered":"2024-09-14T12:16:14.204362+0000","last_clean":"2024-09-14T12:16:14.204362+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:14.204362+0000","last_undegraded":"2024-09-14T12:16:14.204362+0000","last_fullsized":"2024-09-14T12:16:14.204362+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.144668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1111,"num_write":430,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201536+0000","last_change":"2024-09-14T11:17:29.640091+0000","last_active":"2024-09-14T12:12:33.201536+0000","last_peered":"2024-09-14T12:12:33.201536+0000","last_clean":"2024-09-14T12:12:33.201536+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:12:33.201536+0000","last_undegraded":"2024-09-14T12:12:33.201536+0000","last_fullsized":"2024-09-14T12:12:33.201536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:15.297752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'201","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.078225+0000","last_change":"2024-09-14T11:17:31.654553+0000","last_active":"2024-09-14T12:14:32.078225+0000","last_peered":"2024-09-14T12:14:32.078225+0000","last_clean":"2024-09-14T12:14:32.078225+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:14:32.078225+0000","last_undegraded":"2024-09-14T12:14:32.078225+0000","last_fullsized":"2024-09-14T12:14:32.078225+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:30.957381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'415","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.208752+0000","last_change":"2024-09-14T11:17:23.597737+0000","last_active":"2024-09-14T12:14:31.208752+0000","last_peered":"2024-09-14T12:14:31.208752+0000","last_clean":"2024-09-14T12:14:31.208752+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:14:31.208752+0000","last_undegraded":"2024-09-14T12:14:31.208752+0000","last_fullsized":"2024-09-14T12:14:31.208752+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.853930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'361","reported_seq":1122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.469939+0000","last_change":"2024-09-14T11:17:21.572704+0000","last_active":"2024-09-14T12:16:15.469939+0000","last_peered":"2024-09-14T12:16:15.469939+0000","last_clean":"2024-09-14T12:16:15.469939+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:16:15.469939+0000","last_undegraded":"2024-09-14T12:16:15.469939+0000","last_fullsized":"2024-09-14T12:16:15.469939+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:48.097453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":55641,"num_write":1285,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.327534+0000","last_change":"2024-09-14T11:17:25.615822+0000","last_active":"2024-09-14T12:12:28.327534+0000","last_peered":"2024-09-14T12:12:28.327534+0000","last_clean":"2024-09-14T12:12:28.327534+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:12:28.327534+0000","last_undegraded":"2024-09-14T12:12:28.327534+0000","last_fullsized":"2024-09-14T12:12:28.327534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:36.413046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'302","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.006599+0000","last_change":"2024-09-14T11:17:27.632371+0000","last_active":"2024-09-14T12:16:15.006599+0000","last_peered":"2024-09-14T12:16:15.006599+0000","last_clean":"2024-09-14T12:16:15.006599+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:16:15.006599+0000","last_undegraded":"2024-09-14T12:16:15.006599+0000","last_fullsized":"2024-09-14T12:16:15.006599+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:48.220034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53208,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":494,"num_read_kb":1139,"num_write":406,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209176+0000","last_change":"2024-09-14T11:17:29.643082+0000","last_active":"2024-09-14T12:13:43.209176+0000","last_peered":"2024-09-14T12:13:43.209176+0000","last_clean":"2024-09-14T12:13:43.209176+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:13:43.209176+0000","last_undegraded":"2024-09-14T12:13:43.209176+0000","last_fullsized":"2024-09-14T12:13:43.209176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:03.359386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'100","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.251218+0000","last_change":"2024-09-14T11:17:31.657761+0000","last_active":"2024-09-14T12:15:49.251218+0000","last_peered":"2024-09-14T12:15:49.251218+0000","last_clean":"2024-09-14T12:15:49.251218+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:15:49.251218+0000","last_undegraded":"2024-09-14T12:15:49.251218+0000","last_fullsized":"2024-09-14T12:15:49.251218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.568137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'483","reported_seq":2020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:31.869633+0000","last_change":"2024-09-14T11:17:23.594002+0000","last_active":"2024-09-14T12:13:31.869633+0000","last_peered":"2024-09-14T12:13:31.869633+0000","last_clean":"2024-09-14T12:13:31.869633+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:13:31.869633+0000","last_undegraded":"2024-09-14T12:13:31.869633+0000","last_fullsized":"2024-09-14T12:13:31.869633+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:29.422949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'439","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.370611+0000","last_change":"2024-09-14T11:17:21.582882+0000","last_active":"2024-09-14T12:16:15.370611+0000","last_peered":"2024-09-14T12:16:15.370611+0000","last_clean":"2024-09-14T12:16:15.370611+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:16:15.370611+0000","last_undegraded":"2024-09-14T12:16:15.370611+0000","last_fullsized":"2024-09-14T12:16:15.370611+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:26.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1189,"num_read_kb":773,"num_write":1309,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.200982+0000","last_change":"2024-09-14T11:17:25.606521+0000","last_active":"2024-09-14T12:12:28.200982+0000","last_peered":"2024-09-14T12:12:28.200982+0000","last_clean":"2024-09-14T12:12:28.200982+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:12:28.200982+0000","last_undegraded":"2024-09-14T12:12:28.200982+0000","last_fullsized":"2024-09-14T12:12:28.200982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.190615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.336647+0000","last_change":"2024-09-14T11:17:27.625718+0000","last_active":"2024-09-14T12:13:33.336647+0000","last_peered":"2024-09-14T12:13:33.336647+0000","last_clean":"2024-09-14T12:13:33.336647+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:13:33.336647+0000","last_undegraded":"2024-09-14T12:13:33.336647+0000","last_fullsized":"2024-09-14T12:13:33.336647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:13.564944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'781","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.116909+0000","last_change":"2024-09-14T11:17:29.641638+0000","last_active":"2024-09-14T12:16:14.116909+0000","last_peered":"2024-09-14T12:16:14.116909+0000","last_clean":"2024-09-14T12:16:14.116909+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:16:14.116909+0000","last_undegraded":"2024-09-14T12:16:14.116909+0000","last_fullsized":"2024-09-14T12:16:14.116909+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:54.865127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'126","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.517595+0000","last_change":"2024-09-14T11:17:31.654896+0000","last_active":"2024-09-14T12:13:48.517595+0000","last_peered":"2024-09-14T12:13:48.517595+0000","last_clean":"2024-09-14T12:13:48.517595+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:13:48.517595+0000","last_undegraded":"2024-09-14T12:13:48.517595+0000","last_fullsized":"2024-09-14T12:13:48.517595+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:18.947558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'482","reported_seq":2002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606832+0000","last_change":"2024-09-14T11:17:23.603409+0000","last_active":"2024-09-14T12:14:34.606832+0000","last_peered":"2024-09-14T12:14:34.606832+0000","last_clean":"2024-09-14T12:14:34.606832+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:14:34.606832+0000","last_undegraded":"2024-09-14T12:14:34.606832+0000","last_fullsized":"2024-09-14T12:14:34.606832+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:58.876757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'365","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.464607+0000","last_change":"2024-09-14T11:17:21.584853+0000","last_active":"2024-09-14T12:16:15.464607+0000","last_peered":"2024-09-14T12:16:15.464607+0000","last_clean":"2024-09-14T12:16:15.464607+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:16:15.464607+0000","last_undegraded":"2024-09-14T12:16:15.464607+0000","last_fullsized":"2024-09-14T12:16:15.464607+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:42.636525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":665,"num_read_kb":45610,"num_write":1043,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.456732+0000","last_change":"2024-09-14T11:17:25.618200+0000","last_active":"2024-09-14T12:12:28.456732+0000","last_peered":"2024-09-14T12:12:28.456732+0000","last_clean":"2024-09-14T12:12:28.456732+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:12:28.456732+0000","last_undegraded":"2024-09-14T12:12:28.456732+0000","last_fullsized":"2024-09-14T12:12:28.456732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:36.032390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'317","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.211745+0000","last_change":"2024-09-14T11:17:27.632003+0000","last_active":"2024-09-14T12:16:15.211745+0000","last_peered":"2024-09-14T12:16:15.211745+0000","last_clean":"2024-09-14T12:16:15.211745+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:16:15.211745+0000","last_undegraded":"2024-09-14T12:16:15.211745+0000","last_fullsized":"2024-09-14T12:16:15.211745+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":989,"num_write":382,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:05.450810+0000","last_change":"2024-09-14T11:17:29.642860+0000","last_active":"2024-09-14T12:13:05.450810+0000","last_peered":"2024-09-14T12:13:05.450810+0000","last_clean":"2024-09-14T12:13:05.450810+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:13:05.450810+0000","last_undegraded":"2024-09-14T12:13:05.450810+0000","last_fullsized":"2024-09-14T12:13:05.450810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:49.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'163","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.740671+0000","last_change":"2024-09-14T11:17:31.659537+0000","last_active":"2024-09-14T12:14:31.740671+0000","last_peered":"2024-09-14T12:14:31.740671+0000","last_clean":"2024-09-14T12:14:31.740671+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:14:31.740671+0000","last_undegraded":"2024-09-14T12:14:31.740671+0000","last_fullsized":"2024-09-14T12:14:31.740671+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:58.564304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'823","reported_seq":2429,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.532267+0000","last_change":"2024-09-14T11:17:23.603348+0000","last_active":"2024-09-14T12:13:48.532267+0000","last_peered":"2024-09-14T12:13:48.532267+0000","last_clean":"2024-09-14T12:13:48.532267+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:13:48.532267+0000","last_undegraded":"2024-09-14T12:13:48.532267+0000","last_fullsized":"2024-09-14T12:13:48.532267+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.172017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'398","reported_seq":1255,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.427713+0000","last_change":"2024-09-14T11:17:21.586488+0000","last_active":"2024-09-14T12:16:15.427713+0000","last_peered":"2024-09-14T12:16:15.427713+0000","last_clean":"2024-09-14T12:16:15.427713+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:16:15.427713+0000","last_undegraded":"2024-09-14T12:16:15.427713+0000","last_fullsized":"2024-09-14T12:16:15.427713+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:17.459649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1324,"num_read_kb":37458,"num_write":1300,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331124+0000","last_change":"2024-09-14T11:17:25.617051+0000","last_active":"2024-09-14T12:12:28.331124+0000","last_peered":"2024-09-14T12:12:28.331124+0000","last_clean":"2024-09-14T12:12:28.331124+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:12:28.331124+0000","last_undegraded":"2024-09-14T12:12:28.331124+0000","last_fullsized":"2024-09-14T12:12:28.331124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:24.207846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'280","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.249728+0000","last_change":"2024-09-14T11:17:27.635755+0000","last_active":"2024-09-14T12:16:15.249728+0000","last_peered":"2024-09-14T12:16:15.249728+0000","last_clean":"2024-09-14T12:16:15.249728+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:16:15.249728+0000","last_undegraded":"2024-09-14T12:16:15.249728+0000","last_fullsized":"2024-09-14T12:16:15.249728+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46067,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":1076,"num_write":376,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.450854+0000","last_change":"2024-09-14T11:17:29.642662+0000","last_active":"2024-09-14T12:13:13.450854+0000","last_peered":"2024-09-14T12:13:13.450854+0000","last_clean":"2024-09-14T12:13:13.450854+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:13:13.450854+0000","last_undegraded":"2024-09-14T12:13:13.450854+0000","last_fullsized":"2024-09-14T12:13:13.450854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:37.438168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'101","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:52.066499+0000","last_change":"2024-09-14T11:17:31.653130+0000","last_active":"2024-09-14T12:13:52.066499+0000","last_peered":"2024-09-14T12:13:52.066499+0000","last_clean":"2024-09-14T12:13:52.066499+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:13:52.066499+0000","last_undegraded":"2024-09-14T12:13:52.066499+0000","last_fullsized":"2024-09-14T12:13:52.066499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:01.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'466","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.118951+0000","last_change":"2024-09-14T11:17:23.598902+0000","last_active":"2024-09-14T12:15:48.118951+0000","last_peered":"2024-09-14T12:15:48.118951+0000","last_clean":"2024-09-14T12:15:48.118951+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:15:48.118951+0000","last_undegraded":"2024-09-14T12:15:48.118951+0000","last_fullsized":"2024-09-14T12:15:48.118951+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:31.355611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'362","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.455242+0000","last_change":"2024-09-14T11:17:21.589014+0000","last_active":"2024-09-14T12:16:15.455242+0000","last_peered":"2024-09-14T12:16:15.455242+0000","last_clean":"2024-09-14T12:16:15.455242+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:16:15.455242+0000","last_undegraded":"2024-09-14T12:16:15.455242+0000","last_fullsized":"2024-09-14T12:16:15.455242+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:25.221696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":9738,"num_write":1164,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332528+0000","last_change":"2024-09-14T11:17:25.610612+0000","last_active":"2024-09-14T12:13:03.332528+0000","last_peered":"2024-09-14T12:13:03.332528+0000","last_clean":"2024-09-14T12:13:03.332528+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:13:03.332528+0000","last_undegraded":"2024-09-14T12:13:03.332528+0000","last_fullsized":"2024-09-14T12:13:03.332528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:48.115678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'256","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.939829+0000","last_change":"2024-09-14T11:17:27.631891+0000","last_active":"2024-09-14T12:16:14.939829+0000","last_peered":"2024-09-14T12:16:14.939829+0000","last_clean":"2024-09-14T12:16:14.939829+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:16:14.939829+0000","last_undegraded":"2024-09-14T12:16:14.939829+0000","last_fullsized":"2024-09-14T12:16:14.939829+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:44.534516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46060,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":1096,"num_write":366,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328284+0000","last_change":"2024-09-14T11:17:29.643072+0000","last_active":"2024-09-14T12:12:33.328284+0000","last_peered":"2024-09-14T12:12:33.328284+0000","last_clean":"2024-09-14T12:12:33.328284+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:12:33.328284+0000","last_undegraded":"2024-09-14T12:12:33.328284+0000","last_fullsized":"2024-09-14T12:12:33.328284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:34.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'185","reported_seq":1645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.716019+0000","last_change":"2024-09-14T11:17:31.657886+0000","last_active":"2024-09-14T12:14:31.716019+0000","last_peered":"2024-09-14T12:14:31.716019+0000","last_clean":"2024-09-14T12:14:31.716019+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:14:31.716019+0000","last_undegraded":"2024-09-14T12:14:31.716019+0000","last_fullsized":"2024-09-14T12:14:31.716019+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:25.875385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'587","reported_seq":2187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.619382+0000","last_change":"2024-09-14T11:17:23.593981+0000","last_active":"2024-09-14T12:13:57.619382+0000","last_peered":"2024-09-14T12:13:57.619382+0000","last_clean":"2024-09-14T12:13:57.619382+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:13:57.619382+0000","last_undegraded":"2024-09-14T12:13:57.619382+0000","last_fullsized":"2024-09-14T12:13:57.619382+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:57.500739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'352","reported_seq":1148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.473578+0000","last_change":"2024-09-14T11:17:55.706003+0000","last_active":"2024-09-14T12:16:15.473578+0000","last_peered":"2024-09-14T12:16:15.473578+0000","last_clean":"2024-09-14T12:16:15.473578+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:16:15.473578+0000","last_undegraded":"2024-09-14T12:16:15.473578+0000","last_fullsized":"2024-09-14T12:16:15.473578+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.137533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":9181,"num_write":1146,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205682+0000","last_change":"2024-09-14T11:17:25.611418+0000","last_active":"2024-09-14T12:13:13.205682+0000","last_peered":"2024-09-14T12:13:13.205682+0000","last_clean":"2024-09-14T12:13:13.205682+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:13:13.205682+0000","last_undegraded":"2024-09-14T12:13:13.205682+0000","last_fullsized":"2024-09-14T12:13:13.205682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:38.637349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'328","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.043921+0000","last_change":"2024-09-14T11:17:27.631558+0000","last_active":"2024-09-14T12:16:15.043921+0000","last_peered":"2024-09-14T12:16:15.043921+0000","last_clean":"2024-09-14T12:16:15.043921+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:16:15.043921+0000","last_undegraded":"2024-09-14T12:16:15.043921+0000","last_fullsized":"2024-09-14T12:16:15.043921+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:57.236491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1227,"num_write":442,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446967+0000","last_change":"2024-09-14T11:17:29.643690+0000","last_active":"2024-09-14T12:12:30.446967+0000","last_peered":"2024-09-14T12:12:30.446967+0000","last_clean":"2024-09-14T12:12:30.446967+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:12:30.446967+0000","last_undegraded":"2024-09-14T12:12:30.446967+0000","last_fullsized":"2024-09-14T12:12:30.446967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:41.882853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'98","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.149653+0000","last_change":"2024-09-14T11:17:31.656443+0000","last_active":"2024-09-14T12:15:48.149653+0000","last_peered":"2024-09-14T12:15:48.149653+0000","last_clean":"2024-09-14T12:15:48.149653+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:15:48.149653+0000","last_undegraded":"2024-09-14T12:15:48.149653+0000","last_fullsized":"2024-09-14T12:15:48.149653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:42.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'539","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.591433+0000","last_change":"2024-09-14T11:17:23.600867+0000","last_active":"2024-09-14T12:14:01.591433+0000","last_peered":"2024-09-14T12:14:01.591433+0000","last_clean":"2024-09-14T12:14:01.591433+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:14:01.591433+0000","last_undegraded":"2024-09-14T12:14:01.591433+0000","last_fullsized":"2024-09-14T12:14:01.591433+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:37.601941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.434896+0000","last_change":"2024-09-14T11:17:21.582606+0000","last_active":"2024-09-14T12:16:15.434896+0000","last_peered":"2024-09-14T12:16:15.434896+0000","last_clean":"2024-09-14T12:16:15.434896+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:16:15.434896+0000","last_undegraded":"2024-09-14T12:16:15.434896+0000","last_fullsized":"2024-09-14T12:16:15.434896+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:46.655925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":657,"num_read_kb":34326,"num_write":1264,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'835","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.500767+0000","last_change":"2024-09-14T11:17:23.593094+0000","last_active":"2024-09-14T12:15:18.500767+0000","last_peered":"2024-09-14T12:15:18.500767+0000","last_clean":"2024-09-14T12:15:18.500767+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:15:18.500767+0000","last_undegraded":"2024-09-14T12:15:18.500767+0000","last_fullsized":"2024-09-14T12:15:18.500767+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:00.728519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'451","reported_seq":1162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.482142+0000","last_change":"2024-09-14T11:17:21.587023+0000","last_active":"2024-09-14T12:16:15.482142+0000","last_peered":"2024-09-14T12:16:15.482142+0000","last_clean":"2024-09-14T12:16:15.482142+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:16:15.482142+0000","last_undegraded":"2024-09-14T12:16:15.482142+0000","last_fullsized":"2024-09-14T12:16:15.482142+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:28.536485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":108296,"num_write":1392,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'490","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.751737+0000","last_change":"2024-09-14T11:17:23.594077+0000","last_active":"2024-09-14T12:14:02.751737+0000","last_peered":"2024-09-14T12:14:02.751737+0000","last_clean":"2024-09-14T12:14:02.751737+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:14:02.751737+0000","last_undegraded":"2024-09-14T12:14:02.751737+0000","last_fullsized":"2024-09-14T12:14:02.751737+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:09.993223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'333","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.404106+0000","last_change":"2024-09-14T11:17:21.586835+0000","last_active":"2024-09-14T12:16:15.404106+0000","last_peered":"2024-09-14T12:16:15.404106+0000","last_clean":"2024-09-14T12:16:15.404106+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:16:15.404106+0000","last_undegraded":"2024-09-14T12:16:15.404106+0000","last_fullsized":"2024-09-14T12:16:15.404106+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:19.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":31259,"num_write":1097,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1198","reported_seq":2729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.210733+0000","last_change":"2024-09-14T11:17:23.592819+0000","last_active":"2024-09-14T12:14:31.210733+0000","last_peered":"2024-09-14T12:14:31.210733+0000","last_clean":"2024-09-14T12:14:31.210733+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:14:31.210733+0000","last_undegraded":"2024-09-14T12:14:31.210733+0000","last_fullsized":"2024-09-14T12:14:31.210733+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:27.543641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'366","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.427675+0000","last_change":"2024-09-14T11:17:21.585188+0000","last_active":"2024-09-14T12:16:15.427675+0000","last_peered":"2024-09-14T12:16:15.427675+0000","last_clean":"2024-09-14T12:16:15.427675+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:16:15.427675+0000","last_undegraded":"2024-09-14T12:16:15.427675+0000","last_fullsized":"2024-09-14T12:16:15.427675+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:07.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":15201,"num_write":1292,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'918","reported_seq":2573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.502687+0000","last_change":"2024-09-14T11:17:23.601191+0000","last_active":"2024-09-14T12:15:18.502687+0000","last_peered":"2024-09-14T12:15:18.502687+0000","last_clean":"2024-09-14T12:15:18.502687+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:15:18.502687+0000","last_undegraded":"2024-09-14T12:15:18.502687+0000","last_fullsized":"2024-09-14T12:15:18.502687+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:39.840105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'306","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.432143+0000","last_change":"2024-09-14T11:17:21.584208+0000","last_active":"2024-09-14T12:16:15.432143+0000","last_peered":"2024-09-14T12:16:15.432143+0000","last_clean":"2024-09-14T12:16:15.432143+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:16:15.432143+0000","last_undegraded":"2024-09-14T12:16:15.432143+0000","last_fullsized":"2024-09-14T12:16:15.432143+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306882,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":547,"num_read_kb":7710,"num_write":947,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'501","reported_seq":2112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.120303+0000","last_change":"2024-09-14T11:17:23.594912+0000","last_active":"2024-09-14T12:15:48.120303+0000","last_peered":"2024-09-14T12:15:48.120303+0000","last_clean":"2024-09-14T12:15:48.120303+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:15:48.120303+0000","last_undegraded":"2024-09-14T12:15:48.120303+0000","last_fullsized":"2024-09-14T12:15:48.120303+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:05.056139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'410","reported_seq":1082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.454915+0000","last_change":"2024-09-14T11:17:21.579512+0000","last_active":"2024-09-14T12:16:15.454915+0000","last_peered":"2024-09-14T12:16:15.454915+0000","last_clean":"2024-09-14T12:16:15.454915+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:16:15.454915+0000","last_undegraded":"2024-09-14T12:16:15.454915+0000","last_fullsized":"2024-09-14T12:16:15.454915+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:50.912297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":680,"num_read_kb":78819,"num_write":1261,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'832","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.122782+0000","last_change":"2024-09-14T11:17:23.602134+0000","last_active":"2024-09-14T12:15:48.122782+0000","last_peered":"2024-09-14T12:15:48.122782+0000","last_clean":"2024-09-14T12:15:48.122782+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:15:48.122782+0000","last_undegraded":"2024-09-14T12:15:48.122782+0000","last_fullsized":"2024-09-14T12:15:48.122782+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:55.121466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'446","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.440184+0000","last_change":"2024-09-14T11:17:21.587871+0000","last_active":"2024-09-14T12:16:15.440184+0000","last_peered":"2024-09-14T12:16:15.440184+0000","last_clean":"2024-09-14T12:16:15.440184+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:16:15.440184+0000","last_undegraded":"2024-09-14T12:16:15.440184+0000","last_fullsized":"2024-09-14T12:16:15.440184+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:00.375845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":42747,"num_write":1601,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.771846+0000","last_change":"2024-09-14T11:17:23.596351+0000","last_active":"2024-09-14T12:14:33.771846+0000","last_peered":"2024-09-14T12:14:33.771846+0000","last_clean":"2024-09-14T12:14:33.771846+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:14:33.771846+0000","last_undegraded":"2024-09-14T12:14:33.771846+0000","last_fullsized":"2024-09-14T12:14:33.771846+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:13.789039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'364","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.407900+0000","last_change":"2024-09-14T11:17:21.583193+0000","last_active":"2024-09-14T12:16:15.407900+0000","last_peered":"2024-09-14T12:16:15.407900+0000","last_clean":"2024-09-14T12:16:15.407900+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:16:15.407900+0000","last_undegraded":"2024-09-14T12:16:15.407900+0000","last_fullsized":"2024-09-14T12:16:15.407900+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:06.631109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":730,"num_read_kb":25685,"num_write":1212,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'724","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.121608+0000","last_change":"2024-09-14T11:17:23.604245+0000","last_active":"2024-09-14T12:15:48.121608+0000","last_peered":"2024-09-14T12:15:48.121608+0000","last_clean":"2024-09-14T12:15:48.121608+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:15:48.121608+0000","last_undegraded":"2024-09-14T12:15:48.121608+0000","last_fullsized":"2024-09-14T12:15:48.121608+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:40.467603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'313","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.482077+0000","last_change":"2024-09-14T11:17:21.580614+0000","last_active":"2024-09-14T12:16:15.482077+0000","last_peered":"2024-09-14T12:16:15.482077+0000","last_clean":"2024-09-14T12:16:15.482077+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:16:15.482077+0000","last_undegraded":"2024-09-14T12:16:15.482077+0000","last_fullsized":"2024-09-14T12:16:15.482077+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:49.477505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":13781,"num_write":973,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'542","reported_seq":2391,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755084+0000","last_change":"2024-09-14T11:17:23.597056+0000","last_active":"2024-09-14T12:14:02.755084+0000","last_peered":"2024-09-14T12:14:02.755084+0000","last_clean":"2024-09-14T12:14:02.755084+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:14:02.755084+0000","last_undegraded":"2024-09-14T12:14:02.755084+0000","last_fullsized":"2024-09-14T12:14:02.755084+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:25.820590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'372","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.455581+0000","last_change":"2024-09-14T11:17:21.583089+0000","last_active":"2024-09-14T12:16:15.455581+0000","last_peered":"2024-09-14T12:16:15.455581+0000","last_clean":"2024-09-14T12:16:15.455581+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:16:15.455581+0000","last_undegraded":"2024-09-14T12:16:15.455581+0000","last_fullsized":"2024-09-14T12:16:15.455581+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:05.234497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":24861,"num_write":1154,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'886","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.506780+0000","last_change":"2024-09-14T11:17:23.590933+0000","last_active":"2024-09-14T12:15:18.506780+0000","last_peered":"2024-09-14T12:15:18.506780+0000","last_clean":"2024-09-14T12:15:18.506780+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:15:18.506780+0000","last_undegraded":"2024-09-14T12:15:18.506780+0000","last_fullsized":"2024-09-14T12:15:18.506780+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.559604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'392","reported_seq":1060,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.395637+0000","last_change":"2024-09-14T11:17:21.589675+0000","last_active":"2024-09-14T12:16:15.395637+0000","last_peered":"2024-09-14T12:16:15.395637+0000","last_clean":"2024-09-14T12:16:15.395637+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:16:15.395637+0000","last_undegraded":"2024-09-14T12:16:15.395637+0000","last_fullsized":"2024-09-14T12:16:15.395637+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:06.262409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":50704,"num_write":1241,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'681","reported_seq":2448,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.606396+0000","last_change":"2024-09-14T11:17:23.595898+0000","last_active":"2024-09-14T12:14:34.606396+0000","last_peered":"2024-09-14T12:14:34.606396+0000","last_clean":"2024-09-14T12:14:34.606396+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:14:34.606396+0000","last_undegraded":"2024-09-14T12:14:34.606396+0000","last_fullsized":"2024-09-14T12:14:34.606396+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":600,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:45.372928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'352","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.464761+0000","last_change":"2024-09-14T11:17:21.589111+0000","last_active":"2024-09-14T12:16:15.464761+0000","last_peered":"2024-09-14T12:16:15.464761+0000","last_clean":"2024-09-14T12:16:15.464761+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:16:15.464761+0000","last_undegraded":"2024-09-14T12:16:15.464761+0000","last_fullsized":"2024-09-14T12:16:15.464761+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:16.334007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":2146,"num_write":1056,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'754","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:55.576424+0000","last_change":"2024-09-14T11:17:55.700734+0000","last_active":"2024-09-14T12:13:55.576424+0000","last_peered":"2024-09-14T12:13:55.576424+0000","last_clean":"2024-09-14T12:13:55.576424+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:13:55.576424+0000","last_undegraded":"2024-09-14T12:13:55.576424+0000","last_fullsized":"2024-09-14T12:13:55.576424+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.642169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'330","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.470208+0000","last_change":"2024-09-14T11:17:21.582462+0000","last_active":"2024-09-14T12:16:15.470208+0000","last_peered":"2024-09-14T12:16:15.470208+0000","last_clean":"2024-09-14T12:16:15.470208+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:16:15.470208+0000","last_undegraded":"2024-09-14T12:16:15.470208+0000","last_fullsized":"2024-09-14T12:16:15.470208+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:50.146715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":46679,"num_write":958,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'468","reported_seq":1939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.507172+0000","last_change":"2024-09-14T11:17:23.606550+0000","last_active":"2024-09-14T12:15:18.507172+0000","last_peered":"2024-09-14T12:15:18.507172+0000","last_clean":"2024-09-14T12:15:18.507172+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:15:18.507172+0000","last_undegraded":"2024-09-14T12:15:18.507172+0000","last_fullsized":"2024-09-14T12:15:18.507172+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:25.294313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'347","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.482703+0000","last_change":"2024-09-14T11:17:55.703532+0000","last_active":"2024-09-14T12:16:15.482703+0000","last_peered":"2024-09-14T12:16:15.482703+0000","last_clean":"2024-09-14T12:16:15.482703+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:16:15.482703+0000","last_undegraded":"2024-09-14T12:16:15.482703+0000","last_fullsized":"2024-09-14T12:16:15.482703+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:23.137411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":19021,"num_write":1018,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'441","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.819923+0000","last_change":"2024-09-14T11:17:23.602231+0000","last_active":"2024-09-14T12:13:42.819923+0000","last_peered":"2024-09-14T12:13:42.819923+0000","last_clean":"2024-09-14T12:13:42.819923+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:13:42.819923+0000","last_undegraded":"2024-09-14T12:13:42.819923+0000","last_fullsized":"2024-09-14T12:13:42.819923+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:53.898892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'393","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.458089+0000","last_change":"2024-09-14T11:17:21.578753+0000","last_active":"2024-09-14T12:16:15.458089+0000","last_peered":"2024-09-14T12:16:15.458089+0000","last_clean":"2024-09-14T12:16:15.458089+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:16:15.458089+0000","last_undegraded":"2024-09-14T12:16:15.458089+0000","last_fullsized":"2024-09-14T12:16:15.458089+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:48.907563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":76781,"num_write":1270,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.755681+0000","last_change":"2024-09-14T11:17:23.603778+0000","last_active":"2024-09-14T12:14:02.755681+0000","last_peered":"2024-09-14T12:14:02.755681+0000","last_clean":"2024-09-14T12:14:02.755681+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:14:02.755681+0000","last_undegraded":"2024-09-14T12:14:02.755681+0000","last_fullsized":"2024-09-14T12:14:02.755681+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:48.188661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'372","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.455181+0000","last_change":"2024-09-14T11:17:21.587433+0000","last_active":"2024-09-14T12:16:15.455181+0000","last_peered":"2024-09-14T12:16:15.455181+0000","last_clean":"2024-09-14T12:16:15.455181+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:16:15.455181+0000","last_undegraded":"2024-09-14T12:16:15.455181+0000","last_fullsized":"2024-09-14T12:16:15.455181+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:02.070789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":6459,"num_write":1212,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'315","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.467650+0000","last_change":"2024-09-14T11:17:21.583452+0000","last_active":"2024-09-14T12:16:15.467650+0000","last_peered":"2024-09-14T12:16:15.467650+0000","last_clean":"2024-09-14T12:16:15.467650+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:16:15.467650+0000","last_undegraded":"2024-09-14T12:16:15.467650+0000","last_fullsized":"2024-09-14T12:16:15.467650+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:53.126972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":1699,"num_write":1024,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'562","reported_seq":2258,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.111067+0000","last_change":"2024-09-14T11:17:23.605011+0000","last_active":"2024-09-14T12:15:48.111067+0000","last_peered":"2024-09-14T12:15:48.111067+0000","last_clean":"2024-09-14T12:15:48.111067+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:15:48.111067+0000","last_undegraded":"2024-09-14T12:15:48.111067+0000","last_fullsized":"2024-09-14T12:15:48.111067+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:39.124367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'407","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.473365+0000","last_change":"2024-09-14T11:17:21.571626+0000","last_active":"2024-09-14T12:16:15.473365+0000","last_peered":"2024-09-14T12:16:15.473365+0000","last_clean":"2024-09-14T12:16:15.473365+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:16:15.473365+0000","last_undegraded":"2024-09-14T12:16:15.473365+0000","last_fullsized":"2024-09-14T12:16:15.473365+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:20.555978+0000","last_clean_scrub_stamp":"2024-09-14T11:17:20.555978+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:58.165741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":16758,"num_write":1274,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'915","reported_seq":2580,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.605275+0000","last_change":"2024-09-14T11:17:23.597555+0000","last_active":"2024-09-14T12:14:34.605275+0000","last_peered":"2024-09-14T12:14:34.605275+0000","last_clean":"2024-09-14T12:14:34.605275+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:14:34.605275+0000","last_undegraded":"2024-09-14T12:14:34.605275+0000","last_fullsized":"2024-09-14T12:14:34.605275+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":900,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:39.353271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1791,"ondisk_log_size":1791,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1705796,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18087,"num_read_kb":37833,"num_write":15249,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2107,"ondisk_log_size":2107,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3659,"ondisk_log_size":3659,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22160993,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44528,"num_read_kb":1801342,"num_write":73962,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45277184,"data_stored":44321986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4092,"ondisk_log_size":4092,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":187942,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":186673,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510156,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277676,"kb_used_data":11676,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094164,"statfs":{"total":96636764160,"available":96352423936,"internally_reserved":0,"allocated":11956224,"data_stored":10288647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510156,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249448,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94122392,"statfs":{"total":96636764160,"available":96381329408,"internally_reserved":0,"allocated":5844992,"data_stored":4296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510157,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133780,"kb_used_data":12196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94238060,"statfs":{"total":96636764160,"available":96499773440,"internally_reserved":0,"allocated":12488704,"data_stored":10779353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510156,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98796,"kb_used_data":9208,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94273044,"statfs":{"total":96636764160,"available":96535597056,"internally_reserved":0,"allocated":9428992,"data_stored":7842152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510155,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256568,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115272,"statfs":{"total":96636764160,"available":96374038528,"internally_reserved":0,"allocated":12992512,"data_stored":11338592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510156,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92168,"kb_used_data":6756,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279672,"statfs":{"total":96636764160,"available":96542384128,"internally_reserved":0,"allocated":6918144,"data_stored":5375493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510155,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143432,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94228408,"statfs":{"total":96636764160,"available":96489889792,"internally_reserved":0,"allocated":8335360,"data_stored":6711727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575565,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263468,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94108372,"statfs":{"total":96636764160,"available":96366972928,"internally_reserved":0,"allocated":7630848,"data_stored":5968019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262142408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3240346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":4574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330048,"data_stored":3240066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":9200737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5706939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8773632,"data_stored":8639695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2236416,"data_stored":2160102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7680000,"data_stored":7559766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:16:22.082 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.082 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.082 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.082 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.083 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.084 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.085 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.086 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.087 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.088 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.089 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.090 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.091 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.092 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.093 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.094 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.095 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.096 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.097 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.098 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.099 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.100 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.101 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.102 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.103 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.104 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.105 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:17:04.861621+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=4, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.106 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.107 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.108 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.109 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:17:09.889220+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.110 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.111 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.112 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.113 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.114 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.115 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.116 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.117 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.117 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.117 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.117 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.117 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.118 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.119 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.120 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.120 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.120 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.120 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.120 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.121 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.122 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:17:20.555978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.123 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:22.123 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:16:42.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:16:42.458 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:16:42.469 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:16:42.471 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2046,"stamp":"2024-09-14T12:16:41.266216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24474050,"num_objects":732,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":313127,"num_read_kb":2443510,"num_write":166195,"num_write_kb":2394098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30158,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13702,"ondisk_log_size":13702,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518368,"kb_used_data":73824,"kb_used_omap":12,"kb_used_meta":1444403,"kb_avail":753456352,"statfs":{"total":773094113280,"available":771539304448,"internally_reserved":0,"allocated":75595776,"data_stored":62600240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1479069235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26937,"num_omap_keys":108,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006126"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.235486+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:15:03.235486+0000","last_peered":"2024-09-14T12:15:03.235486+0000","last_clean":"2024-09-14T12:15:03.235486+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:15:03.235486+0000","last_undegraded":"2024-09-14T12:15:03.235486+0000","last_fullsized":"2024-09-14T12:15:03.235486+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.311879+0000","last_change":"2024-09-14T11:51:07.025774+0000","last_active":"2024-09-14T12:13:38.311879+0000","last_peered":"2024-09-14T12:13:38.311879+0000","last_clean":"2024-09-14T12:13:38.311879+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:13:38.311879+0000","last_undegraded":"2024-09-14T12:13:38.311879+0000","last_fullsized":"2024-09-14T12:13:38.311879+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.449121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.561956+0000","last_change":"2024-09-14T11:35:00.449276+0000","last_active":"2024-09-14T12:16:14.561956+0000","last_peered":"2024-09-14T12:16:14.561956+0000","last_clean":"2024-09-14T12:16:14.561956+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:16:14.561956+0000","last_undegraded":"2024-09-14T12:16:14.561956+0000","last_fullsized":"2024-09-14T12:16:14.561956+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:28.070565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:58.313986+0000","last_change":"2024-09-14T11:31:47.462526+0000","last_active":"2024-09-14T12:13:58.313986+0000","last_peered":"2024-09-14T12:13:58.313986+0000","last_clean":"2024-09-14T12:13:58.313986+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:13:58.313986+0000","last_undegraded":"2024-09-14T12:13:58.313986+0000","last_fullsized":"2024-09-14T12:13:58.313986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:37.396723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.448111+0000","last_change":"2024-09-14T11:51:07.028080+0000","last_active":"2024-09-14T12:12:53.448111+0000","last_peered":"2024-09-14T12:12:53.448111+0000","last_clean":"2024-09-14T12:12:53.448111+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:12:53.448111+0000","last_undegraded":"2024-09-14T12:12:53.448111+0000","last_fullsized":"2024-09-14T12:12:53.448111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.359237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255665+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:16:15.255665+0000","last_peered":"2024-09-14T12:16:15.255665+0000","last_clean":"2024-09-14T12:16:15.255665+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:16:15.255665+0000","last_undegraded":"2024-09-14T12:16:15.255665+0000","last_fullsized":"2024-09-14T12:16:15.255665+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:50.280918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.322144+0000","last_change":"2024-09-14T11:35:00.438757+0000","last_active":"2024-09-14T12:15:13.322144+0000","last_peered":"2024-09-14T12:15:13.322144+0000","last_clean":"2024-09-14T12:15:13.322144+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:15:13.322144+0000","last_undegraded":"2024-09-14T12:15:13.322144+0000","last_fullsized":"2024-09-14T12:15:13.322144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:50.182947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:50.442209+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:11:50.442209+0000","last_peered":"2024-09-14T12:11:50.442209+0000","last_clean":"2024-09-14T12:11:50.442209+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:11:50.442209+0000","last_undegraded":"2024-09-14T12:11:50.442209+0000","last_fullsized":"2024-09-14T12:11:50.442209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:01.804143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.231335+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:15:13.231335+0000","last_peered":"2024-09-14T12:15:13.231335+0000","last_clean":"2024-09-14T12:15:13.231335+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:15:13.231335+0000","last_undegraded":"2024-09-14T12:15:13.231335+0000","last_fullsized":"2024-09-14T12:15:13.231335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.346085+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:14:38.346085+0000","last_peered":"2024-09-14T12:14:38.346085+0000","last_clean":"2024-09-14T12:14:38.346085+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:14:38.346085+0000","last_undegraded":"2024-09-14T12:14:38.346085+0000","last_fullsized":"2024-09-14T12:14:38.346085+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.966334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205890+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:11:48.205890+0000","last_peered":"2024-09-14T12:11:48.205890+0000","last_clean":"2024-09-14T12:11:48.205890+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:11:48.205890+0000","last_undegraded":"2024-09-14T12:11:48.205890+0000","last_fullsized":"2024-09-14T12:11:48.205890+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:51.734740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.906271+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:16:14.906271+0000","last_peered":"2024-09-14T12:16:14.906271+0000","last_clean":"2024-09-14T12:16:14.906271+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:16:14.906271+0000","last_undegraded":"2024-09-14T12:16:14.906271+0000","last_fullsized":"2024-09-14T12:16:14.906271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4136,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.205846+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:11:48.205846+0000","last_peered":"2024-09-14T12:11:48.205846+0000","last_clean":"2024-09-14T12:11:48.205846+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:11:48.205846+0000","last_undegraded":"2024-09-14T12:11:48.205846+0000","last_fullsized":"2024-09-14T12:11:48.205846+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211503+0000","last_change":"2024-09-14T11:51:07.022651+0000","last_active":"2024-09-14T12:14:03.211503+0000","last_peered":"2024-09-14T12:14:03.211503+0000","last_clean":"2024-09-14T12:14:03.211503+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:14:03.211503+0000","last_undegraded":"2024-09-14T12:14:03.211503+0000","last_fullsized":"2024-09-14T12:14:03.211503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:59.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.455134+0000","last_change":"2024-09-14T11:35:03.472494+0000","last_active":"2024-09-14T12:13:43.455134+0000","last_peered":"2024-09-14T12:13:43.455134+0000","last_clean":"2024-09-14T12:13:43.455134+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:13:43.455134+0000","last_undegraded":"2024-09-14T12:13:43.455134+0000","last_fullsized":"2024-09-14T12:13:43.455134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:49.051891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339062+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:13:48.339062+0000","last_peered":"2024-09-14T12:13:48.339062+0000","last_clean":"2024-09-14T12:13:48.339062+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:13:48.339062+0000","last_undegraded":"2024-09-14T12:13:48.339062+0000","last_fullsized":"2024-09-14T12:13:48.339062+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:11:48.439584+0000","last_change":"2024-09-14T11:31:47.462449+0000","last_active":"2024-09-14T12:11:48.439584+0000","last_peered":"2024-09-14T12:11:48.439584+0000","last_clean":"2024-09-14T12:11:48.439584+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:11:48.439584+0000","last_undegraded":"2024-09-14T12:11:48.439584+0000","last_fullsized":"2024-09-14T12:11:48.439584+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:14.902151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.354760+0000","last_change":"2024-09-14T11:35:03.473587+0000","last_active":"2024-09-14T12:15:03.354760+0000","last_peered":"2024-09-14T12:15:03.354760+0000","last_clean":"2024-09-14T12:15:03.354760+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:15:03.354760+0000","last_undegraded":"2024-09-14T12:15:03.354760+0000","last_fullsized":"2024-09-14T12:15:03.354760+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.755910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'14","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.229789+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:15:03.229789+0000","last_peered":"2024-09-14T12:15:03.229789+0000","last_clean":"2024-09-14T12:15:03.229789+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:15:03.229789+0000","last_undegraded":"2024-09-14T12:15:03.229789+0000","last_fullsized":"2024-09-14T12:15:03.229789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17412,"num_write":24,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.203551+0000","last_change":"2024-09-14T11:31:47.457527+0000","last_active":"2024-09-14T12:12:53.203551+0000","last_peered":"2024-09-14T12:12:53.203551+0000","last_clean":"2024-09-14T12:12:53.203551+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:12:53.203551+0000","last_undegraded":"2024-09-14T12:12:53.203551+0000","last_fullsized":"2024-09-14T12:12:53.203551+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:10.893316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.198600+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:12:08.198600+0000","last_peered":"2024-09-14T12:12:08.198600+0000","last_clean":"2024-09-14T12:12:08.198600+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:12:08.198600+0000","last_undegraded":"2024-09-14T12:12:08.198600+0000","last_fullsized":"2024-09-14T12:12:08.198600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:27.310781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454746+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:16:14.454746+0000","last_peered":"2024-09-14T12:16:14.454746+0000","last_clean":"2024-09-14T12:16:14.454746+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:16:14.454746+0000","last_undegraded":"2024-09-14T12:16:14.454746+0000","last_fullsized":"2024-09-14T12:16:14.454746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6146,"num_write":6,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.302497+0000","last_change":"2024-09-14T11:51:07.028060+0000","last_active":"2024-09-14T12:12:08.302497+0000","last_peered":"2024-09-14T12:12:08.302497+0000","last_clean":"2024-09-14T12:12:08.302497+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:12:08.302497+0000","last_undegraded":"2024-09-14T12:12:08.302497+0000","last_fullsized":"2024-09-14T12:12:08.302497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.552311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.453694+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:12:08.453694+0000","last_peered":"2024-09-14T12:12:08.453694+0000","last_clean":"2024-09-14T12:12:08.453694+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:12:08.453694+0000","last_undegraded":"2024-09-14T12:12:08.453694+0000","last_fullsized":"2024-09-14T12:12:08.453694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:12.592203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.239491+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:16:08.239491+0000","last_peered":"2024-09-14T12:16:08.239491+0000","last_clean":"2024-09-14T12:16:08.239491+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:16:08.239491+0000","last_undegraded":"2024-09-14T12:16:08.239491+0000","last_fullsized":"2024-09-14T12:16:08.239491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":14,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.312475+0000","last_change":"2024-09-14T11:35:00.443367+0000","last_active":"2024-09-14T12:13:43.312475+0000","last_peered":"2024-09-14T12:13:43.312475+0000","last_clean":"2024-09-14T12:13:43.312475+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:13:43.312475+0000","last_undegraded":"2024-09-14T12:13:43.312475+0000","last_fullsized":"2024-09-14T12:13:43.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:39.932103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.307053+0000","last_change":"2024-09-14T11:31:47.459863+0000","last_active":"2024-09-14T12:12:53.307053+0000","last_peered":"2024-09-14T12:12:53.307053+0000","last_clean":"2024-09-14T12:12:53.307053+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:12:53.307053+0000","last_undegraded":"2024-09-14T12:12:53.307053+0000","last_fullsized":"2024-09-14T12:12:53.307053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:34.115513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:08.328248+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:12:08.328248+0000","last_peered":"2024-09-14T12:12:08.328248+0000","last_clean":"2024-09-14T12:12:08.328248+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:12:08.328248+0000","last_undegraded":"2024-09-14T12:12:08.328248+0000","last_fullsized":"2024-09-14T12:12:08.328248+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:28.383593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.237216+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:16:08.237216+0000","last_peered":"2024-09-14T12:16:08.237216+0000","last_clean":"2024-09-14T12:16:08.237216+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:16:08.237216+0000","last_undegraded":"2024-09-14T12:16:08.237216+0000","last_fullsized":"2024-09-14T12:16:08.237216+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211827+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:16:14.211827+0000","last_peered":"2024-09-14T12:16:14.211827+0000","last_clean":"2024-09-14T12:16:14.211827+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:16:14.211827+0000","last_undegraded":"2024-09-14T12:16:14.211827+0000","last_fullsized":"2024-09-14T12:16:14.211827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.346671+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:14:43.346671+0000","last_peered":"2024-09-14T12:14:43.346671+0000","last_clean":"2024-09-14T12:14:43.346671+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:14:43.346671+0000","last_undegraded":"2024-09-14T12:14:43.346671+0000","last_fullsized":"2024-09-14T12:14:43.346671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.216054+0000","last_change":"2024-09-14T11:35:03.476474+0000","last_active":"2024-09-14T12:14:43.216054+0000","last_peered":"2024-09-14T12:14:43.216054+0000","last_clean":"2024-09-14T12:14:43.216054+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:14:43.216054+0000","last_undegraded":"2024-09-14T12:14:43.216054+0000","last_fullsized":"2024-09-14T12:14:43.216054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:43.941080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'9","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211522+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:16:14.211522+0000","last_peered":"2024-09-14T12:16:14.211522+0000","last_clean":"2024-09-14T12:16:14.211522+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:16:14.211522+0000","last_undegraded":"2024-09-14T12:16:14.211522+0000","last_fullsized":"2024-09-14T12:16:14.211522+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:15.445086+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:12:15.445086+0000","last_peered":"2024-09-14T12:12:15.445086+0000","last_clean":"2024-09-14T12:12:15.445086+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:12:15.445086+0000","last_undegraded":"2024-09-14T12:12:15.445086+0000","last_fullsized":"2024-09-14T12:12:15.445086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:16.454913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.945221+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:16:14.945221+0000","last_peered":"2024-09-14T12:16:14.945221+0000","last_clean":"2024-09-14T12:16:14.945221+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:16:14.945221+0000","last_undegraded":"2024-09-14T12:16:14.945221+0000","last_fullsized":"2024-09-14T12:16:14.945221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7286,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'13","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454552+0000","last_change":"2024-09-14T11:35:00.447506+0000","last_active":"2024-09-14T12:16:14.454552+0000","last_peered":"2024-09-14T12:16:14.454552+0000","last_clean":"2024-09-14T12:16:14.454552+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:16:14.454552+0000","last_undegraded":"2024-09-14T12:16:14.454552+0000","last_fullsized":"2024-09-14T12:16:14.454552+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:00.533644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16386,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.351850+0000","last_change":"2024-09-14T11:35:03.480075+0000","last_active":"2024-09-14T12:14:43.351850+0000","last_peered":"2024-09-14T12:14:43.351850+0000","last_clean":"2024-09-14T12:14:43.351850+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:14:43.351850+0000","last_undegraded":"2024-09-14T12:14:43.351850+0000","last_fullsized":"2024-09-14T12:14:43.351850+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:33.496292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'8","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.423979+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:16:14.423979+0000","last_peered":"2024-09-14T12:16:14.423979+0000","last_clean":"2024-09-14T12:16:14.423979+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:16:14.423979+0000","last_undegraded":"2024-09-14T12:16:14.423979+0000","last_fullsized":"2024-09-14T12:16:14.423979+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.306990+0000","last_change":"2024-09-14T11:51:07.027822+0000","last_active":"2024-09-14T12:12:53.306990+0000","last_peered":"2024-09-14T12:12:53.306990+0000","last_clean":"2024-09-14T12:12:53.306990+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:12:53.306990+0000","last_undegraded":"2024-09-14T12:12:53.306990+0000","last_fullsized":"2024-09-14T12:12:53.306990+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:23.309895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:33.234122+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:15:33.234122+0000","last_peered":"2024-09-14T12:15:33.234122+0000","last_clean":"2024-09-14T12:15:33.234122+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:15:33.234122+0000","last_undegraded":"2024-09-14T12:15:33.234122+0000","last_fullsized":"2024-09-14T12:15:33.234122+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.309609+0000","last_change":"2024-09-14T11:35:00.448968+0000","last_active":"2024-09-14T12:13:18.309609+0000","last_peered":"2024-09-14T12:13:18.309609+0000","last_clean":"2024-09-14T12:13:18.309609+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:13:18.309609+0000","last_undegraded":"2024-09-14T12:13:18.309609+0000","last_fullsized":"2024-09-14T12:13:18.309609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:26.693742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.329763+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:12:18.329763+0000","last_peered":"2024-09-14T12:12:18.329763+0000","last_clean":"2024-09-14T12:12:18.329763+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:12:18.329763+0000","last_undegraded":"2024-09-14T12:12:18.329763+0000","last_fullsized":"2024-09-14T12:12:18.329763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:10.558327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.447497+0000","last_change":"2024-09-14T11:51:07.027403+0000","last_active":"2024-09-14T12:12:48.447497+0000","last_peered":"2024-09-14T12:12:48.447497+0000","last_clean":"2024-09-14T12:12:48.447497+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:12:48.447497+0000","last_undegraded":"2024-09-14T12:12:48.447497+0000","last_fullsized":"2024-09-14T12:12:48.447497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:41.431415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207455+0000","last_change":"2024-09-14T11:35:03.477782+0000","last_active":"2024-09-14T12:13:28.207455+0000","last_peered":"2024-09-14T12:13:28.207455+0000","last_clean":"2024-09-14T12:13:28.207455+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:13:28.207455+0000","last_undegraded":"2024-09-14T12:13:28.207455+0000","last_fullsized":"2024-09-14T12:13:28.207455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:40.078111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.443370+0000","last_change":"2024-09-14T11:31:47.459051+0000","last_active":"2024-09-14T12:12:18.443370+0000","last_peered":"2024-09-14T12:12:18.443370+0000","last_clean":"2024-09-14T12:12:18.443370+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:12:18.443370+0000","last_undegraded":"2024-09-14T12:12:18.443370+0000","last_fullsized":"2024-09-14T12:12:18.443370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:51.494106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:43.223397+0000","last_change":"2024-09-14T11:35:00.446767+0000","last_active":"2024-09-14T12:15:43.223397+0000","last_peered":"2024-09-14T12:15:43.223397+0000","last_clean":"2024-09-14T12:15:43.223397+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:15:43.223397+0000","last_undegraded":"2024-09-14T12:15:43.223397+0000","last_fullsized":"2024-09-14T12:15:43.223397+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:07.682575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:18.303508+0000","last_change":"2024-09-14T11:31:47.461172+0000","last_active":"2024-09-14T12:12:18.303508+0000","last_peered":"2024-09-14T12:12:18.303508+0000","last_clean":"2024-09-14T12:12:18.303508+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:12:18.303508+0000","last_undegraded":"2024-09-14T12:12:18.303508+0000","last_fullsized":"2024-09-14T12:12:18.303508+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:24.137730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255791+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:16:15.255791+0000","last_peered":"2024-09-14T12:16:15.255791+0000","last_clean":"2024-09-14T12:16:15.255791+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:16:15.255791+0000","last_undegraded":"2024-09-14T12:16:15.255791+0000","last_fullsized":"2024-09-14T12:16:15.255791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9588,"num_write":6,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.210185+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:16:14.210185+0000","last_peered":"2024-09-14T12:16:14.210185+0000","last_clean":"2024-09-14T12:16:14.210185+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:16:14.210185+0000","last_undegraded":"2024-09-14T12:16:14.210185+0000","last_fullsized":"2024-09-14T12:16:14.210185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:20.445608+0000","last_change":"2024-09-14T11:31:47.455100+0000","last_active":"2024-09-14T12:12:20.445608+0000","last_peered":"2024-09-14T12:12:20.445608+0000","last_clean":"2024-09-14T12:12:20.445608+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:12:20.445608+0000","last_undegraded":"2024-09-14T12:12:20.445608+0000","last_fullsized":"2024-09-14T12:12:20.445608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:09.736061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.227718+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:16:13.227718+0000","last_peered":"2024-09-14T12:16:13.227718+0000","last_clean":"2024-09-14T12:16:13.227718+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:16:13.227718+0000","last_undegraded":"2024-09-14T12:16:13.227718+0000","last_fullsized":"2024-09-14T12:16:13.227718+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.464147+0000","last_change":"2024-09-14T11:31:47.454175+0000","last_active":"2024-09-14T12:13:03.464147+0000","last_peered":"2024-09-14T12:13:03.464147+0000","last_clean":"2024-09-14T12:13:03.464147+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:13:03.464147+0000","last_undegraded":"2024-09-14T12:13:03.464147+0000","last_fullsized":"2024-09-14T12:13:03.464147+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.297114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.206264+0000","last_change":"2024-09-14T11:35:03.477505+0000","last_active":"2024-09-14T12:13:18.206264+0000","last_peered":"2024-09-14T12:13:18.206264+0000","last_clean":"2024-09-14T12:13:18.206264+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:13:18.206264+0000","last_undegraded":"2024-09-14T12:13:18.206264+0000","last_fullsized":"2024-09-14T12:13:18.206264+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:56.366132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458103+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:14:05.458103+0000","last_peered":"2024-09-14T12:14:05.458103+0000","last_clean":"2024-09-14T12:14:05.458103+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:14:05.458103+0000","last_undegraded":"2024-09-14T12:14:05.458103+0000","last_fullsized":"2024-09-14T12:14:05.458103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.290329+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:16:15.290329+0000","last_peered":"2024-09-14T12:16:15.290329+0000","last_clean":"2024-09-14T12:16:15.290329+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:16:15.290329+0000","last_undegraded":"2024-09-14T12:16:15.290329+0000","last_fullsized":"2024-09-14T12:16:15.290329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:33.231573+0000","last_change":"2024-09-14T11:35:00.437763+0000","last_active":"2024-09-14T12:15:33.231573+0000","last_peered":"2024-09-14T12:15:33.231573+0000","last_clean":"2024-09-14T12:15:33.231573+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:15:33.231573+0000","last_undegraded":"2024-09-14T12:15:33.231573+0000","last_fullsized":"2024-09-14T12:15:33.231573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:10.195413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448816+0000","last_change":"2024-09-14T11:31:47.455016+0000","last_active":"2024-09-14T12:12:58.448816+0000","last_peered":"2024-09-14T12:12:58.448816+0000","last_clean":"2024-09-14T12:12:58.448816+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:12:58.448816+0000","last_undegraded":"2024-09-14T12:12:58.448816+0000","last_fullsized":"2024-09-14T12:12:58.448816+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:05.916872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:40.448133+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:12:40.448133+0000","last_peered":"2024-09-14T12:12:40.448133+0000","last_clean":"2024-09-14T12:12:40.448133+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:12:40.448133+0000","last_undegraded":"2024-09-14T12:12:40.448133+0000","last_fullsized":"2024-09-14T12:12:40.448133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:19.901941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.665782+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:16:14.665782+0000","last_peered":"2024-09-14T12:16:14.665782+0000","last_clean":"2024-09-14T12:16:14.665782+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:16:14.665782+0000","last_undegraded":"2024-09-14T12:16:14.665782+0000","last_fullsized":"2024-09-14T12:16:14.665782+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:41.032154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12294,"num_write":18,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450330+0000","last_change":"2024-09-14T11:31:47.456677+0000","last_active":"2024-09-14T12:13:00.450330+0000","last_peered":"2024-09-14T12:13:00.450330+0000","last_clean":"2024-09-14T12:13:00.450330+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:13:00.450330+0000","last_undegraded":"2024-09-14T12:13:00.450330+0000","last_fullsized":"2024-09-14T12:13:00.450330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:50.544493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447594+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:12:35.447594+0000","last_peered":"2024-09-14T12:12:35.447594+0000","last_clean":"2024-09-14T12:12:35.447594+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:12:35.447594+0000","last_undegraded":"2024-09-14T12:12:35.447594+0000","last_fullsized":"2024-09-14T12:12:35.447594+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:39.273428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:48.319648+0000","last_change":"2024-09-14T11:35:00.449492+0000","last_active":"2024-09-14T12:14:48.319648+0000","last_peered":"2024-09-14T12:14:48.319648+0000","last_clean":"2024-09-14T12:14:48.319648+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:14:48.319648+0000","last_undegraded":"2024-09-14T12:14:48.319648+0000","last_fullsized":"2024-09-14T12:14:48.319648+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:07.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.448902+0000","last_change":"2024-09-14T11:31:47.458093+0000","last_active":"2024-09-14T12:12:58.448902+0000","last_peered":"2024-09-14T12:12:58.448902+0000","last_clean":"2024-09-14T12:12:58.448902+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:12:58.448902+0000","last_undegraded":"2024-09-14T12:12:58.448902+0000","last_fullsized":"2024-09-14T12:12:58.448902+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:32.003627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.493311+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:16:13.493311+0000","last_peered":"2024-09-14T12:16:13.493311+0000","last_clean":"2024-09-14T12:16:13.493311+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:16:13.493311+0000","last_undegraded":"2024-09-14T12:16:13.493311+0000","last_fullsized":"2024-09-14T12:16:13.493311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468672+0000","last_change":"2024-09-14T11:31:47.461691+0000","last_active":"2024-09-14T12:13:33.468672+0000","last_peered":"2024-09-14T12:13:33.468672+0000","last_clean":"2024-09-14T12:13:33.468672+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:13:33.468672+0000","last_undegraded":"2024-09-14T12:13:33.468672+0000","last_fullsized":"2024-09-14T12:13:33.468672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:28.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.207399+0000","last_change":"2024-09-14T11:31:47.462125+0000","last_active":"2024-09-14T12:13:28.207399+0000","last_peered":"2024-09-14T12:13:28.207399+0000","last_clean":"2024-09-14T12:13:28.207399+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:13:28.207399+0000","last_undegraded":"2024-09-14T12:13:28.207399+0000","last_fullsized":"2024-09-14T12:13:28.207399+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:55.114065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.306468+0000","last_change":"2024-09-14T11:51:07.031655+0000","last_active":"2024-09-14T12:12:48.306468+0000","last_peered":"2024-09-14T12:12:48.306468+0000","last_clean":"2024-09-14T12:12:48.306468+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:12:48.306468+0000","last_undegraded":"2024-09-14T12:12:48.306468+0000","last_fullsized":"2024-09-14T12:12:48.306468+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:23.951366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.215366+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:14:38.215366+0000","last_peered":"2024-09-14T12:14:38.215366+0000","last_clean":"2024-09-14T12:14:38.215366+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:14:38.215366+0000","last_undegraded":"2024-09-14T12:14:38.215366+0000","last_fullsized":"2024-09-14T12:14:38.215366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:50.359964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:08.483121+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:15:08.483121+0000","last_peered":"2024-09-14T12:15:08.483121+0000","last_clean":"2024-09-14T12:15:08.483121+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:15:08.483121+0000","last_undegraded":"2024-09-14T12:15:08.483121+0000","last_fullsized":"2024-09-14T12:15:08.483121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.221763+0000","last_change":"2024-09-14T11:31:47.454368+0000","last_active":"2024-09-14T12:13:28.221763+0000","last_peered":"2024-09-14T12:13:28.221763+0000","last_clean":"2024-09-14T12:13:28.221763+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:13:28.221763+0000","last_undegraded":"2024-09-14T12:13:28.221763+0000","last_fullsized":"2024-09-14T12:13:28.221763+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:49.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.457485+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:12:33.457485+0000","last_peered":"2024-09-14T12:12:33.457485+0000","last_clean":"2024-09-14T12:12:33.457485+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:12:33.457485+0000","last_undegraded":"2024-09-14T12:12:33.457485+0000","last_fullsized":"2024-09-14T12:12:33.457485+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:14.503456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.335995+0000","last_change":"2024-09-14T11:31:47.458566+0000","last_active":"2024-09-14T12:13:28.335995+0000","last_peered":"2024-09-14T12:13:28.335995+0000","last_clean":"2024-09-14T12:13:28.335995+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:13:28.335995+0000","last_undegraded":"2024-09-14T12:13:28.335995+0000","last_fullsized":"2024-09-14T12:13:28.335995+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:16.885698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445234+0000","last_change":"2024-09-14T11:35:03.475098+0000","last_active":"2024-09-14T12:12:33.445234+0000","last_peered":"2024-09-14T12:12:33.445234+0000","last_clean":"2024-09-14T12:12:33.445234+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:12:33.445234+0000","last_undegraded":"2024-09-14T12:12:33.445234+0000","last_fullsized":"2024-09-14T12:12:33.445234+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:47.664159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.215423+0000","last_change":"2024-09-14T11:35:00.441606+0000","last_active":"2024-09-14T12:14:38.215423+0000","last_peered":"2024-09-14T12:14:38.215423+0000","last_clean":"2024-09-14T12:14:38.215423+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:14:38.215423+0000","last_undegraded":"2024-09-14T12:14:38.215423+0000","last_fullsized":"2024-09-14T12:14:38.215423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:26.099191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.453081+0000","last_change":"2024-09-14T11:31:47.457442+0000","last_active":"2024-09-14T12:13:28.453081+0000","last_peered":"2024-09-14T12:13:28.453081+0000","last_clean":"2024-09-14T12:13:28.453081+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:13:28.453081+0000","last_undegraded":"2024-09-14T12:13:28.453081+0000","last_fullsized":"2024-09-14T12:13:28.453081+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:30.421189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328235+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:12:33.328235+0000","last_peered":"2024-09-14T12:12:33.328235+0000","last_clean":"2024-09-14T12:12:33.328235+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:12:33.328235+0000","last_undegraded":"2024-09-14T12:12:33.328235+0000","last_fullsized":"2024-09-14T12:12:33.328235+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.691369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.445253+0000","last_change":"2024-09-14T11:35:00.438555+0000","last_active":"2024-09-14T12:12:33.445253+0000","last_peered":"2024-09-14T12:12:33.445253+0000","last_clean":"2024-09-14T12:12:33.445253+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:12:33.445253+0000","last_undegraded":"2024-09-14T12:12:33.445253+0000","last_fullsized":"2024-09-14T12:12:33.445253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:40.844681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471478+0000","last_change":"2024-09-14T11:31:47.457290+0000","last_active":"2024-09-14T12:13:53.471478+0000","last_peered":"2024-09-14T12:13:53.471478+0000","last_clean":"2024-09-14T12:13:53.471478+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:13:53.471478+0000","last_undegraded":"2024-09-14T12:13:53.471478+0000","last_fullsized":"2024-09-14T12:13:53.471478+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:56.244895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'382","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.421319+0000","last_change":"2024-09-14T12:16:34.421319+0000","last_active":"2024-09-14T12:16:34.421319+0000","last_peered":"2024-09-14T12:16:34.421319+0000","last_clean":"2024-09-14T12:16:34.421319+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:16:34.421319+0000","last_undegraded":"2024-09-14T12:16:34.421319+0000","last_fullsized":"2024-09-14T12:16:34.421319+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.421201+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:14.328374+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":629,"num_read_kb":9737,"num_write":1248,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'481","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.932313+0000","last_change":"2024-09-14T12:16:37.932313+0000","last_active":"2024-09-14T12:16:37.932313+0000","last_peered":"2024-09-14T12:16:37.932313+0000","last_clean":"2024-09-14T12:16:37.932313+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:16:37.932313+0000","last_undegraded":"2024-09-14T12:16:37.932313+0000","last_fullsized":"2024-09-14T12:16:37.932313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.932203+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:41.524216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'342","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.075044+0000","last_change":"2024-09-14T12:16:24.075044+0000","last_active":"2024-09-14T12:16:24.075044+0000","last_peered":"2024-09-14T12:16:24.075044+0000","last_clean":"2024-09-14T12:16:24.075044+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:16:24.075044+0000","last_undegraded":"2024-09-14T12:16:24.075044+0000","last_fullsized":"2024-09-14T12:16:24.075044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.074907+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:57.224200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":22753,"num_write":1016,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.399657+0000","last_change":"2024-09-14T12:16:38.399657+0000","last_active":"2024-09-14T12:16:38.399657+0000","last_peered":"2024-09-14T12:16:38.399657+0000","last_clean":"2024-09-14T12:16:38.399657+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:16:38.399657+0000","last_undegraded":"2024-09-14T12:16:38.399657+0000","last_fullsized":"2024-09-14T12:16:38.399657+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.399570+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:31.558475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'369","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.917158+0000","last_change":"2024-09-14T12:16:27.917158+0000","last_active":"2024-09-14T12:16:27.917158+0000","last_peered":"2024-09-14T12:16:27.917158+0000","last_clean":"2024-09-14T12:16:27.917158+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:16:27.917158+0000","last_undegraded":"2024-09-14T12:16:27.917158+0000","last_fullsized":"2024-09-14T12:16:27.917158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.917052+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.304387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":8099,"num_write":1164,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'828","reported_seq":2473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:53.348237+0000","last_change":"2024-09-14T11:17:23.599492+0000","last_active":"2024-09-14T12:14:53.348237+0000","last_peered":"2024-09-14T12:14:53.348237+0000","last_clean":"2024-09-14T12:14:53.348237+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:14:53.348237+0000","last_undegraded":"2024-09-14T12:14:53.348237+0000","last_fullsized":"2024-09-14T12:14:53.348237+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:31.073964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'398","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.842121+0000","last_change":"2024-09-14T12:16:30.842121+0000","last_active":"2024-09-14T12:16:30.842121+0000","last_peered":"2024-09-14T12:16:30.842121+0000","last_clean":"2024-09-14T12:16:30.842121+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:16:30.842121+0000","last_undegraded":"2024-09-14T12:16:30.842121+0000","last_fullsized":"2024-09-14T12:16:30.842121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.842017+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:52.781230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":69334,"num_write":1242,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'480","reported_seq":2211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.894365+0000","last_change":"2024-09-14T12:16:38.894365+0000","last_active":"2024-09-14T12:16:38.894365+0000","last_peered":"2024-09-14T12:16:38.894365+0000","last_clean":"2024-09-14T12:16:38.894365+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:16:38.894365+0000","last_undegraded":"2024-09-14T12:16:38.894365+0000","last_fullsized":"2024-09-14T12:16:38.894365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.894277+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:07.704197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'345","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.396720+0000","last_change":"2024-09-14T12:16:33.396720+0000","last_active":"2024-09-14T12:16:33.396720+0000","last_peered":"2024-09-14T12:16:33.396720+0000","last_clean":"2024-09-14T12:16:33.396720+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:16:33.396720+0000","last_undegraded":"2024-09-14T12:16:33.396720+0000","last_fullsized":"2024-09-14T12:16:33.396720+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.396612+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:50.383330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8504,"num_write":1105,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'931","reported_seq":2506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.470843+0000","last_change":"2024-09-14T12:16:33.470843+0000","last_active":"2024-09-14T12:16:33.470843+0000","last_peered":"2024-09-14T12:16:33.470843+0000","last_clean":"2024-09-14T12:16:33.470843+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:16:33.470843+0000","last_undegraded":"2024-09-14T12:16:33.470843+0000","last_fullsized":"2024-09-14T12:16:33.470843+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'931","last_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_deep_scrub":"263'931","last_deep_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.470747+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:53.569158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'339","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.824033+0000","last_change":"2024-09-14T12:16:29.824033+0000","last_active":"2024-09-14T12:16:29.824033+0000","last_peered":"2024-09-14T12:16:29.824033+0000","last_clean":"2024-09-14T12:16:29.824033+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:16:29.824033+0000","last_undegraded":"2024-09-14T12:16:29.824033+0000","last_fullsized":"2024-09-14T12:16:29.824033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.823921+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.850213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":13223,"num_write":1062,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'322","reported_seq":1677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.773491+0000","last_change":"2024-09-14T11:17:23.598233+0000","last_active":"2024-09-14T12:14:33.773491+0000","last_peered":"2024-09-14T12:14:33.773491+0000","last_clean":"2024-09-14T12:14:33.773491+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:14:33.773491+0000","last_undegraded":"2024-09-14T12:14:33.773491+0000","last_fullsized":"2024-09-14T12:14:33.773491+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:42.186568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'337","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.350810+0000","last_change":"2024-09-14T12:16:32.350810+0000","last_active":"2024-09-14T12:16:32.350810+0000","last_peered":"2024-09-14T12:16:32.350810+0000","last_clean":"2024-09-14T12:16:32.350810+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:16:32.350810+0000","last_undegraded":"2024-09-14T12:16:32.350810+0000","last_fullsized":"2024-09-14T12:16:32.350810+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.350698+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.629745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":13115,"num_write":1013,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'406","reported_seq":1944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:01.589436+0000","last_change":"2024-09-14T11:17:23.595095+0000","last_active":"2024-09-14T12:14:01.589436+0000","last_peered":"2024-09-14T12:14:01.589436+0000","last_clean":"2024-09-14T12:14:01.589436+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:14:01.589436+0000","last_undegraded":"2024-09-14T12:14:01.589436+0000","last_fullsized":"2024-09-14T12:14:01.589436+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:51.571958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'358","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.244252+0000","last_change":"2024-09-14T12:16:28.244252+0000","last_active":"2024-09-14T12:16:28.244252+0000","last_peered":"2024-09-14T12:16:28.244252+0000","last_clean":"2024-09-14T12:16:28.244252+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:16:28.244252+0000","last_undegraded":"2024-09-14T12:16:28.244252+0000","last_fullsized":"2024-09-14T12:16:28.244252+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.244160+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.741764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":594,"num_read_kb":3517,"num_write":1114,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'929","reported_seq":2505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.227870+0000","last_change":"2024-09-14T12:16:29.227870+0000","last_active":"2024-09-14T12:16:29.227870+0000","last_peered":"2024-09-14T12:16:29.227870+0000","last_clean":"2024-09-14T12:16:29.227870+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:16:29.227870+0000","last_undegraded":"2024-09-14T12:16:29.227870+0000","last_fullsized":"2024-09-14T12:16:29.227870+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'929","last_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_deep_scrub":"263'929","last_deep_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.227765+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:23.885174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'888","reported_seq":2517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.593824+0000","last_change":"2024-09-14T12:16:36.593824+0000","last_active":"2024-09-14T12:16:36.593824+0000","last_peered":"2024-09-14T12:16:36.593824+0000","last_clean":"2024-09-14T12:16:36.593824+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:16:36.593824+0000","last_undegraded":"2024-09-14T12:16:36.593824+0000","last_fullsized":"2024-09-14T12:16:36.593824+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'888","last_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_deep_scrub":"263'888","last_deep_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.593729+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:47.300409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'374","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.359854+0000","last_change":"2024-09-14T12:16:31.359854+0000","last_active":"2024-09-14T12:16:31.359854+0000","last_peered":"2024-09-14T12:16:31.359854+0000","last_clean":"2024-09-14T12:16:31.359854+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:16:31.359854+0000","last_undegraded":"2024-09-14T12:16:31.359854+0000","last_fullsized":"2024-09-14T12:16:31.359854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'374","last_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_deep_scrub":"263'374","last_deep_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.359749+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:50.234169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":33506,"num_write":1216,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'724","reported_seq":2275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.385574+0000","last_change":"2024-09-14T12:16:37.385574+0000","last_active":"2024-09-14T12:16:37.385574+0000","last_peered":"2024-09-14T12:16:37.385574+0000","last_clean":"2024-09-14T12:16:37.385574+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:16:37.385574+0000","last_undegraded":"2024-09-14T12:16:37.385574+0000","last_fullsized":"2024-09-14T12:16:37.385574+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.385484+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:48.262117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'479","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402397+0000","last_change":"2024-09-14T12:16:28.402397+0000","last_active":"2024-09-14T12:16:28.402397+0000","last_peered":"2024-09-14T12:16:28.402397+0000","last_clean":"2024-09-14T12:16:28.402397+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:16:28.402397+0000","last_undegraded":"2024-09-14T12:16:28.402397+0000","last_fullsized":"2024-09-14T12:16:28.402397+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402248+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:10.326854+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":934,"num_read_kb":10641,"num_write":1221,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'768","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.917096+0000","last_change":"2024-09-14T12:16:34.917096+0000","last_active":"2024-09-14T12:16:34.917096+0000","last_peered":"2024-09-14T12:16:34.917096+0000","last_clean":"2024-09-14T12:16:34.917096+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:16:34.917096+0000","last_undegraded":"2024-09-14T12:16:34.917096+0000","last_fullsized":"2024-09-14T12:16:34.917096+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.917005+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.725565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2731,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'393","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.429189+0000","last_change":"2024-09-14T12:16:27.429189+0000","last_active":"2024-09-14T12:16:27.429189+0000","last_peered":"2024-09-14T12:16:27.429189+0000","last_clean":"2024-09-14T12:16:27.429189+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:16:27.429189+0000","last_undegraded":"2024-09-14T12:16:27.429189+0000","last_fullsized":"2024-09-14T12:16:27.429189+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.429104+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.207355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":671,"num_read_kb":6370,"num_write":1079,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.267509+0000","last_change":"2024-09-14T12:16:27.267509+0000","last_active":"2024-09-14T12:16:27.267509+0000","last_peered":"2024-09-14T12:16:27.267509+0000","last_clean":"2024-09-14T12:16:27.267509+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:16:27.267509+0000","last_undegraded":"2024-09-14T12:16:27.267509+0000","last_fullsized":"2024-09-14T12:16:27.267509+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'608","last_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_deep_scrub":"263'608","last_deep_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.267429+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'328","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.529800+0000","last_change":"2024-09-14T12:16:23.529800+0000","last_active":"2024-09-14T12:16:23.529800+0000","last_peered":"2024-09-14T12:16:23.529800+0000","last_clean":"2024-09-14T12:16:23.529800+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:16:23.529800+0000","last_undegraded":"2024-09-14T12:16:23.529800+0000","last_fullsized":"2024-09-14T12:16:23.529800+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.529693+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:47.093569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":17017,"num_write":957,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'904","reported_seq":2620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.232914+0000","last_change":"2024-09-14T12:16:30.232914+0000","last_active":"2024-09-14T12:16:30.232914+0000","last_peered":"2024-09-14T12:16:30.232914+0000","last_clean":"2024-09-14T12:16:30.232914+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:16:30.232914+0000","last_undegraded":"2024-09-14T12:16:30.232914+0000","last_fullsized":"2024-09-14T12:16:30.232914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'904","last_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_deep_scrub":"263'904","last_deep_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.232832+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:17.647079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.551085+0000","last_change":"2024-09-14T12:16:27.551085+0000","last_active":"2024-09-14T12:16:27.551085+0000","last_peered":"2024-09-14T12:16:27.551085+0000","last_clean":"2024-09-14T12:16:27.551085+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:16:27.551085+0000","last_undegraded":"2024-09-14T12:16:27.551085+0000","last_fullsized":"2024-09-14T12:16:27.551085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.551001+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:40.128897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":19406,"num_write":864,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1147","reported_seq":2706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.559648+0000","last_change":"2024-09-14T12:16:37.559648+0000","last_active":"2024-09-14T12:16:37.559648+0000","last_peered":"2024-09-14T12:16:37.559648+0000","last_clean":"2024-09-14T12:16:37.559648+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:16:37.559648+0000","last_undegraded":"2024-09-14T12:16:37.559648+0000","last_fullsized":"2024-09-14T12:16:37.559648+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1147","last_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_deep_scrub":"263'1147","last_deep_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.559541+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:26.343620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'342","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.928565+0000","last_change":"2024-09-14T12:16:26.928565+0000","last_active":"2024-09-14T12:16:26.928565+0000","last_peered":"2024-09-14T12:16:26.928565+0000","last_clean":"2024-09-14T12:16:26.928565+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:16:26.928565+0000","last_undegraded":"2024-09-14T12:16:26.928565+0000","last_fullsized":"2024-09-14T12:16:26.928565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.928480+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:10.385752+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":705,"num_read_kb":10760,"num_write":996,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'124","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.745040+0000","last_change":"2024-09-14T11:17:31.654831+0000","last_active":"2024-09-14T12:14:34.745040+0000","last_peered":"2024-09-14T12:14:34.745040+0000","last_clean":"2024-09-14T12:14:34.745040+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:14:34.745040+0000","last_undegraded":"2024-09-14T12:14:34.745040+0000","last_fullsized":"2024-09-14T12:14:34.745040+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:31.244666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'525","reported_seq":2474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.537472+0000","last_change":"2024-09-14T12:16:30.537472+0000","last_active":"2024-09-14T12:16:30.537472+0000","last_peered":"2024-09-14T12:16:30.537472+0000","last_clean":"2024-09-14T12:16:30.537472+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:16:30.537472+0000","last_undegraded":"2024-09-14T12:16:30.537472+0000","last_fullsized":"2024-09-14T12:16:30.537472+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.537378+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:15.507796+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6633,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'294","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.359063+0000","last_change":"2024-09-14T12:16:30.359063+0000","last_active":"2024-09-14T12:16:30.359063+0000","last_peered":"2024-09-14T12:16:30.359063+0000","last_clean":"2024-09-14T12:16:30.359063+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:16:30.359063+0000","last_undegraded":"2024-09-14T12:16:30.359063+0000","last_fullsized":"2024-09-14T12:16:30.359063+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.358952+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:21.930313+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":3402,"num_write":873,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217819+0000","last_change":"2024-09-14T11:17:25.615823+0000","last_active":"2024-09-14T12:13:03.217819+0000","last_peered":"2024-09-14T12:13:03.217819+0000","last_clean":"2024-09-14T12:13:03.217819+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:13:03.217819+0000","last_undegraded":"2024-09-14T12:13:03.217819+0000","last_fullsized":"2024-09-14T12:13:03.217819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:11.906978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'346","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.485891+0000","last_change":"2024-09-14T11:17:27.635100+0000","last_active":"2024-09-14T12:16:14.485891+0000","last_peered":"2024-09-14T12:16:14.485891+0000","last_clean":"2024-09-14T12:16:14.485891+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:16:14.485891+0000","last_undegraded":"2024-09-14T12:16:14.485891+0000","last_fullsized":"2024-09-14T12:16:14.485891+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:40.414857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":1214,"num_write":454,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.465023+0000","last_change":"2024-09-14T11:17:29.648345+0000","last_active":"2024-09-14T12:13:08.465023+0000","last_peered":"2024-09-14T12:13:08.465023+0000","last_clean":"2024-09-14T12:13:08.465023+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:13:08.465023+0000","last_undegraded":"2024-09-14T12:13:08.465023+0000","last_fullsized":"2024-09-14T12:13:08.465023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:26.711675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'125","reported_seq":610,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.666407+0000","last_change":"2024-09-14T11:17:31.655931+0000","last_active":"2024-09-14T12:14:32.666407+0000","last_peered":"2024-09-14T12:14:32.666407+0000","last_clean":"2024-09-14T12:14:32.666407+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:14:32.666407+0000","last_undegraded":"2024-09-14T12:14:32.666407+0000","last_fullsized":"2024-09-14T12:14:32.666407+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.187962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'408","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.893645+0000","last_change":"2024-09-14T12:16:35.893645+0000","last_active":"2024-09-14T12:16:35.893645+0000","last_peered":"2024-09-14T12:16:35.893645+0000","last_clean":"2024-09-14T12:16:35.893645+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:16:35.893645+0000","last_undegraded":"2024-09-14T12:16:35.893645+0000","last_fullsized":"2024-09-14T12:16:35.893645+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.893533+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:50.859418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'384","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:18.857599+0000","last_change":"2024-09-14T12:16:18.857599+0000","last_active":"2024-09-14T12:16:18.857599+0000","last_peered":"2024-09-14T12:16:18.857599+0000","last_clean":"2024-09-14T12:16:18.857599+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:16:18.857599+0000","last_undegraded":"2024-09-14T12:16:18.857599+0000","last_fullsized":"2024-09-14T12:16:18.857599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_clean_scrub_stamp":"2024-09-14T12:16:18.857499+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:10.889774+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":9438,"num_write":1138,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219417+0000","last_change":"2024-09-14T11:17:25.616433+0000","last_active":"2024-09-14T12:13:43.219417+0000","last_peered":"2024-09-14T12:13:43.219417+0000","last_clean":"2024-09-14T12:13:43.219417+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:13:43.219417+0000","last_undegraded":"2024-09-14T12:13:43.219417+0000","last_fullsized":"2024-09-14T12:13:43.219417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:30.075195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'98","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332635+0000","last_change":"2024-09-14T11:17:27.625733+0000","last_active":"2024-09-14T12:13:03.332635+0000","last_peered":"2024-09-14T12:13:03.332635+0000","last_clean":"2024-09-14T12:13:03.332635+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:13:03.332635+0000","last_undegraded":"2024-09-14T12:13:03.332635+0000","last_fullsized":"2024-09-14T12:13:03.332635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:02.964076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:08.333430+0000","last_change":"2024-09-14T11:17:29.644069+0000","last_active":"2024-09-14T12:13:08.333430+0000","last_peered":"2024-09-14T12:13:08.333430+0000","last_clean":"2024-09-14T12:13:08.333430+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:13:08.333430+0000","last_undegraded":"2024-09-14T12:13:08.333430+0000","last_fullsized":"2024-09-14T12:13:08.333430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:57.125690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'115","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:35.447544+0000","last_change":"2024-09-14T11:17:31.656073+0000","last_active":"2024-09-14T12:12:35.447544+0000","last_peered":"2024-09-14T12:12:35.447544+0000","last_clean":"2024-09-14T12:12:35.447544+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:12:35.447544+0000","last_undegraded":"2024-09-14T12:12:35.447544+0000","last_fullsized":"2024-09-14T12:12:35.447544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.047265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'519","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.928397+0000","last_change":"2024-09-14T12:16:31.928397+0000","last_active":"2024-09-14T12:16:31.928397+0000","last_peered":"2024-09-14T12:16:31.928397+0000","last_clean":"2024-09-14T12:16:31.928397+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:16:31.928397+0000","last_undegraded":"2024-09-14T12:16:31.928397+0000","last_fullsized":"2024-09-14T12:16:31.928397+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.928310+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:24.464818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'451","reported_seq":1174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402865+0000","last_change":"2024-09-14T12:16:28.402865+0000","last_active":"2024-09-14T12:16:28.402865+0000","last_peered":"2024-09-14T12:16:28.402865+0000","last_clean":"2024-09-14T12:16:28.402865+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:16:28.402865+0000","last_undegraded":"2024-09-14T12:16:28.402865+0000","last_fullsized":"2024-09-14T12:16:28.402865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402734+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:14.475372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1029,"num_read_kb":13380,"num_write":1416,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.214581+0000","last_change":"2024-09-14T11:17:25.616302+0000","last_active":"2024-09-14T12:13:03.214581+0000","last_peered":"2024-09-14T12:13:03.214581+0000","last_clean":"2024-09-14T12:13:03.214581+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:13:03.214581+0000","last_undegraded":"2024-09-14T12:13:03.214581+0000","last_fullsized":"2024-09-14T12:13:03.214581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:14.747448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'120","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.190637+0000","last_change":"2024-09-14T12:16:36.190637+0000","last_active":"2024-09-14T12:16:36.190637+0000","last_peered":"2024-09-14T12:16:36.190637+0000","last_clean":"2024-09-14T12:16:36.190637+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:16:36.190637+0000","last_undegraded":"2024-09-14T12:16:36.190637+0000","last_fullsized":"2024-09-14T12:16:36.190637+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.190540+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:19.260626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'763","reported_seq":2260,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.119202+0000","last_change":"2024-09-14T11:17:29.644411+0000","last_active":"2024-09-14T12:16:14.119202+0000","last_peered":"2024-09-14T12:16:14.119202+0000","last_clean":"2024-09-14T12:16:14.119202+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:16:14.119202+0000","last_undegraded":"2024-09-14T12:16:14.119202+0000","last_fullsized":"2024-09-14T12:16:14.119202+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:09.032379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.802436+0000","last_change":"2024-09-14T11:17:31.653029+0000","last_active":"2024-09-14T12:14:34.802436+0000","last_peered":"2024-09-14T12:14:34.802436+0000","last_clean":"2024-09-14T12:14:34.802436+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:14:34.802436+0000","last_undegraded":"2024-09-14T12:14:34.802436+0000","last_fullsized":"2024-09-14T12:14:34.802436+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.378206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1037","reported_seq":2664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.534133+0000","last_change":"2024-09-14T12:16:31.534133+0000","last_active":"2024-09-14T12:16:31.534133+0000","last_peered":"2024-09-14T12:16:31.534133+0000","last_clean":"2024-09-14T12:16:31.534133+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:16:31.534133+0000","last_undegraded":"2024-09-14T12:16:31.534133+0000","last_fullsized":"2024-09-14T12:16:31.534133+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1037","last_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_deep_scrub":"263'1037","last_deep_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.534041+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:18.670329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'353","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.487007+0000","last_change":"2024-09-14T12:16:25.487007+0000","last_active":"2024-09-14T12:16:25.487007+0000","last_peered":"2024-09-14T12:16:25.487007+0000","last_clean":"2024-09-14T12:16:25.487007+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:16:25.487007+0000","last_undegraded":"2024-09-14T12:16:25.487007+0000","last_fullsized":"2024-09-14T12:16:25.487007+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.486896+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:43.830472+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":31887,"num_write":1106,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.217853+0000","last_change":"2024-09-14T11:17:25.618783+0000","last_active":"2024-09-14T12:13:03.217853+0000","last_peered":"2024-09-14T12:13:03.217853+0000","last_clean":"2024-09-14T12:13:03.217853+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:13:03.217853+0000","last_undegraded":"2024-09-14T12:13:03.217853+0000","last_fullsized":"2024-09-14T12:13:03.217853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:17.470265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'271","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.320031+0000","last_change":"2024-09-14T11:17:27.633216+0000","last_active":"2024-09-14T12:16:14.320031+0000","last_peered":"2024-09-14T12:16:14.320031+0000","last_clean":"2024-09-14T12:16:14.320031+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:16:14.320031+0000","last_undegraded":"2024-09-14T12:16:14.320031+0000","last_fullsized":"2024-09-14T12:16:14.320031+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.992449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1100,"num_write":378,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'803","reported_seq":2956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.257878+0000","last_change":"2024-09-14T11:17:29.645452+0000","last_active":"2024-09-14T12:16:15.257878+0000","last_peered":"2024-09-14T12:16:15.257878+0000","last_clean":"2024-09-14T12:16:15.257878+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:16:15.257878+0000","last_undegraded":"2024-09-14T12:16:15.257878+0000","last_fullsized":"2024-09-14T12:16:15.257878+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:20.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'783","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.907394+0000","last_change":"2024-09-14T12:16:33.907394+0000","last_active":"2024-09-14T12:16:33.907394+0000","last_peered":"2024-09-14T12:16:33.907394+0000","last_clean":"2024-09-14T12:16:33.907394+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:16:33.907394+0000","last_undegraded":"2024-09-14T12:16:33.907394+0000","last_fullsized":"2024-09-14T12:16:33.907394+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.907284+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:14.084827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'401","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.415684+0000","last_change":"2024-09-14T12:16:26.415684+0000","last_active":"2024-09-14T12:16:26.415684+0000","last_peered":"2024-09-14T12:16:26.415684+0000","last_clean":"2024-09-14T12:16:26.415684+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:16:26.415684+0000","last_undegraded":"2024-09-14T12:16:26.415684+0000","last_fullsized":"2024-09-14T12:16:26.415684+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.415569+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.364031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":683,"num_read_kb":56115,"num_write":1123,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470857+0000","last_change":"2024-09-14T11:17:25.612123+0000","last_active":"2024-09-14T12:13:48.470857+0000","last_peered":"2024-09-14T12:13:48.470857+0000","last_clean":"2024-09-14T12:13:48.470857+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:13:48.470857+0000","last_undegraded":"2024-09-14T12:13:48.470857+0000","last_fullsized":"2024-09-14T12:13:48.470857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.389407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'354","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.626512+0000","last_change":"2024-09-14T11:17:27.632368+0000","last_active":"2024-09-14T12:16:14.626512+0000","last_peered":"2024-09-14T12:16:14.626512+0000","last_clean":"2024-09-14T12:16:14.626512+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:16:14.626512+0000","last_undegraded":"2024-09-14T12:16:14.626512+0000","last_fullsized":"2024-09-14T12:16:14.626512+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:56.760176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":1208,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.209730+0000","last_change":"2024-09-14T11:17:29.646397+0000","last_active":"2024-09-14T12:13:48.209730+0000","last_peered":"2024-09-14T12:13:48.209730+0000","last_clean":"2024-09-14T12:13:48.209730+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:13:48.209730+0000","last_undegraded":"2024-09-14T12:13:48.209730+0000","last_fullsized":"2024-09-14T12:13:48.209730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:47.686669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'546","reported_seq":1351,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.248613+0000","last_change":"2024-09-14T11:17:31.656988+0000","last_active":"2024-09-14T12:15:49.248613+0000","last_peered":"2024-09-14T12:15:49.248613+0000","last_clean":"2024-09-14T12:15:49.248613+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:15:49.248613+0000","last_undegraded":"2024-09-14T12:15:49.248613+0000","last_fullsized":"2024-09-14T12:15:49.248613+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:43.507000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'388","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.589366+0000","last_change":"2024-09-14T12:16:27.589366+0000","last_active":"2024-09-14T12:16:27.589366+0000","last_peered":"2024-09-14T12:16:27.589366+0000","last_clean":"2024-09-14T12:16:27.589366+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:16:27.589366+0000","last_undegraded":"2024-09-14T12:16:27.589366+0000","last_fullsized":"2024-09-14T12:16:27.589366+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.589279+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:02.284167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'393","reported_seq":1157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.373988+0000","last_change":"2024-09-14T12:16:27.373988+0000","last_active":"2024-09-14T12:16:27.373988+0000","last_peered":"2024-09-14T12:16:27.373988+0000","last_clean":"2024-09-14T12:16:27.373988+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:16:27.373988+0000","last_undegraded":"2024-09-14T12:16:27.373988+0000","last_fullsized":"2024-09-14T12:16:27.373988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.373835+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:53.729046+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079941,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1043,"num_read_kb":12713,"num_write":1259,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.264334+0000","last_change":"2024-09-14T12:16:32.264334+0000","last_active":"2024-09-14T12:16:32.264334+0000","last_peered":"2024-09-14T12:16:32.264334+0000","last_clean":"2024-09-14T12:16:32.264334+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:16:32.264334+0000","last_undegraded":"2024-09-14T12:16:32.264334+0000","last_fullsized":"2024-09-14T12:16:32.264334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:13.721660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'252","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.284682+0000","last_change":"2024-09-14T11:17:27.631285+0000","last_active":"2024-09-14T12:16:15.284682+0000","last_peered":"2024-09-14T12:16:15.284682+0000","last_clean":"2024-09-14T12:16:15.284682+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:16:15.284682+0000","last_undegraded":"2024-09-14T12:16:15.284682+0000","last_fullsized":"2024-09-14T12:16:15.284682+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:15.793000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":973,"num_write":336,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:08.222209+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:14:08.222209+0000","last_peered":"2024-09-14T12:14:08.222209+0000","last_clean":"2024-09-14T12:14:08.222209+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:14:08.222209+0000","last_undegraded":"2024-09-14T12:14:08.222209+0000","last_fullsized":"2024-09-14T12:14:08.222209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2525","reported_seq":4361,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.132063+0000","last_change":"2024-09-14T11:17:31.655728+0000","last_active":"2024-09-14T12:15:48.132063+0000","last_peered":"2024-09-14T12:15:48.132063+0000","last_clean":"2024-09-14T12:15:48.132063+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:15:48.132063+0000","last_undegraded":"2024-09-14T12:15:48.132063+0000","last_fullsized":"2024-09-14T12:15:48.132063+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:25.453442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1158","reported_seq":2800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.464675+0000","last_change":"2024-09-14T12:16:30.464675+0000","last_active":"2024-09-14T12:16:30.464675+0000","last_peered":"2024-09-14T12:16:30.464675+0000","last_clean":"2024-09-14T12:16:30.464675+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:16:30.464675+0000","last_undegraded":"2024-09-14T12:16:30.464675+0000","last_fullsized":"2024-09-14T12:16:30.464675+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.464582+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:39.530289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'378","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.366637+0000","last_change":"2024-09-14T12:16:25.366637+0000","last_active":"2024-09-14T12:16:25.366637+0000","last_peered":"2024-09-14T12:16:25.366637+0000","last_clean":"2024-09-14T12:16:25.366637+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:16:25.366637+0000","last_undegraded":"2024-09-14T12:16:25.366637+0000","last_fullsized":"2024-09-14T12:16:25.366637+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.366516+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:07.861044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":648,"num_read_kb":71361,"num_write":1111,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.201858+0000","last_change":"2024-09-14T12:16:34.201858+0000","last_active":"2024-09-14T12:16:34.201858+0000","last_peered":"2024-09-14T12:16:34.201858+0000","last_clean":"2024-09-14T12:16:34.201858+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:16:34.201858+0000","last_undegraded":"2024-09-14T12:16:34.201858+0000","last_fullsized":"2024-09-14T12:16:34.201858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.201763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.946713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'308","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.899707+0000","last_change":"2024-09-14T11:17:27.635877+0000","last_active":"2024-09-14T12:16:14.899707+0000","last_peered":"2024-09-14T12:16:14.899707+0000","last_clean":"2024-09-14T12:16:14.899707+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:16:14.899707+0000","last_undegraded":"2024-09-14T12:16:14.899707+0000","last_fullsized":"2024-09-14T12:16:14.899707+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:09.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":517,"num_read_kb":1149,"num_write":414,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.124558+0000","last_change":"2024-09-14T11:17:29.645441+0000","last_active":"2024-09-14T12:16:14.124558+0000","last_peered":"2024-09-14T12:16:14.124558+0000","last_clean":"2024-09-14T12:16:14.124558+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:16:14.124558+0000","last_undegraded":"2024-09-14T12:16:14.124558+0000","last_fullsized":"2024-09-14T12:16:14.124558+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":701,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.991498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.126444+0000","last_change":"2024-09-14T11:17:31.657084+0000","last_active":"2024-09-14T12:15:48.126444+0000","last_peered":"2024-09-14T12:15:48.126444+0000","last_clean":"2024-09-14T12:15:48.126444+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:15:48.126444+0000","last_undegraded":"2024-09-14T12:15:48.126444+0000","last_fullsized":"2024-09-14T12:15:48.126444+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:26.090131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'584","reported_seq":2161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.905808+0000","last_change":"2024-09-14T12:16:30.905808+0000","last_active":"2024-09-14T12:16:30.905808+0000","last_peered":"2024-09-14T12:16:30.905808+0000","last_clean":"2024-09-14T12:16:30.905808+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:16:30.905808+0000","last_undegraded":"2024-09-14T12:16:30.905808+0000","last_fullsized":"2024-09-14T12:16:30.905808+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'584","last_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_deep_scrub":"263'584","last_deep_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.905703+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:35.243549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":769,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'426","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.190429+0000","last_change":"2024-09-14T12:16:20.190380+0000","last_active":"2024-09-14T12:16:20.190429+0000","last_peered":"2024-09-14T12:16:20.190429+0000","last_clean":"2024-09-14T12:16:20.190429+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:16:20.190429+0000","last_undegraded":"2024-09-14T12:16:20.190429+0000","last_fullsized":"2024-09-14T12:16:20.190429+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.190319+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:02.075520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":58896,"num_write":1397,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.229371+0000","last_change":"2024-09-14T12:16:33.229371+0000","last_active":"2024-09-14T12:16:33.229371+0000","last_peered":"2024-09-14T12:16:33.229371+0000","last_clean":"2024-09-14T12:16:33.229371+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:16:33.229371+0000","last_undegraded":"2024-09-14T12:16:33.229371+0000","last_fullsized":"2024-09-14T12:16:33.229371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.229270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:28.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'489","reported_seq":1125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.385023+0000","last_change":"2024-09-14T11:17:27.632963+0000","last_active":"2024-09-14T12:16:15.385023+0000","last_peered":"2024-09-14T12:16:15.385023+0000","last_clean":"2024-09-14T12:16:15.385023+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:16:15.385023+0000","last_undegraded":"2024-09-14T12:16:15.385023+0000","last_fullsized":"2024-09-14T12:16:15.385023+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:19.107003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94670,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":854,"num_read_kb":2046,"num_write":706,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.249723+0000","last_change":"2024-09-14T12:16:38.249723+0000","last_active":"2024-09-14T12:16:38.249723+0000","last_peered":"2024-09-14T12:16:38.249723+0000","last_clean":"2024-09-14T12:16:38.249723+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:16:38.249723+0000","last_undegraded":"2024-09-14T12:16:38.249723+0000","last_fullsized":"2024-09-14T12:16:38.249723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.249638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:30.373505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.210299+0000","last_change":"2024-09-14T11:17:31.660313+0000","last_active":"2024-09-14T12:13:53.210299+0000","last_peered":"2024-09-14T12:13:53.210299+0000","last_clean":"2024-09-14T12:13:53.210299+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:13:53.210299+0000","last_undegraded":"2024-09-14T12:13:53.210299+0000","last_fullsized":"2024-09-14T12:13:53.210299+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:47.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'492","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.619063+0000","last_change":"2024-09-14T12:16:31.619063+0000","last_active":"2024-09-14T12:16:31.619063+0000","last_peered":"2024-09-14T12:16:31.619063+0000","last_clean":"2024-09-14T12:16:31.619063+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:16:31.619063+0000","last_undegraded":"2024-09-14T12:16:31.619063+0000","last_fullsized":"2024-09-14T12:16:31.619063+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'492","last_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_deep_scrub":"263'492","last_deep_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.618980+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.751585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'356","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.428532+0000","last_change":"2024-09-14T12:16:22.428532+0000","last_active":"2024-09-14T12:16:22.428532+0000","last_peered":"2024-09-14T12:16:22.428532+0000","last_clean":"2024-09-14T12:16:22.428532+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:16:22.428532+0000","last_undegraded":"2024-09-14T12:16:22.428532+0000","last_fullsized":"2024-09-14T12:16:22.428532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.428437+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:49.436320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":23428,"num_write":1121,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.152681+0000","last_change":"2024-09-14T12:16:35.152681+0000","last_active":"2024-09-14T12:16:35.152681+0000","last_peered":"2024-09-14T12:16:35.152681+0000","last_clean":"2024-09-14T12:16:35.152681+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:16:35.152681+0000","last_undegraded":"2024-09-14T12:16:35.152681+0000","last_fullsized":"2024-09-14T12:16:35.152681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.152591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:03.738990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'288","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.417846+0000","last_change":"2024-09-14T11:17:27.634022+0000","last_active":"2024-09-14T12:16:15.417846+0000","last_peered":"2024-09-14T12:16:15.417846+0000","last_clean":"2024-09-14T12:16:15.417846+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:16:15.417846+0000","last_undegraded":"2024-09-14T12:16:15.417846+0000","last_fullsized":"2024-09-14T12:16:15.417846+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:42.665521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53607,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":516,"num_read_kb":1139,"num_write":462,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456437+0000","last_change":"2024-09-14T11:17:29.647566+0000","last_active":"2024-09-14T12:13:50.456437+0000","last_peered":"2024-09-14T12:13:50.456437+0000","last_clean":"2024-09-14T12:13:50.456437+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:13:50.456437+0000","last_undegraded":"2024-09-14T12:13:50.456437+0000","last_fullsized":"2024-09-14T12:13:50.456437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:15.794875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'110","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:38.479972+0000","last_change":"2024-09-14T11:17:31.655541+0000","last_active":"2024-09-14T12:15:38.479972+0000","last_peered":"2024-09-14T12:15:38.479972+0000","last_clean":"2024-09-14T12:15:38.479972+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:15:38.479972+0000","last_undegraded":"2024-09-14T12:15:38.479972+0000","last_fullsized":"2024-09-14T12:15:38.479972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:33.617603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'543","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.579010+0000","last_change":"2024-09-14T12:16:25.579010+0000","last_active":"2024-09-14T12:16:25.579010+0000","last_peered":"2024-09-14T12:16:25.579010+0000","last_clean":"2024-09-14T12:16:25.579010+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:16:25.579010+0000","last_undegraded":"2024-09-14T12:16:25.579010+0000","last_fullsized":"2024-09-14T12:16:25.579010+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'543","last_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_deep_scrub":"263'543","last_deep_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.578907+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:02.855337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1110,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'412","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.444164+0000","last_change":"2024-09-14T12:16:22.444164+0000","last_active":"2024-09-14T12:16:22.444164+0000","last_peered":"2024-09-14T12:16:22.444164+0000","last_clean":"2024-09-14T12:16:22.444164+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:16:22.444164+0000","last_undegraded":"2024-09-14T12:16:22.444164+0000","last_fullsized":"2024-09-14T12:16:22.444164+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.444058+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:52.547807+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":761,"num_read_kb":21492,"num_write":1380,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.158786+0000","last_change":"2024-09-14T12:16:36.158786+0000","last_active":"2024-09-14T12:16:36.158786+0000","last_peered":"2024-09-14T12:16:36.158786+0000","last_clean":"2024-09-14T12:16:36.158786+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:16:36.158786+0000","last_undegraded":"2024-09-14T12:16:36.158786+0000","last_fullsized":"2024-09-14T12:16:36.158786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.158693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'306","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.183230+0000","last_change":"2024-09-14T11:17:27.627740+0000","last_active":"2024-09-14T12:16:15.183230+0000","last_peered":"2024-09-14T12:16:15.183230+0000","last_clean":"2024-09-14T12:16:15.183230+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:16:15.183230+0000","last_undegraded":"2024-09-14T12:16:15.183230+0000","last_fullsized":"2024-09-14T12:16:15.183230+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:01.987766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":1085,"num_write":392,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'748","reported_seq":2443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.218331+0000","last_change":"2024-09-14T12:16:37.218331+0000","last_active":"2024-09-14T12:16:37.218331+0000","last_peered":"2024-09-14T12:16:37.218331+0000","last_clean":"2024-09-14T12:16:37.218331+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:16:37.218331+0000","last_undegraded":"2024-09-14T12:16:37.218331+0000","last_fullsized":"2024-09-14T12:16:37.218331+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.218240+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":701,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.806696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'183","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.243227+0000","last_change":"2024-09-14T11:17:31.656014+0000","last_active":"2024-09-14T12:15:49.243227+0000","last_peered":"2024-09-14T12:15:49.243227+0000","last_clean":"2024-09-14T12:15:49.243227+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:15:49.243227+0000","last_undegraded":"2024-09-14T12:15:49.243227+0000","last_fullsized":"2024-09-14T12:15:49.243227+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:31.925155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'788","reported_seq":2327,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.550891+0000","last_change":"2024-09-14T12:16:24.550891+0000","last_active":"2024-09-14T12:16:24.550891+0000","last_peered":"2024-09-14T12:16:24.550891+0000","last_clean":"2024-09-14T12:16:24.550891+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:16:24.550891+0000","last_undegraded":"2024-09-14T12:16:24.550891+0000","last_fullsized":"2024-09-14T12:16:24.550891+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.550810+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:52.077298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.516595+0000","last_change":"2024-09-14T12:16:20.516595+0000","last_active":"2024-09-14T12:16:20.516595+0000","last_peered":"2024-09-14T12:16:20.516595+0000","last_clean":"2024-09-14T12:16:20.516595+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:16:20.516595+0000","last_undegraded":"2024-09-14T12:16:20.516595+0000","last_fullsized":"2024-09-14T12:16:20.516595+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.516495+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.683715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":54223,"num_write":971,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.100610+0000","last_change":"2024-09-14T11:17:25.619652+0000","last_active":"2024-09-14T12:16:14.100610+0000","last_peered":"2024-09-14T12:16:14.100610+0000","last_clean":"2024-09-14T12:16:14.100610+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:16:14.100610+0000","last_undegraded":"2024-09-14T12:16:14.100610+0000","last_fullsized":"2024-09-14T12:16:14.100610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:20.219288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'84","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219434+0000","last_change":"2024-09-14T11:17:27.632484+0000","last_active":"2024-09-14T12:13:43.219434+0000","last_peered":"2024-09-14T12:13:43.219434+0000","last_clean":"2024-09-14T12:13:43.219434+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:13:43.219434+0000","last_undegraded":"2024-09-14T12:13:43.219434+0000","last_fullsized":"2024-09-14T12:13:43.219434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'782","reported_seq":2456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.121422+0000","last_change":"2024-09-14T11:17:29.640978+0000","last_active":"2024-09-14T12:16:14.121422+0000","last_peered":"2024-09-14T12:16:14.121422+0000","last_clean":"2024-09-14T12:16:14.121422+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:16:14.121422+0000","last_undegraded":"2024-09-14T12:16:14.121422+0000","last_fullsized":"2024-09-14T12:16:14.121422+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":702,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:21.396632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.764408+0000","last_change":"2024-09-14T11:17:31.656199+0000","last_active":"2024-09-14T12:14:33.764408+0000","last_peered":"2024-09-14T12:14:33.764408+0000","last_clean":"2024-09-14T12:14:33.764408+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:14:33.764408+0000","last_undegraded":"2024-09-14T12:14:33.764408+0000","last_fullsized":"2024-09-14T12:14:33.764408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:30.802461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'448","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.122847+0000","last_change":"2024-09-14T12:16:33.122847+0000","last_active":"2024-09-14T12:16:33.122847+0000","last_peered":"2024-09-14T12:16:33.122847+0000","last_clean":"2024-09-14T12:16:33.122847+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:16:33.122847+0000","last_undegraded":"2024-09-14T12:16:33.122847+0000","last_fullsized":"2024-09-14T12:16:33.122847+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.122743+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:16.368922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'335","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.471275+0000","last_change":"2024-09-14T12:16:23.471275+0000","last_active":"2024-09-14T12:16:23.471275+0000","last_peered":"2024-09-14T12:16:23.471275+0000","last_clean":"2024-09-14T12:16:23.471275+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:16:23.471275+0000","last_undegraded":"2024-09-14T12:16:23.471275+0000","last_fullsized":"2024-09-14T12:16:23.471275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.471155+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:57.341077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254166,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":11146,"num_write":1071,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338261+0000","last_change":"2024-09-14T11:17:25.616843+0000","last_active":"2024-09-14T12:13:43.338261+0000","last_peered":"2024-09-14T12:13:43.338261+0000","last_clean":"2024-09-14T12:13:43.338261+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:13:43.338261+0000","last_undegraded":"2024-09-14T12:13:43.338261+0000","last_fullsized":"2024-09-14T12:13:43.338261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:24.981755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'364","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.522185+0000","last_change":"2024-09-14T11:17:27.635744+0000","last_active":"2024-09-14T12:16:14.522185+0000","last_peered":"2024-09-14T12:16:14.522185+0000","last_clean":"2024-09-14T12:16:14.522185+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:16:14.522185+0000","last_undegraded":"2024-09-14T12:16:14.522185+0000","last_fullsized":"2024-09-14T12:16:14.522185+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:39.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":1225,"num_write":466,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.343756+0000","last_change":"2024-09-14T11:17:29.646394+0000","last_active":"2024-09-14T12:13:48.343756+0000","last_peered":"2024-09-14T12:13:48.343756+0000","last_clean":"2024-09-14T12:13:48.343756+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:13:48.343756+0000","last_undegraded":"2024-09-14T12:13:48.343756+0000","last_fullsized":"2024-09-14T12:13:48.343756+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:23.198544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'153","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.201239+0000","last_change":"2024-09-14T11:17:31.657114+0000","last_active":"2024-09-14T12:14:31.201239+0000","last_peered":"2024-09-14T12:14:31.201239+0000","last_clean":"2024-09-14T12:14:31.201239+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:14:31.201239+0000","last_undegraded":"2024-09-14T12:14:31.201239+0000","last_fullsized":"2024-09-14T12:14:31.201239+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:58.329950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'837","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.414190+0000","last_change":"2024-09-14T12:16:29.414190+0000","last_active":"2024-09-14T12:16:29.414190+0000","last_peered":"2024-09-14T12:16:29.414190+0000","last_clean":"2024-09-14T12:16:29.414190+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:16:29.414190+0000","last_undegraded":"2024-09-14T12:16:29.414190+0000","last_fullsized":"2024-09-14T12:16:29.414190+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'837","last_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_deep_scrub":"263'837","last_deep_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.414099+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:46.138941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.360268+0000","last_change":"2024-09-14T12:16:22.360268+0000","last_active":"2024-09-14T12:16:22.360268+0000","last_peered":"2024-09-14T12:16:22.360268+0000","last_clean":"2024-09-14T12:16:22.360268+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:16:22.360268+0000","last_undegraded":"2024-09-14T12:16:22.360268+0000","last_fullsized":"2024-09-14T12:16:22.360268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.360181+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.818652+0000","last_change":"2024-09-14T12:16:21.818652+0000","last_active":"2024-09-14T12:16:21.818652+0000","last_peered":"2024-09-14T12:16:21.818652+0000","last_clean":"2024-09-14T12:16:21.818652+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:16:21.818652+0000","last_undegraded":"2024-09-14T12:16:21.818652+0000","last_fullsized":"2024-09-14T12:16:21.818652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.818511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:14.072170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'359","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.414614+0000","last_change":"2024-09-14T12:16:20.414614+0000","last_active":"2024-09-14T12:16:20.414614+0000","last_peered":"2024-09-14T12:16:20.414614+0000","last_clean":"2024-09-14T12:16:20.414614+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:16:20.414614+0000","last_undegraded":"2024-09-14T12:16:20.414614+0000","last_fullsized":"2024-09-14T12:16:20.414614+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.414538+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:37.794945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":16922,"num_write":1091,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470216+0000","last_change":"2024-09-14T11:17:25.613638+0000","last_active":"2024-09-14T12:13:43.470216+0000","last_peered":"2024-09-14T12:13:43.470216+0000","last_clean":"2024-09-14T12:13:43.470216+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:13:43.470216+0000","last_undegraded":"2024-09-14T12:13:43.470216+0000","last_fullsized":"2024-09-14T12:13:43.470216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:59.751658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'762","reported_seq":1463,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.114733+0000","last_change":"2024-09-14T11:17:27.633577+0000","last_active":"2024-09-14T12:16:15.114733+0000","last_peered":"2024-09-14T12:16:15.114733+0000","last_clean":"2024-09-14T12:16:15.114733+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:16:15.114733+0000","last_undegraded":"2024-09-14T12:16:15.114733+0000","last_fullsized":"2024-09-14T12:16:15.114733+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:24.125363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143710,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1487,"num_read_kb":3441,"num_write":1400,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456404+0000","last_change":"2024-09-14T11:17:29.646281+0000","last_active":"2024-09-14T12:13:50.456404+0000","last_peered":"2024-09-14T12:13:50.456404+0000","last_clean":"2024-09-14T12:13:50.456404+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:13:50.456404+0000","last_undegraded":"2024-09-14T12:13:50.456404+0000","last_fullsized":"2024-09-14T12:13:50.456404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:03.727278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'170","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.634305+0000","last_change":"2024-09-14T11:17:31.655031+0000","last_active":"2024-09-14T12:14:34.634305+0000","last_peered":"2024-09-14T12:14:34.634305+0000","last_clean":"2024-09-14T12:14:34.634305+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:14:34.634305+0000","last_undegraded":"2024-09-14T12:14:34.634305+0000","last_fullsized":"2024-09-14T12:14:34.634305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:19.605574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'460","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.938707+0000","last_change":"2024-09-14T12:16:29.938707+0000","last_active":"2024-09-14T12:16:29.938707+0000","last_peered":"2024-09-14T12:16:29.938707+0000","last_clean":"2024-09-14T12:16:29.938707+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:16:29.938707+0000","last_undegraded":"2024-09-14T12:16:29.938707+0000","last_fullsized":"2024-09-14T12:16:29.938707+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.938619+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:25.975325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.365217+0000","last_change":"2024-09-14T12:16:23.365217+0000","last_active":"2024-09-14T12:16:23.365217+0000","last_peered":"2024-09-14T12:16:23.365217+0000","last_clean":"2024-09-14T12:16:23.365217+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:16:23.365217+0000","last_undegraded":"2024-09-14T12:16:23.365217+0000","last_fullsized":"2024-09-14T12:16:23.365217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.365091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.254811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'385","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.868893+0000","last_change":"2024-09-14T12:16:19.868893+0000","last_active":"2024-09-14T12:16:19.868893+0000","last_peered":"2024-09-14T12:16:19.868893+0000","last_clean":"2024-09-14T12:16:19.868893+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:16:19.868893+0000","last_undegraded":"2024-09-14T12:16:19.868893+0000","last_fullsized":"2024-09-14T12:16:19.868893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.868790+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.225391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":9086,"num_write":1281,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.224869+0000","last_change":"2024-09-14T11:17:25.617276+0000","last_active":"2024-09-14T12:13:48.224869+0000","last_peered":"2024-09-14T12:13:48.224869+0000","last_clean":"2024-09-14T12:13:48.224869+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:13:48.224869+0000","last_undegraded":"2024-09-14T12:13:48.224869+0000","last_fullsized":"2024-09-14T12:13:48.224869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:50.601228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1305","reported_seq":2943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.319903+0000","last_change":"2024-09-14T11:17:27.631903+0000","last_active":"2024-09-14T12:16:15.319903+0000","last_peered":"2024-09-14T12:16:15.319903+0000","last_clean":"2024-09-14T12:16:15.319903+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:15.319903+0000","last_undegraded":"2024-09-14T12:16:15.319903+0000","last_fullsized":"2024-09-14T12:16:15.319903+0000","mapping_epoch":31,"log_start":"263'1200","ondisk_log_start":"263'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:33.016381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235088,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2047,"num_read_kb":3984,"num_write":1154,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471608+0000","last_change":"2024-09-14T11:17:29.645394+0000","last_active":"2024-09-14T12:13:53.471608+0000","last_peered":"2024-09-14T12:13:53.471608+0000","last_clean":"2024-09-14T12:13:53.471608+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:13:53.471608+0000","last_undegraded":"2024-09-14T12:13:53.471608+0000","last_fullsized":"2024-09-14T12:13:53.471608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:49.499047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'216","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.211448+0000","last_change":"2024-09-14T11:17:31.658892+0000","last_active":"2024-09-14T12:14:03.211448+0000","last_peered":"2024-09-14T12:14:03.211448+0000","last_clean":"2024-09-14T12:14:03.211448+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:14:03.211448+0000","last_undegraded":"2024-09-14T12:14:03.211448+0000","last_fullsized":"2024-09-14T12:14:03.211448+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:34.868207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'658","reported_seq":2314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.055652+0000","last_change":"2024-09-14T12:16:30.055652+0000","last_active":"2024-09-14T12:16:30.055652+0000","last_peered":"2024-09-14T12:16:30.055652+0000","last_clean":"2024-09-14T12:16:30.055652+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:16:30.055652+0000","last_undegraded":"2024-09-14T12:16:30.055652+0000","last_fullsized":"2024-09-14T12:16:30.055652+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'658","last_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_deep_scrub":"263'658","last_deep_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.055562+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:55.630653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.219556+0000","last_change":"2024-09-14T12:16:22.219556+0000","last_active":"2024-09-14T12:16:22.219556+0000","last_peered":"2024-09-14T12:16:22.219556+0000","last_clean":"2024-09-14T12:16:22.219556+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:16:22.219556+0000","last_undegraded":"2024-09-14T12:16:22.219556+0000","last_fullsized":"2024-09-14T12:16:22.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.219484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:41.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'369","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.058930+0000","last_change":"2024-09-14T12:16:23.058930+0000","last_active":"2024-09-14T12:16:23.058930+0000","last_peered":"2024-09-14T12:16:23.058930+0000","last_clean":"2024-09-14T12:16:23.058930+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:16:23.058930+0000","last_undegraded":"2024-09-14T12:16:23.058930+0000","last_fullsized":"2024-09-14T12:16:23.058930+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.058848+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:55.317203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":678,"num_read_kb":56413,"num_write":1142,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.272785+0000","last_change":"2024-09-14T12:16:31.272785+0000","last_active":"2024-09-14T12:16:31.272785+0000","last_peered":"2024-09-14T12:16:31.272785+0000","last_clean":"2024-09-14T12:16:31.272785+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:16:31.272785+0000","last_undegraded":"2024-09-14T12:16:31.272785+0000","last_fullsized":"2024-09-14T12:16:31.272785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.272700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:53.072319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'258","reported_seq":1503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.376331+0000","last_change":"2024-09-14T11:17:27.633187+0000","last_active":"2024-09-14T12:15:49.376331+0000","last_peered":"2024-09-14T12:15:49.376331+0000","last_clean":"2024-09-14T12:15:49.376331+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:15:49.376331+0000","last_undegraded":"2024-09-14T12:15:49.376331+0000","last_fullsized":"2024-09-14T12:15:49.376331+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.161248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:45.455781+0000","last_change":"2024-09-14T11:17:29.647473+0000","last_active":"2024-09-14T12:13:45.455781+0000","last_peered":"2024-09-14T12:13:45.455781+0000","last_clean":"2024-09-14T12:13:45.455781+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:13:45.455781+0000","last_undegraded":"2024-09-14T12:13:45.455781+0000","last_fullsized":"2024-09-14T12:13:45.455781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:28.646908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'799","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.067463+0000","last_change":"2024-09-14T12:16:26.067463+0000","last_active":"2024-09-14T12:16:26.067463+0000","last_peered":"2024-09-14T12:16:26.067463+0000","last_clean":"2024-09-14T12:16:26.067463+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:16:26.067463+0000","last_undegraded":"2024-09-14T12:16:26.067463+0000","last_fullsized":"2024-09-14T12:16:26.067463+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.067346+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:40.289749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.828188+0000","last_change":"2024-09-14T12:16:20.828188+0000","last_active":"2024-09-14T12:16:20.828188+0000","last_peered":"2024-09-14T12:16:20.828188+0000","last_clean":"2024-09-14T12:16:20.828188+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:16:20.828188+0000","last_undegraded":"2024-09-14T12:16:20.828188+0000","last_fullsized":"2024-09-14T12:16:20.828188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.828073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:36.232253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'428","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.205035+0000","last_change":"2024-09-14T12:16:23.205035+0000","last_active":"2024-09-14T12:16:23.205035+0000","last_peered":"2024-09-14T12:16:23.205035+0000","last_clean":"2024-09-14T12:16:23.205035+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:16:23.205035+0000","last_undegraded":"2024-09-14T12:16:23.205035+0000","last_fullsized":"2024-09-14T12:16:23.205035+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.204951+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:51.476005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":100618,"num_write":1363,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"263'4","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.885003+0000","last_change":"2024-09-14T12:16:36.885003+0000","last_active":"2024-09-14T12:16:36.885003+0000","last_peered":"2024-09-14T12:16:36.885003+0000","last_clean":"2024-09-14T12:16:36.885003+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:16:36.885003+0000","last_undegraded":"2024-09-14T12:16:36.885003+0000","last_fullsized":"2024-09-14T12:16:36.885003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.884909+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:15.222253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":727,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'141","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.389956+0000","last_change":"2024-09-14T11:17:27.629622+0000","last_active":"2024-09-14T12:15:49.389956+0000","last_peered":"2024-09-14T12:15:49.389956+0000","last_clean":"2024-09-14T12:15:49.389956+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:15:49.389956+0000","last_undegraded":"2024-09-14T12:15:49.389956+0000","last_fullsized":"2024-09-14T12:15:49.389956+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:36.891527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.529888+0000","last_change":"2024-09-14T12:16:37.529888+0000","last_active":"2024-09-14T12:16:37.529888+0000","last_peered":"2024-09-14T12:16:37.529888+0000","last_clean":"2024-09-14T12:16:37.529888+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:16:37.529888+0000","last_undegraded":"2024-09-14T12:16:37.529888+0000","last_fullsized":"2024-09-14T12:16:37.529888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.529798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:43.161355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'152","reported_seq":750,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.225431+0000","last_change":"2024-09-14T11:17:31.658341+0000","last_active":"2024-09-14T12:13:53.225431+0000","last_peered":"2024-09-14T12:13:53.225431+0000","last_clean":"2024-09-14T12:13:53.225431+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:13:53.225431+0000","last_undegraded":"2024-09-14T12:13:53.225431+0000","last_fullsized":"2024-09-14T12:13:53.225431+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:31.293556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'541","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.067347+0000","last_change":"2024-09-14T12:16:25.067347+0000","last_active":"2024-09-14T12:16:25.067347+0000","last_peered":"2024-09-14T12:16:25.067347+0000","last_clean":"2024-09-14T12:16:25.067347+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:16:25.067347+0000","last_undegraded":"2024-09-14T12:16:25.067347+0000","last_fullsized":"2024-09-14T12:16:25.067347+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.067268+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:52.957237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'376","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.831672+0000","last_change":"2024-09-14T12:16:22.831672+0000","last_active":"2024-09-14T12:16:22.831672+0000","last_peered":"2024-09-14T12:16:22.831672+0000","last_clean":"2024-09-14T12:16:22.831672+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:16:22.831672+0000","last_undegraded":"2024-09-14T12:16:22.831672+0000","last_fullsized":"2024-09-14T12:16:22.831672+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.831568+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:25.922575+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":15898,"num_write":1178,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.046268+0000","last_change":"2024-09-14T12:16:21.046268+0000","last_active":"2024-09-14T12:16:21.046268+0000","last_peered":"2024-09-14T12:16:21.046268+0000","last_clean":"2024-09-14T12:16:21.046268+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:16:21.046268+0000","last_undegraded":"2024-09-14T12:16:21.046268+0000","last_fullsized":"2024-09-14T12:16:21.046268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.046203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:19.507992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.917486+0000","last_change":"2024-09-14T12:16:39.917486+0000","last_active":"2024-09-14T12:16:39.917486+0000","last_peered":"2024-09-14T12:16:39.917486+0000","last_clean":"2024-09-14T12:16:39.917486+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:16:39.917486+0000","last_undegraded":"2024-09-14T12:16:39.917486+0000","last_fullsized":"2024-09-14T12:16:39.917486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.917368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:02.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'596","reported_seq":1268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.147113+0000","last_change":"2024-09-14T11:17:27.638848+0000","last_active":"2024-09-14T12:16:15.147113+0000","last_peered":"2024-09-14T12:16:15.147113+0000","last_clean":"2024-09-14T12:16:15.147113+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:16:15.147113+0000","last_undegraded":"2024-09-14T12:16:15.147113+0000","last_fullsized":"2024-09-14T12:16:15.147113+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.865878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94377,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1665,"num_read_kb":2783,"num_write":2218,"num_write_kb":2033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339077+0000","last_change":"2024-09-14T11:17:29.647531+0000","last_active":"2024-09-14T12:13:48.339077+0000","last_peered":"2024-09-14T12:13:48.339077+0000","last_clean":"2024-09-14T12:13:48.339077+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:13:48.339077+0000","last_undegraded":"2024-09-14T12:13:48.339077+0000","last_fullsized":"2024-09-14T12:13:48.339077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:29.660582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'144","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.737717+0000","last_change":"2024-09-14T11:17:31.650597+0000","last_active":"2024-09-14T12:14:31.737717+0000","last_peered":"2024-09-14T12:14:31.737717+0000","last_clean":"2024-09-14T12:14:31.737717+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:14:31.737717+0000","last_undegraded":"2024-09-14T12:14:31.737717+0000","last_fullsized":"2024-09-14T12:14:31.737717+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:24.077884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'817","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.948833+0000","last_change":"2024-09-14T12:16:28.948833+0000","last_active":"2024-09-14T12:16:28.948833+0000","last_peered":"2024-09-14T12:16:28.948833+0000","last_clean":"2024-09-14T12:16:28.948833+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:16:28.948833+0000","last_undegraded":"2024-09-14T12:16:28.948833+0000","last_fullsized":"2024-09-14T12:16:28.948833+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.948726+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:45.026434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'370","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.036275+0000","last_change":"2024-09-14T12:16:20.036275+0000","last_active":"2024-09-14T12:16:20.036275+0000","last_peered":"2024-09-14T12:16:20.036275+0000","last_clean":"2024-09-14T12:16:20.036275+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:16:20.036275+0000","last_undegraded":"2024-09-14T12:16:20.036275+0000","last_fullsized":"2024-09-14T12:16:20.036275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.036170+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.821484+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159837,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":790,"num_read_kb":26393,"num_write":1261,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.388449+0000","last_change":"2024-09-14T12:16:24.388449+0000","last_active":"2024-09-14T12:16:24.388449+0000","last_peered":"2024-09-14T12:16:24.388449+0000","last_clean":"2024-09-14T12:16:24.388449+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:16:24.388449+0000","last_undegraded":"2024-09-14T12:16:24.388449+0000","last_fullsized":"2024-09-14T12:16:24.388449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.388360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:24.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.511200+0000","last_change":"2024-09-14T12:16:34.511200+0000","last_active":"2024-09-14T12:16:34.511200+0000","last_peered":"2024-09-14T12:16:34.511200+0000","last_clean":"2024-09-14T12:16:34.511200+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:16:34.511200+0000","last_undegraded":"2024-09-14T12:16:34.511200+0000","last_fullsized":"2024-09-14T12:16:34.511200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.511111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:08.764095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.612668+0000","last_change":"2024-09-14T11:17:27.630067+0000","last_active":"2024-09-14T12:14:34.612668+0000","last_peered":"2024-09-14T12:14:34.612668+0000","last_clean":"2024-09-14T12:14:34.612668+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:14:34.612668+0000","last_undegraded":"2024-09-14T12:14:34.612668+0000","last_fullsized":"2024-09-14T12:14:34.612668+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:12.127579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'813","reported_seq":6811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.224377+0000","last_change":"2024-09-14T11:17:29.642605+0000","last_active":"2024-09-14T12:16:15.224377+0000","last_peered":"2024-09-14T12:16:15.224377+0000","last_clean":"2024-09-14T12:16:15.224377+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:16:15.224377+0000","last_undegraded":"2024-09-14T12:16:15.224377+0000","last_fullsized":"2024-09-14T12:16:15.224377+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:10.588277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'138","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.245879+0000","last_change":"2024-09-14T11:17:31.658974+0000","last_active":"2024-09-14T12:15:49.245879+0000","last_peered":"2024-09-14T12:15:49.245879+0000","last_clean":"2024-09-14T12:15:49.245879+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:15:49.245879+0000","last_undegraded":"2024-09-14T12:15:49.245879+0000","last_fullsized":"2024-09-14T12:15:49.245879+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:06.184401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1162","reported_seq":2666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.564857+0000","last_change":"2024-09-14T12:16:32.564857+0000","last_active":"2024-09-14T12:16:32.564857+0000","last_peered":"2024-09-14T12:16:32.564857+0000","last_clean":"2024-09-14T12:16:32.564857+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:16:32.564857+0000","last_undegraded":"2024-09-14T12:16:32.564857+0000","last_fullsized":"2024-09-14T12:16:32.564857+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1162","last_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_deep_scrub":"263'1162","last_deep_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.564750+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.939513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.380483+0000","last_change":"2024-09-14T12:16:21.380483+0000","last_active":"2024-09-14T12:16:21.380483+0000","last_peered":"2024-09-14T12:16:21.380483+0000","last_clean":"2024-09-14T12:16:21.380483+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:16:21.380483+0000","last_undegraded":"2024-09-14T12:16:21.380483+0000","last_fullsized":"2024-09-14T12:16:21.380483+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.380404+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:16.067361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":24953,"num_write":917,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.057317+0000","last_change":"2024-09-14T12:16:19.057317+0000","last_active":"2024-09-14T12:16:19.057317+0000","last_peered":"2024-09-14T12:16:19.057317+0000","last_clean":"2024-09-14T12:16:19.057317+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:16:19.057317+0000","last_undegraded":"2024-09-14T12:16:19.057317+0000","last_fullsized":"2024-09-14T12:16:19.057317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.057236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:56.674413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338159+0000","last_change":"2024-09-14T11:17:25.612971+0000","last_active":"2024-09-14T12:13:43.338159+0000","last_peered":"2024-09-14T12:13:43.338159+0000","last_clean":"2024-09-14T12:13:43.338159+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:13:43.338159+0000","last_undegraded":"2024-09-14T12:13:43.338159+0000","last_fullsized":"2024-09-14T12:13:43.338159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:01.406616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'112","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.338189+0000","last_change":"2024-09-14T11:17:27.630261+0000","last_active":"2024-09-14T12:13:43.338189+0000","last_peered":"2024-09-14T12:13:43.338189+0000","last_clean":"2024-09-14T12:13:43.338189+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:13:43.338189+0000","last_undegraded":"2024-09-14T12:13:43.338189+0000","last_fullsized":"2024-09-14T12:13:43.338189+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:38.765597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'804","reported_seq":2504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.257712+0000","last_change":"2024-09-14T11:17:29.646106+0000","last_active":"2024-09-14T12:16:15.257712+0000","last_peered":"2024-09-14T12:16:15.257712+0000","last_clean":"2024-09-14T12:16:15.257712+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:16:15.257712+0000","last_undegraded":"2024-09-14T12:16:15.257712+0000","last_fullsized":"2024-09-14T12:16:15.257712+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.541372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'195","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.076897+0000","last_change":"2024-09-14T11:17:31.656972+0000","last_active":"2024-09-14T12:14:33.076897+0000","last_peered":"2024-09-14T12:14:33.076897+0000","last_clean":"2024-09-14T12:14:33.076897+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:14:33.076897+0000","last_undegraded":"2024-09-14T12:14:33.076897+0000","last_fullsized":"2024-09-14T12:14:33.076897+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:57.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2360,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.613914+0000","last_change":"2024-09-14T12:16:30.613914+0000","last_active":"2024-09-14T12:16:30.613914+0000","last_peered":"2024-09-14T12:16:30.613914+0000","last_clean":"2024-09-14T12:16:30.613914+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:16:30.613914+0000","last_undegraded":"2024-09-14T12:16:30.613914+0000","last_fullsized":"2024-09-14T12:16:30.613914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'873","last_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_deep_scrub":"263'873","last_deep_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.613828+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:47.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'407","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.862986+0000","last_change":"2024-09-14T12:16:20.862986+0000","last_active":"2024-09-14T12:16:20.862986+0000","last_peered":"2024-09-14T12:16:20.862986+0000","last_clean":"2024-09-14T12:16:20.862986+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:16:20.862986+0000","last_undegraded":"2024-09-14T12:16:20.862986+0000","last_fullsized":"2024-09-14T12:16:20.862986+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.862919+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:17.038200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":7690,"num_write":1106,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.452659+0000","last_change":"2024-09-14T12:16:21.452659+0000","last_active":"2024-09-14T12:16:21.452659+0000","last_peered":"2024-09-14T12:16:21.452659+0000","last_clean":"2024-09-14T12:16:21.452659+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:16:21.452659+0000","last_undegraded":"2024-09-14T12:16:21.452659+0000","last_fullsized":"2024-09-14T12:16:21.452659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.452570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:20.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219350+0000","last_change":"2024-09-14T11:17:25.617838+0000","last_active":"2024-09-14T12:13:43.219350+0000","last_peered":"2024-09-14T12:13:43.219350+0000","last_clean":"2024-09-14T12:13:43.219350+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:13:43.219350+0000","last_undegraded":"2024-09-14T12:13:43.219350+0000","last_fullsized":"2024-09-14T12:13:43.219350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.722602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'719","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.349407+0000","last_change":"2024-09-14T11:17:27.628721+0000","last_active":"2024-09-14T12:16:15.349407+0000","last_peered":"2024-09-14T12:16:15.349407+0000","last_clean":"2024-09-14T12:16:15.349407+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:16:15.349407+0000","last_undegraded":"2024-09-14T12:16:15.349407+0000","last_fullsized":"2024-09-14T12:16:15.349407+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:43.091580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149203,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1276,"num_read_kb":2979,"num_write":1030,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219994+0000","last_change":"2024-09-14T11:17:29.643858+0000","last_active":"2024-09-14T12:13:48.219994+0000","last_peered":"2024-09-14T12:13:48.219994+0000","last_clean":"2024-09-14T12:13:48.219994+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:13:48.219994+0000","last_undegraded":"2024-09-14T12:13:48.219994+0000","last_fullsized":"2024-09-14T12:13:48.219994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.290912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'112","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.590948+0000","last_change":"2024-09-14T11:17:31.659136+0000","last_active":"2024-09-14T12:14:34.590948+0000","last_peered":"2024-09-14T12:14:34.590948+0000","last_clean":"2024-09-14T12:14:34.590948+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:14:34.590948+0000","last_undegraded":"2024-09-14T12:14:34.590948+0000","last_fullsized":"2024-09-14T12:14:34.590948+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:30.679212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'154","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.818840+0000","last_change":"2024-09-14T11:17:31.657903+0000","last_active":"2024-09-14T12:14:34.818840+0000","last_peered":"2024-09-14T12:14:34.818840+0000","last_clean":"2024-09-14T12:14:34.818840+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:14:34.818840+0000","last_undegraded":"2024-09-14T12:14:34.818840+0000","last_fullsized":"2024-09-14T12:14:34.818840+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:29.439862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'378","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.578669+0000","last_change":"2024-09-14T12:16:26.578669+0000","last_active":"2024-09-14T12:16:26.578669+0000","last_peered":"2024-09-14T12:16:26.578669+0000","last_clean":"2024-09-14T12:16:26.578669+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:16:26.578669+0000","last_undegraded":"2024-09-14T12:16:26.578669+0000","last_fullsized":"2024-09-14T12:16:26.578669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.578576+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:26.873670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'334","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.549518+0000","last_change":"2024-09-14T12:16:21.549518+0000","last_active":"2024-09-14T12:16:21.549518+0000","last_peered":"2024-09-14T12:16:21.549518+0000","last_clean":"2024-09-14T12:16:21.549518+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:16:21.549518+0000","last_undegraded":"2024-09-14T12:16:21.549518+0000","last_fullsized":"2024-09-14T12:16:21.549518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.549418+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:07.371079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":681,"num_read_kb":30194,"num_write":1111,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.196236+0000","last_change":"2024-09-14T12:16:37.196236+0000","last_active":"2024-09-14T12:16:37.196236+0000","last_peered":"2024-09-14T12:16:37.196236+0000","last_clean":"2024-09-14T12:16:37.196236+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:16:37.196236+0000","last_undegraded":"2024-09-14T12:16:37.196236+0000","last_fullsized":"2024-09-14T12:16:37.196236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.196124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:44.046644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'299","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.659689+0000","last_change":"2024-09-14T11:17:27.630446+0000","last_active":"2024-09-14T12:16:14.659689+0000","last_peered":"2024-09-14T12:16:14.659689+0000","last_clean":"2024-09-14T12:16:14.659689+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:16:14.659689+0000","last_undegraded":"2024-09-14T12:16:14.659689+0000","last_fullsized":"2024-09-14T12:16:14.659689+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:50.687391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55106,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1151,"num_write":410,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.218125+0000","last_change":"2024-09-14T11:17:29.645258+0000","last_active":"2024-09-14T12:13:33.218125+0000","last_peered":"2024-09-14T12:13:33.218125+0000","last_clean":"2024-09-14T12:13:33.218125+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:13:33.218125+0000","last_undegraded":"2024-09-14T12:13:33.218125+0000","last_fullsized":"2024-09-14T12:13:33.218125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:46.921971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.045329+0000","last_change":"2024-09-14T12:16:27.045329+0000","last_active":"2024-09-14T12:16:27.045329+0000","last_peered":"2024-09-14T12:16:27.045329+0000","last_clean":"2024-09-14T12:16:27.045329+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:16:27.045329+0000","last_undegraded":"2024-09-14T12:16:27.045329+0000","last_fullsized":"2024-09-14T12:16:27.045329+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.045215+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:32.784518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'400","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.377374+0000","last_change":"2024-09-14T12:16:29.377374+0000","last_active":"2024-09-14T12:16:29.377374+0000","last_peered":"2024-09-14T12:16:29.377374+0000","last_clean":"2024-09-14T12:16:29.377374+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:16:29.377374+0000","last_undegraded":"2024-09-14T12:16:29.377374+0000","last_fullsized":"2024-09-14T12:16:29.377374+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.377285+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:31.072073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":23223,"num_write":1213,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.217660+0000","last_change":"2024-09-14T11:17:25.615312+0000","last_active":"2024-09-14T12:13:28.217660+0000","last_peered":"2024-09-14T12:13:28.217660+0000","last_clean":"2024-09-14T12:13:28.217660+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:13:28.217660+0000","last_undegraded":"2024-09-14T12:13:28.217660+0000","last_fullsized":"2024-09-14T12:13:28.217660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:18.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'61","reported_seq":567,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:46.936226+0000","last_change":"2024-09-14T11:17:27.636113+0000","last_active":"2024-09-14T12:13:46.936226+0000","last_peered":"2024-09-14T12:13:46.936226+0000","last_clean":"2024-09-14T12:13:46.936226+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:13:46.936226+0000","last_undegraded":"2024-09-14T12:13:46.936226+0000","last_fullsized":"2024-09-14T12:13:46.936226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:28.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.468624+0000","last_change":"2024-09-14T11:17:29.642497+0000","last_active":"2024-09-14T12:13:33.468624+0000","last_peered":"2024-09-14T12:13:33.468624+0000","last_clean":"2024-09-14T12:13:33.468624+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:13:33.468624+0000","last_undegraded":"2024-09-14T12:13:33.468624+0000","last_fullsized":"2024-09-14T12:13:33.468624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:18.572740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'219","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.825413+0000","last_change":"2024-09-14T11:17:31.655716+0000","last_active":"2024-09-14T12:14:33.825413+0000","last_peered":"2024-09-14T12:14:33.825413+0000","last_clean":"2024-09-14T12:14:33.825413+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:14:33.825413+0000","last_undegraded":"2024-09-14T12:14:33.825413+0000","last_fullsized":"2024-09-14T12:14:33.825413+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:00.360800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'493","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.522624+0000","last_change":"2024-09-14T12:16:34.522624+0000","last_active":"2024-09-14T12:16:34.522624+0000","last_peered":"2024-09-14T12:16:34.522624+0000","last_clean":"2024-09-14T12:16:34.522624+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:16:34.522624+0000","last_undegraded":"2024-09-14T12:16:34.522624+0000","last_fullsized":"2024-09-14T12:16:34.522624+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.522537+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:24.965499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'366","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.762267+0000","last_change":"2024-09-14T12:16:24.762267+0000","last_active":"2024-09-14T12:16:24.762267+0000","last_peered":"2024-09-14T12:16:24.762267+0000","last_clean":"2024-09-14T12:16:24.762267+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:16:24.762267+0000","last_undegraded":"2024-09-14T12:16:24.762267+0000","last_fullsized":"2024-09-14T12:16:24.762267+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.762175+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.783635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":658,"num_read_kb":51938,"num_write":1111,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:28.467979+0000","last_change":"2024-09-14T11:17:25.617478+0000","last_active":"2024-09-14T12:13:28.467979+0000","last_peered":"2024-09-14T12:13:28.467979+0000","last_clean":"2024-09-14T12:13:28.467979+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:13:28.467979+0000","last_undegraded":"2024-09-14T12:13:28.467979+0000","last_fullsized":"2024-09-14T12:13:28.467979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:19.271955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.281671+0000","last_change":"2024-09-14T11:17:27.636107+0000","last_active":"2024-09-14T12:16:14.281671+0000","last_peered":"2024-09-14T12:16:14.281671+0000","last_clean":"2024-09-14T12:16:14.281671+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:16:14.281671+0000","last_undegraded":"2024-09-14T12:16:14.281671+0000","last_fullsized":"2024-09-14T12:16:14.281671+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:04.296570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51654,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1212,"num_write":436,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.453820+0000","last_change":"2024-09-14T11:17:29.643307+0000","last_active":"2024-09-14T12:13:33.453820+0000","last_peered":"2024-09-14T12:13:33.453820+0000","last_clean":"2024-09-14T12:13:33.453820+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:13:33.453820+0000","last_undegraded":"2024-09-14T12:13:33.453820+0000","last_fullsized":"2024-09-14T12:13:33.453820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:35.656780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'141","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.811510+0000","last_change":"2024-09-14T11:17:31.659547+0000","last_active":"2024-09-14T12:13:42.811510+0000","last_peered":"2024-09-14T12:13:42.811510+0000","last_clean":"2024-09-14T12:13:42.811510+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:13:42.811510+0000","last_undegraded":"2024-09-14T12:13:42.811510+0000","last_fullsized":"2024-09-14T12:13:42.811510+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:01.530736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'928","reported_seq":2579,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.519388+0000","last_change":"2024-09-14T12:16:33.519388+0000","last_active":"2024-09-14T12:16:33.519388+0000","last_peered":"2024-09-14T12:16:33.519388+0000","last_clean":"2024-09-14T12:16:33.519388+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:16:33.519388+0000","last_undegraded":"2024-09-14T12:16:33.519388+0000","last_fullsized":"2024-09-14T12:16:33.519388+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'928","last_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_deep_scrub":"263'928","last_deep_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.519304+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.269882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'348","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.882011+0000","last_change":"2024-09-14T12:16:22.882011+0000","last_active":"2024-09-14T12:16:22.882011+0000","last_peered":"2024-09-14T12:16:22.882011+0000","last_clean":"2024-09-14T12:16:22.882011+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:16:22.882011+0000","last_undegraded":"2024-09-14T12:16:22.882011+0000","last_fullsized":"2024-09-14T12:16:22.882011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.881926+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:26.520282+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":18794,"num_write":1109,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.503912+0000","last_change":"2024-09-14T12:16:35.503912+0000","last_active":"2024-09-14T12:16:35.503912+0000","last_peered":"2024-09-14T12:16:35.503912+0000","last_clean":"2024-09-14T12:16:35.503912+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:16:35.503912+0000","last_undegraded":"2024-09-14T12:16:35.503912+0000","last_fullsized":"2024-09-14T12:16:35.503912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.503820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.750327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'303","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.489645+0000","last_change":"2024-09-14T11:17:27.628464+0000","last_active":"2024-09-14T12:16:15.489645+0000","last_peered":"2024-09-14T12:16:15.489645+0000","last_clean":"2024-09-14T12:16:15.489645+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:16:15.489645+0000","last_undegraded":"2024-09-14T12:16:15.489645+0000","last_fullsized":"2024-09-14T12:16:15.489645+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:11.155512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1246,"num_write":418,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.453988+0000","last_change":"2024-09-14T11:17:29.647028+0000","last_active":"2024-09-14T12:13:30.453988+0000","last_peered":"2024-09-14T12:13:30.453988+0000","last_clean":"2024-09-14T12:13:30.453988+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:13:30.453988+0000","last_undegraded":"2024-09-14T12:13:30.453988+0000","last_fullsized":"2024-09-14T12:13:30.453988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:25.762240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'449","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.477989+0000","last_change":"2024-09-14T12:16:31.477989+0000","last_active":"2024-09-14T12:16:31.477989+0000","last_peered":"2024-09-14T12:16:31.477989+0000","last_clean":"2024-09-14T12:16:31.477989+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:16:31.477989+0000","last_undegraded":"2024-09-14T12:16:31.477989+0000","last_fullsized":"2024-09-14T12:16:31.477989+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.477885+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:41.643421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.509398+0000","last_change":"2024-09-14T12:16:24.509398+0000","last_active":"2024-09-14T12:16:24.509398+0000","last_peered":"2024-09-14T12:16:24.509398+0000","last_clean":"2024-09-14T12:16:24.509398+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:16:24.509398+0000","last_undegraded":"2024-09-14T12:16:24.509398+0000","last_fullsized":"2024-09-14T12:16:24.509398+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.509303+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:37.841214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":38674,"num_write":1067,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.862176+0000","last_change":"2024-09-14T12:16:37.862176+0000","last_active":"2024-09-14T12:16:37.862176+0000","last_peered":"2024-09-14T12:16:37.862176+0000","last_clean":"2024-09-14T12:16:37.862176+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:16:37.862176+0000","last_undegraded":"2024-09-14T12:16:37.862176+0000","last_fullsized":"2024-09-14T12:16:37.862176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.862072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:47.575762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'492","reported_seq":1122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.449310+0000","last_change":"2024-09-14T11:17:27.633619+0000","last_active":"2024-09-14T12:16:15.449310+0000","last_peered":"2024-09-14T12:16:15.449310+0000","last_clean":"2024-09-14T12:16:15.449310+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:16:15.449310+0000","last_undegraded":"2024-09-14T12:16:15.449310+0000","last_fullsized":"2024-09-14T12:16:15.449310+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:36.703508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":2075,"num_write":756,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.213328+0000","last_change":"2024-09-14T11:17:29.645579+0000","last_active":"2024-09-14T12:12:33.213328+0000","last_peered":"2024-09-14T12:12:33.213328+0000","last_clean":"2024-09-14T12:12:33.213328+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:12:33.213328+0000","last_undegraded":"2024-09-14T12:12:33.213328+0000","last_fullsized":"2024-09-14T12:12:33.213328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:26.891079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'840","reported_seq":2544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.898323+0000","last_change":"2024-09-14T12:16:32.898323+0000","last_active":"2024-09-14T12:16:32.898323+0000","last_peered":"2024-09-14T12:16:32.898323+0000","last_clean":"2024-09-14T12:16:32.898323+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:16:32.898323+0000","last_undegraded":"2024-09-14T12:16:32.898323+0000","last_fullsized":"2024-09-14T12:16:32.898323+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'840","last_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_deep_scrub":"263'840","last_deep_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.898237+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:01.360421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'404","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.069459+0000","last_change":"2024-09-14T12:16:22.069459+0000","last_active":"2024-09-14T12:16:22.069459+0000","last_peered":"2024-09-14T12:16:22.069459+0000","last_clean":"2024-09-14T12:16:22.069459+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:16:22.069459+0000","last_undegraded":"2024-09-14T12:16:22.069459+0000","last_fullsized":"2024-09-14T12:16:22.069459+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.069380+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:18.179502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":5750,"num_write":1256,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.486620+0000","last_change":"2024-09-14T12:16:36.486620+0000","last_active":"2024-09-14T12:16:36.486620+0000","last_peered":"2024-09-14T12:16:36.486620+0000","last_clean":"2024-09-14T12:16:36.486620+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:16:36.486620+0000","last_undegraded":"2024-09-14T12:16:36.486620+0000","last_fullsized":"2024-09-14T12:16:36.486620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.486533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:47.840538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'313","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.204362+0000","last_change":"2024-09-14T11:17:27.631864+0000","last_active":"2024-09-14T12:16:14.204362+0000","last_peered":"2024-09-14T12:16:14.204362+0000","last_clean":"2024-09-14T12:16:14.204362+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:14.204362+0000","last_undegraded":"2024-09-14T12:16:14.204362+0000","last_fullsized":"2024-09-14T12:16:14.204362+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.144668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1111,"num_write":430,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.201536+0000","last_change":"2024-09-14T11:17:29.640091+0000","last_active":"2024-09-14T12:12:33.201536+0000","last_peered":"2024-09-14T12:12:33.201536+0000","last_clean":"2024-09-14T12:12:33.201536+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:12:33.201536+0000","last_undegraded":"2024-09-14T12:12:33.201536+0000","last_fullsized":"2024-09-14T12:12:33.201536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:15.297752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'201","reported_seq":709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:32.078225+0000","last_change":"2024-09-14T11:17:31.654553+0000","last_active":"2024-09-14T12:14:32.078225+0000","last_peered":"2024-09-14T12:14:32.078225+0000","last_clean":"2024-09-14T12:14:32.078225+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:14:32.078225+0000","last_undegraded":"2024-09-14T12:14:32.078225+0000","last_fullsized":"2024-09-14T12:14:32.078225+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:30.957381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'416","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.571028+0000","last_change":"2024-09-14T12:16:35.571028+0000","last_active":"2024-09-14T12:16:35.571028+0000","last_peered":"2024-09-14T12:16:35.571028+0000","last_clean":"2024-09-14T12:16:35.571028+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:16:35.571028+0000","last_undegraded":"2024-09-14T12:16:35.571028+0000","last_fullsized":"2024-09-14T12:16:35.571028+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.570946+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:00.910326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'367","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.510136+0000","last_change":"2024-09-14T12:16:22.510136+0000","last_active":"2024-09-14T12:16:22.510136+0000","last_peered":"2024-09-14T12:16:22.510136+0000","last_clean":"2024-09-14T12:16:22.510136+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:16:22.510136+0000","last_undegraded":"2024-09-14T12:16:22.510136+0000","last_fullsized":"2024-09-14T12:16:22.510136+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.510039+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:28.698454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":55641,"num_write":1285,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.327534+0000","last_change":"2024-09-14T11:17:25.615822+0000","last_active":"2024-09-14T12:12:28.327534+0000","last_peered":"2024-09-14T12:12:28.327534+0000","last_clean":"2024-09-14T12:12:28.327534+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:12:28.327534+0000","last_undegraded":"2024-09-14T12:12:28.327534+0000","last_fullsized":"2024-09-14T12:12:28.327534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:36.413046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'302","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.006599+0000","last_change":"2024-09-14T11:17:27.632371+0000","last_active":"2024-09-14T12:16:15.006599+0000","last_peered":"2024-09-14T12:16:15.006599+0000","last_clean":"2024-09-14T12:16:15.006599+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:16:15.006599+0000","last_undegraded":"2024-09-14T12:16:15.006599+0000","last_fullsized":"2024-09-14T12:16:15.006599+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:48.220034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53208,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":494,"num_read_kb":1139,"num_write":406,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.209176+0000","last_change":"2024-09-14T11:17:29.643082+0000","last_active":"2024-09-14T12:13:43.209176+0000","last_peered":"2024-09-14T12:13:43.209176+0000","last_clean":"2024-09-14T12:13:43.209176+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:13:43.209176+0000","last_undegraded":"2024-09-14T12:13:43.209176+0000","last_fullsized":"2024-09-14T12:13:43.209176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:03.359386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'100","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:49.251218+0000","last_change":"2024-09-14T11:17:31.657761+0000","last_active":"2024-09-14T12:15:49.251218+0000","last_peered":"2024-09-14T12:15:49.251218+0000","last_clean":"2024-09-14T12:15:49.251218+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:15:49.251218+0000","last_undegraded":"2024-09-14T12:15:49.251218+0000","last_fullsized":"2024-09-14T12:15:49.251218+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:00.568137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'485","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.218673+0000","last_change":"2024-09-14T12:16:26.218673+0000","last_active":"2024-09-14T12:16:26.218673+0000","last_peered":"2024-09-14T12:16:26.218673+0000","last_clean":"2024-09-14T12:16:26.218673+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:16:26.218673+0000","last_undegraded":"2024-09-14T12:16:26.218673+0000","last_fullsized":"2024-09-14T12:16:26.218673+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'485","last_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_deep_scrub":"263'485","last_deep_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.218577+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:32.733118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'441","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.912181+0000","last_change":"2024-09-14T12:16:21.912181+0000","last_active":"2024-09-14T12:16:21.912181+0000","last_peered":"2024-09-14T12:16:21.912181+0000","last_clean":"2024-09-14T12:16:21.912181+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:16:21.912181+0000","last_undegraded":"2024-09-14T12:16:21.912181+0000","last_fullsized":"2024-09-14T12:16:21.912181+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.912110+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:39.992075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1189,"num_read_kb":773,"num_write":1309,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.200982+0000","last_change":"2024-09-14T11:17:25.606521+0000","last_active":"2024-09-14T12:12:28.200982+0000","last_peered":"2024-09-14T12:12:28.200982+0000","last_clean":"2024-09-14T12:12:28.200982+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:12:28.200982+0000","last_undegraded":"2024-09-14T12:12:28.200982+0000","last_fullsized":"2024-09-14T12:12:28.200982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.190615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'97","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:33.336647+0000","last_change":"2024-09-14T11:17:27.625718+0000","last_active":"2024-09-14T12:13:33.336647+0000","last_peered":"2024-09-14T12:13:33.336647+0000","last_clean":"2024-09-14T12:13:33.336647+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:13:33.336647+0000","last_undegraded":"2024-09-14T12:13:33.336647+0000","last_fullsized":"2024-09-14T12:13:33.336647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:13.564944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'781","reported_seq":2537,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.116909+0000","last_change":"2024-09-14T11:17:29.641638+0000","last_active":"2024-09-14T12:16:14.116909+0000","last_peered":"2024-09-14T12:16:14.116909+0000","last_clean":"2024-09-14T12:16:14.116909+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:16:14.116909+0000","last_undegraded":"2024-09-14T12:16:14.116909+0000","last_fullsized":"2024-09-14T12:16:14.116909+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:54.865127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'126","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.517595+0000","last_change":"2024-09-14T11:17:31.654896+0000","last_active":"2024-09-14T12:13:48.517595+0000","last_peered":"2024-09-14T12:13:48.517595+0000","last_clean":"2024-09-14T12:13:48.517595+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:13:48.517595+0000","last_undegraded":"2024-09-14T12:13:48.517595+0000","last_fullsized":"2024-09-14T12:13:48.517595+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:18.947558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'484","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.602934+0000","last_change":"2024-09-14T12:16:33.602934+0000","last_active":"2024-09-14T12:16:33.602934+0000","last_peered":"2024-09-14T12:16:33.602934+0000","last_clean":"2024-09-14T12:16:33.602934+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:16:33.602934+0000","last_undegraded":"2024-09-14T12:16:33.602934+0000","last_fullsized":"2024-09-14T12:16:33.602934+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'484","last_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_deep_scrub":"263'484","last_deep_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.602835+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:59.909062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3026,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.790342+0000","last_change":"2024-09-14T12:16:23.790342+0000","last_active":"2024-09-14T12:16:23.790342+0000","last_peered":"2024-09-14T12:16:23.790342+0000","last_clean":"2024-09-14T12:16:23.790342+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:16:23.790342+0000","last_undegraded":"2024-09-14T12:16:23.790342+0000","last_fullsized":"2024-09-14T12:16:23.790342+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.790199+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:45.806183+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":665,"num_read_kb":45610,"num_write":1043,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.456732+0000","last_change":"2024-09-14T11:17:25.618200+0000","last_active":"2024-09-14T12:12:28.456732+0000","last_peered":"2024-09-14T12:12:28.456732+0000","last_clean":"2024-09-14T12:12:28.456732+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:12:28.456732+0000","last_undegraded":"2024-09-14T12:12:28.456732+0000","last_fullsized":"2024-09-14T12:12:28.456732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:36.032390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'317","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.211745+0000","last_change":"2024-09-14T11:17:27.632003+0000","last_active":"2024-09-14T12:16:15.211745+0000","last_peered":"2024-09-14T12:16:15.211745+0000","last_clean":"2024-09-14T12:16:15.211745+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:16:15.211745+0000","last_undegraded":"2024-09-14T12:16:15.211745+0000","last_fullsized":"2024-09-14T12:16:15.211745+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":989,"num_write":382,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:05.450810+0000","last_change":"2024-09-14T11:17:29.642860+0000","last_active":"2024-09-14T12:13:05.450810+0000","last_peered":"2024-09-14T12:13:05.450810+0000","last_clean":"2024-09-14T12:13:05.450810+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:13:05.450810+0000","last_undegraded":"2024-09-14T12:13:05.450810+0000","last_fullsized":"2024-09-14T12:13:05.450810+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:49.657802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'163","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.740671+0000","last_change":"2024-09-14T11:17:31.659537+0000","last_active":"2024-09-14T12:14:31.740671+0000","last_peered":"2024-09-14T12:14:31.740671+0000","last_clean":"2024-09-14T12:14:31.740671+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:14:31.740671+0000","last_undegraded":"2024-09-14T12:14:31.740671+0000","last_fullsized":"2024-09-14T12:14:31.740671+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:58.564304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'825","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.565380+0000","last_change":"2024-09-14T12:16:28.565380+0000","last_active":"2024-09-14T12:16:28.565380+0000","last_peered":"2024-09-14T12:16:28.565380+0000","last_clean":"2024-09-14T12:16:28.565380+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:16:28.565380+0000","last_undegraded":"2024-09-14T12:16:28.565380+0000","last_fullsized":"2024-09-14T12:16:28.565380+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'825","last_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_deep_scrub":"263'825","last_deep_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.565300+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:29.751301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'403","reported_seq":1268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.799080+0000","last_change":"2024-09-14T12:16:25.799080+0000","last_active":"2024-09-14T12:16:25.799080+0000","last_peered":"2024-09-14T12:16:25.799080+0000","last_clean":"2024-09-14T12:16:25.799080+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:16:25.799080+0000","last_undegraded":"2024-09-14T12:16:25.799080+0000","last_fullsized":"2024-09-14T12:16:25.799080+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.798955+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.565631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1324,"num_read_kb":37458,"num_write":1300,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:28.331124+0000","last_change":"2024-09-14T11:17:25.617051+0000","last_active":"2024-09-14T12:12:28.331124+0000","last_peered":"2024-09-14T12:12:28.331124+0000","last_clean":"2024-09-14T12:12:28.331124+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:12:28.331124+0000","last_undegraded":"2024-09-14T12:12:28.331124+0000","last_fullsized":"2024-09-14T12:12:28.331124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:24.207846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'280","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.249728+0000","last_change":"2024-09-14T11:17:27.635755+0000","last_active":"2024-09-14T12:16:15.249728+0000","last_peered":"2024-09-14T12:16:15.249728+0000","last_clean":"2024-09-14T12:16:15.249728+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:16:15.249728+0000","last_undegraded":"2024-09-14T12:16:15.249728+0000","last_fullsized":"2024-09-14T12:16:15.249728+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46067,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":1076,"num_write":376,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.450854+0000","last_change":"2024-09-14T11:17:29.642662+0000","last_active":"2024-09-14T12:13:13.450854+0000","last_peered":"2024-09-14T12:13:13.450854+0000","last_clean":"2024-09-14T12:13:13.450854+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:13:13.450854+0000","last_undegraded":"2024-09-14T12:13:13.450854+0000","last_fullsized":"2024-09-14T12:13:13.450854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:37.438168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'101","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:52.066499+0000","last_change":"2024-09-14T11:17:31.653130+0000","last_active":"2024-09-14T12:13:52.066499+0000","last_peered":"2024-09-14T12:13:52.066499+0000","last_clean":"2024-09-14T12:13:52.066499+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:13:52.066499+0000","last_undegraded":"2024-09-14T12:13:52.066499+0000","last_fullsized":"2024-09-14T12:13:52.066499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:01.586940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'468","reported_seq":2032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.595539+0000","last_change":"2024-09-14T12:16:36.595539+0000","last_active":"2024-09-14T12:16:36.595539+0000","last_peered":"2024-09-14T12:16:36.595539+0000","last_clean":"2024-09-14T12:16:36.595539+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:16:36.595539+0000","last_undegraded":"2024-09-14T12:16:36.595539+0000","last_fullsized":"2024-09-14T12:16:36.595539+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.595458+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.327912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'363","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.520987+0000","last_change":"2024-09-14T12:16:25.520987+0000","last_active":"2024-09-14T12:16:25.520987+0000","last_peered":"2024-09-14T12:16:25.520987+0000","last_clean":"2024-09-14T12:16:25.520987+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:16:25.520987+0000","last_undegraded":"2024-09-14T12:16:25.520987+0000","last_fullsized":"2024-09-14T12:16:25.520987+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.520888+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.356077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":9738,"num_write":1164,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:03.332528+0000","last_change":"2024-09-14T11:17:25.610612+0000","last_active":"2024-09-14T12:13:03.332528+0000","last_peered":"2024-09-14T12:13:03.332528+0000","last_clean":"2024-09-14T12:13:03.332528+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:13:03.332528+0000","last_undegraded":"2024-09-14T12:13:03.332528+0000","last_fullsized":"2024-09-14T12:13:03.332528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:24.587839+0000","last_clean_scrub_stamp":"2024-09-14T11:17:24.587839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:48.115678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'256","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.939829+0000","last_change":"2024-09-14T11:17:27.631891+0000","last_active":"2024-09-14T12:16:14.939829+0000","last_peered":"2024-09-14T12:16:14.939829+0000","last_clean":"2024-09-14T12:16:14.939829+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:16:14.939829+0000","last_undegraded":"2024-09-14T12:16:14.939829+0000","last_fullsized":"2024-09-14T12:16:14.939829+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:44.534516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46060,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":1096,"num_write":366,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328284+0000","last_change":"2024-09-14T11:17:29.643072+0000","last_active":"2024-09-14T12:12:33.328284+0000","last_peered":"2024-09-14T12:12:33.328284+0000","last_clean":"2024-09-14T12:12:33.328284+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:12:33.328284+0000","last_undegraded":"2024-09-14T12:12:33.328284+0000","last_fullsized":"2024-09-14T12:12:33.328284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:34.811132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'185","reported_seq":1645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:31.716019+0000","last_change":"2024-09-14T11:17:31.657886+0000","last_active":"2024-09-14T12:14:31.716019+0000","last_peered":"2024-09-14T12:14:31.716019+0000","last_clean":"2024-09-14T12:14:31.716019+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:14:31.716019+0000","last_undegraded":"2024-09-14T12:14:31.716019+0000","last_fullsized":"2024-09-14T12:14:31.716019+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:25.875385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'591","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.580916+0000","last_change":"2024-09-14T12:16:29.580916+0000","last_active":"2024-09-14T12:16:29.580916+0000","last_peered":"2024-09-14T12:16:29.580916+0000","last_clean":"2024-09-14T12:16:29.580916+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:16:29.580916+0000","last_undegraded":"2024-09-14T12:16:29.580916+0000","last_fullsized":"2024-09-14T12:16:29.580916+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'591","last_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_deep_scrub":"263'591","last_deep_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.580819+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:36.205569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'359","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.913612+0000","last_change":"2024-09-14T12:16:23.913612+0000","last_active":"2024-09-14T12:16:23.913612+0000","last_peered":"2024-09-14T12:16:23.913612+0000","last_clean":"2024-09-14T12:16:23.913612+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:16:23.913612+0000","last_undegraded":"2024-09-14T12:16:23.913612+0000","last_fullsized":"2024-09-14T12:16:23.913612+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.913491+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:11.317852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":9181,"num_write":1146,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.227953+0000","last_change":"2024-09-14T12:16:38.227953+0000","last_active":"2024-09-14T12:16:38.227953+0000","last_peered":"2024-09-14T12:16:38.227953+0000","last_clean":"2024-09-14T12:16:38.227953+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:16:38.227953+0000","last_undegraded":"2024-09-14T12:16:38.227953+0000","last_fullsized":"2024-09-14T12:16:38.227953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.227869+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:50.267903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'328","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.043921+0000","last_change":"2024-09-14T11:17:27.631558+0000","last_active":"2024-09-14T12:16:15.043921+0000","last_peered":"2024-09-14T12:16:15.043921+0000","last_clean":"2024-09-14T12:16:15.043921+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:16:15.043921+0000","last_undegraded":"2024-09-14T12:16:15.043921+0000","last_fullsized":"2024-09-14T12:16:15.043921+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:26.606209+0000","last_clean_scrub_stamp":"2024-09-14T11:17:26.606209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:57.236491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1227,"num_write":442,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446967+0000","last_change":"2024-09-14T11:17:29.643690+0000","last_active":"2024-09-14T12:12:30.446967+0000","last_peered":"2024-09-14T12:12:30.446967+0000","last_clean":"2024-09-14T12:12:30.446967+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:12:30.446967+0000","last_undegraded":"2024-09-14T12:12:30.446967+0000","last_fullsized":"2024-09-14T12:12:30.446967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:41.882853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'98","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:48.149653+0000","last_change":"2024-09-14T11:17:31.656443+0000","last_active":"2024-09-14T12:15:48.149653+0000","last_peered":"2024-09-14T12:15:48.149653+0000","last_clean":"2024-09-14T12:15:48.149653+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:15:48.149653+0000","last_undegraded":"2024-09-14T12:15:48.149653+0000","last_fullsized":"2024-09-14T12:15:48.149653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:42.123302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'541","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.161351+0000","last_change":"2024-09-14T12:16:35.161351+0000","last_active":"2024-09-14T12:16:35.161351+0000","last_peered":"2024-09-14T12:16:35.161351+0000","last_clean":"2024-09-14T12:16:35.161351+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:16:35.161351+0000","last_undegraded":"2024-09-14T12:16:35.161351+0000","last_fullsized":"2024-09-14T12:16:35.161351+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.161259+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:47.150238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'399","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.437493+0000","last_change":"2024-09-14T12:16:26.437493+0000","last_active":"2024-09-14T12:16:26.437493+0000","last_peered":"2024-09-14T12:16:26.437493+0000","last_clean":"2024-09-14T12:16:26.437493+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:16:26.437493+0000","last_undegraded":"2024-09-14T12:16:26.437493+0000","last_fullsized":"2024-09-14T12:16:26.437493+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.437376+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:56.164832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":657,"num_read_kb":34326,"num_write":1264,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'836","reported_seq":2425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.160886+0000","last_change":"2024-09-14T12:16:34.160886+0000","last_active":"2024-09-14T12:16:34.160886+0000","last_peered":"2024-09-14T12:16:34.160886+0000","last_clean":"2024-09-14T12:16:34.160886+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:16:34.160886+0000","last_undegraded":"2024-09-14T12:16:34.160886+0000","last_fullsized":"2024-09-14T12:16:34.160886+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.160775+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:02.536094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'458","reported_seq":1177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.178320+0000","last_change":"2024-09-14T12:16:24.178320+0000","last_active":"2024-09-14T12:16:24.178320+0000","last_peered":"2024-09-14T12:16:24.178320+0000","last_clean":"2024-09-14T12:16:24.178320+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:16:24.178320+0000","last_undegraded":"2024-09-14T12:16:24.178320+0000","last_fullsized":"2024-09-14T12:16:24.178320+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.178222+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:00.886938+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":108296,"num_write":1392,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'490","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:02.751737+0000","last_change":"2024-09-14T11:17:23.594077+0000","last_active":"2024-09-14T12:14:02.751737+0000","last_peered":"2024-09-14T12:14:02.751737+0000","last_clean":"2024-09-14T12:14:02.751737+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:14:02.751737+0000","last_undegraded":"2024-09-14T12:14:02.751737+0000","last_fullsized":"2024-09-14T12:14:02.751737+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:09.993223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'337","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.773355+0000","last_change":"2024-09-14T12:16:26.773355+0000","last_active":"2024-09-14T12:16:26.773355+0000","last_peered":"2024-09-14T12:16:26.773355+0000","last_clean":"2024-09-14T12:16:26.773355+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:16:26.773355+0000","last_undegraded":"2024-09-14T12:16:26.773355+0000","last_fullsized":"2024-09-14T12:16:26.773355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.773234+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:32.185869+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":31259,"num_write":1097,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1203","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.050987+0000","last_change":"2024-09-14T12:16:29.050987+0000","last_active":"2024-09-14T12:16:29.050987+0000","last_peered":"2024-09-14T12:16:29.050987+0000","last_clean":"2024-09-14T12:16:29.050987+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:16:29.050987+0000","last_undegraded":"2024-09-14T12:16:29.050987+0000","last_fullsized":"2024-09-14T12:16:29.050987+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1203","last_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_deep_scrub":"263'1203","last_deep_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.050902+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:27.737996+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.892822+0000","last_change":"2024-09-14T12:16:24.892822+0000","last_active":"2024-09-14T12:16:24.892822+0000","last_peered":"2024-09-14T12:16:24.892822+0000","last_clean":"2024-09-14T12:16:24.892822+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:16:24.892822+0000","last_undegraded":"2024-09-14T12:16:24.892822+0000","last_fullsized":"2024-09-14T12:16:24.892822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.892704+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:06.999544+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":15201,"num_write":1292,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'918","reported_seq":2573,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:18.502687+0000","last_change":"2024-09-14T11:17:23.601191+0000","last_active":"2024-09-14T12:15:18.502687+0000","last_peered":"2024-09-14T12:15:18.502687+0000","last_clean":"2024-09-14T12:15:18.502687+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:15:18.502687+0000","last_undegraded":"2024-09-14T12:15:18.502687+0000","last_fullsized":"2024-09-14T12:15:18.502687+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:39.840105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'308","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.509875+0000","last_change":"2024-09-14T12:16:26.509875+0000","last_active":"2024-09-14T12:16:26.509875+0000","last_peered":"2024-09-14T12:16:26.509875+0000","last_clean":"2024-09-14T12:16:26.509875+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:16:26.509875+0000","last_undegraded":"2024-09-14T12:16:26.509875+0000","last_fullsized":"2024-09-14T12:16:26.509875+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.509772+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.441645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306882,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":547,"num_read_kb":7710,"num_write":947,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'504","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.650472+0000","last_change":"2024-09-14T12:16:32.650472+0000","last_active":"2024-09-14T12:16:32.650472+0000","last_peered":"2024-09-14T12:16:32.650472+0000","last_clean":"2024-09-14T12:16:32.650472+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:16:32.650472+0000","last_undegraded":"2024-09-14T12:16:32.650472+0000","last_fullsized":"2024-09-14T12:16:32.650472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.650377+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:57.980647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'416","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.053960+0000","last_change":"2024-09-14T12:16:28.053960+0000","last_active":"2024-09-14T12:16:28.053960+0000","last_peered":"2024-09-14T12:16:28.053960+0000","last_clean":"2024-09-14T12:16:28.053960+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:16:28.053960+0000","last_undegraded":"2024-09-14T12:16:28.053960+0000","last_fullsized":"2024-09-14T12:16:28.053960+0000","mapping_epoch":25,"log_start":"263'401","ondisk_log_start":"263'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.053860+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.211944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":680,"num_read_kb":78819,"num_write":1261,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'834","reported_seq":2551,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.564900+0000","last_change":"2024-09-14T12:16:37.564900+0000","last_active":"2024-09-14T12:16:37.564900+0000","last_peered":"2024-09-14T12:16:37.564900+0000","last_clean":"2024-09-14T12:16:37.564900+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:16:37.564900+0000","last_undegraded":"2024-09-14T12:16:37.564900+0000","last_fullsized":"2024-09-14T12:16:37.564900+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'834","last_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_deep_scrub":"263'834","last_deep_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.564799+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:22.157858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'453","reported_seq":1138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.477694+0000","last_change":"2024-09-14T12:16:23.477694+0000","last_active":"2024-09-14T12:16:23.477694+0000","last_peered":"2024-09-14T12:16:23.477694+0000","last_clean":"2024-09-14T12:16:23.477694+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:16:23.477694+0000","last_undegraded":"2024-09-14T12:16:23.477694+0000","last_fullsized":"2024-09-14T12:16:23.477694+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.477569+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.655283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":42747,"num_write":1601,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.510021+0000","last_change":"2024-09-14T12:16:32.510021+0000","last_active":"2024-09-14T12:16:32.510021+0000","last_peered":"2024-09-14T12:16:32.510021+0000","last_clean":"2024-09-14T12:16:32.510021+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:16:32.510021+0000","last_undegraded":"2024-09-14T12:16:32.510021+0000","last_fullsized":"2024-09-14T12:16:32.510021+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.509908+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:43.358006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'368","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.603639+0000","last_change":"2024-09-14T12:16:28.603639+0000","last_active":"2024-09-14T12:16:28.603639+0000","last_peered":"2024-09-14T12:16:28.603639+0000","last_clean":"2024-09-14T12:16:28.603639+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:16:28.603639+0000","last_undegraded":"2024-09-14T12:16:28.603639+0000","last_fullsized":"2024-09-14T12:16:28.603639+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.603520+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:07.583029+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":730,"num_read_kb":25685,"num_write":1212,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'725","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.853714+0000","last_change":"2024-09-14T12:16:34.853714+0000","last_active":"2024-09-14T12:16:34.853714+0000","last_peered":"2024-09-14T12:16:34.853714+0000","last_clean":"2024-09-14T12:16:34.853714+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:16:34.853714+0000","last_undegraded":"2024-09-14T12:16:34.853714+0000","last_fullsized":"2024-09-14T12:16:34.853714+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'725","last_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_deep_scrub":"263'725","last_deep_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.853630+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:40.766897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.783873+0000","last_change":"2024-09-14T12:16:27.783873+0000","last_active":"2024-09-14T12:16:27.783873+0000","last_peered":"2024-09-14T12:16:27.783873+0000","last_clean":"2024-09-14T12:16:27.783873+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:16:27.783873+0000","last_undegraded":"2024-09-14T12:16:27.783873+0000","last_fullsized":"2024-09-14T12:16:27.783873+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.783754+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:26.128419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":13781,"num_write":973,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'544","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.617175+0000","last_change":"2024-09-14T12:16:35.617175+0000","last_active":"2024-09-14T12:16:35.617175+0000","last_peered":"2024-09-14T12:16:35.617175+0000","last_clean":"2024-09-14T12:16:35.617175+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:16:35.617175+0000","last_undegraded":"2024-09-14T12:16:35.617175+0000","last_fullsized":"2024-09-14T12:16:35.617175+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.617088+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:52.504033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'378","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.560326+0000","last_change":"2024-09-14T12:16:29.560326+0000","last_active":"2024-09-14T12:16:29.560326+0000","last_peered":"2024-09-14T12:16:29.560326+0000","last_clean":"2024-09-14T12:16:29.560326+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:16:29.560326+0000","last_undegraded":"2024-09-14T12:16:29.560326+0000","last_fullsized":"2024-09-14T12:16:29.560326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.560203+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.633237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":24861,"num_write":1154,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'887","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.214957+0000","last_change":"2024-09-14T12:16:25.214957+0000","last_active":"2024-09-14T12:16:25.214957+0000","last_peered":"2024-09-14T12:16:25.214957+0000","last_clean":"2024-09-14T12:16:25.214957+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:16:25.214957+0000","last_undegraded":"2024-09-14T12:16:25.214957+0000","last_fullsized":"2024-09-14T12:16:25.214957+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'887","last_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_deep_scrub":"263'887","last_deep_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.214874+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:03.118395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'399","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.777956+0000","last_change":"2024-09-14T12:16:28.777956+0000","last_active":"2024-09-14T12:16:28.777956+0000","last_peered":"2024-09-14T12:16:28.777956+0000","last_clean":"2024-09-14T12:16:28.777956+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:16:28.777956+0000","last_undegraded":"2024-09-14T12:16:28.777956+0000","last_fullsized":"2024-09-14T12:16:28.777956+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.777834+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:20.454980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":50704,"num_write":1241,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'684","reported_seq":2459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.605611+0000","last_change":"2024-09-14T12:16:34.605611+0000","last_active":"2024-09-14T12:16:34.605611+0000","last_peered":"2024-09-14T12:16:34.605611+0000","last_clean":"2024-09-14T12:16:34.605611+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:16:34.605611+0000","last_undegraded":"2024-09-14T12:16:34.605611+0000","last_fullsized":"2024-09-14T12:16:34.605611+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.605515+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:49.073360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'359","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.891383+0000","last_change":"2024-09-14T12:16:25.891383+0000","last_active":"2024-09-14T12:16:25.891383+0000","last_peered":"2024-09-14T12:16:25.891383+0000","last_clean":"2024-09-14T12:16:25.891383+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:16:25.891383+0000","last_undegraded":"2024-09-14T12:16:25.891383+0000","last_fullsized":"2024-09-14T12:16:25.891383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.891261+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:39.670161+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":2146,"num_write":1056,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'755","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.405692+0000","last_change":"2024-09-14T12:16:36.405692+0000","last_active":"2024-09-14T12:16:36.405692+0000","last_peered":"2024-09-14T12:16:36.405692+0000","last_clean":"2024-09-14T12:16:36.405692+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:16:36.405692+0000","last_undegraded":"2024-09-14T12:16:36.405692+0000","last_fullsized":"2024-09-14T12:16:36.405692+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.405559+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:19.573245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'333","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.520197+0000","last_change":"2024-09-14T12:16:24.520197+0000","last_active":"2024-09-14T12:16:24.520197+0000","last_peered":"2024-09-14T12:16:24.520197+0000","last_clean":"2024-09-14T12:16:24.520197+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:16:24.520197+0000","last_undegraded":"2024-09-14T12:16:24.520197+0000","last_fullsized":"2024-09-14T12:16:24.520197+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.520092+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:01.332103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":46679,"num_write":958,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'471","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.895312+0000","last_change":"2024-09-14T12:16:33.895312+0000","last_active":"2024-09-14T12:16:33.895312+0000","last_peered":"2024-09-14T12:16:33.895312+0000","last_clean":"2024-09-14T12:16:33.895312+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:16:33.895312+0000","last_undegraded":"2024-09-14T12:16:33.895312+0000","last_fullsized":"2024-09-14T12:16:33.895312+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.895220+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.754997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'348","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.097196+0000","last_change":"2024-09-14T12:16:31.097130+0000","last_active":"2024-09-14T12:16:31.097196+0000","last_peered":"2024-09-14T12:16:31.097196+0000","last_clean":"2024-09-14T12:16:31.097196+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:16:31.097196+0000","last_undegraded":"2024-09-14T12:16:31.097196+0000","last_fullsized":"2024-09-14T12:16:31.097196+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.097044+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:55.804352+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":19021,"num_write":1018,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'441","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:42.819923+0000","last_change":"2024-09-14T11:17:23.602231+0000","last_active":"2024-09-14T12:13:42.819923+0000","last_peered":"2024-09-14T12:13:42.819923+0000","last_clean":"2024-09-14T12:13:42.819923+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:13:42.819923+0000","last_undegraded":"2024-09-14T12:13:42.819923+0000","last_fullsized":"2024-09-14T12:13:42.819923+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:22.565855+0000","last_clean_scrub_stamp":"2024-09-14T11:17:22.565855+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:53.898892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'400","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.185633+0000","last_change":"2024-09-14T12:16:21.185633+0000","last_active":"2024-09-14T12:16:21.185633+0000","last_peered":"2024-09-14T12:16:21.185633+0000","last_clean":"2024-09-14T12:16:21.185633+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:16:21.185633+0000","last_undegraded":"2024-09-14T12:16:21.185633+0000","last_fullsized":"2024-09-14T12:16:21.185633+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.185559+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:24.059335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":76781,"num_write":1270,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'460","reported_seq":2085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.432720+0000","last_change":"2024-09-14T12:16:35.432720+0000","last_active":"2024-09-14T12:16:35.432720+0000","last_peered":"2024-09-14T12:16:35.432720+0000","last_clean":"2024-09-14T12:16:35.432720+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:16:35.432720+0000","last_undegraded":"2024-09-14T12:16:35.432720+0000","last_fullsized":"2024-09-14T12:16:35.432720+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.432637+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:31.011136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'375","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.890775+0000","last_change":"2024-09-14T12:16:32.890775+0000","last_active":"2024-09-14T12:16:32.890775+0000","last_peered":"2024-09-14T12:16:32.890775+0000","last_clean":"2024-09-14T12:16:32.890775+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:16:32.890775+0000","last_undegraded":"2024-09-14T12:16:32.890775+0000","last_fullsized":"2024-09-14T12:16:32.890775+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.890669+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:26.033762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":6459,"num_write":1212,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'316","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.839863+0000","last_change":"2024-09-14T12:16:31.839863+0000","last_active":"2024-09-14T12:16:31.839863+0000","last_peered":"2024-09-14T12:16:31.839863+0000","last_clean":"2024-09-14T12:16:31.839863+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:16:31.839863+0000","last_undegraded":"2024-09-14T12:16:31.839863+0000","last_fullsized":"2024-09-14T12:16:31.839863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.839755+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:18.749494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":1699,"num_write":1024,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'564","reported_seq":2268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.882132+0000","last_change":"2024-09-14T12:16:35.882132+0000","last_active":"2024-09-14T12:16:35.882132+0000","last_peered":"2024-09-14T12:16:35.882132+0000","last_clean":"2024-09-14T12:16:35.882132+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:16:35.882132+0000","last_undegraded":"2024-09-14T12:16:35.882132+0000","last_fullsized":"2024-09-14T12:16:35.882132+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.882034+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:28.610668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'411","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.093411+0000","last_change":"2024-09-14T12:16:32.093411+0000","last_active":"2024-09-14T12:16:32.093411+0000","last_peered":"2024-09-14T12:16:32.093411+0000","last_clean":"2024-09-14T12:16:32.093411+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:16:32.093411+0000","last_undegraded":"2024-09-14T12:16:32.093411+0000","last_fullsized":"2024-09-14T12:16:32.093411+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.093316+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:14.969406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":16758,"num_write":1274,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'916","reported_seq":2589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.894057+0000","last_change":"2024-09-14T12:16:36.894057+0000","last_active":"2024-09-14T12:16:36.894057+0000","last_peered":"2024-09-14T12:16:36.894057+0000","last_clean":"2024-09-14T12:16:36.894057+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:16:36.894057+0000","last_undegraded":"2024-09-14T12:16:36.894057+0000","last_fullsized":"2024-09-14T12:16:36.894057+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'916","last_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_deep_scrub":"263'916","last_deep_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.893938+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:11.186412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1791,"ondisk_log_size":1791,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1705796,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18087,"num_read_kb":37833,"num_write":15249,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2113,"ondisk_log_size":2113,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30158,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3791,"ondisk_log_size":3791,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22160993,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44528,"num_read_kb":1801342,"num_write":73962,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45277184,"data_stored":44321986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4060,"ondisk_log_size":4060,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":187942,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":186673,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510160,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277484,"kb_used_data":11676,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094356,"statfs":{"total":96636764160,"available":96352620544,"internally_reserved":0,"allocated":11956224,"data_stored":10288647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510160,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249308,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94122532,"statfs":{"total":96636764160,"available":96381472768,"internally_reserved":0,"allocated":5844992,"data_stored":4296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510161,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133556,"kb_used_data":12196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94238284,"statfs":{"total":96636764160,"available":96500002816,"internally_reserved":0,"allocated":12488704,"data_stored":10779353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510160,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98696,"kb_used_data":9208,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94273144,"statfs":{"total":96636764160,"available":96535699456,"internally_reserved":0,"allocated":9428992,"data_stored":7842152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510159,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256288,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115552,"statfs":{"total":96636764160,"available":96374325248,"internally_reserved":0,"allocated":12992512,"data_stored":11338592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510160,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92020,"kb_used_data":6756,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279820,"statfs":{"total":96636764160,"available":96542535680,"internally_reserved":0,"allocated":6918144,"data_stored":5375493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510159,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147548,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94224292,"statfs":{"total":96636764160,"available":96485675008,"internally_reserved":0,"allocated":8335360,"data_stored":6711727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575569,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263468,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94108372,"statfs":{"total":96636764160,"available":96366972928,"internally_reserved":0,"allocated":7630848,"data_stored":5968019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262142408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3240346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":4574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330048,"data_stored":3240066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":9200737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5706939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8773632,"data_stored":8639695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2236416,"data_stored":2160102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7680000,"data_stored":7559766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:16:42.485 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.486 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.487 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.488 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.489 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.490 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.491 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.492 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.493 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.494 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.495 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.496 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.497 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.498 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.499 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.500 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.501 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.502 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.503 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.504 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.505 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.506 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.507 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.508 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.509 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.510 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:17:24.587839+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:17:26.606209+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.511 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.512 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:17:22.565855+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:16:42.512 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:17:02.513 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:17:02.845 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:17:02.857 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:17:02.858 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2056,"stamp":"2024-09-14T12:17:01.275150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24474050,"num_objects":732,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":313127,"num_read_kb":2443510,"num_write":166195,"num_write_kb":2394098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750658,"num_omap_keys":1789,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13582,"ondisk_log_size":13582,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1518368,"kb_used_data":73824,"kb_used_omap":12,"kb_used_meta":1444403,"kb_avail":753456352,"statfs":{"total":773094113280,"available":771539304448,"internally_reserved":0,"allocated":75595776,"data_stored":62600240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1479069235},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1338,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005730"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.223235+0000","last_change":"2024-09-14T11:51:07.033575+0000","last_active":"2024-09-14T12:13:38.223235+0000","last_peered":"2024-09-14T12:13:38.223235+0000","last_clean":"2024-09-14T12:13:38.223235+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:13:38.223235+0000","last_undegraded":"2024-09-14T12:13:38.223235+0000","last_fullsized":"2024-09-14T12:13:38.223235+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:01.747430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.235486+0000","last_change":"2024-09-14T11:35:03.479412+0000","last_active":"2024-09-14T12:15:03.235486+0000","last_peered":"2024-09-14T12:15:03.235486+0000","last_clean":"2024-09-14T12:15:03.235486+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:15:03.235486+0000","last_undegraded":"2024-09-14T12:15:03.235486+0000","last_fullsized":"2024-09-14T12:15:03.235486+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.711593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211077+0000","last_change":"2024-09-14T11:35:00.442301+0000","last_active":"2024-09-14T12:12:33.211077+0000","last_peered":"2024-09-14T12:12:33.211077+0000","last_clean":"2024-09-14T12:12:33.211077+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:12:33.211077+0000","last_undegraded":"2024-09-14T12:12:33.211077+0000","last_fullsized":"2024-09-14T12:12:33.211077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:07.355647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:30.454057+0000","last_change":"2024-09-14T11:31:47.458570+0000","last_active":"2024-09-14T12:13:30.454057+0000","last_peered":"2024-09-14T12:13:30.454057+0000","last_clean":"2024-09-14T12:13:30.454057+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:13:30.454057+0000","last_undegraded":"2024-09-14T12:13:30.454057+0000","last_fullsized":"2024-09-14T12:13:30.454057+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.758304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.229089+0000","last_change":"2024-09-14T12:16:50.229089+0000","last_active":"2024-09-14T12:16:50.229089+0000","last_peered":"2024-09-14T12:16:50.229089+0000","last_clean":"2024-09-14T12:16:50.229089+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:16:50.229089+0000","last_undegraded":"2024-09-14T12:16:50.229089+0000","last_fullsized":"2024-09-14T12:16:50.229089+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.228992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328317+0000","last_change":"2024-09-14T11:35:03.478962+0000","last_active":"2024-09-14T12:12:33.328317+0000","last_peered":"2024-09-14T12:12:33.328317+0000","last_clean":"2024-09-14T12:12:33.328317+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:12:33.328317+0000","last_undegraded":"2024-09-14T12:12:33.328317+0000","last_fullsized":"2024-09-14T12:12:33.328317+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:36.740534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.028331+0000","last_change":"2024-09-14T12:16:55.028331+0000","last_active":"2024-09-14T12:16:55.028331+0000","last_peered":"2024-09-14T12:16:55.028331+0000","last_clean":"2024-09-14T12:16:55.028331+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:16:55.028331+0000","last_undegraded":"2024-09-14T12:16:55.028331+0000","last_fullsized":"2024-09-14T12:16:55.028331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.028237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:15.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.227547+0000","last_change":"2024-09-14T12:16:41.227547+0000","last_active":"2024-09-14T12:16:41.227547+0000","last_peered":"2024-09-14T12:16:41.227547+0000","last_clean":"2024-09-14T12:16:41.227547+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:16:41.227547+0000","last_undegraded":"2024-09-14T12:16:41.227547+0000","last_fullsized":"2024-09-14T12:16:41.227547+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.227460+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:49.105464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.342822+0000","last_change":"2024-09-14T12:16:58.342822+0000","last_active":"2024-09-14T12:16:58.342822+0000","last_peered":"2024-09-14T12:16:58.342822+0000","last_clean":"2024-09-14T12:16:58.342822+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:16:58.342822+0000","last_undegraded":"2024-09-14T12:16:58.342822+0000","last_fullsized":"2024-09-14T12:16:58.342822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.342708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:41.494086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255935+0000","last_change":"2024-09-14T11:35:03.464696+0000","last_active":"2024-09-14T12:16:15.255935+0000","last_peered":"2024-09-14T12:16:15.255935+0000","last_clean":"2024-09-14T12:16:15.255935+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:16:15.255935+0000","last_undegraded":"2024-09-14T12:16:15.255935+0000","last_fullsized":"2024-09-14T12:16:15.255935+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.199719+0000","last_change":"2024-09-14T12:16:46.199719+0000","last_active":"2024-09-14T12:16:46.199719+0000","last_peered":"2024-09-14T12:16:46.199719+0000","last_clean":"2024-09-14T12:16:46.199719+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:16:46.199719+0000","last_undegraded":"2024-09-14T12:16:46.199719+0000","last_fullsized":"2024-09-14T12:16:46.199719+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.199614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:24.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:20.459835+0000","last_change":"2024-09-14T11:31:47.448692+0000","last_active":"2024-09-14T12:14:20.459835+0000","last_peered":"2024-09-14T12:14:20.459835+0000","last_clean":"2024-09-14T12:14:20.459835+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:14:20.459835+0000","last_undegraded":"2024-09-14T12:14:20.459835+0000","last_fullsized":"2024-09-14T12:14:20.459835+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.231335+0000","last_change":"2024-09-14T11:35:03.475309+0000","last_active":"2024-09-14T12:15:13.231335+0000","last_peered":"2024-09-14T12:15:13.231335+0000","last_clean":"2024-09-14T12:15:13.231335+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:15:13.231335+0000","last_undegraded":"2024-09-14T12:15:13.231335+0000","last_fullsized":"2024-09-14T12:15:13.231335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:41.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454427+0000","last_change":"2024-09-14T11:35:00.436760+0000","last_active":"2024-09-14T12:16:14.454427+0000","last_peered":"2024-09-14T12:16:14.454427+0000","last_clean":"2024-09-14T12:16:14.454427+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:16:14.454427+0000","last_undegraded":"2024-09-14T12:16:14.454427+0000","last_fullsized":"2024-09-14T12:16:14.454427+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:18.223421+0000","last_change":"2024-09-14T11:31:47.457266+0000","last_active":"2024-09-14T12:14:18.223421+0000","last_peered":"2024-09-14T12:14:18.223421+0000","last_clean":"2024-09-14T12:14:18.223421+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:14:18.223421+0000","last_undegraded":"2024-09-14T12:14:18.223421+0000","last_fullsized":"2024-09-14T12:14:18.223421+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.215732+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:13:13.215732+0000","last_peered":"2024-09-14T12:13:13.215732+0000","last_clean":"2024-09-14T12:13:13.215732+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:13:13.215732+0000","last_undegraded":"2024-09-14T12:13:13.215732+0000","last_fullsized":"2024-09-14T12:13:13.215732+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.906271+0000","last_change":"2024-09-14T11:35:03.476084+0000","last_active":"2024-09-14T12:16:14.906271+0000","last_peered":"2024-09-14T12:16:14.906271+0000","last_clean":"2024-09-14T12:16:14.906271+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:16:14.906271+0000","last_undegraded":"2024-09-14T12:16:14.906271+0000","last_fullsized":"2024-09-14T12:16:14.906271+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:33.839222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4136,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455082+0000","last_change":"2024-09-14T11:35:00.448072+0000","last_active":"2024-09-14T12:13:40.455082+0000","last_peered":"2024-09-14T12:13:40.455082+0000","last_clean":"2024-09-14T12:13:40.455082+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:13:40.455082+0000","last_undegraded":"2024-09-14T12:13:40.455082+0000","last_fullsized":"2024-09-14T12:13:40.455082+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:28.347710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:18.223390+0000","last_change":"2024-09-14T11:31:47.462106+0000","last_active":"2024-09-14T12:14:18.223390+0000","last_peered":"2024-09-14T12:14:18.223390+0000","last_clean":"2024-09-14T12:14:18.223390+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:14:18.223390+0000","last_undegraded":"2024-09-14T12:14:18.223390+0000","last_fullsized":"2024-09-14T12:14:18.223390+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.000001+0000","last_change":"2024-09-14T12:16:58.000001+0000","last_active":"2024-09-14T12:16:58.000001+0000","last_peered":"2024-09-14T12:16:58.000001+0000","last_clean":"2024-09-14T12:16:58.000001+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:16:58.000001+0000","last_undegraded":"2024-09-14T12:16:58.000001+0000","last_fullsized":"2024-09-14T12:16:58.000001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.999898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:38.804877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.417537+0000","last_change":"2024-09-14T12:16:55.417537+0000","last_active":"2024-09-14T12:16:55.417537+0000","last_peered":"2024-09-14T12:16:55.417537+0000","last_clean":"2024-09-14T12:16:55.417537+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:16:55.417537+0000","last_undegraded":"2024-09-14T12:16:55.417537+0000","last_fullsized":"2024-09-14T12:16:55.417537+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.417453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.938224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339062+0000","last_change":"2024-09-14T11:35:00.438296+0000","last_active":"2024-09-14T12:13:48.339062+0000","last_peered":"2024-09-14T12:13:48.339062+0000","last_clean":"2024-09-14T12:13:48.339062+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:13:48.339062+0000","last_undegraded":"2024-09-14T12:13:48.339062+0000","last_fullsized":"2024-09-14T12:13:48.339062+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:54.475609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.431266+0000","last_change":"2024-09-14T12:16:50.431266+0000","last_active":"2024-09-14T12:16:50.431266+0000","last_peered":"2024-09-14T12:16:50.431266+0000","last_clean":"2024-09-14T12:16:50.431266+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:16:50.431266+0000","last_undegraded":"2024-09-14T12:16:50.431266+0000","last_fullsized":"2024-09-14T12:16:50.431266+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'265","last_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_deep_scrub":"263'265","last_deep_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.431183+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469353+0000","last_change":"2024-09-14T11:51:07.025464+0000","last_active":"2024-09-14T12:13:38.469353+0000","last_peered":"2024-09-14T12:13:38.469353+0000","last_clean":"2024-09-14T12:13:38.469353+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:13:38.469353+0000","last_undegraded":"2024-09-14T12:13:38.469353+0000","last_fullsized":"2024-09-14T12:13:38.469353+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:19.282302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.370761+0000","last_change":"2024-09-14T12:16:56.370761+0000","last_active":"2024-09-14T12:16:56.370761+0000","last_peered":"2024-09-14T12:16:56.370761+0000","last_clean":"2024-09-14T12:16:56.370761+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:16:56.370761+0000","last_undegraded":"2024-09-14T12:16:56.370761+0000","last_fullsized":"2024-09-14T12:16:56.370761+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.370676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.956462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.328263+0000","last_change":"2024-09-14T11:35:00.437973+0000","last_active":"2024-09-14T12:12:33.328263+0000","last_peered":"2024-09-14T12:12:33.328263+0000","last_clean":"2024-09-14T12:12:33.328263+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:12:33.328263+0000","last_undegraded":"2024-09-14T12:12:33.328263+0000","last_fullsized":"2024-09-14T12:12:33.328263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:27.001459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:00.450230+0000","last_change":"2024-09-14T11:31:47.453761+0000","last_active":"2024-09-14T12:13:00.450230+0000","last_peered":"2024-09-14T12:13:00.450230+0000","last_clean":"2024-09-14T12:13:00.450230+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:13:00.450230+0000","last_undegraded":"2024-09-14T12:13:00.450230+0000","last_fullsized":"2024-09-14T12:13:00.450230+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:09.950493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469389+0000","last_change":"2024-09-14T11:51:07.025062+0000","last_active":"2024-09-14T12:13:38.469389+0000","last_peered":"2024-09-14T12:13:38.469389+0000","last_clean":"2024-09-14T12:13:38.469389+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:13:38.469389+0000","last_undegraded":"2024-09-14T12:13:38.469389+0000","last_fullsized":"2024-09-14T12:13:38.469389+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:40.448743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'14","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:03.229789+0000","last_change":"2024-09-14T11:35:03.471849+0000","last_active":"2024-09-14T12:15:03.229789+0000","last_peered":"2024-09-14T12:15:03.229789+0000","last_clean":"2024-09-14T12:15:03.229789+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:15:03.229789+0000","last_undegraded":"2024-09-14T12:15:03.229789+0000","last_fullsized":"2024-09-14T12:15:03.229789+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:07.443411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17412,"num_write":24,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:30.446943+0000","last_change":"2024-09-14T11:35:00.442805+0000","last_active":"2024-09-14T12:12:30.446943+0000","last_peered":"2024-09-14T12:12:30.446943+0000","last_clean":"2024-09-14T12:12:30.446943+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:12:30.446943+0000","last_undegraded":"2024-09-14T12:12:30.446943+0000","last_fullsized":"2024-09-14T12:12:30.446943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:46.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.038191+0000","last_change":"2024-09-14T12:16:52.038191+0000","last_active":"2024-09-14T12:16:52.038191+0000","last_peered":"2024-09-14T12:16:52.038191+0000","last_clean":"2024-09-14T12:16:52.038191+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:16:52.038191+0000","last_undegraded":"2024-09-14T12:16:52.038191+0000","last_fullsized":"2024-09-14T12:16:52.038191+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.038107+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:18.125308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.214114+0000","last_change":"2024-09-14T11:51:07.034227+0000","last_active":"2024-09-14T12:14:28.214114+0000","last_peered":"2024-09-14T12:14:28.214114+0000","last_clean":"2024-09-14T12:14:28.214114+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:14:28.214114+0000","last_undegraded":"2024-09-14T12:14:28.214114+0000","last_fullsized":"2024-09-14T12:14:28.214114+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.219445+0000","last_change":"2024-09-14T11:35:03.473504+0000","last_active":"2024-09-14T12:13:43.219445+0000","last_peered":"2024-09-14T12:13:43.219445+0000","last_clean":"2024-09-14T12:13:43.219445+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:13:43.219445+0000","last_undegraded":"2024-09-14T12:13:43.219445+0000","last_fullsized":"2024-09-14T12:13:43.219445+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:16.016858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'6","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.454746+0000","last_change":"2024-09-14T11:35:00.440906+0000","last_active":"2024-09-14T12:16:14.454746+0000","last_peered":"2024-09-14T12:16:14.454746+0000","last_clean":"2024-09-14T12:16:14.454746+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:16:14.454746+0000","last_undegraded":"2024-09-14T12:16:14.454746+0000","last_fullsized":"2024-09-14T12:16:14.454746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:41.455610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6146,"num_write":6,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449764+0000","last_change":"2024-09-14T11:31:47.456394+0000","last_active":"2024-09-14T12:12:55.449764+0000","last_peered":"2024-09-14T12:12:55.449764+0000","last_clean":"2024-09-14T12:12:55.449764+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:12:55.449764+0000","last_undegraded":"2024-09-14T12:12:55.449764+0000","last_fullsized":"2024-09-14T12:12:55.449764+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.211985+0000","last_change":"2024-09-14T12:16:47.211908+0000","last_active":"2024-09-14T12:16:47.211985+0000","last_peered":"2024-09-14T12:16:47.211985+0000","last_clean":"2024-09-14T12:16:47.211985+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:16:47.211985+0000","last_undegraded":"2024-09-14T12:16:47.211985+0000","last_fullsized":"2024-09-14T12:16:47.211985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.211816+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:34.600918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:25.453337+0000","last_change":"2024-09-14T11:35:56.552398+0000","last_active":"2024-09-14T12:13:25.453337+0000","last_peered":"2024-09-14T12:13:25.453337+0000","last_clean":"2024-09-14T12:13:25.453337+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:13:25.453337+0000","last_undegraded":"2024-09-14T12:13:25.453337+0000","last_fullsized":"2024-09-14T12:13:25.453337+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:38.380653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:43.470240+0000","last_change":"2024-09-14T11:35:00.442974+0000","last_active":"2024-09-14T12:13:43.470240+0000","last_peered":"2024-09-14T12:13:43.470240+0000","last_clean":"2024-09-14T12:13:43.470240+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:13:43.470240+0000","last_undegraded":"2024-09-14T12:13:43.470240+0000","last_fullsized":"2024-09-14T12:13:43.470240+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.940084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213321+0000","last_change":"2024-09-14T11:31:47.462516+0000","last_active":"2024-09-14T12:12:53.213321+0000","last_peered":"2024-09-14T12:12:53.213321+0000","last_clean":"2024-09-14T12:12:53.213321+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:12:53.213321+0000","last_undegraded":"2024-09-14T12:12:53.213321+0000","last_fullsized":"2024-09-14T12:12:53.213321+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:09.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.477114+0000","last_change":"2024-09-14T11:51:07.026323+0000","last_active":"2024-09-14T12:14:28.477114+0000","last_peered":"2024-09-14T12:14:28.477114+0000","last_clean":"2024-09-14T12:14:28.477114+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:14:28.477114+0000","last_undegraded":"2024-09-14T12:14:28.477114+0000","last_fullsized":"2024-09-14T12:14:28.477114+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.239491+0000","last_change":"2024-09-14T11:35:03.475543+0000","last_active":"2024-09-14T12:16:08.239491+0000","last_peered":"2024-09-14T12:16:08.239491+0000","last_clean":"2024-09-14T12:16:08.239491+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:16:08.239491+0000","last_undegraded":"2024-09-14T12:16:08.239491+0000","last_fullsized":"2024-09-14T12:16:08.239491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:11.985039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":14,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.223174+0000","last_change":"2024-09-14T12:16:45.223174+0000","last_active":"2024-09-14T12:16:45.223174+0000","last_peered":"2024-09-14T12:16:45.223174+0000","last_clean":"2024-09-14T12:16:45.223174+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:16:45.223174+0000","last_undegraded":"2024-09-14T12:16:45.223174+0000","last_fullsized":"2024-09-14T12:16:45.223174+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.223090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.214548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.249068+0000","last_change":"2024-09-14T12:16:42.249068+0000","last_active":"2024-09-14T12:16:42.249068+0000","last_peered":"2024-09-14T12:16:42.249068+0000","last_clean":"2024-09-14T12:16:42.249068+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:16:42.249068+0000","last_undegraded":"2024-09-14T12:16:42.249068+0000","last_fullsized":"2024-09-14T12:16:42.249068+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.248991+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:14.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:28.230496+0000","last_change":"2024-09-14T11:51:07.033220+0000","last_active":"2024-09-14T12:14:28.230496+0000","last_peered":"2024-09-14T12:14:28.230496+0000","last_clean":"2024-09-14T12:14:28.230496+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:14:28.230496+0000","last_undegraded":"2024-09-14T12:14:28.230496+0000","last_fullsized":"2024-09-14T12:14:28.230496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:08.237216+0000","last_change":"2024-09-14T11:35:03.473424+0000","last_active":"2024-09-14T12:16:08.237216+0000","last_peered":"2024-09-14T12:16:08.237216+0000","last_clean":"2024-09-14T12:16:08.237216+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:16:08.237216+0000","last_undegraded":"2024-09-14T12:16:08.237216+0000","last_fullsized":"2024-09-14T12:16:08.237216+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:59.654565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455263+0000","last_change":"2024-09-14T11:35:00.445032+0000","last_active":"2024-09-14T12:13:40.455263+0000","last_peered":"2024-09-14T12:13:40.455263+0000","last_clean":"2024-09-14T12:13:40.455263+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:13:40.455263+0000","last_undegraded":"2024-09-14T12:13:40.455263+0000","last_fullsized":"2024-09-14T12:13:40.455263+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:28.041388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:53.471558+0000","last_change":"2024-09-14T11:31:47.456001+0000","last_active":"2024-09-14T12:13:53.471558+0000","last_peered":"2024-09-14T12:13:53.471558+0000","last_clean":"2024-09-14T12:13:53.471558+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:13:53.471558+0000","last_undegraded":"2024-09-14T12:13:53.471558+0000","last_fullsized":"2024-09-14T12:13:53.471558+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:13.225303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211827+0000","last_change":"2024-09-14T11:35:03.477503+0000","last_active":"2024-09-14T12:16:14.211827+0000","last_peered":"2024-09-14T12:16:14.211827+0000","last_clean":"2024-09-14T12:16:14.211827+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:16:14.211827+0000","last_undegraded":"2024-09-14T12:16:14.211827+0000","last_fullsized":"2024-09-14T12:16:14.211827+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:41.041770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:43.346671+0000","last_change":"2024-09-14T11:35:00.439851+0000","last_active":"2024-09-14T12:14:43.346671+0000","last_peered":"2024-09-14T12:14:43.346671+0000","last_clean":"2024-09-14T12:14:43.346671+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:14:43.346671+0000","last_undegraded":"2024-09-14T12:14:43.346671+0000","last_fullsized":"2024-09-14T12:14:43.346671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.584648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.470880+0000","last_change":"2024-09-14T11:31:47.462411+0000","last_active":"2024-09-14T12:13:48.470880+0000","last_peered":"2024-09-14T12:13:48.470880+0000","last_clean":"2024-09-14T12:13:48.470880+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:13:48.470880+0000","last_undegraded":"2024-09-14T12:13:48.470880+0000","last_fullsized":"2024-09-14T12:13:48.470880+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:36.552467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:55.449727+0000","last_change":"2024-09-14T11:51:07.030742+0000","last_active":"2024-09-14T12:12:55.449727+0000","last_peered":"2024-09-14T12:12:55.449727+0000","last_clean":"2024-09-14T12:12:55.449727+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:12:55.449727+0000","last_undegraded":"2024-09-14T12:12:55.449727+0000","last_fullsized":"2024-09-14T12:12:55.449727+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:08.419828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.009764+0000","last_change":"2024-09-14T12:16:57.009764+0000","last_active":"2024-09-14T12:16:57.009764+0000","last_peered":"2024-09-14T12:16:57.009764+0000","last_clean":"2024-09-14T12:16:57.009764+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:16:57.009764+0000","last_undegraded":"2024-09-14T12:16:57.009764+0000","last_fullsized":"2024-09-14T12:16:57.009764+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.009666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:55.446041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'9","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.211522+0000","last_change":"2024-09-14T11:35:00.441850+0000","last_active":"2024-09-14T12:16:14.211522+0000","last_peered":"2024-09-14T12:16:14.211522+0000","last_clean":"2024-09-14T12:16:14.211522+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:16:14.211522+0000","last_undegraded":"2024-09-14T12:16:14.211522+0000","last_fullsized":"2024-09-14T12:16:14.211522+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:30.122035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:50.456324+0000","last_change":"2024-09-14T11:31:47.451072+0000","last_active":"2024-09-14T12:13:50.456324+0000","last_peered":"2024-09-14T12:13:50.456324+0000","last_clean":"2024-09-14T12:13:50.456324+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:13:50.456324+0000","last_undegraded":"2024-09-14T12:13:50.456324+0000","last_fullsized":"2024-09-14T12:13:50.456324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:14.883783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:35.461622+0000","last_change":"2024-09-14T11:51:07.028426+0000","last_active":"2024-09-14T12:14:35.461622+0000","last_peered":"2024-09-14T12:14:35.461622+0000","last_clean":"2024-09-14T12:14:35.461622+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:14:35.461622+0000","last_undegraded":"2024-09-14T12:14:35.461622+0000","last_fullsized":"2024-09-14T12:14:35.461622+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.945221+0000","last_change":"2024-09-14T11:35:03.472450+0000","last_active":"2024-09-14T12:16:14.945221+0000","last_peered":"2024-09-14T12:16:14.945221+0000","last_clean":"2024-09-14T12:16:14.945221+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:16:14.945221+0000","last_undegraded":"2024-09-14T12:16:14.945221+0000","last_fullsized":"2024-09-14T12:16:14.945221+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:01.749241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7286,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'13","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.486051+0000","last_change":"2024-09-14T12:16:52.486051+0000","last_active":"2024-09-14T12:16:52.486051+0000","last_peered":"2024-09-14T12:16:52.486051+0000","last_clean":"2024-09-14T12:16:52.486051+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:16:52.486051+0000","last_undegraded":"2024-09-14T12:16:52.486051+0000","last_fullsized":"2024-09-14T12:16:52.486051+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.485960+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.159924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16386,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.339011+0000","last_change":"2024-09-14T11:31:47.456301+0000","last_active":"2024-09-14T12:13:48.339011+0000","last_peered":"2024-09-14T12:13:48.339011+0000","last_clean":"2024-09-14T12:13:48.339011+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:13:48.339011+0000","last_undegraded":"2024-09-14T12:13:48.339011+0000","last_fullsized":"2024-09-14T12:13:48.339011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:28.476013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.452074+0000","last_change":"2024-09-14T12:16:53.452074+0000","last_active":"2024-09-14T12:16:53.452074+0000","last_peered":"2024-09-14T12:16:53.452074+0000","last_clean":"2024-09-14T12:16:53.452074+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:16:53.452074+0000","last_undegraded":"2024-09-14T12:16:53.452074+0000","last_fullsized":"2024-09-14T12:16:53.452074+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.451986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:58.732860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'8","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.423979+0000","last_change":"2024-09-14T11:35:00.447462+0000","last_active":"2024-09-14T12:16:14.423979+0000","last_peered":"2024-09-14T12:16:14.423979+0000","last_clean":"2024-09-14T12:16:14.423979+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:16:14.423979+0000","last_undegraded":"2024-09-14T12:16:14.423979+0000","last_fullsized":"2024-09-14T12:16:14.423979+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:55.617345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:48.219948+0000","last_change":"2024-09-14T11:31:47.464229+0000","last_active":"2024-09-14T12:13:48.219948+0000","last_peered":"2024-09-14T12:13:48.219948+0000","last_clean":"2024-09-14T12:13:48.219948+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:13:48.219948+0000","last_undegraded":"2024-09-14T12:13:48.219948+0000","last_fullsized":"2024-09-14T12:13:48.219948+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:19.148734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.228751+0000","last_change":"2024-09-14T12:16:43.228751+0000","last_active":"2024-09-14T12:16:43.228751+0000","last_peered":"2024-09-14T12:16:43.228751+0000","last_clean":"2024-09-14T12:16:43.228751+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:16:43.228751+0000","last_undegraded":"2024-09-14T12:16:43.228751+0000","last_fullsized":"2024-09-14T12:16:43.228751+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.228673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:31.730916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:33.234122+0000","last_change":"2024-09-14T11:35:03.471476+0000","last_active":"2024-09-14T12:15:33.234122+0000","last_peered":"2024-09-14T12:15:33.234122+0000","last_clean":"2024-09-14T12:15:33.234122+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:15:33.234122+0000","last_undegraded":"2024-09-14T12:15:33.234122+0000","last_fullsized":"2024-09-14T12:15:33.234122+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:58.704173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.466433+0000","last_change":"2024-09-14T11:35:00.442307+0000","last_active":"2024-09-14T12:13:18.466433+0000","last_peered":"2024-09-14T12:13:18.466433+0000","last_clean":"2024-09-14T12:13:18.466433+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:13:18.466433+0000","last_undegraded":"2024-09-14T12:13:18.466433+0000","last_fullsized":"2024-09-14T12:13:18.466433+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:49.905323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:33.211125+0000","last_change":"2024-09-14T11:31:47.463433+0000","last_active":"2024-09-14T12:12:33.211125+0000","last_peered":"2024-09-14T12:12:33.211125+0000","last_clean":"2024-09-14T12:12:33.211125+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:12:33.211125+0000","last_undegraded":"2024-09-14T12:12:33.211125+0000","last_fullsized":"2024-09-14T12:12:33.211125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.949009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469291+0000","last_change":"2024-09-14T11:51:07.026926+0000","last_active":"2024-09-14T12:13:38.469291+0000","last_peered":"2024-09-14T12:13:38.469291+0000","last_clean":"2024-09-14T12:13:38.469291+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:13:38.469291+0000","last_undegraded":"2024-09-14T12:13:38.469291+0000","last_fullsized":"2024-09-14T12:13:38.469291+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:39.846146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216330+0000","last_change":"2024-09-14T11:35:03.475916+0000","last_active":"2024-09-14T12:13:18.216330+0000","last_peered":"2024-09-14T12:13:18.216330+0000","last_clean":"2024-09-14T12:13:18.216330+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:13:18.216330+0000","last_undegraded":"2024-09-14T12:13:18.216330+0000","last_fullsized":"2024-09-14T12:13:18.216330+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.889437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.239047+0000","last_change":"2024-09-14T12:16:48.239047+0000","last_active":"2024-09-14T12:16:48.239047+0000","last_peered":"2024-09-14T12:16:48.239047+0000","last_clean":"2024-09-14T12:16:48.239047+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:16:48.239047+0000","last_undegraded":"2024-09-14T12:16:48.239047+0000","last_fullsized":"2024-09-14T12:16:48.239047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.238958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:48.498973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":223,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:33.231284+0000","last_change":"2024-09-14T11:31:47.456460+0000","last_active":"2024-09-14T12:14:33.231284+0000","last_peered":"2024-09-14T12:14:33.231284+0000","last_clean":"2024-09-14T12:14:33.231284+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:14:33.231284+0000","last_undegraded":"2024-09-14T12:14:33.231284+0000","last_fullsized":"2024-09-14T12:14:33.231284+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.356091+0000","last_change":"2024-09-14T12:16:57.356091+0000","last_active":"2024-09-14T12:16:57.356091+0000","last_peered":"2024-09-14T12:16:57.356091+0000","last_clean":"2024-09-14T12:16:57.356091+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:16:57.356091+0000","last_undegraded":"2024-09-14T12:16:57.356091+0000","last_fullsized":"2024-09-14T12:16:57.356091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.355955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:36.110361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.055519+0000","last_change":"2024-09-14T12:16:56.055519+0000","last_active":"2024-09-14T12:16:56.055519+0000","last_peered":"2024-09-14T12:16:56.055519+0000","last_clean":"2024-09-14T12:16:56.055519+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:16:56.055519+0000","last_undegraded":"2024-09-14T12:16:56.055519+0000","last_fullsized":"2024-09-14T12:16:56.055519+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.055430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:58.544259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:15.452011+0000","last_change":"2024-09-14T11:35:00.448197+0000","last_active":"2024-09-14T12:13:15.452011+0000","last_peered":"2024-09-14T12:13:15.452011+0000","last_clean":"2024-09-14T12:13:15.452011+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:13:15.452011+0000","last_undegraded":"2024-09-14T12:13:15.452011+0000","last_fullsized":"2024-09-14T12:13:15.452011+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:06.991768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.418419+0000","last_change":"2024-09-14T12:16:49.418419+0000","last_active":"2024-09-14T12:16:49.418419+0000","last_peered":"2024-09-14T12:16:49.418419+0000","last_clean":"2024-09-14T12:16:49.418419+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:16:49.418419+0000","last_undegraded":"2024-09-14T12:16:49.418419+0000","last_fullsized":"2024-09-14T12:16:49.418419+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.418336+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.489845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:48.462000+0000","last_change":"2024-09-14T11:51:07.032187+0000","last_active":"2024-09-14T12:12:48.462000+0000","last_peered":"2024-09-14T12:12:48.462000+0000","last_clean":"2024-09-14T12:12:48.462000+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:12:48.462000+0000","last_undegraded":"2024-09-14T12:12:48.462000+0000","last_fullsized":"2024-09-14T12:12:48.462000+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:20.706585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:18.216374+0000","last_change":"2024-09-14T11:35:03.472672+0000","last_active":"2024-09-14T12:13:18.216374+0000","last_peered":"2024-09-14T12:13:18.216374+0000","last_clean":"2024-09-14T12:13:18.216374+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:13:18.216374+0000","last_undegraded":"2024-09-14T12:13:18.216374+0000","last_fullsized":"2024-09-14T12:13:18.216374+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:37.610733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.029184+0000","last_change":"2024-09-14T12:16:53.029184+0000","last_active":"2024-09-14T12:16:53.029184+0000","last_peered":"2024-09-14T12:16:53.029184+0000","last_clean":"2024-09-14T12:16:53.029184+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:16:53.029184+0000","last_undegraded":"2024-09-14T12:16:53.029184+0000","last_fullsized":"2024-09-14T12:16:53.029184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.029084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:57.527264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.212969+0000","last_change":"2024-09-14T12:16:39.212912+0000","last_active":"2024-09-14T12:16:39.212969+0000","last_peered":"2024-09-14T12:16:39.212969+0000","last_clean":"2024-09-14T12:16:39.212969+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:16:39.212969+0000","last_undegraded":"2024-09-14T12:16:39.212969+0000","last_fullsized":"2024-09-14T12:16:39.212969+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.212821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:58.488819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.255791+0000","last_change":"2024-09-14T11:35:03.477086+0000","last_active":"2024-09-14T12:16:15.255791+0000","last_peered":"2024-09-14T12:16:15.255791+0000","last_clean":"2024-09-14T12:16:15.255791+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:16:15.255791+0000","last_undegraded":"2024-09-14T12:16:15.255791+0000","last_fullsized":"2024-09-14T12:16:15.255791+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:13.260908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9588,"num_write":6,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.210185+0000","last_change":"2024-09-14T11:35:00.447168+0000","last_active":"2024-09-14T12:16:14.210185+0000","last_peered":"2024-09-14T12:16:14.210185+0000","last_clean":"2024-09-14T12:16:14.210185+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:16:14.210185+0000","last_undegraded":"2024-09-14T12:16:14.210185+0000","last_fullsized":"2024-09-14T12:16:14.210185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:06.149402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.158587+0000","last_change":"2024-09-14T12:16:59.158587+0000","last_active":"2024-09-14T12:16:59.158587+0000","last_peered":"2024-09-14T12:16:59.158587+0000","last_clean":"2024-09-14T12:16:59.158587+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:16:59.158587+0000","last_undegraded":"2024-09-14T12:16:59.158587+0000","last_fullsized":"2024-09-14T12:16:59.158587+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.158491+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:35.267689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469413+0000","last_change":"2024-09-14T11:51:07.031509+0000","last_active":"2024-09-14T12:13:38.469413+0000","last_peered":"2024-09-14T12:13:38.469413+0000","last_clean":"2024-09-14T12:13:38.469413+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:13:38.469413+0000","last_undegraded":"2024-09-14T12:13:38.469413+0000","last_fullsized":"2024-09-14T12:13:38.469413+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:28.376294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473093+0000","last_change":"2024-09-14T11:35:03.469329+0000","last_active":"2024-09-14T12:14:03.473093+0000","last_peered":"2024-09-14T12:14:03.473093+0000","last_clean":"2024-09-14T12:14:03.473093+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:14:03.473093+0000","last_undegraded":"2024-09-14T12:14:03.473093+0000","last_fullsized":"2024-09-14T12:14:03.473093+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:17.447209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.227718+0000","last_change":"2024-09-14T11:35:00.445950+0000","last_active":"2024-09-14T12:16:13.227718+0000","last_peered":"2024-09-14T12:16:13.227718+0000","last_clean":"2024-09-14T12:16:13.227718+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:16:13.227718+0000","last_undegraded":"2024-09-14T12:16:13.227718+0000","last_fullsized":"2024-09-14T12:16:13.227718+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:53.807409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.205563+0000","last_change":"2024-09-14T12:16:58.205563+0000","last_active":"2024-09-14T12:16:58.205563+0000","last_peered":"2024-09-14T12:16:58.205563+0000","last_clean":"2024-09-14T12:16:58.205563+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:16:58.205563+0000","last_undegraded":"2024-09-14T12:16:58.205563+0000","last_fullsized":"2024-09-14T12:16:58.205563+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.205482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:05.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.469335+0000","last_change":"2024-09-14T11:51:07.028218+0000","last_active":"2024-09-14T12:13:38.469335+0000","last_peered":"2024-09-14T12:13:38.469335+0000","last_clean":"2024-09-14T12:13:38.469335+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:13:38.469335+0000","last_undegraded":"2024-09-14T12:13:38.469335+0000","last_fullsized":"2024-09-14T12:13:38.469335+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:46.626074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.990589+0000","last_change":"2024-09-14T12:16:53.990589+0000","last_active":"2024-09-14T12:16:53.990589+0000","last_peered":"2024-09-14T12:16:53.990589+0000","last_clean":"2024-09-14T12:16:53.990589+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:16:53.990589+0000","last_undegraded":"2024-09-14T12:16:53.990589+0000","last_fullsized":"2024-09-14T12:16:53.990589+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.990505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:38.600472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458103+0000","last_change":"2024-09-14T11:35:00.446455+0000","last_active":"2024-09-14T12:14:05.458103+0000","last_peered":"2024-09-14T12:14:05.458103+0000","last_clean":"2024-09-14T12:14:05.458103+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:14:05.458103+0000","last_undegraded":"2024-09-14T12:14:05.458103+0000","last_fullsized":"2024-09-14T12:14:05.458103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:52.061963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":85,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213813+0000","last_change":"2024-09-14T11:31:47.457537+0000","last_active":"2024-09-14T12:12:58.213813+0000","last_peered":"2024-09-14T12:12:58.213813+0000","last_clean":"2024-09-14T12:12:58.213813+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:12:58.213813+0000","last_undegraded":"2024-09-14T12:12:58.213813+0000","last_fullsized":"2024-09-14T12:12:58.213813+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:31:46.434147+0000","last_clean_scrub_stamp":"2024-09-14T11:31:46.434147+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.669205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:40.455223+0000","last_change":"2024-09-14T11:51:07.030522+0000","last_active":"2024-09-14T12:13:40.455223+0000","last_peered":"2024-09-14T12:13:40.455223+0000","last_clean":"2024-09-14T12:13:40.455223+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:13:40.455223+0000","last_undegraded":"2024-09-14T12:13:40.455223+0000","last_fullsized":"2024-09-14T12:13:40.455223+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:20.421839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.290329+0000","last_change":"2024-09-14T11:35:03.472900+0000","last_active":"2024-09-14T12:16:15.290329+0000","last_peered":"2024-09-14T12:16:15.290329+0000","last_clean":"2024-09-14T12:16:15.290329+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:16:15.290329+0000","last_undegraded":"2024-09-14T12:16:15.290329+0000","last_fullsized":"2024-09-14T12:16:15.290329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:14.821160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.686308+0000","last_change":"2024-09-14T12:16:57.686308+0000","last_active":"2024-09-14T12:16:57.686308+0000","last_peered":"2024-09-14T12:16:57.686308+0000","last_clean":"2024-09-14T12:16:57.686308+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:16:57.686308+0000","last_undegraded":"2024-09-14T12:16:57.686308+0000","last_fullsized":"2024-09-14T12:16:57.686308+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.686213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:26.967385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.448296+0000","last_change":"2024-09-14T12:16:48.448296+0000","last_active":"2024-09-14T12:16:48.448296+0000","last_peered":"2024-09-14T12:16:48.448296+0000","last_clean":"2024-09-14T12:16:48.448296+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:16:48.448296+0000","last_undegraded":"2024-09-14T12:16:48.448296+0000","last_fullsized":"2024-09-14T12:16:48.448296+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.448209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:26.636696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473158+0000","last_change":"2024-09-14T11:51:07.030414+0000","last_active":"2024-09-14T12:14:03.473158+0000","last_peered":"2024-09-14T12:14:03.473158+0000","last_clean":"2024-09-14T12:14:03.473158+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:14:03.473158+0000","last_undegraded":"2024-09-14T12:14:03.473158+0000","last_fullsized":"2024-09-14T12:14:03.473158+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:56.519204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:45.463337+0000","last_change":"2024-09-14T11:35:03.477592+0000","last_active":"2024-09-14T12:14:45.463337+0000","last_peered":"2024-09-14T12:14:45.463337+0000","last_clean":"2024-09-14T12:14:45.463337+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:14:45.463337+0000","last_undegraded":"2024-09-14T12:14:45.463337+0000","last_fullsized":"2024-09-14T12:14:45.463337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'13","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:15.355106+0000","last_change":"2024-09-14T11:35:00.442086+0000","last_active":"2024-09-14T12:16:15.355106+0000","last_peered":"2024-09-14T12:16:15.355106+0000","last_clean":"2024-09-14T12:16:15.355106+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:16:15.355106+0000","last_undegraded":"2024-09-14T12:16:15.355106+0000","last_fullsized":"2024-09-14T12:16:15.355106+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12294,"num_write":18,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":76,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.141579+0000","last_change":"2024-09-14T12:17:00.141579+0000","last_active":"2024-09-14T12:17:00.141579+0000","last_peered":"2024-09-14T12:17:00.141579+0000","last_clean":"2024-09-14T12:17:00.141579+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:17:00.141579+0000","last_undegraded":"2024-09-14T12:17:00.141579+0000","last_fullsized":"2024-09-14T12:17:00.141579+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.141488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.683293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226821+0000","last_change":"2024-09-14T11:51:07.036928+0000","last_active":"2024-09-14T12:14:03.226821+0000","last_peered":"2024-09-14T12:14:03.226821+0000","last_clean":"2024-09-14T12:14:03.226821+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:14:03.226821+0000","last_undegraded":"2024-09-14T12:14:03.226821+0000","last_fullsized":"2024-09-14T12:14:03.226821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:16.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:40.462529+0000","last_change":"2024-09-14T11:35:03.467041+0000","last_active":"2024-09-14T12:14:40.462529+0000","last_peered":"2024-09-14T12:14:40.462529+0000","last_clean":"2024-09-14T12:14:40.462529+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:14:40.462529+0000","last_undegraded":"2024-09-14T12:14:40.462529+0000","last_fullsized":"2024-09-14T12:14:40.462529+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.230945+0000","last_change":"2024-09-14T12:16:44.230855+0000","last_active":"2024-09-14T12:16:44.230945+0000","last_peered":"2024-09-14T12:16:44.230945+0000","last_clean":"2024-09-14T12:16:44.230945+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:16:44.230945+0000","last_undegraded":"2024-09-14T12:16:44.230945+0000","last_fullsized":"2024-09-14T12:16:44.230945+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.230752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:11.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.487986+0000","last_change":"2024-09-14T12:16:47.487986+0000","last_active":"2024-09-14T12:16:47.487986+0000","last_peered":"2024-09-14T12:16:47.487986+0000","last_clean":"2024-09-14T12:16:47.487986+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:16:47.487986+0000","last_undegraded":"2024-09-14T12:16:47.487986+0000","last_fullsized":"2024-09-14T12:16:47.487986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.487890+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:34.728943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.205645+0000","last_change":"2024-09-14T11:51:07.029634+0000","last_active":"2024-09-14T12:13:13.205645+0000","last_peered":"2024-09-14T12:13:13.205645+0000","last_clean":"2024-09-14T12:13:13.205645+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:13:13.205645+0000","last_undegraded":"2024-09-14T12:13:13.205645+0000","last_fullsized":"2024-09-14T12:13:13.205645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.489359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:13.493311+0000","last_change":"2024-09-14T11:35:03.473756+0000","last_active":"2024-09-14T12:16:13.493311+0000","last_peered":"2024-09-14T12:16:13.493311+0000","last_clean":"2024-09-14T12:16:13.493311+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:16:13.493311+0000","last_undegraded":"2024-09-14T12:16:13.493311+0000","last_fullsized":"2024-09-14T12:16:13.493311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:21.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.226870+0000","last_change":"2024-09-14T11:35:00.439036+0000","last_active":"2024-09-14T12:14:03.226870+0000","last_peered":"2024-09-14T12:14:03.226870+0000","last_clean":"2024-09-14T12:14:03.226870+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:14:03.226870+0000","last_undegraded":"2024-09-14T12:14:03.226870+0000","last_fullsized":"2024-09-14T12:14:03.226870+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:47.872300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.211375+0000","last_change":"2024-09-14T12:16:57.211375+0000","last_active":"2024-09-14T12:16:57.211375+0000","last_peered":"2024-09-14T12:16:57.211375+0000","last_clean":"2024-09-14T12:16:57.211375+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:16:57.211375+0000","last_undegraded":"2024-09-14T12:16:57.211375+0000","last_fullsized":"2024-09-14T12:16:57.211375+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.211282+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:58.100464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341091+0000","last_change":"2024-09-14T11:51:07.026936+0000","last_active":"2024-09-14T12:14:03.341091+0000","last_peered":"2024-09-14T12:14:03.341091+0000","last_clean":"2024-09-14T12:14:03.341091+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:14:03.341091+0000","last_undegraded":"2024-09-14T12:14:03.341091+0000","last_fullsized":"2024-09-14T12:14:03.341091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:04.574603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.341185+0000","last_change":"2024-09-14T11:35:03.474100+0000","last_active":"2024-09-14T12:14:03.341185+0000","last_peered":"2024-09-14T12:14:03.341185+0000","last_clean":"2024-09-14T12:14:03.341185+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:14:03.341185+0000","last_undegraded":"2024-09-14T12:14:03.341185+0000","last_fullsized":"2024-09-14T12:14:03.341185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:03.415583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473252+0000","last_change":"2024-09-14T11:35:00.444718+0000","last_active":"2024-09-14T12:14:03.473252+0000","last_peered":"2024-09-14T12:14:03.473252+0000","last_clean":"2024-09-14T12:14:03.473252+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:14:03.473252+0000","last_undegraded":"2024-09-14T12:14:03.473252+0000","last_fullsized":"2024-09-14T12:14:03.473252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:42.564069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.030749+0000","last_change":"2024-09-14T12:16:49.030749+0000","last_active":"2024-09-14T12:16:49.030749+0000","last_peered":"2024-09-14T12:16:49.030749+0000","last_clean":"2024-09-14T12:16:49.030749+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:16:49.030749+0000","last_undegraded":"2024-09-14T12:16:49.030749+0000","last_fullsized":"2024-09-14T12:16:49.030749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.030667+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:33.596870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.224573+0000","last_change":"2024-09-14T12:16:49.224573+0000","last_active":"2024-09-14T12:16:49.224573+0000","last_peered":"2024-09-14T12:16:49.224573+0000","last_clean":"2024-09-14T12:16:49.224573+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:16:49.224573+0000","last_undegraded":"2024-09-14T12:16:49.224573+0000","last_fullsized":"2024-09-14T12:16:49.224573+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.224477+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:40.222740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:14.945666+0000","last_change":"2024-09-14T11:35:03.477493+0000","last_active":"2024-09-14T12:16:14.945666+0000","last_peered":"2024-09-14T12:16:14.945666+0000","last_clean":"2024-09-14T12:16:14.945666+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:16:14.945666+0000","last_undegraded":"2024-09-14T12:16:14.945666+0000","last_fullsized":"2024-09-14T12:16:14.945666+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:08.483121+0000","last_change":"2024-09-14T11:35:00.449237+0000","last_active":"2024-09-14T12:15:08.483121+0000","last_peered":"2024-09-14T12:15:08.483121+0000","last_clean":"2024-09-14T12:15:08.483121+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:15:08.483121+0000","last_undegraded":"2024-09-14T12:15:08.483121+0000","last_fullsized":"2024-09-14T12:15:08.483121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:39.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.895946+0000","last_change":"2024-09-14T12:16:57.895946+0000","last_active":"2024-09-14T12:16:57.895946+0000","last_peered":"2024-09-14T12:16:57.895946+0000","last_clean":"2024-09-14T12:16:57.895946+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:16:57.895946+0000","last_undegraded":"2024-09-14T12:16:57.895946+0000","last_fullsized":"2024-09-14T12:16:57.895946+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.895851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.309184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:50.449191+0000","last_change":"2024-09-14T11:51:07.031060+0000","last_active":"2024-09-14T12:12:50.449191+0000","last_peered":"2024-09-14T12:12:50.449191+0000","last_clean":"2024-09-14T12:12:50.449191+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:12:50.449191+0000","last_undegraded":"2024-09-14T12:12:50.449191+0000","last_fullsized":"2024-09-14T12:12:50.449191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:57.953759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:13.219327+0000","last_change":"2024-09-14T11:35:03.472256+0000","last_active":"2024-09-14T12:13:13.219327+0000","last_peered":"2024-09-14T12:13:13.219327+0000","last_clean":"2024-09-14T12:13:13.219327+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:13:13.219327+0000","last_undegraded":"2024-09-14T12:13:13.219327+0000","last_fullsized":"2024-09-14T12:13:13.219327+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.305722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.478594+0000","last_change":"2024-09-14T11:35:00.439672+0000","last_active":"2024-09-14T12:14:38.478594+0000","last_peered":"2024-09-14T12:14:38.478594+0000","last_clean":"2024-09-14T12:14:38.478594+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:14:38.478594+0000","last_undegraded":"2024-09-14T12:14:38.478594+0000","last_fullsized":"2024-09-14T12:14:38.478594+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:34:59.419693+0000","last_clean_scrub_stamp":"2024-09-14T11:34:59.419693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.658184+0000","last_change":"2024-09-14T12:16:56.658184+0000","last_active":"2024-09-14T12:16:56.658184+0000","last_peered":"2024-09-14T12:16:56.658184+0000","last_clean":"2024-09-14T12:16:56.658184+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:16:56.658184+0000","last_undegraded":"2024-09-14T12:16:56.658184+0000","last_fullsized":"2024-09-14T12:16:56.658184+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.658093+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:09.745831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:05.458152+0000","last_change":"2024-09-14T11:51:07.031010+0000","last_active":"2024-09-14T12:14:05.458152+0000","last_peered":"2024-09-14T12:14:05.458152+0000","last_clean":"2024-09-14T12:14:05.458152+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:14:05.458152+0000","last_undegraded":"2024-09-14T12:14:05.458152+0000","last_fullsized":"2024-09-14T12:14:05.458152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:09.135672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.462662+0000","last_change":"2024-09-14T12:16:54.462662+0000","last_active":"2024-09-14T12:16:54.462662+0000","last_peered":"2024-09-14T12:16:54.462662+0000","last_clean":"2024-09-14T12:16:54.462662+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:16:54.462662+0000","last_undegraded":"2024-09-14T12:16:54.462662+0000","last_fullsized":"2024-09-14T12:16:54.462662+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.462562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:19.119324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.022371+0000","last_change":"2024-09-14T12:16:51.022371+0000","last_active":"2024-09-14T12:16:51.022371+0000","last_peered":"2024-09-14T12:16:51.022371+0000","last_clean":"2024-09-14T12:16:51.022371+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:16:51.022371+0000","last_undegraded":"2024-09-14T12:16:51.022371+0000","last_fullsized":"2024-09-14T12:16:51.022371+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.022279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:56.027562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.485749+0000","last_change":"2024-09-14T12:16:46.485749+0000","last_active":"2024-09-14T12:16:46.485749+0000","last_peered":"2024-09-14T12:16:46.485749+0000","last_clean":"2024-09-14T12:16:46.485749+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:16:46.485749+0000","last_undegraded":"2024-09-14T12:16:46.485749+0000","last_fullsized":"2024-09-14T12:16:46.485749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.485637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:50.770891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:03.473207+0000","last_change":"2024-09-14T11:51:07.032497+0000","last_active":"2024-09-14T12:14:03.473207+0000","last_peered":"2024-09-14T12:14:03.473207+0000","last_clean":"2024-09-14T12:14:03.473207+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:14:03.473207+0000","last_undegraded":"2024-09-14T12:14:03.473207+0000","last_fullsized":"2024-09-14T12:14:03.473207+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:31.763310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:38.345977+0000","last_change":"2024-09-14T11:35:03.472806+0000","last_active":"2024-09-14T12:14:38.345977+0000","last_peered":"2024-09-14T12:14:38.345977+0000","last_clean":"2024-09-14T12:14:38.345977+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:14:38.345977+0000","last_undegraded":"2024-09-14T12:14:38.345977+0000","last_fullsized":"2024-09-14T12:14:38.345977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:35:02.447518+0000","last_clean_scrub_stamp":"2024-09-14T11:35:02.447518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.470151+0000","last_change":"2024-09-14T12:16:51.470151+0000","last_active":"2024-09-14T12:16:51.470151+0000","last_peered":"2024-09-14T12:16:51.470151+0000","last_clean":"2024-09-14T12:16:51.470151+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:16:51.470151+0000","last_undegraded":"2024-09-14T12:16:51.470151+0000","last_fullsized":"2024-09-14T12:16:51.470151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.470054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:40.419580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.213866+0000","last_change":"2024-09-14T12:16:56.213866+0000","last_active":"2024-09-14T12:16:56.213866+0000","last_peered":"2024-09-14T12:16:56.213866+0000","last_clean":"2024-09-14T12:16:56.213866+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:16:56.213866+0000","last_undegraded":"2024-09-14T12:16:56.213866+0000","last_fullsized":"2024-09-14T12:16:56.213866+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.213760+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.580078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'382","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.421319+0000","last_change":"2024-09-14T12:16:34.421319+0000","last_active":"2024-09-14T12:16:34.421319+0000","last_peered":"2024-09-14T12:16:34.421319+0000","last_clean":"2024-09-14T12:16:34.421319+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:16:34.421319+0000","last_undegraded":"2024-09-14T12:16:34.421319+0000","last_fullsized":"2024-09-14T12:16:34.421319+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.421201+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:14.328374+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":629,"num_read_kb":9737,"num_write":1248,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'481","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.932313+0000","last_change":"2024-09-14T12:16:37.932313+0000","last_active":"2024-09-14T12:16:37.932313+0000","last_peered":"2024-09-14T12:16:37.932313+0000","last_clean":"2024-09-14T12:16:37.932313+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:16:37.932313+0000","last_undegraded":"2024-09-14T12:16:37.932313+0000","last_fullsized":"2024-09-14T12:16:37.932313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.932203+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:41.524216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'342","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.075044+0000","last_change":"2024-09-14T12:16:24.075044+0000","last_active":"2024-09-14T12:16:24.075044+0000","last_peered":"2024-09-14T12:16:24.075044+0000","last_clean":"2024-09-14T12:16:24.075044+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:16:24.075044+0000","last_undegraded":"2024-09-14T12:16:24.075044+0000","last_fullsized":"2024-09-14T12:16:24.075044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.074907+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:57.224200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":22753,"num_write":1016,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.399657+0000","last_change":"2024-09-14T12:16:38.399657+0000","last_active":"2024-09-14T12:16:38.399657+0000","last_peered":"2024-09-14T12:16:38.399657+0000","last_clean":"2024-09-14T12:16:38.399657+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:16:38.399657+0000","last_undegraded":"2024-09-14T12:16:38.399657+0000","last_fullsized":"2024-09-14T12:16:38.399657+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.399570+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:31.558475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'369","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.917158+0000","last_change":"2024-09-14T12:16:27.917158+0000","last_active":"2024-09-14T12:16:27.917158+0000","last_peered":"2024-09-14T12:16:27.917158+0000","last_clean":"2024-09-14T12:16:27.917158+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:16:27.917158+0000","last_undegraded":"2024-09-14T12:16:27.917158+0000","last_fullsized":"2024-09-14T12:16:27.917158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.917052+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.304387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":8099,"num_write":1164,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'831","reported_seq":2484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.599551+0000","last_change":"2024-09-14T12:16:38.599551+0000","last_active":"2024-09-14T12:16:38.599551+0000","last_peered":"2024-09-14T12:16:38.599551+0000","last_clean":"2024-09-14T12:16:38.599551+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:16:38.599551+0000","last_undegraded":"2024-09-14T12:16:38.599551+0000","last_fullsized":"2024-09-14T12:16:38.599551+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.599465+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:41.116547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'398","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.842121+0000","last_change":"2024-09-14T12:16:30.842121+0000","last_active":"2024-09-14T12:16:30.842121+0000","last_peered":"2024-09-14T12:16:30.842121+0000","last_clean":"2024-09-14T12:16:30.842121+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:16:30.842121+0000","last_undegraded":"2024-09-14T12:16:30.842121+0000","last_fullsized":"2024-09-14T12:16:30.842121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.842017+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:52.781230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":69334,"num_write":1242,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'480","reported_seq":2211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.894365+0000","last_change":"2024-09-14T12:16:38.894365+0000","last_active":"2024-09-14T12:16:38.894365+0000","last_peered":"2024-09-14T12:16:38.894365+0000","last_clean":"2024-09-14T12:16:38.894365+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:16:38.894365+0000","last_undegraded":"2024-09-14T12:16:38.894365+0000","last_fullsized":"2024-09-14T12:16:38.894365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.894277+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:07.704197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'345","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.396720+0000","last_change":"2024-09-14T12:16:33.396720+0000","last_active":"2024-09-14T12:16:33.396720+0000","last_peered":"2024-09-14T12:16:33.396720+0000","last_clean":"2024-09-14T12:16:33.396720+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:16:33.396720+0000","last_undegraded":"2024-09-14T12:16:33.396720+0000","last_fullsized":"2024-09-14T12:16:33.396720+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.396612+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:50.383330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8504,"num_write":1105,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'931","reported_seq":2506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.470843+0000","last_change":"2024-09-14T12:16:33.470843+0000","last_active":"2024-09-14T12:16:33.470843+0000","last_peered":"2024-09-14T12:16:33.470843+0000","last_clean":"2024-09-14T12:16:33.470843+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:16:33.470843+0000","last_undegraded":"2024-09-14T12:16:33.470843+0000","last_fullsized":"2024-09-14T12:16:33.470843+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'931","last_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_deep_scrub":"263'931","last_deep_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.470747+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:53.569158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'339","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.824033+0000","last_change":"2024-09-14T12:16:29.824033+0000","last_active":"2024-09-14T12:16:29.824033+0000","last_peered":"2024-09-14T12:16:29.824033+0000","last_clean":"2024-09-14T12:16:29.824033+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:16:29.824033+0000","last_undegraded":"2024-09-14T12:16:29.824033+0000","last_fullsized":"2024-09-14T12:16:29.824033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.823921+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.850213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":13223,"num_write":1062,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'323","reported_seq":1686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.645228+0000","last_change":"2024-09-14T12:16:39.645228+0000","last_active":"2024-09-14T12:16:39.645228+0000","last_peered":"2024-09-14T12:16:39.645228+0000","last_clean":"2024-09-14T12:16:39.645228+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:16:39.645228+0000","last_undegraded":"2024-09-14T12:16:39.645228+0000","last_fullsized":"2024-09-14T12:16:39.645228+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.645135+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.959759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'337","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.350810+0000","last_change":"2024-09-14T12:16:32.350810+0000","last_active":"2024-09-14T12:16:32.350810+0000","last_peered":"2024-09-14T12:16:32.350810+0000","last_clean":"2024-09-14T12:16:32.350810+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:16:32.350810+0000","last_undegraded":"2024-09-14T12:16:32.350810+0000","last_fullsized":"2024-09-14T12:16:32.350810+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.350698+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.629745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":13115,"num_write":1013,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'407","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.868085+0000","last_change":"2024-09-14T12:16:39.868085+0000","last_active":"2024-09-14T12:16:39.868085+0000","last_peered":"2024-09-14T12:16:39.868085+0000","last_clean":"2024-09-14T12:16:39.868085+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:16:39.868085+0000","last_undegraded":"2024-09-14T12:16:39.868085+0000","last_fullsized":"2024-09-14T12:16:39.868085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.867997+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.305924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'358","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.244252+0000","last_change":"2024-09-14T12:16:28.244252+0000","last_active":"2024-09-14T12:16:28.244252+0000","last_peered":"2024-09-14T12:16:28.244252+0000","last_clean":"2024-09-14T12:16:28.244252+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:16:28.244252+0000","last_undegraded":"2024-09-14T12:16:28.244252+0000","last_fullsized":"2024-09-14T12:16:28.244252+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.244160+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.741764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":594,"num_read_kb":3517,"num_write":1114,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'929","reported_seq":2505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.227870+0000","last_change":"2024-09-14T12:16:29.227870+0000","last_active":"2024-09-14T12:16:29.227870+0000","last_peered":"2024-09-14T12:16:29.227870+0000","last_clean":"2024-09-14T12:16:29.227870+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:16:29.227870+0000","last_undegraded":"2024-09-14T12:16:29.227870+0000","last_fullsized":"2024-09-14T12:16:29.227870+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'929","last_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_deep_scrub":"263'929","last_deep_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.227765+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:23.885174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'888","reported_seq":2517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.593824+0000","last_change":"2024-09-14T12:16:36.593824+0000","last_active":"2024-09-14T12:16:36.593824+0000","last_peered":"2024-09-14T12:16:36.593824+0000","last_clean":"2024-09-14T12:16:36.593824+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:16:36.593824+0000","last_undegraded":"2024-09-14T12:16:36.593824+0000","last_fullsized":"2024-09-14T12:16:36.593824+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'888","last_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_deep_scrub":"263'888","last_deep_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.593729+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:47.300409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'374","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.359854+0000","last_change":"2024-09-14T12:16:31.359854+0000","last_active":"2024-09-14T12:16:31.359854+0000","last_peered":"2024-09-14T12:16:31.359854+0000","last_clean":"2024-09-14T12:16:31.359854+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:16:31.359854+0000","last_undegraded":"2024-09-14T12:16:31.359854+0000","last_fullsized":"2024-09-14T12:16:31.359854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'374","last_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_deep_scrub":"263'374","last_deep_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.359749+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:50.234169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":33506,"num_write":1216,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'724","reported_seq":2275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.385574+0000","last_change":"2024-09-14T12:16:37.385574+0000","last_active":"2024-09-14T12:16:37.385574+0000","last_peered":"2024-09-14T12:16:37.385574+0000","last_clean":"2024-09-14T12:16:37.385574+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:16:37.385574+0000","last_undegraded":"2024-09-14T12:16:37.385574+0000","last_fullsized":"2024-09-14T12:16:37.385574+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.385484+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:48.262117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'479","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402397+0000","last_change":"2024-09-14T12:16:28.402397+0000","last_active":"2024-09-14T12:16:28.402397+0000","last_peered":"2024-09-14T12:16:28.402397+0000","last_clean":"2024-09-14T12:16:28.402397+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:16:28.402397+0000","last_undegraded":"2024-09-14T12:16:28.402397+0000","last_fullsized":"2024-09-14T12:16:28.402397+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402248+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:10.326854+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":934,"num_read_kb":10641,"num_write":1221,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'768","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.917096+0000","last_change":"2024-09-14T12:16:34.917096+0000","last_active":"2024-09-14T12:16:34.917096+0000","last_peered":"2024-09-14T12:16:34.917096+0000","last_clean":"2024-09-14T12:16:34.917096+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:16:34.917096+0000","last_undegraded":"2024-09-14T12:16:34.917096+0000","last_fullsized":"2024-09-14T12:16:34.917096+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.917005+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.725565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2731,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'393","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.429189+0000","last_change":"2024-09-14T12:16:27.429189+0000","last_active":"2024-09-14T12:16:27.429189+0000","last_peered":"2024-09-14T12:16:27.429189+0000","last_clean":"2024-09-14T12:16:27.429189+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:16:27.429189+0000","last_undegraded":"2024-09-14T12:16:27.429189+0000","last_fullsized":"2024-09-14T12:16:27.429189+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.429104+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.207355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":671,"num_read_kb":6370,"num_write":1079,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.267509+0000","last_change":"2024-09-14T12:16:27.267509+0000","last_active":"2024-09-14T12:16:27.267509+0000","last_peered":"2024-09-14T12:16:27.267509+0000","last_clean":"2024-09-14T12:16:27.267509+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:16:27.267509+0000","last_undegraded":"2024-09-14T12:16:27.267509+0000","last_fullsized":"2024-09-14T12:16:27.267509+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'608","last_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_deep_scrub":"263'608","last_deep_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.267429+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'328","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.529800+0000","last_change":"2024-09-14T12:16:23.529800+0000","last_active":"2024-09-14T12:16:23.529800+0000","last_peered":"2024-09-14T12:16:23.529800+0000","last_clean":"2024-09-14T12:16:23.529800+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:16:23.529800+0000","last_undegraded":"2024-09-14T12:16:23.529800+0000","last_fullsized":"2024-09-14T12:16:23.529800+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.529693+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:47.093569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":17017,"num_write":957,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'904","reported_seq":2620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.232914+0000","last_change":"2024-09-14T12:16:30.232914+0000","last_active":"2024-09-14T12:16:30.232914+0000","last_peered":"2024-09-14T12:16:30.232914+0000","last_clean":"2024-09-14T12:16:30.232914+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:16:30.232914+0000","last_undegraded":"2024-09-14T12:16:30.232914+0000","last_fullsized":"2024-09-14T12:16:30.232914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'904","last_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_deep_scrub":"263'904","last_deep_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.232832+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:17.647079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.551085+0000","last_change":"2024-09-14T12:16:27.551085+0000","last_active":"2024-09-14T12:16:27.551085+0000","last_peered":"2024-09-14T12:16:27.551085+0000","last_clean":"2024-09-14T12:16:27.551085+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:16:27.551085+0000","last_undegraded":"2024-09-14T12:16:27.551085+0000","last_fullsized":"2024-09-14T12:16:27.551085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.551001+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:40.128897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":19406,"num_write":864,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1147","reported_seq":2706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.559648+0000","last_change":"2024-09-14T12:16:37.559648+0000","last_active":"2024-09-14T12:16:37.559648+0000","last_peered":"2024-09-14T12:16:37.559648+0000","last_clean":"2024-09-14T12:16:37.559648+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:16:37.559648+0000","last_undegraded":"2024-09-14T12:16:37.559648+0000","last_fullsized":"2024-09-14T12:16:37.559648+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1147","last_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_deep_scrub":"263'1147","last_deep_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.559541+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:26.343620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'342","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.928565+0000","last_change":"2024-09-14T12:16:26.928565+0000","last_active":"2024-09-14T12:16:26.928565+0000","last_peered":"2024-09-14T12:16:26.928565+0000","last_clean":"2024-09-14T12:16:26.928565+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:16:26.928565+0000","last_undegraded":"2024-09-14T12:16:26.928565+0000","last_fullsized":"2024-09-14T12:16:26.928565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.928480+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:10.385752+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":705,"num_read_kb":10760,"num_write":996,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'126","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.677663+0000","last_change":"2024-09-14T12:16:54.677663+0000","last_active":"2024-09-14T12:16:54.677663+0000","last_peered":"2024-09-14T12:16:54.677663+0000","last_clean":"2024-09-14T12:16:54.677663+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:16:54.677663+0000","last_undegraded":"2024-09-14T12:16:54.677663+0000","last_fullsized":"2024-09-14T12:16:54.677663+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.677580+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:34.005917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'525","reported_seq":2474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.537472+0000","last_change":"2024-09-14T12:16:30.537472+0000","last_active":"2024-09-14T12:16:30.537472+0000","last_peered":"2024-09-14T12:16:30.537472+0000","last_clean":"2024-09-14T12:16:30.537472+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:16:30.537472+0000","last_undegraded":"2024-09-14T12:16:30.537472+0000","last_fullsized":"2024-09-14T12:16:30.537472+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.537378+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:15.507796+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6633,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'294","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.359063+0000","last_change":"2024-09-14T12:16:30.359063+0000","last_active":"2024-09-14T12:16:30.359063+0000","last_peered":"2024-09-14T12:16:30.359063+0000","last_clean":"2024-09-14T12:16:30.359063+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:16:30.359063+0000","last_undegraded":"2024-09-14T12:16:30.359063+0000","last_fullsized":"2024-09-14T12:16:30.359063+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.358952+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:21.930313+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":3402,"num_write":873,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.860022+0000","last_change":"2024-09-14T12:16:41.860022+0000","last_active":"2024-09-14T12:16:41.860022+0000","last_peered":"2024-09-14T12:16:41.860022+0000","last_clean":"2024-09-14T12:16:41.860022+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:16:41.860022+0000","last_undegraded":"2024-09-14T12:16:41.860022+0000","last_fullsized":"2024-09-14T12:16:41.860022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.859933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:06.116453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'349","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.883151+0000","last_change":"2024-09-14T12:16:42.883151+0000","last_active":"2024-09-14T12:16:42.883151+0000","last_peered":"2024-09-14T12:16:42.883151+0000","last_clean":"2024-09-14T12:16:42.883151+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:16:42.883151+0000","last_undegraded":"2024-09-14T12:16:42.883151+0000","last_fullsized":"2024-09-14T12:16:42.883151+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.883082+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:19.400996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":1214,"num_write":454,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.302668+0000","last_change":"2024-09-14T12:16:52.302668+0000","last_active":"2024-09-14T12:16:52.302668+0000","last_peered":"2024-09-14T12:16:52.302668+0000","last_clean":"2024-09-14T12:16:52.302668+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:16:52.302668+0000","last_undegraded":"2024-09-14T12:16:52.302668+0000","last_fullsized":"2024-09-14T12:16:52.302668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.302584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:43.381958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'128","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.905972+0000","last_change":"2024-09-14T12:16:55.905972+0000","last_active":"2024-09-14T12:16:55.905972+0000","last_peered":"2024-09-14T12:16:55.905972+0000","last_clean":"2024-09-14T12:16:55.905972+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:16:55.905972+0000","last_undegraded":"2024-09-14T12:16:55.905972+0000","last_fullsized":"2024-09-14T12:16:55.905972+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.905879+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:00.503553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'408","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.893645+0000","last_change":"2024-09-14T12:16:35.893645+0000","last_active":"2024-09-14T12:16:35.893645+0000","last_peered":"2024-09-14T12:16:35.893645+0000","last_clean":"2024-09-14T12:16:35.893645+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:16:35.893645+0000","last_undegraded":"2024-09-14T12:16:35.893645+0000","last_fullsized":"2024-09-14T12:16:35.893645+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.893533+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:50.859418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'384","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:18.857599+0000","last_change":"2024-09-14T12:16:18.857599+0000","last_active":"2024-09-14T12:16:18.857599+0000","last_peered":"2024-09-14T12:16:18.857599+0000","last_clean":"2024-09-14T12:16:18.857599+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:16:18.857599+0000","last_undegraded":"2024-09-14T12:16:18.857599+0000","last_fullsized":"2024-09-14T12:16:18.857599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_clean_scrub_stamp":"2024-09-14T12:16:18.857499+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:10.889774+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":9438,"num_write":1138,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.549387+0000","last_change":"2024-09-14T12:16:41.549387+0000","last_active":"2024-09-14T12:16:41.549387+0000","last_peered":"2024-09-14T12:16:41.549387+0000","last_clean":"2024-09-14T12:16:41.549387+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:16:41.549387+0000","last_undegraded":"2024-09-14T12:16:41.549387+0000","last_fullsized":"2024-09-14T12:16:41.549387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.549287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:55.365473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.555911+0000","last_change":"2024-09-14T12:16:48.555911+0000","last_active":"2024-09-14T12:16:48.555911+0000","last_peered":"2024-09-14T12:16:48.555911+0000","last_clean":"2024-09-14T12:16:48.555911+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:16:48.555911+0000","last_undegraded":"2024-09-14T12:16:48.555911+0000","last_fullsized":"2024-09-14T12:16:48.555911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.555817+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:34.096081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.589732+0000","last_change":"2024-09-14T12:16:50.589732+0000","last_active":"2024-09-14T12:16:50.589732+0000","last_peered":"2024-09-14T12:16:50.589732+0000","last_clean":"2024-09-14T12:16:50.589732+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:16:50.589732+0000","last_undegraded":"2024-09-14T12:16:50.589732+0000","last_fullsized":"2024-09-14T12:16:50.589732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.589634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:28.546997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.107623+0000","last_change":"2024-09-14T12:16:54.107623+0000","last_active":"2024-09-14T12:16:54.107623+0000","last_peered":"2024-09-14T12:16:54.107623+0000","last_clean":"2024-09-14T12:16:54.107623+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:16:54.107623+0000","last_undegraded":"2024-09-14T12:16:54.107623+0000","last_fullsized":"2024-09-14T12:16:54.107623+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.107518+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:01.171946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'519","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.928397+0000","last_change":"2024-09-14T12:16:31.928397+0000","last_active":"2024-09-14T12:16:31.928397+0000","last_peered":"2024-09-14T12:16:31.928397+0000","last_clean":"2024-09-14T12:16:31.928397+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:16:31.928397+0000","last_undegraded":"2024-09-14T12:16:31.928397+0000","last_fullsized":"2024-09-14T12:16:31.928397+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.928310+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:24.464818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'451","reported_seq":1174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402865+0000","last_change":"2024-09-14T12:16:28.402865+0000","last_active":"2024-09-14T12:16:28.402865+0000","last_peered":"2024-09-14T12:16:28.402865+0000","last_clean":"2024-09-14T12:16:28.402865+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:16:28.402865+0000","last_undegraded":"2024-09-14T12:16:28.402865+0000","last_fullsized":"2024-09-14T12:16:28.402865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402734+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:14.475372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1029,"num_read_kb":13380,"num_write":1416,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.588891+0000","last_change":"2024-09-14T12:16:43.588891+0000","last_active":"2024-09-14T12:16:43.588891+0000","last_peered":"2024-09-14T12:16:43.588891+0000","last_clean":"2024-09-14T12:16:43.588891+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:16:43.588891+0000","last_undegraded":"2024-09-14T12:16:43.588891+0000","last_fullsized":"2024-09-14T12:16:43.588891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.588791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:40.236472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'120","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.190637+0000","last_change":"2024-09-14T12:16:36.190637+0000","last_active":"2024-09-14T12:16:36.190637+0000","last_peered":"2024-09-14T12:16:36.190637+0000","last_clean":"2024-09-14T12:16:36.190637+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:16:36.190637+0000","last_undegraded":"2024-09-14T12:16:36.190637+0000","last_fullsized":"2024-09-14T12:16:36.190637+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.190540+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:19.260626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'764","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.274685+0000","last_change":"2024-09-14T12:16:51.274685+0000","last_active":"2024-09-14T12:16:51.274685+0000","last_peered":"2024-09-14T12:16:51.274685+0000","last_clean":"2024-09-14T12:16:51.274685+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:16:51.274685+0000","last_undegraded":"2024-09-14T12:16:51.274685+0000","last_fullsized":"2024-09-14T12:16:51.274685+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'764","last_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_deep_scrub":"263'764","last_deep_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.274603+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:39.300185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'201","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.659882+0000","last_change":"2024-09-14T12:16:55.659882+0000","last_active":"2024-09-14T12:16:55.659882+0000","last_peered":"2024-09-14T12:16:55.659882+0000","last_clean":"2024-09-14T12:16:55.659882+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:16:55.659882+0000","last_undegraded":"2024-09-14T12:16:55.659882+0000","last_fullsized":"2024-09-14T12:16:55.659882+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.659760+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:36.216083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1037","reported_seq":2664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.534133+0000","last_change":"2024-09-14T12:16:31.534133+0000","last_active":"2024-09-14T12:16:31.534133+0000","last_peered":"2024-09-14T12:16:31.534133+0000","last_clean":"2024-09-14T12:16:31.534133+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:16:31.534133+0000","last_undegraded":"2024-09-14T12:16:31.534133+0000","last_fullsized":"2024-09-14T12:16:31.534133+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1037","last_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_deep_scrub":"263'1037","last_deep_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.534041+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:18.670329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'353","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.487007+0000","last_change":"2024-09-14T12:16:25.487007+0000","last_active":"2024-09-14T12:16:25.487007+0000","last_peered":"2024-09-14T12:16:25.487007+0000","last_clean":"2024-09-14T12:16:25.487007+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:16:25.487007+0000","last_undegraded":"2024-09-14T12:16:25.487007+0000","last_fullsized":"2024-09-14T12:16:25.487007+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.486896+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:43.830472+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":31887,"num_write":1106,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.909083+0000","last_change":"2024-09-14T12:16:43.909083+0000","last_active":"2024-09-14T12:16:43.909083+0000","last_peered":"2024-09-14T12:16:43.909083+0000","last_clean":"2024-09-14T12:16:43.909083+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:16:43.909083+0000","last_undegraded":"2024-09-14T12:16:43.909083+0000","last_fullsized":"2024-09-14T12:16:43.909083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.908989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:42.037972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'275","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.386812+0000","last_change":"2024-09-14T12:16:45.386812+0000","last_active":"2024-09-14T12:16:45.386812+0000","last_peered":"2024-09-14T12:16:45.386812+0000","last_clean":"2024-09-14T12:16:45.386812+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:16:45.386812+0000","last_undegraded":"2024-09-14T12:16:45.386812+0000","last_fullsized":"2024-09-14T12:16:45.386812+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.386711+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:51.799127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1100,"num_write":378,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'804","reported_seq":2965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.492291+0000","last_change":"2024-09-14T12:16:52.492291+0000","last_active":"2024-09-14T12:16:52.492291+0000","last_peered":"2024-09-14T12:16:52.492291+0000","last_clean":"2024-09-14T12:16:52.492291+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:16:52.492291+0000","last_undegraded":"2024-09-14T12:16:52.492291+0000","last_fullsized":"2024-09-14T12:16:52.492291+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.492206+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:03.160461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'783","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.907394+0000","last_change":"2024-09-14T12:16:33.907394+0000","last_active":"2024-09-14T12:16:33.907394+0000","last_peered":"2024-09-14T12:16:33.907394+0000","last_clean":"2024-09-14T12:16:33.907394+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:16:33.907394+0000","last_undegraded":"2024-09-14T12:16:33.907394+0000","last_fullsized":"2024-09-14T12:16:33.907394+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.907284+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:14.084827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'401","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.415684+0000","last_change":"2024-09-14T12:16:26.415684+0000","last_active":"2024-09-14T12:16:26.415684+0000","last_peered":"2024-09-14T12:16:26.415684+0000","last_clean":"2024-09-14T12:16:26.415684+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:16:26.415684+0000","last_undegraded":"2024-09-14T12:16:26.415684+0000","last_fullsized":"2024-09-14T12:16:26.415684+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.415569+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.364031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":683,"num_read_kb":56115,"num_write":1123,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.392134+0000","last_change":"2024-09-14T12:16:40.392134+0000","last_active":"2024-09-14T12:16:40.392134+0000","last_peered":"2024-09-14T12:16:40.392134+0000","last_clean":"2024-09-14T12:16:40.392134+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:16:40.392134+0000","last_undegraded":"2024-09-14T12:16:40.392134+0000","last_fullsized":"2024-09-14T12:16:40.392134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.392039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:46.721248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'363","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.958094+0000","last_change":"2024-09-14T12:16:46.958094+0000","last_active":"2024-09-14T12:16:46.958094+0000","last_peered":"2024-09-14T12:16:46.958094+0000","last_clean":"2024-09-14T12:16:46.958094+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:16:46.958094+0000","last_undegraded":"2024-09-14T12:16:46.958094+0000","last_fullsized":"2024-09-14T12:16:46.958094+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.957991+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.598522+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":1208,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.095966+0000","last_change":"2024-09-14T12:16:46.095966+0000","last_active":"2024-09-14T12:16:46.095966+0000","last_peered":"2024-09-14T12:16:46.095966+0000","last_clean":"2024-09-14T12:16:46.095966+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:16:46.095966+0000","last_undegraded":"2024-09-14T12:16:46.095966+0000","last_fullsized":"2024-09-14T12:16:46.095966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.095876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.747404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'552","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.997043+0000","last_change":"2024-09-14T12:16:51.997043+0000","last_active":"2024-09-14T12:16:51.997043+0000","last_peered":"2024-09-14T12:16:51.997043+0000","last_clean":"2024-09-14T12:16:51.997043+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:16:51.997043+0000","last_undegraded":"2024-09-14T12:16:51.997043+0000","last_fullsized":"2024-09-14T12:16:51.997043+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'552","last_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_deep_scrub":"263'552","last_deep_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.996944+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.908296+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'388","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.589366+0000","last_change":"2024-09-14T12:16:27.589366+0000","last_active":"2024-09-14T12:16:27.589366+0000","last_peered":"2024-09-14T12:16:27.589366+0000","last_clean":"2024-09-14T12:16:27.589366+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:16:27.589366+0000","last_undegraded":"2024-09-14T12:16:27.589366+0000","last_fullsized":"2024-09-14T12:16:27.589366+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.589279+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:02.284167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'393","reported_seq":1157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.373988+0000","last_change":"2024-09-14T12:16:27.373988+0000","last_active":"2024-09-14T12:16:27.373988+0000","last_peered":"2024-09-14T12:16:27.373988+0000","last_clean":"2024-09-14T12:16:27.373988+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:16:27.373988+0000","last_undegraded":"2024-09-14T12:16:27.373988+0000","last_fullsized":"2024-09-14T12:16:27.373988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.373835+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:53.729046+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079941,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1043,"num_read_kb":12713,"num_write":1259,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.264334+0000","last_change":"2024-09-14T12:16:32.264334+0000","last_active":"2024-09-14T12:16:32.264334+0000","last_peered":"2024-09-14T12:16:32.264334+0000","last_clean":"2024-09-14T12:16:32.264334+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:16:32.264334+0000","last_undegraded":"2024-09-14T12:16:32.264334+0000","last_fullsized":"2024-09-14T12:16:32.264334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:13.721660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'256","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.562418+0000","last_change":"2024-09-14T12:16:48.562418+0000","last_active":"2024-09-14T12:16:48.562418+0000","last_peered":"2024-09-14T12:16:48.562418+0000","last_clean":"2024-09-14T12:16:48.562418+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:16:48.562418+0000","last_undegraded":"2024-09-14T12:16:48.562418+0000","last_fullsized":"2024-09-14T12:16:48.562418+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.562275+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.348621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":973,"num_write":336,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:08.222209+0000","last_change":"2024-09-14T11:17:29.645664+0000","last_active":"2024-09-14T12:14:08.222209+0000","last_peered":"2024-09-14T12:14:08.222209+0000","last_clean":"2024-09-14T12:14:08.222209+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:14:08.222209+0000","last_undegraded":"2024-09-14T12:14:08.222209+0000","last_fullsized":"2024-09-14T12:14:08.222209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:28.616433+0000","last_clean_scrub_stamp":"2024-09-14T11:17:28.616433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:47.582709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2528","reported_seq":4372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.464633+0000","last_change":"2024-09-14T12:16:43.464633+0000","last_active":"2024-09-14T12:16:43.464633+0000","last_peered":"2024-09-14T12:16:43.464633+0000","last_clean":"2024-09-14T12:16:43.464633+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:16:43.464633+0000","last_undegraded":"2024-09-14T12:16:43.464633+0000","last_fullsized":"2024-09-14T12:16:43.464633+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.464554+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:41.993155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1158","reported_seq":2800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.464675+0000","last_change":"2024-09-14T12:16:30.464675+0000","last_active":"2024-09-14T12:16:30.464675+0000","last_peered":"2024-09-14T12:16:30.464675+0000","last_clean":"2024-09-14T12:16:30.464675+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:16:30.464675+0000","last_undegraded":"2024-09-14T12:16:30.464675+0000","last_fullsized":"2024-09-14T12:16:30.464675+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.464582+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:39.530289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'378","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.366637+0000","last_change":"2024-09-14T12:16:25.366637+0000","last_active":"2024-09-14T12:16:25.366637+0000","last_peered":"2024-09-14T12:16:25.366637+0000","last_clean":"2024-09-14T12:16:25.366637+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:16:25.366637+0000","last_undegraded":"2024-09-14T12:16:25.366637+0000","last_fullsized":"2024-09-14T12:16:25.366637+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.366516+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:07.861044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":648,"num_read_kb":71361,"num_write":1111,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.201858+0000","last_change":"2024-09-14T12:16:34.201858+0000","last_active":"2024-09-14T12:16:34.201858+0000","last_peered":"2024-09-14T12:16:34.201858+0000","last_clean":"2024-09-14T12:16:34.201858+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:16:34.201858+0000","last_undegraded":"2024-09-14T12:16:34.201858+0000","last_fullsized":"2024-09-14T12:16:34.201858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.201763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.946713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'315","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.398295+0000","last_change":"2024-09-14T12:16:46.398295+0000","last_active":"2024-09-14T12:16:46.398295+0000","last_peered":"2024-09-14T12:16:46.398295+0000","last_clean":"2024-09-14T12:16:46.398295+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:16:46.398295+0000","last_undegraded":"2024-09-14T12:16:46.398295+0000","last_fullsized":"2024-09-14T12:16:46.398295+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.398188+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:49.529445+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":517,"num_read_kb":1149,"num_write":414,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'797","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.995107+0000","last_change":"2024-09-14T12:16:47.995107+0000","last_active":"2024-09-14T12:16:47.995107+0000","last_peered":"2024-09-14T12:16:47.995107+0000","last_clean":"2024-09-14T12:16:47.995107+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:16:47.995107+0000","last_undegraded":"2024-09-14T12:16:47.995107+0000","last_fullsized":"2024-09-14T12:16:47.995107+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'797","last_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_deep_scrub":"263'797","last_deep_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.995029+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:26.627644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.129168+0000","last_change":"2024-09-14T12:16:53.129168+0000","last_active":"2024-09-14T12:16:53.129168+0000","last_peered":"2024-09-14T12:16:53.129168+0000","last_clean":"2024-09-14T12:16:53.129168+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:16:53.129168+0000","last_undegraded":"2024-09-14T12:16:53.129168+0000","last_fullsized":"2024-09-14T12:16:53.129168+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.129089+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:25.226244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'584","reported_seq":2161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.905808+0000","last_change":"2024-09-14T12:16:30.905808+0000","last_active":"2024-09-14T12:16:30.905808+0000","last_peered":"2024-09-14T12:16:30.905808+0000","last_clean":"2024-09-14T12:16:30.905808+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:16:30.905808+0000","last_undegraded":"2024-09-14T12:16:30.905808+0000","last_fullsized":"2024-09-14T12:16:30.905808+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'584","last_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_deep_scrub":"263'584","last_deep_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.905703+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:35.243549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":769,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'426","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.190429+0000","last_change":"2024-09-14T12:16:20.190380+0000","last_active":"2024-09-14T12:16:20.190429+0000","last_peered":"2024-09-14T12:16:20.190429+0000","last_clean":"2024-09-14T12:16:20.190429+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:16:20.190429+0000","last_undegraded":"2024-09-14T12:16:20.190429+0000","last_fullsized":"2024-09-14T12:16:20.190429+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.190319+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:02.075520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":58896,"num_write":1397,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.229371+0000","last_change":"2024-09-14T12:16:33.229371+0000","last_active":"2024-09-14T12:16:33.229371+0000","last_peered":"2024-09-14T12:16:33.229371+0000","last_clean":"2024-09-14T12:16:33.229371+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:16:33.229371+0000","last_undegraded":"2024-09-14T12:16:33.229371+0000","last_fullsized":"2024-09-14T12:16:33.229371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.229270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:28.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'493","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.926750+0000","last_change":"2024-09-14T12:16:41.926750+0000","last_active":"2024-09-14T12:16:41.926750+0000","last_peered":"2024-09-14T12:16:41.926750+0000","last_clean":"2024-09-14T12:16:41.926750+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:16:41.926750+0000","last_undegraded":"2024-09-14T12:16:41.926750+0000","last_fullsized":"2024-09-14T12:16:41.926750+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.926660+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:07.959468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94670,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":854,"num_read_kb":2046,"num_write":706,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.249723+0000","last_change":"2024-09-14T12:16:38.249723+0000","last_active":"2024-09-14T12:16:38.249723+0000","last_peered":"2024-09-14T12:16:38.249723+0000","last_clean":"2024-09-14T12:16:38.249723+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:16:38.249723+0000","last_undegraded":"2024-09-14T12:16:38.249723+0000","last_fullsized":"2024-09-14T12:16:38.249723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.249638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:30.373505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.053669+0000","last_change":"2024-09-14T12:16:47.053669+0000","last_active":"2024-09-14T12:16:47.053669+0000","last_peered":"2024-09-14T12:16:47.053669+0000","last_clean":"2024-09-14T12:16:47.053669+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:16:47.053669+0000","last_undegraded":"2024-09-14T12:16:47.053669+0000","last_fullsized":"2024-09-14T12:16:47.053669+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.053583+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:20.332007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'492","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.619063+0000","last_change":"2024-09-14T12:16:31.619063+0000","last_active":"2024-09-14T12:16:31.619063+0000","last_peered":"2024-09-14T12:16:31.619063+0000","last_clean":"2024-09-14T12:16:31.619063+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:16:31.619063+0000","last_undegraded":"2024-09-14T12:16:31.619063+0000","last_fullsized":"2024-09-14T12:16:31.619063+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'492","last_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_deep_scrub":"263'492","last_deep_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.618980+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.751585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'356","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.428532+0000","last_change":"2024-09-14T12:16:22.428532+0000","last_active":"2024-09-14T12:16:22.428532+0000","last_peered":"2024-09-14T12:16:22.428532+0000","last_clean":"2024-09-14T12:16:22.428532+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:16:22.428532+0000","last_undegraded":"2024-09-14T12:16:22.428532+0000","last_fullsized":"2024-09-14T12:16:22.428532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.428437+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:49.436320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":23428,"num_write":1121,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.152681+0000","last_change":"2024-09-14T12:16:35.152681+0000","last_active":"2024-09-14T12:16:35.152681+0000","last_peered":"2024-09-14T12:16:35.152681+0000","last_clean":"2024-09-14T12:16:35.152681+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:16:35.152681+0000","last_undegraded":"2024-09-14T12:16:35.152681+0000","last_fullsized":"2024-09-14T12:16:35.152681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.152591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:03.738990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'294","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.591487+0000","last_change":"2024-09-14T12:16:45.591487+0000","last_active":"2024-09-14T12:16:45.591487+0000","last_peered":"2024-09-14T12:16:45.591487+0000","last_clean":"2024-09-14T12:16:45.591487+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:16:45.591487+0000","last_undegraded":"2024-09-14T12:16:45.591487+0000","last_fullsized":"2024-09-14T12:16:45.591487+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.591348+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:31.602741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53607,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":516,"num_read_kb":1139,"num_write":462,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.034027+0000","last_change":"2024-09-14T12:16:49.034027+0000","last_active":"2024-09-14T12:16:49.034027+0000","last_peered":"2024-09-14T12:16:49.034027+0000","last_clean":"2024-09-14T12:16:49.034027+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:16:49.034027+0000","last_undegraded":"2024-09-14T12:16:49.034027+0000","last_fullsized":"2024-09-14T12:16:49.034027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.033929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:16.318566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'114","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.484733+0000","last_change":"2024-09-14T12:16:54.484733+0000","last_active":"2024-09-14T12:16:54.484733+0000","last_peered":"2024-09-14T12:16:54.484733+0000","last_clean":"2024-09-14T12:16:54.484733+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:16:54.484733+0000","last_undegraded":"2024-09-14T12:16:54.484733+0000","last_fullsized":"2024-09-14T12:16:54.484733+0000","mapping_epoch":35,"log_start":"263'101","ondisk_log_start":"263'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.484636+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":101,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:22.339169+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'543","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.579010+0000","last_change":"2024-09-14T12:16:25.579010+0000","last_active":"2024-09-14T12:16:25.579010+0000","last_peered":"2024-09-14T12:16:25.579010+0000","last_clean":"2024-09-14T12:16:25.579010+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:16:25.579010+0000","last_undegraded":"2024-09-14T12:16:25.579010+0000","last_fullsized":"2024-09-14T12:16:25.579010+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'543","last_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_deep_scrub":"263'543","last_deep_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.578907+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:02.855337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1110,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'412","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.444164+0000","last_change":"2024-09-14T12:16:22.444164+0000","last_active":"2024-09-14T12:16:22.444164+0000","last_peered":"2024-09-14T12:16:22.444164+0000","last_clean":"2024-09-14T12:16:22.444164+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:16:22.444164+0000","last_undegraded":"2024-09-14T12:16:22.444164+0000","last_fullsized":"2024-09-14T12:16:22.444164+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.444058+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:52.547807+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":761,"num_read_kb":21492,"num_write":1380,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.158786+0000","last_change":"2024-09-14T12:16:36.158786+0000","last_active":"2024-09-14T12:16:36.158786+0000","last_peered":"2024-09-14T12:16:36.158786+0000","last_clean":"2024-09-14T12:16:36.158786+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:16:36.158786+0000","last_undegraded":"2024-09-14T12:16:36.158786+0000","last_fullsized":"2024-09-14T12:16:36.158786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.158693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'312","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.241522+0000","last_change":"2024-09-14T12:16:40.241522+0000","last_active":"2024-09-14T12:16:40.241522+0000","last_peered":"2024-09-14T12:16:40.241522+0000","last_clean":"2024-09-14T12:16:40.241522+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:16:40.241522+0000","last_undegraded":"2024-09-14T12:16:40.241522+0000","last_fullsized":"2024-09-14T12:16:40.241522+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.241411+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:41.593606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":1085,"num_write":392,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'748","reported_seq":2443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.218331+0000","last_change":"2024-09-14T12:16:37.218331+0000","last_active":"2024-09-14T12:16:37.218331+0000","last_peered":"2024-09-14T12:16:37.218331+0000","last_clean":"2024-09-14T12:16:37.218331+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:16:37.218331+0000","last_undegraded":"2024-09-14T12:16:37.218331+0000","last_fullsized":"2024-09-14T12:16:37.218331+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.218240+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":701,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.806696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'186","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.145740+0000","last_change":"2024-09-14T12:16:43.145740+0000","last_active":"2024-09-14T12:16:43.145740+0000","last_peered":"2024-09-14T12:16:43.145740+0000","last_clean":"2024-09-14T12:16:43.145740+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:16:43.145740+0000","last_undegraded":"2024-09-14T12:16:43.145740+0000","last_fullsized":"2024-09-14T12:16:43.145740+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.145658+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:05.792206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'788","reported_seq":2327,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.550891+0000","last_change":"2024-09-14T12:16:24.550891+0000","last_active":"2024-09-14T12:16:24.550891+0000","last_peered":"2024-09-14T12:16:24.550891+0000","last_clean":"2024-09-14T12:16:24.550891+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:16:24.550891+0000","last_undegraded":"2024-09-14T12:16:24.550891+0000","last_fullsized":"2024-09-14T12:16:24.550891+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.550810+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:52.077298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.516595+0000","last_change":"2024-09-14T12:16:20.516595+0000","last_active":"2024-09-14T12:16:20.516595+0000","last_peered":"2024-09-14T12:16:20.516595+0000","last_clean":"2024-09-14T12:16:20.516595+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:16:20.516595+0000","last_undegraded":"2024-09-14T12:16:20.516595+0000","last_fullsized":"2024-09-14T12:16:20.516595+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.516495+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.683715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":54223,"num_write":971,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.906954+0000","last_change":"2024-09-14T12:16:42.906954+0000","last_active":"2024-09-14T12:16:42.906954+0000","last_peered":"2024-09-14T12:16:42.906954+0000","last_clean":"2024-09-14T12:16:42.906954+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:16:42.906954+0000","last_undegraded":"2024-09-14T12:16:42.906954+0000","last_fullsized":"2024-09-14T12:16:42.906954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.906839+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:05.333521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'89","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.625482+0000","last_change":"2024-09-14T12:16:44.625482+0000","last_active":"2024-09-14T12:16:44.625482+0000","last_peered":"2024-09-14T12:16:44.625482+0000","last_clean":"2024-09-14T12:16:44.625482+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:16:44.625482+0000","last_undegraded":"2024-09-14T12:16:44.625482+0000","last_fullsized":"2024-09-14T12:16:44.625482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.625381+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:00.052025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'782","reported_seq":2464,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.525981+0000","last_change":"2024-09-14T12:16:39.525981+0000","last_active":"2024-09-14T12:16:39.525981+0000","last_peered":"2024-09-14T12:16:39.525981+0000","last_clean":"2024-09-14T12:16:39.525981+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:16:39.525981+0000","last_undegraded":"2024-09-14T12:16:39.525981+0000","last_fullsized":"2024-09-14T12:16:39.525981+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.525886+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":702,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.113925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.659466+0000","last_change":"2024-09-14T12:16:52.659466+0000","last_active":"2024-09-14T12:16:52.659466+0000","last_peered":"2024-09-14T12:16:52.659466+0000","last_clean":"2024-09-14T12:16:52.659466+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:16:52.659466+0000","last_undegraded":"2024-09-14T12:16:52.659466+0000","last_fullsized":"2024-09-14T12:16:52.659466+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.659374+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.223342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'448","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.122847+0000","last_change":"2024-09-14T12:16:33.122847+0000","last_active":"2024-09-14T12:16:33.122847+0000","last_peered":"2024-09-14T12:16:33.122847+0000","last_clean":"2024-09-14T12:16:33.122847+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:16:33.122847+0000","last_undegraded":"2024-09-14T12:16:33.122847+0000","last_fullsized":"2024-09-14T12:16:33.122847+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.122743+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:16.368922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'335","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.471275+0000","last_change":"2024-09-14T12:16:23.471275+0000","last_active":"2024-09-14T12:16:23.471275+0000","last_peered":"2024-09-14T12:16:23.471275+0000","last_clean":"2024-09-14T12:16:23.471275+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:16:23.471275+0000","last_undegraded":"2024-09-14T12:16:23.471275+0000","last_fullsized":"2024-09-14T12:16:23.471275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.471155+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:57.341077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254166,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":11146,"num_write":1071,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.670140+0000","last_change":"2024-09-14T12:16:40.670140+0000","last_active":"2024-09-14T12:16:40.670140+0000","last_peered":"2024-09-14T12:16:40.670140+0000","last_clean":"2024-09-14T12:16:40.670140+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:16:40.670140+0000","last_undegraded":"2024-09-14T12:16:40.670140+0000","last_fullsized":"2024-09-14T12:16:40.670140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.670043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:21.707903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'372","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.966676+0000","last_change":"2024-09-14T12:16:47.966676+0000","last_active":"2024-09-14T12:16:47.966676+0000","last_peered":"2024-09-14T12:16:47.966676+0000","last_clean":"2024-09-14T12:16:47.966676+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:16:47.966676+0000","last_undegraded":"2024-09-14T12:16:47.966676+0000","last_fullsized":"2024-09-14T12:16:47.966676+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.966585+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:21.699551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":1225,"num_write":466,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.534552+0000","last_change":"2024-09-14T12:16:38.534552+0000","last_active":"2024-09-14T12:16:38.534552+0000","last_peered":"2024-09-14T12:16:38.534552+0000","last_clean":"2024-09-14T12:16:38.534552+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:16:38.534552+0000","last_undegraded":"2024-09-14T12:16:38.534552+0000","last_fullsized":"2024-09-14T12:16:38.534552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.534449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:17.580045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.038582+0000","last_change":"2024-09-14T12:16:50.038582+0000","last_active":"2024-09-14T12:16:50.038582+0000","last_peered":"2024-09-14T12:16:50.038582+0000","last_clean":"2024-09-14T12:16:50.038582+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:16:50.038582+0000","last_undegraded":"2024-09-14T12:16:50.038582+0000","last_fullsized":"2024-09-14T12:16:50.038582+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.038494+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.031187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'837","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.414190+0000","last_change":"2024-09-14T12:16:29.414190+0000","last_active":"2024-09-14T12:16:29.414190+0000","last_peered":"2024-09-14T12:16:29.414190+0000","last_clean":"2024-09-14T12:16:29.414190+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:16:29.414190+0000","last_undegraded":"2024-09-14T12:16:29.414190+0000","last_fullsized":"2024-09-14T12:16:29.414190+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'837","last_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_deep_scrub":"263'837","last_deep_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.414099+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:46.138941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.360268+0000","last_change":"2024-09-14T12:16:22.360268+0000","last_active":"2024-09-14T12:16:22.360268+0000","last_peered":"2024-09-14T12:16:22.360268+0000","last_clean":"2024-09-14T12:16:22.360268+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:16:22.360268+0000","last_undegraded":"2024-09-14T12:16:22.360268+0000","last_fullsized":"2024-09-14T12:16:22.360268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.360181+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.818652+0000","last_change":"2024-09-14T12:16:21.818652+0000","last_active":"2024-09-14T12:16:21.818652+0000","last_peered":"2024-09-14T12:16:21.818652+0000","last_clean":"2024-09-14T12:16:21.818652+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:16:21.818652+0000","last_undegraded":"2024-09-14T12:16:21.818652+0000","last_fullsized":"2024-09-14T12:16:21.818652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.818511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:14.072170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'359","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.414614+0000","last_change":"2024-09-14T12:16:20.414614+0000","last_active":"2024-09-14T12:16:20.414614+0000","last_peered":"2024-09-14T12:16:20.414614+0000","last_clean":"2024-09-14T12:16:20.414614+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:16:20.414614+0000","last_undegraded":"2024-09-14T12:16:20.414614+0000","last_fullsized":"2024-09-14T12:16:20.414614+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.414538+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:37.794945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":16922,"num_write":1091,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.408905+0000","last_change":"2024-09-14T12:16:39.408905+0000","last_active":"2024-09-14T12:16:39.408905+0000","last_peered":"2024-09-14T12:16:39.408905+0000","last_clean":"2024-09-14T12:16:39.408905+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:16:39.408905+0000","last_undegraded":"2024-09-14T12:16:39.408905+0000","last_fullsized":"2024-09-14T12:16:39.408905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.408812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:14.037956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'768","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.907046+0000","last_change":"2024-09-14T12:16:45.907046+0000","last_active":"2024-09-14T12:16:45.907046+0000","last_peered":"2024-09-14T12:16:45.907046+0000","last_clean":"2024-09-14T12:16:45.907046+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:16:45.907046+0000","last_undegraded":"2024-09-14T12:16:45.907046+0000","last_fullsized":"2024-09-14T12:16:45.907046+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.906955+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.165111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143710,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1487,"num_read_kb":3441,"num_write":1400,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89202,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.939891+0000","last_change":"2024-09-14T12:16:45.939891+0000","last_active":"2024-09-14T12:16:45.939891+0000","last_peered":"2024-09-14T12:16:45.939891+0000","last_clean":"2024-09-14T12:16:45.939891+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:16:45.939891+0000","last_undegraded":"2024-09-14T12:16:45.939891+0000","last_fullsized":"2024-09-14T12:16:45.939891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.939787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:47.502672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'172","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.447039+0000","last_change":"2024-09-14T12:16:45.447039+0000","last_active":"2024-09-14T12:16:45.447039+0000","last_peered":"2024-09-14T12:16:45.447039+0000","last_clean":"2024-09-14T12:16:45.447039+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:16:45.447039+0000","last_undegraded":"2024-09-14T12:16:45.447039+0000","last_fullsized":"2024-09-14T12:16:45.447039+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.446945+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:23.013556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'460","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.938707+0000","last_change":"2024-09-14T12:16:29.938707+0000","last_active":"2024-09-14T12:16:29.938707+0000","last_peered":"2024-09-14T12:16:29.938707+0000","last_clean":"2024-09-14T12:16:29.938707+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:16:29.938707+0000","last_undegraded":"2024-09-14T12:16:29.938707+0000","last_fullsized":"2024-09-14T12:16:29.938707+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.938619+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:25.975325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.365217+0000","last_change":"2024-09-14T12:16:23.365217+0000","last_active":"2024-09-14T12:16:23.365217+0000","last_peered":"2024-09-14T12:16:23.365217+0000","last_clean":"2024-09-14T12:16:23.365217+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:16:23.365217+0000","last_undegraded":"2024-09-14T12:16:23.365217+0000","last_fullsized":"2024-09-14T12:16:23.365217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.365091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.254811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'385","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.868893+0000","last_change":"2024-09-14T12:16:19.868893+0000","last_active":"2024-09-14T12:16:19.868893+0000","last_peered":"2024-09-14T12:16:19.868893+0000","last_clean":"2024-09-14T12:16:19.868893+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:16:19.868893+0000","last_undegraded":"2024-09-14T12:16:19.868893+0000","last_fullsized":"2024-09-14T12:16:19.868893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.868790+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.225391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":9086,"num_write":1281,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.832305+0000","last_change":"2024-09-14T12:16:40.832305+0000","last_active":"2024-09-14T12:16:40.832305+0000","last_peered":"2024-09-14T12:16:40.832305+0000","last_clean":"2024-09-14T12:16:40.832305+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:16:40.832305+0000","last_undegraded":"2024-09-14T12:16:40.832305+0000","last_fullsized":"2024-09-14T12:16:40.832305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.832190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.850016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1313","reported_seq":2959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.186119+0000","last_change":"2024-09-14T12:16:40.186119+0000","last_active":"2024-09-14T12:16:40.186119+0000","last_peered":"2024-09-14T12:16:40.186119+0000","last_clean":"2024-09-14T12:16:40.186119+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:40.186119+0000","last_undegraded":"2024-09-14T12:16:40.186119+0000","last_fullsized":"2024-09-14T12:16:40.186119+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1313","last_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_deep_scrub":"263'1313","last_deep_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.186008+0000","objects_scrubbed":12,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:59.234504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235088,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2047,"num_read_kb":3984,"num_write":1154,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.309899+0000","last_change":"2024-09-14T12:16:49.309899+0000","last_active":"2024-09-14T12:16:49.309899+0000","last_peered":"2024-09-14T12:16:49.309899+0000","last_clean":"2024-09-14T12:16:49.309899+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:16:49.309899+0000","last_undegraded":"2024-09-14T12:16:49.309899+0000","last_fullsized":"2024-09-14T12:16:49.309899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.309809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:41.869846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'218","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.081317+0000","last_change":"2024-09-14T12:16:48.081317+0000","last_active":"2024-09-14T12:16:48.081317+0000","last_peered":"2024-09-14T12:16:48.081317+0000","last_clean":"2024-09-14T12:16:48.081317+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:16:48.081317+0000","last_undegraded":"2024-09-14T12:16:48.081317+0000","last_fullsized":"2024-09-14T12:16:48.081317+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.081221+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.106916+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'658","reported_seq":2314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.055652+0000","last_change":"2024-09-14T12:16:30.055652+0000","last_active":"2024-09-14T12:16:30.055652+0000","last_peered":"2024-09-14T12:16:30.055652+0000","last_clean":"2024-09-14T12:16:30.055652+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:16:30.055652+0000","last_undegraded":"2024-09-14T12:16:30.055652+0000","last_fullsized":"2024-09-14T12:16:30.055652+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'658","last_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_deep_scrub":"263'658","last_deep_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.055562+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:55.630653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.219556+0000","last_change":"2024-09-14T12:16:22.219556+0000","last_active":"2024-09-14T12:16:22.219556+0000","last_peered":"2024-09-14T12:16:22.219556+0000","last_clean":"2024-09-14T12:16:22.219556+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:16:22.219556+0000","last_undegraded":"2024-09-14T12:16:22.219556+0000","last_fullsized":"2024-09-14T12:16:22.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.219484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:41.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'369","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.058930+0000","last_change":"2024-09-14T12:16:23.058930+0000","last_active":"2024-09-14T12:16:23.058930+0000","last_peered":"2024-09-14T12:16:23.058930+0000","last_clean":"2024-09-14T12:16:23.058930+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:16:23.058930+0000","last_undegraded":"2024-09-14T12:16:23.058930+0000","last_fullsized":"2024-09-14T12:16:23.058930+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.058848+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:55.317203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":678,"num_read_kb":56413,"num_write":1142,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.272785+0000","last_change":"2024-09-14T12:16:31.272785+0000","last_active":"2024-09-14T12:16:31.272785+0000","last_peered":"2024-09-14T12:16:31.272785+0000","last_clean":"2024-09-14T12:16:31.272785+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:16:31.272785+0000","last_undegraded":"2024-09-14T12:16:31.272785+0000","last_fullsized":"2024-09-14T12:16:31.272785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.272700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:53.072319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'267","reported_seq":1520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.415445+0000","last_change":"2024-09-14T12:16:44.415445+0000","last_active":"2024-09-14T12:16:44.415445+0000","last_peered":"2024-09-14T12:16:44.415445+0000","last_clean":"2024-09-14T12:16:44.415445+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:16:44.415445+0000","last_undegraded":"2024-09-14T12:16:44.415445+0000","last_fullsized":"2024-09-14T12:16:44.415445+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.415344+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:52.267747+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.890170+0000","last_change":"2024-09-14T12:16:44.890170+0000","last_active":"2024-09-14T12:16:44.890170+0000","last_peered":"2024-09-14T12:16:44.890170+0000","last_clean":"2024-09-14T12:16:44.890170+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:16:44.890170+0000","last_undegraded":"2024-09-14T12:16:44.890170+0000","last_fullsized":"2024-09-14T12:16:44.890170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.890089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:11.036712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'258","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.877384+0000","last_change":"2024-09-14T11:17:31.662477+0000","last_active":"2024-09-14T12:14:34.877384+0000","last_peered":"2024-09-14T12:14:34.877384+0000","last_clean":"2024-09-14T12:14:34.877384+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:14:34.877384+0000","last_undegraded":"2024-09-14T12:14:34.877384+0000","last_fullsized":"2024-09-14T12:14:34.877384+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:16.277053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'799","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.067463+0000","last_change":"2024-09-14T12:16:26.067463+0000","last_active":"2024-09-14T12:16:26.067463+0000","last_peered":"2024-09-14T12:16:26.067463+0000","last_clean":"2024-09-14T12:16:26.067463+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:16:26.067463+0000","last_undegraded":"2024-09-14T12:16:26.067463+0000","last_fullsized":"2024-09-14T12:16:26.067463+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.067346+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:40.289749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.828188+0000","last_change":"2024-09-14T12:16:20.828188+0000","last_active":"2024-09-14T12:16:20.828188+0000","last_peered":"2024-09-14T12:16:20.828188+0000","last_clean":"2024-09-14T12:16:20.828188+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:16:20.828188+0000","last_undegraded":"2024-09-14T12:16:20.828188+0000","last_fullsized":"2024-09-14T12:16:20.828188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.828073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:36.232253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'428","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.205035+0000","last_change":"2024-09-14T12:16:23.205035+0000","last_active":"2024-09-14T12:16:23.205035+0000","last_peered":"2024-09-14T12:16:23.205035+0000","last_clean":"2024-09-14T12:16:23.205035+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:16:23.205035+0000","last_undegraded":"2024-09-14T12:16:23.205035+0000","last_fullsized":"2024-09-14T12:16:23.205035+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.204951+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:51.476005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":100618,"num_write":1363,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"263'4","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.885003+0000","last_change":"2024-09-14T12:16:36.885003+0000","last_active":"2024-09-14T12:16:36.885003+0000","last_peered":"2024-09-14T12:16:36.885003+0000","last_clean":"2024-09-14T12:16:36.885003+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:16:36.885003+0000","last_undegraded":"2024-09-14T12:16:36.885003+0000","last_fullsized":"2024-09-14T12:16:36.885003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.884909+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:15.222253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":727,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'148","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.593588+0000","last_change":"2024-09-14T12:16:46.593588+0000","last_active":"2024-09-14T12:16:46.593588+0000","last_peered":"2024-09-14T12:16:46.593588+0000","last_clean":"2024-09-14T12:16:46.593588+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:16:46.593588+0000","last_undegraded":"2024-09-14T12:16:46.593588+0000","last_fullsized":"2024-09-14T12:16:46.593588+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.593480+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:01.417091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.529888+0000","last_change":"2024-09-14T12:16:37.529888+0000","last_active":"2024-09-14T12:16:37.529888+0000","last_peered":"2024-09-14T12:16:37.529888+0000","last_clean":"2024-09-14T12:16:37.529888+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:16:37.529888+0000","last_undegraded":"2024-09-14T12:16:37.529888+0000","last_fullsized":"2024-09-14T12:16:37.529888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.529798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:43.161355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'154","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.949519+0000","last_change":"2024-09-14T12:16:52.949519+0000","last_active":"2024-09-14T12:16:52.949519+0000","last_peered":"2024-09-14T12:16:52.949519+0000","last_clean":"2024-09-14T12:16:52.949519+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:16:52.949519+0000","last_undegraded":"2024-09-14T12:16:52.949519+0000","last_fullsized":"2024-09-14T12:16:52.949519+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.949406+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:56.125512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'541","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.067347+0000","last_change":"2024-09-14T12:16:25.067347+0000","last_active":"2024-09-14T12:16:25.067347+0000","last_peered":"2024-09-14T12:16:25.067347+0000","last_clean":"2024-09-14T12:16:25.067347+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:16:25.067347+0000","last_undegraded":"2024-09-14T12:16:25.067347+0000","last_fullsized":"2024-09-14T12:16:25.067347+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.067268+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:52.957237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'376","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.831672+0000","last_change":"2024-09-14T12:16:22.831672+0000","last_active":"2024-09-14T12:16:22.831672+0000","last_peered":"2024-09-14T12:16:22.831672+0000","last_clean":"2024-09-14T12:16:22.831672+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:16:22.831672+0000","last_undegraded":"2024-09-14T12:16:22.831672+0000","last_fullsized":"2024-09-14T12:16:22.831672+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.831568+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:25.922575+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":15898,"num_write":1178,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.046268+0000","last_change":"2024-09-14T12:16:21.046268+0000","last_active":"2024-09-14T12:16:21.046268+0000","last_peered":"2024-09-14T12:16:21.046268+0000","last_clean":"2024-09-14T12:16:21.046268+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:16:21.046268+0000","last_undegraded":"2024-09-14T12:16:21.046268+0000","last_fullsized":"2024-09-14T12:16:21.046268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.046203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:19.507992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.917486+0000","last_change":"2024-09-14T12:16:39.917486+0000","last_active":"2024-09-14T12:16:39.917486+0000","last_peered":"2024-09-14T12:16:39.917486+0000","last_clean":"2024-09-14T12:16:39.917486+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:16:39.917486+0000","last_undegraded":"2024-09-14T12:16:39.917486+0000","last_fullsized":"2024-09-14T12:16:39.917486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.917368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:02.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'604","reported_seq":1284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.886334+0000","last_change":"2024-09-14T12:16:40.886334+0000","last_active":"2024-09-14T12:16:40.886334+0000","last_peered":"2024-09-14T12:16:40.886334+0000","last_clean":"2024-09-14T12:16:40.886334+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:16:40.886334+0000","last_undegraded":"2024-09-14T12:16:40.886334+0000","last_fullsized":"2024-09-14T12:16:40.886334+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'604","last_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_deep_scrub":"263'604","last_deep_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.886241+0000","objects_scrubbed":10,"log_size":104,"log_dups_size":500,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:15.346475+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94377,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1665,"num_read_kb":2783,"num_write":2218,"num_write_kb":2033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537284,"num_omap_keys":1216,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.573449+0000","last_change":"2024-09-14T12:16:49.573449+0000","last_active":"2024-09-14T12:16:49.573449+0000","last_peered":"2024-09-14T12:16:49.573449+0000","last_clean":"2024-09-14T12:16:49.573449+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:16:49.573449+0000","last_undegraded":"2024-09-14T12:16:49.573449+0000","last_fullsized":"2024-09-14T12:16:49.573449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.573330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:10.996167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.144806+0000","last_change":"2024-09-14T12:16:55.144806+0000","last_active":"2024-09-14T12:16:55.144806+0000","last_peered":"2024-09-14T12:16:55.144806+0000","last_clean":"2024-09-14T12:16:55.144806+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:16:55.144806+0000","last_undegraded":"2024-09-14T12:16:55.144806+0000","last_fullsized":"2024-09-14T12:16:55.144806+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.144697+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:13.488584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'817","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.948833+0000","last_change":"2024-09-14T12:16:28.948833+0000","last_active":"2024-09-14T12:16:28.948833+0000","last_peered":"2024-09-14T12:16:28.948833+0000","last_clean":"2024-09-14T12:16:28.948833+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:16:28.948833+0000","last_undegraded":"2024-09-14T12:16:28.948833+0000","last_fullsized":"2024-09-14T12:16:28.948833+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.948726+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:45.026434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'370","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.036275+0000","last_change":"2024-09-14T12:16:20.036275+0000","last_active":"2024-09-14T12:16:20.036275+0000","last_peered":"2024-09-14T12:16:20.036275+0000","last_clean":"2024-09-14T12:16:20.036275+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:16:20.036275+0000","last_undegraded":"2024-09-14T12:16:20.036275+0000","last_fullsized":"2024-09-14T12:16:20.036275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.036170+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.821484+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159837,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":790,"num_read_kb":26393,"num_write":1261,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.388449+0000","last_change":"2024-09-14T12:16:24.388449+0000","last_active":"2024-09-14T12:16:24.388449+0000","last_peered":"2024-09-14T12:16:24.388449+0000","last_clean":"2024-09-14T12:16:24.388449+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:16:24.388449+0000","last_undegraded":"2024-09-14T12:16:24.388449+0000","last_fullsized":"2024-09-14T12:16:24.388449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.388360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:24.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.511200+0000","last_change":"2024-09-14T12:16:34.511200+0000","last_active":"2024-09-14T12:16:34.511200+0000","last_peered":"2024-09-14T12:16:34.511200+0000","last_clean":"2024-09-14T12:16:34.511200+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:16:34.511200+0000","last_undegraded":"2024-09-14T12:16:34.511200+0000","last_fullsized":"2024-09-14T12:16:34.511200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.511111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:08.764095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'170","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.152901+0000","last_change":"2024-09-14T12:16:41.152901+0000","last_active":"2024-09-14T12:16:41.152901+0000","last_peered":"2024-09-14T12:16:41.152901+0000","last_clean":"2024-09-14T12:16:41.152901+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:16:41.152901+0000","last_undegraded":"2024-09-14T12:16:41.152901+0000","last_fullsized":"2024-09-14T12:16:41.152901+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.152803+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:51.429920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'814","reported_seq":6820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.987827+0000","last_change":"2024-09-14T12:16:49.987827+0000","last_active":"2024-09-14T12:16:49.987827+0000","last_peered":"2024-09-14T12:16:49.987827+0000","last_clean":"2024-09-14T12:16:49.987827+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:16:49.987827+0000","last_undegraded":"2024-09-14T12:16:49.987827+0000","last_fullsized":"2024-09-14T12:16:49.987827+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.987737+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:21.547053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.486856+0000","last_change":"2024-09-14T12:16:55.486856+0000","last_active":"2024-09-14T12:16:55.486856+0000","last_peered":"2024-09-14T12:16:55.486856+0000","last_clean":"2024-09-14T12:16:55.486856+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:16:55.486856+0000","last_undegraded":"2024-09-14T12:16:55.486856+0000","last_fullsized":"2024-09-14T12:16:55.486856+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.486751+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:56.365995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1162","reported_seq":2666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.564857+0000","last_change":"2024-09-14T12:16:32.564857+0000","last_active":"2024-09-14T12:16:32.564857+0000","last_peered":"2024-09-14T12:16:32.564857+0000","last_clean":"2024-09-14T12:16:32.564857+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:16:32.564857+0000","last_undegraded":"2024-09-14T12:16:32.564857+0000","last_fullsized":"2024-09-14T12:16:32.564857+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1162","last_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_deep_scrub":"263'1162","last_deep_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.564750+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.939513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.380483+0000","last_change":"2024-09-14T12:16:21.380483+0000","last_active":"2024-09-14T12:16:21.380483+0000","last_peered":"2024-09-14T12:16:21.380483+0000","last_clean":"2024-09-14T12:16:21.380483+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:16:21.380483+0000","last_undegraded":"2024-09-14T12:16:21.380483+0000","last_fullsized":"2024-09-14T12:16:21.380483+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.380404+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:16.067361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":24953,"num_write":917,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.057317+0000","last_change":"2024-09-14T12:16:19.057317+0000","last_active":"2024-09-14T12:16:19.057317+0000","last_peered":"2024-09-14T12:16:19.057317+0000","last_clean":"2024-09-14T12:16:19.057317+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:16:19.057317+0000","last_undegraded":"2024-09-14T12:16:19.057317+0000","last_fullsized":"2024-09-14T12:16:19.057317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.057236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:56.674413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.626832+0000","last_change":"2024-09-14T12:16:41.626832+0000","last_active":"2024-09-14T12:16:41.626832+0000","last_peered":"2024-09-14T12:16:41.626832+0000","last_clean":"2024-09-14T12:16:41.626832+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:16:41.626832+0000","last_undegraded":"2024-09-14T12:16:41.626832+0000","last_fullsized":"2024-09-14T12:16:41.626832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.626734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:08.346841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'117","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.595797+0000","last_change":"2024-09-14T12:16:44.595797+0000","last_active":"2024-09-14T12:16:44.595797+0000","last_peered":"2024-09-14T12:16:44.595797+0000","last_clean":"2024-09-14T12:16:44.595797+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:16:44.595797+0000","last_undegraded":"2024-09-14T12:16:44.595797+0000","last_fullsized":"2024-09-14T12:16:44.595797+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.595693+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.936891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.514247+0000","last_change":"2024-09-14T12:16:56.514247+0000","last_active":"2024-09-14T12:16:56.514247+0000","last_peered":"2024-09-14T12:16:56.514247+0000","last_clean":"2024-09-14T12:16:56.514247+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:16:56.514247+0000","last_undegraded":"2024-09-14T12:16:56.514247+0000","last_fullsized":"2024-09-14T12:16:56.514247+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.514137+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.995492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.088408+0000","last_change":"2024-09-14T12:16:57.088408+0000","last_active":"2024-09-14T12:16:57.088408+0000","last_peered":"2024-09-14T12:16:57.088408+0000","last_clean":"2024-09-14T12:16:57.088408+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:16:57.088408+0000","last_undegraded":"2024-09-14T12:16:57.088408+0000","last_fullsized":"2024-09-14T12:16:57.088408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.088257+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:44.271140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2360,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.613914+0000","last_change":"2024-09-14T12:16:30.613914+0000","last_active":"2024-09-14T12:16:30.613914+0000","last_peered":"2024-09-14T12:16:30.613914+0000","last_clean":"2024-09-14T12:16:30.613914+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:16:30.613914+0000","last_undegraded":"2024-09-14T12:16:30.613914+0000","last_fullsized":"2024-09-14T12:16:30.613914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'873","last_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_deep_scrub":"263'873","last_deep_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.613828+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:47.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'407","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.862986+0000","last_change":"2024-09-14T12:16:20.862986+0000","last_active":"2024-09-14T12:16:20.862986+0000","last_peered":"2024-09-14T12:16:20.862986+0000","last_clean":"2024-09-14T12:16:20.862986+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:16:20.862986+0000","last_undegraded":"2024-09-14T12:16:20.862986+0000","last_fullsized":"2024-09-14T12:16:20.862986+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.862919+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:17.038200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":7690,"num_write":1106,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.452659+0000","last_change":"2024-09-14T12:16:21.452659+0000","last_active":"2024-09-14T12:16:21.452659+0000","last_peered":"2024-09-14T12:16:21.452659+0000","last_clean":"2024-09-14T12:16:21.452659+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:16:21.452659+0000","last_undegraded":"2024-09-14T12:16:21.452659+0000","last_fullsized":"2024-09-14T12:16:21.452659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.452570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:20.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.587319+0000","last_change":"2024-09-14T12:16:40.587319+0000","last_active":"2024-09-14T12:16:40.587319+0000","last_peered":"2024-09-14T12:16:40.587319+0000","last_clean":"2024-09-14T12:16:40.587319+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:16:40.587319+0000","last_undegraded":"2024-09-14T12:16:40.587319+0000","last_fullsized":"2024-09-14T12:16:40.587319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.587220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:50.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'724","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.390623+0000","last_change":"2024-09-14T12:16:43.390623+0000","last_active":"2024-09-14T12:16:43.390623+0000","last_peered":"2024-09-14T12:16:43.390623+0000","last_clean":"2024-09-14T12:16:43.390623+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:16:43.390623+0000","last_undegraded":"2024-09-14T12:16:43.390623+0000","last_fullsized":"2024-09-14T12:16:43.390623+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.390516+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:55.678494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149203,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1276,"num_read_kb":2979,"num_write":1030,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.547127+0000","last_change":"2024-09-14T12:16:50.547127+0000","last_active":"2024-09-14T12:16:50.547127+0000","last_peered":"2024-09-14T12:16:50.547127+0000","last_clean":"2024-09-14T12:16:50.547127+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:16:50.547127+0000","last_undegraded":"2024-09-14T12:16:50.547127+0000","last_fullsized":"2024-09-14T12:16:50.547127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.547030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:37.215198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'118","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.911032+0000","last_change":"2024-09-14T12:16:53.911032+0000","last_active":"2024-09-14T12:16:53.911032+0000","last_peered":"2024-09-14T12:16:53.911032+0000","last_clean":"2024-09-14T12:16:53.911032+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:16:53.911032+0000","last_undegraded":"2024-09-14T12:16:53.911032+0000","last_fullsized":"2024-09-14T12:16:53.911032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.910928+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:38.507193+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'155","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.121007+0000","last_change":"2024-09-14T12:16:58.121007+0000","last_active":"2024-09-14T12:16:58.121007+0000","last_peered":"2024-09-14T12:16:58.121007+0000","last_clean":"2024-09-14T12:16:58.121007+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:16:58.121007+0000","last_undegraded":"2024-09-14T12:16:58.121007+0000","last_fullsized":"2024-09-14T12:16:58.121007+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.120916+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:20.789699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'378","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.578669+0000","last_change":"2024-09-14T12:16:26.578669+0000","last_active":"2024-09-14T12:16:26.578669+0000","last_peered":"2024-09-14T12:16:26.578669+0000","last_clean":"2024-09-14T12:16:26.578669+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:16:26.578669+0000","last_undegraded":"2024-09-14T12:16:26.578669+0000","last_fullsized":"2024-09-14T12:16:26.578669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.578576+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:26.873670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'334","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.549518+0000","last_change":"2024-09-14T12:16:21.549518+0000","last_active":"2024-09-14T12:16:21.549518+0000","last_peered":"2024-09-14T12:16:21.549518+0000","last_clean":"2024-09-14T12:16:21.549518+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:16:21.549518+0000","last_undegraded":"2024-09-14T12:16:21.549518+0000","last_fullsized":"2024-09-14T12:16:21.549518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.549418+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:07.371079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":681,"num_read_kb":30194,"num_write":1111,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.196236+0000","last_change":"2024-09-14T12:16:37.196236+0000","last_active":"2024-09-14T12:16:37.196236+0000","last_peered":"2024-09-14T12:16:37.196236+0000","last_clean":"2024-09-14T12:16:37.196236+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:16:37.196236+0000","last_undegraded":"2024-09-14T12:16:37.196236+0000","last_fullsized":"2024-09-14T12:16:37.196236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.196124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:44.046644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.627395+0000","last_change":"2024-09-14T12:16:45.627395+0000","last_active":"2024-09-14T12:16:45.627395+0000","last_peered":"2024-09-14T12:16:45.627395+0000","last_clean":"2024-09-14T12:16:45.627395+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:16:45.627395+0000","last_undegraded":"2024-09-14T12:16:45.627395+0000","last_fullsized":"2024-09-14T12:16:45.627395+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.627286+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:15.850593+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55106,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1151,"num_write":410,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.538291+0000","last_change":"2024-09-14T12:16:51.538291+0000","last_active":"2024-09-14T12:16:51.538291+0000","last_peered":"2024-09-14T12:16:51.538291+0000","last_clean":"2024-09-14T12:16:51.538291+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:16:51.538291+0000","last_undegraded":"2024-09-14T12:16:51.538291+0000","last_fullsized":"2024-09-14T12:16:51.538291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.538191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:23.700459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:14:34.740021+0000","last_change":"2024-09-14T11:17:31.653229+0000","last_active":"2024-09-14T12:14:34.740021+0000","last_peered":"2024-09-14T12:14:34.740021+0000","last_clean":"2024-09-14T12:14:34.740021+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:14:34.740021+0000","last_undegraded":"2024-09-14T12:14:34.740021+0000","last_fullsized":"2024-09-14T12:14:34.740021+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:49.375896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.045329+0000","last_change":"2024-09-14T12:16:27.045329+0000","last_active":"2024-09-14T12:16:27.045329+0000","last_peered":"2024-09-14T12:16:27.045329+0000","last_clean":"2024-09-14T12:16:27.045329+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:16:27.045329+0000","last_undegraded":"2024-09-14T12:16:27.045329+0000","last_fullsized":"2024-09-14T12:16:27.045329+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.045215+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:32.784518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'400","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.377374+0000","last_change":"2024-09-14T12:16:29.377374+0000","last_active":"2024-09-14T12:16:29.377374+0000","last_peered":"2024-09-14T12:16:29.377374+0000","last_clean":"2024-09-14T12:16:29.377374+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:16:29.377374+0000","last_undegraded":"2024-09-14T12:16:29.377374+0000","last_fullsized":"2024-09-14T12:16:29.377374+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.377285+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:31.072073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":23223,"num_write":1213,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.564140+0000","last_change":"2024-09-14T12:16:42.564140+0000","last_active":"2024-09-14T12:16:42.564140+0000","last_peered":"2024-09-14T12:16:42.564140+0000","last_clean":"2024-09-14T12:16:42.564140+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:16:42.564140+0000","last_undegraded":"2024-09-14T12:16:42.564140+0000","last_fullsized":"2024-09-14T12:16:42.564140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.564074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.344761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'64","reported_seq":578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.866020+0000","last_change":"2024-09-14T12:16:43.866020+0000","last_active":"2024-09-14T12:16:43.866020+0000","last_peered":"2024-09-14T12:16:43.866020+0000","last_clean":"2024-09-14T12:16:43.866020+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:16:43.866020+0000","last_undegraded":"2024-09-14T12:16:43.866020+0000","last_fullsized":"2024-09-14T12:16:43.866020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.865930+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:19.821383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.259687+0000","last_change":"2024-09-14T12:16:50.259687+0000","last_active":"2024-09-14T12:16:50.259687+0000","last_peered":"2024-09-14T12:16:50.259687+0000","last_clean":"2024-09-14T12:16:50.259687+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:16:50.259687+0000","last_undegraded":"2024-09-14T12:16:50.259687+0000","last_fullsized":"2024-09-14T12:16:50.259687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.259609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:13.804578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'220","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.097630+0000","last_change":"2024-09-14T12:16:56.097630+0000","last_active":"2024-09-14T12:16:56.097630+0000","last_peered":"2024-09-14T12:16:56.097630+0000","last_clean":"2024-09-14T12:16:56.097630+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:16:56.097630+0000","last_undegraded":"2024-09-14T12:16:56.097630+0000","last_fullsized":"2024-09-14T12:16:56.097630+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.097543+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:57:00.542228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'493","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.522624+0000","last_change":"2024-09-14T12:16:34.522624+0000","last_active":"2024-09-14T12:16:34.522624+0000","last_peered":"2024-09-14T12:16:34.522624+0000","last_clean":"2024-09-14T12:16:34.522624+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:16:34.522624+0000","last_undegraded":"2024-09-14T12:16:34.522624+0000","last_fullsized":"2024-09-14T12:16:34.522624+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.522537+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:24.965499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'366","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.762267+0000","last_change":"2024-09-14T12:16:24.762267+0000","last_active":"2024-09-14T12:16:24.762267+0000","last_peered":"2024-09-14T12:16:24.762267+0000","last_clean":"2024-09-14T12:16:24.762267+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:16:24.762267+0000","last_undegraded":"2024-09-14T12:16:24.762267+0000","last_fullsized":"2024-09-14T12:16:24.762267+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.762175+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.783635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":658,"num_read_kb":51938,"num_write":1111,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.436681+0000","last_change":"2024-09-14T12:16:41.436681+0000","last_active":"2024-09-14T12:16:41.436681+0000","last_peered":"2024-09-14T12:16:41.436681+0000","last_clean":"2024-09-14T12:16:41.436681+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:16:41.436681+0000","last_undegraded":"2024-09-14T12:16:41.436681+0000","last_fullsized":"2024-09-14T12:16:41.436681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.436586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:34.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'334","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.568525+0000","last_change":"2024-09-14T12:16:49.568525+0000","last_active":"2024-09-14T12:16:49.568525+0000","last_peered":"2024-09-14T12:16:49.568525+0000","last_clean":"2024-09-14T12:16:49.568525+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:16:49.568525+0000","last_undegraded":"2024-09-14T12:16:49.568525+0000","last_fullsized":"2024-09-14T12:16:49.568525+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.568425+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:19.040053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51654,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1212,"num_write":436,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.505488+0000","last_change":"2024-09-14T12:16:40.505488+0000","last_active":"2024-09-14T12:16:40.505488+0000","last_peered":"2024-09-14T12:16:40.505488+0000","last_clean":"2024-09-14T12:16:40.505488+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:16:40.505488+0000","last_undegraded":"2024-09-14T12:16:40.505488+0000","last_fullsized":"2024-09-14T12:16:40.505488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.505400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.146164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'144","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.940108+0000","last_change":"2024-09-14T12:16:56.940108+0000","last_active":"2024-09-14T12:16:56.940108+0000","last_peered":"2024-09-14T12:16:56.940108+0000","last_clean":"2024-09-14T12:16:56.940108+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:16:56.940108+0000","last_undegraded":"2024-09-14T12:16:56.940108+0000","last_fullsized":"2024-09-14T12:16:56.940108+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.940008+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:04.385514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'928","reported_seq":2579,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.519388+0000","last_change":"2024-09-14T12:16:33.519388+0000","last_active":"2024-09-14T12:16:33.519388+0000","last_peered":"2024-09-14T12:16:33.519388+0000","last_clean":"2024-09-14T12:16:33.519388+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:16:33.519388+0000","last_undegraded":"2024-09-14T12:16:33.519388+0000","last_fullsized":"2024-09-14T12:16:33.519388+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'928","last_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_deep_scrub":"263'928","last_deep_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.519304+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.269882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'348","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.882011+0000","last_change":"2024-09-14T12:16:22.882011+0000","last_active":"2024-09-14T12:16:22.882011+0000","last_peered":"2024-09-14T12:16:22.882011+0000","last_clean":"2024-09-14T12:16:22.882011+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:16:22.882011+0000","last_undegraded":"2024-09-14T12:16:22.882011+0000","last_fullsized":"2024-09-14T12:16:22.882011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.881926+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:26.520282+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":18794,"num_write":1109,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.503912+0000","last_change":"2024-09-14T12:16:35.503912+0000","last_active":"2024-09-14T12:16:35.503912+0000","last_peered":"2024-09-14T12:16:35.503912+0000","last_clean":"2024-09-14T12:16:35.503912+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:16:35.503912+0000","last_undegraded":"2024-09-14T12:16:35.503912+0000","last_fullsized":"2024-09-14T12:16:35.503912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.503820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.750327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'307","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.382617+0000","last_change":"2024-09-14T12:16:47.382617+0000","last_active":"2024-09-14T12:16:47.382617+0000","last_peered":"2024-09-14T12:16:47.382617+0000","last_clean":"2024-09-14T12:16:47.382617+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:16:47.382617+0000","last_undegraded":"2024-09-14T12:16:47.382617+0000","last_fullsized":"2024-09-14T12:16:47.382617+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.382533+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:00.688987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1246,"num_write":418,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.069438+0000","last_change":"2024-09-14T12:16:50.069438+0000","last_active":"2024-09-14T12:16:50.069438+0000","last_peered":"2024-09-14T12:16:50.069438+0000","last_clean":"2024-09-14T12:16:50.069438+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:16:50.069438+0000","last_undegraded":"2024-09-14T12:16:50.069438+0000","last_fullsized":"2024-09-14T12:16:50.069438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.069325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:11.352276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'449","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.477989+0000","last_change":"2024-09-14T12:16:31.477989+0000","last_active":"2024-09-14T12:16:31.477989+0000","last_peered":"2024-09-14T12:16:31.477989+0000","last_clean":"2024-09-14T12:16:31.477989+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:16:31.477989+0000","last_undegraded":"2024-09-14T12:16:31.477989+0000","last_fullsized":"2024-09-14T12:16:31.477989+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.477885+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:41.643421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.509398+0000","last_change":"2024-09-14T12:16:24.509398+0000","last_active":"2024-09-14T12:16:24.509398+0000","last_peered":"2024-09-14T12:16:24.509398+0000","last_clean":"2024-09-14T12:16:24.509398+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:16:24.509398+0000","last_undegraded":"2024-09-14T12:16:24.509398+0000","last_fullsized":"2024-09-14T12:16:24.509398+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.509303+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:37.841214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":38674,"num_write":1067,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.862176+0000","last_change":"2024-09-14T12:16:37.862176+0000","last_active":"2024-09-14T12:16:37.862176+0000","last_peered":"2024-09-14T12:16:37.862176+0000","last_clean":"2024-09-14T12:16:37.862176+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:16:37.862176+0000","last_undegraded":"2024-09-14T12:16:37.862176+0000","last_fullsized":"2024-09-14T12:16:37.862176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.862072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:47.575762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'496","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.177068+0000","last_change":"2024-09-14T12:16:42.177068+0000","last_active":"2024-09-14T12:16:42.177068+0000","last_peered":"2024-09-14T12:16:42.177068+0000","last_clean":"2024-09-14T12:16:42.177068+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:16:42.177068+0000","last_undegraded":"2024-09-14T12:16:42.177068+0000","last_fullsized":"2024-09-14T12:16:42.177068+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.176992+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.979936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":2075,"num_write":756,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.024287+0000","last_change":"2024-09-14T12:16:51.024287+0000","last_active":"2024-09-14T12:16:51.024287+0000","last_peered":"2024-09-14T12:16:51.024287+0000","last_clean":"2024-09-14T12:16:51.024287+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:16:51.024287+0000","last_undegraded":"2024-09-14T12:16:51.024287+0000","last_fullsized":"2024-09-14T12:16:51.024287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.024168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.115991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'186","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:57.604467+0000","last_change":"2024-09-14T11:17:31.658914+0000","last_active":"2024-09-14T12:13:57.604467+0000","last_peered":"2024-09-14T12:13:57.604467+0000","last_clean":"2024-09-14T12:13:57.604467+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:13:57.604467+0000","last_undegraded":"2024-09-14T12:13:57.604467+0000","last_fullsized":"2024-09-14T12:13:57.604467+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:17:30.634857+0000","last_clean_scrub_stamp":"2024-09-14T11:17:30.634857+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:56.873985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'840","reported_seq":2544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.898323+0000","last_change":"2024-09-14T12:16:32.898323+0000","last_active":"2024-09-14T12:16:32.898323+0000","last_peered":"2024-09-14T12:16:32.898323+0000","last_clean":"2024-09-14T12:16:32.898323+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:16:32.898323+0000","last_undegraded":"2024-09-14T12:16:32.898323+0000","last_fullsized":"2024-09-14T12:16:32.898323+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'840","last_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_deep_scrub":"263'840","last_deep_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.898237+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:01.360421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'404","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.069459+0000","last_change":"2024-09-14T12:16:22.069459+0000","last_active":"2024-09-14T12:16:22.069459+0000","last_peered":"2024-09-14T12:16:22.069459+0000","last_clean":"2024-09-14T12:16:22.069459+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:16:22.069459+0000","last_undegraded":"2024-09-14T12:16:22.069459+0000","last_fullsized":"2024-09-14T12:16:22.069459+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.069380+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:18.179502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":5750,"num_write":1256,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.486620+0000","last_change":"2024-09-14T12:16:36.486620+0000","last_active":"2024-09-14T12:16:36.486620+0000","last_peered":"2024-09-14T12:16:36.486620+0000","last_clean":"2024-09-14T12:16:36.486620+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:16:36.486620+0000","last_undegraded":"2024-09-14T12:16:36.486620+0000","last_fullsized":"2024-09-14T12:16:36.486620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.486533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:47.840538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.350195+0000","last_change":"2024-09-14T12:16:48.350195+0000","last_active":"2024-09-14T12:16:48.350195+0000","last_peered":"2024-09-14T12:16:48.350195+0000","last_clean":"2024-09-14T12:16:48.350195+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:48.350195+0000","last_undegraded":"2024-09-14T12:16:48.350195+0000","last_fullsized":"2024-09-14T12:16:48.350195+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.350063+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:00.713091+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1111,"num_write":430,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.081996+0000","last_change":"2024-09-14T12:16:45.081996+0000","last_active":"2024-09-14T12:16:45.081996+0000","last_peered":"2024-09-14T12:16:45.081996+0000","last_clean":"2024-09-14T12:16:45.081996+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:16:45.081996+0000","last_undegraded":"2024-09-14T12:16:45.081996+0000","last_fullsized":"2024-09-14T12:16:45.081996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.081910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:44.716876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'205","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.455049+0000","last_change":"2024-09-14T12:16:44.455049+0000","last_active":"2024-09-14T12:16:44.455049+0000","last_peered":"2024-09-14T12:16:44.455049+0000","last_clean":"2024-09-14T12:16:44.455049+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:16:44.455049+0000","last_undegraded":"2024-09-14T12:16:44.455049+0000","last_fullsized":"2024-09-14T12:16:44.455049+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.454939+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:36.039287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'416","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.571028+0000","last_change":"2024-09-14T12:16:35.571028+0000","last_active":"2024-09-14T12:16:35.571028+0000","last_peered":"2024-09-14T12:16:35.571028+0000","last_clean":"2024-09-14T12:16:35.571028+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:16:35.571028+0000","last_undegraded":"2024-09-14T12:16:35.571028+0000","last_fullsized":"2024-09-14T12:16:35.571028+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.570946+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:00.910326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'367","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.510136+0000","last_change":"2024-09-14T12:16:22.510136+0000","last_active":"2024-09-14T12:16:22.510136+0000","last_peered":"2024-09-14T12:16:22.510136+0000","last_clean":"2024-09-14T12:16:22.510136+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:16:22.510136+0000","last_undegraded":"2024-09-14T12:16:22.510136+0000","last_fullsized":"2024-09-14T12:16:22.510136+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.510039+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:28.698454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":55641,"num_write":1285,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.617674+0000","last_change":"2024-09-14T12:16:43.617674+0000","last_active":"2024-09-14T12:16:43.617674+0000","last_peered":"2024-09-14T12:16:43.617674+0000","last_clean":"2024-09-14T12:16:43.617674+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:16:43.617674+0000","last_undegraded":"2024-09-14T12:16:43.617674+0000","last_fullsized":"2024-09-14T12:16:43.617674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.617596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:29.744676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.549558+0000","last_change":"2024-09-14T12:16:47.549558+0000","last_active":"2024-09-14T12:16:47.549558+0000","last_peered":"2024-09-14T12:16:47.549558+0000","last_clean":"2024-09-14T12:16:47.549558+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:16:47.549558+0000","last_undegraded":"2024-09-14T12:16:47.549558+0000","last_fullsized":"2024-09-14T12:16:47.549558+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.549469+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:38.899315+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53208,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":494,"num_read_kb":1139,"num_write":406,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.118086+0000","last_change":"2024-09-14T12:16:44.118086+0000","last_active":"2024-09-14T12:16:44.118086+0000","last_peered":"2024-09-14T12:16:44.118086+0000","last_clean":"2024-09-14T12:16:44.118086+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:16:44.118086+0000","last_undegraded":"2024-09-14T12:16:44.118086+0000","last_fullsized":"2024-09-14T12:16:44.118086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.117999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:36.635428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'103","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.865701+0000","last_change":"2024-09-14T12:16:54.865701+0000","last_active":"2024-09-14T12:16:54.865701+0000","last_peered":"2024-09-14T12:16:54.865701+0000","last_clean":"2024-09-14T12:16:54.865701+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:16:54.865701+0000","last_undegraded":"2024-09-14T12:16:54.865701+0000","last_fullsized":"2024-09-14T12:16:54.865701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.865614+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:23.014343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'485","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.218673+0000","last_change":"2024-09-14T12:16:26.218673+0000","last_active":"2024-09-14T12:16:26.218673+0000","last_peered":"2024-09-14T12:16:26.218673+0000","last_clean":"2024-09-14T12:16:26.218673+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:16:26.218673+0000","last_undegraded":"2024-09-14T12:16:26.218673+0000","last_fullsized":"2024-09-14T12:16:26.218673+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'485","last_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_deep_scrub":"263'485","last_deep_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.218577+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:32.733118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'441","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.912181+0000","last_change":"2024-09-14T12:16:21.912181+0000","last_active":"2024-09-14T12:16:21.912181+0000","last_peered":"2024-09-14T12:16:21.912181+0000","last_clean":"2024-09-14T12:16:21.912181+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:16:21.912181+0000","last_undegraded":"2024-09-14T12:16:21.912181+0000","last_fullsized":"2024-09-14T12:16:21.912181+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.912110+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:39.992075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1189,"num_read_kb":773,"num_write":1309,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.198180+0000","last_change":"2024-09-14T12:16:39.198180+0000","last_active":"2024-09-14T12:16:39.198180+0000","last_peered":"2024-09-14T12:16:39.198180+0000","last_clean":"2024-09-14T12:16:39.198180+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:16:39.198180+0000","last_undegraded":"2024-09-14T12:16:39.198180+0000","last_fullsized":"2024-09-14T12:16:39.198180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.198089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:04.354915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.599681+0000","last_change":"2024-09-14T12:16:47.599681+0000","last_active":"2024-09-14T12:16:47.599681+0000","last_peered":"2024-09-14T12:16:47.599681+0000","last_clean":"2024-09-14T12:16:47.599681+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:16:47.599681+0000","last_undegraded":"2024-09-14T12:16:47.599681+0000","last_fullsized":"2024-09-14T12:16:47.599681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.599583+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:21.557554+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'781","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.463071+0000","last_change":"2024-09-14T12:16:42.463071+0000","last_active":"2024-09-14T12:16:42.463071+0000","last_peered":"2024-09-14T12:16:42.463071+0000","last_clean":"2024-09-14T12:16:42.463071+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:16:42.463071+0000","last_undegraded":"2024-09-14T12:16:42.463071+0000","last_fullsized":"2024-09-14T12:16:42.463071+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.462978+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:02.034354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'127","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.281509+0000","last_change":"2024-09-14T12:16:53.281509+0000","last_active":"2024-09-14T12:16:53.281509+0000","last_peered":"2024-09-14T12:16:53.281509+0000","last_clean":"2024-09-14T12:16:53.281509+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:16:53.281509+0000","last_undegraded":"2024-09-14T12:16:53.281509+0000","last_fullsized":"2024-09-14T12:16:53.281509+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.281413+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:45.751283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'484","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.602934+0000","last_change":"2024-09-14T12:16:33.602934+0000","last_active":"2024-09-14T12:16:33.602934+0000","last_peered":"2024-09-14T12:16:33.602934+0000","last_clean":"2024-09-14T12:16:33.602934+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:16:33.602934+0000","last_undegraded":"2024-09-14T12:16:33.602934+0000","last_fullsized":"2024-09-14T12:16:33.602934+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'484","last_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_deep_scrub":"263'484","last_deep_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.602835+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:59.909062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3026,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.790342+0000","last_change":"2024-09-14T12:16:23.790342+0000","last_active":"2024-09-14T12:16:23.790342+0000","last_peered":"2024-09-14T12:16:23.790342+0000","last_clean":"2024-09-14T12:16:23.790342+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:16:23.790342+0000","last_undegraded":"2024-09-14T12:16:23.790342+0000","last_fullsized":"2024-09-14T12:16:23.790342+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.790199+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:45.806183+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":665,"num_read_kb":45610,"num_write":1043,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.390636+0000","last_change":"2024-09-14T12:16:42.390636+0000","last_active":"2024-09-14T12:16:42.390636+0000","last_peered":"2024-09-14T12:16:42.390636+0000","last_clean":"2024-09-14T12:16:42.390636+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:16:42.390636+0000","last_undegraded":"2024-09-14T12:16:42.390636+0000","last_fullsized":"2024-09-14T12:16:42.390636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.390528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:38.711595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'324","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.996393+0000","last_change":"2024-09-14T12:16:48.996393+0000","last_active":"2024-09-14T12:16:48.996393+0000","last_peered":"2024-09-14T12:16:48.996393+0000","last_clean":"2024-09-14T12:16:48.996393+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:16:48.996393+0000","last_undegraded":"2024-09-14T12:16:48.996393+0000","last_fullsized":"2024-09-14T12:16:48.996393+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.996286+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:54.778486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":989,"num_write":382,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.096297+0000","last_change":"2024-09-14T12:16:51.096297+0000","last_active":"2024-09-14T12:16:51.096297+0000","last_peered":"2024-09-14T12:16:51.096297+0000","last_clean":"2024-09-14T12:16:51.096297+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:16:51.096297+0000","last_undegraded":"2024-09-14T12:16:51.096297+0000","last_fullsized":"2024-09-14T12:16:51.096297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.096182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:46.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'168","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.228359+0000","last_change":"2024-09-14T12:16:55.228359+0000","last_active":"2024-09-14T12:16:55.228359+0000","last_peered":"2024-09-14T12:16:55.228359+0000","last_clean":"2024-09-14T12:16:55.228359+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:16:55.228359+0000","last_undegraded":"2024-09-14T12:16:55.228359+0000","last_fullsized":"2024-09-14T12:16:55.228359+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.228265+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:59.821910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'825","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.565380+0000","last_change":"2024-09-14T12:16:28.565380+0000","last_active":"2024-09-14T12:16:28.565380+0000","last_peered":"2024-09-14T12:16:28.565380+0000","last_clean":"2024-09-14T12:16:28.565380+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:16:28.565380+0000","last_undegraded":"2024-09-14T12:16:28.565380+0000","last_fullsized":"2024-09-14T12:16:28.565380+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'825","last_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_deep_scrub":"263'825","last_deep_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.565300+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:29.751301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'403","reported_seq":1268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.799080+0000","last_change":"2024-09-14T12:16:25.799080+0000","last_active":"2024-09-14T12:16:25.799080+0000","last_peered":"2024-09-14T12:16:25.799080+0000","last_clean":"2024-09-14T12:16:25.799080+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:16:25.799080+0000","last_undegraded":"2024-09-14T12:16:25.799080+0000","last_fullsized":"2024-09-14T12:16:25.799080+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.798955+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.565631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1324,"num_read_kb":37458,"num_write":1300,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.862542+0000","last_change":"2024-09-14T12:16:44.862542+0000","last_active":"2024-09-14T12:16:44.862542+0000","last_peered":"2024-09-14T12:16:44.862542+0000","last_clean":"2024-09-14T12:16:44.862542+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:16:44.862542+0000","last_undegraded":"2024-09-14T12:16:44.862542+0000","last_fullsized":"2024-09-14T12:16:44.862542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.862406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:59.669337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.955854+0000","last_change":"2024-09-14T12:16:46.955854+0000","last_active":"2024-09-14T12:16:46.955854+0000","last_peered":"2024-09-14T12:16:46.955854+0000","last_clean":"2024-09-14T12:16:46.955854+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:16:46.955854+0000","last_undegraded":"2024-09-14T12:16:46.955854+0000","last_fullsized":"2024-09-14T12:16:46.955854+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.955737+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:59.807750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46067,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":1076,"num_write":376,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.482275+0000","last_change":"2024-09-14T12:16:41.482275+0000","last_active":"2024-09-14T12:16:41.482275+0000","last_peered":"2024-09-14T12:16:41.482275+0000","last_clean":"2024-09-14T12:16:41.482275+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:16:41.482275+0000","last_undegraded":"2024-09-14T12:16:41.482275+0000","last_fullsized":"2024-09-14T12:16:41.482275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.482182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:09.893270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'102","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.551081+0000","last_change":"2024-09-14T12:16:57.551081+0000","last_active":"2024-09-14T12:16:57.551081+0000","last_peered":"2024-09-14T12:16:57.551081+0000","last_clean":"2024-09-14T12:16:57.551081+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:16:57.551081+0000","last_undegraded":"2024-09-14T12:16:57.551081+0000","last_fullsized":"2024-09-14T12:16:57.551081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.550997+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:04.907290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'468","reported_seq":2032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.595539+0000","last_change":"2024-09-14T12:16:36.595539+0000","last_active":"2024-09-14T12:16:36.595539+0000","last_peered":"2024-09-14T12:16:36.595539+0000","last_clean":"2024-09-14T12:16:36.595539+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:16:36.595539+0000","last_undegraded":"2024-09-14T12:16:36.595539+0000","last_fullsized":"2024-09-14T12:16:36.595539+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.595458+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.327912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'363","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.520987+0000","last_change":"2024-09-14T12:16:25.520987+0000","last_active":"2024-09-14T12:16:25.520987+0000","last_peered":"2024-09-14T12:16:25.520987+0000","last_clean":"2024-09-14T12:16:25.520987+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:16:25.520987+0000","last_undegraded":"2024-09-14T12:16:25.520987+0000","last_fullsized":"2024-09-14T12:16:25.520987+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.520888+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.356077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":9738,"num_write":1164,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.633463+0000","last_change":"2024-09-14T12:16:42.633463+0000","last_active":"2024-09-14T12:16:42.633463+0000","last_peered":"2024-09-14T12:16:42.633463+0000","last_clean":"2024-09-14T12:16:42.633463+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:16:42.633463+0000","last_undegraded":"2024-09-14T12:16:42.633463+0000","last_fullsized":"2024-09-14T12:16:42.633463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.633379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:04.343825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'258","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.468390+0000","last_change":"2024-09-14T12:16:53.468390+0000","last_active":"2024-09-14T12:16:53.468390+0000","last_peered":"2024-09-14T12:16:53.468390+0000","last_clean":"2024-09-14T12:16:53.468390+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:16:53.468390+0000","last_undegraded":"2024-09-14T12:16:53.468390+0000","last_fullsized":"2024-09-14T12:16:53.468390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.468286+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:55.124534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46060,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":1096,"num_write":366,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.613551+0000","last_change":"2024-09-14T12:16:51.613551+0000","last_active":"2024-09-14T12:16:51.613551+0000","last_peered":"2024-09-14T12:16:51.613551+0000","last_clean":"2024-09-14T12:16:51.613551+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:16:51.613551+0000","last_undegraded":"2024-09-14T12:16:51.613551+0000","last_fullsized":"2024-09-14T12:16:51.613551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.613450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:42.650909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'191","reported_seq":1659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.260076+0000","last_change":"2024-09-14T12:16:54.260076+0000","last_active":"2024-09-14T12:16:54.260076+0000","last_peered":"2024-09-14T12:16:54.260076+0000","last_clean":"2024-09-14T12:16:54.260076+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:16:54.260076+0000","last_undegraded":"2024-09-14T12:16:54.260076+0000","last_fullsized":"2024-09-14T12:16:54.260076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.259974+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:28.566983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'591","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.580916+0000","last_change":"2024-09-14T12:16:29.580916+0000","last_active":"2024-09-14T12:16:29.580916+0000","last_peered":"2024-09-14T12:16:29.580916+0000","last_clean":"2024-09-14T12:16:29.580916+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:16:29.580916+0000","last_undegraded":"2024-09-14T12:16:29.580916+0000","last_fullsized":"2024-09-14T12:16:29.580916+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'591","last_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_deep_scrub":"263'591","last_deep_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.580819+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:36.205569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'359","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.913612+0000","last_change":"2024-09-14T12:16:23.913612+0000","last_active":"2024-09-14T12:16:23.913612+0000","last_peered":"2024-09-14T12:16:23.913612+0000","last_clean":"2024-09-14T12:16:23.913612+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:16:23.913612+0000","last_undegraded":"2024-09-14T12:16:23.913612+0000","last_fullsized":"2024-09-14T12:16:23.913612+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.913491+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:11.317852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":9181,"num_write":1146,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.227953+0000","last_change":"2024-09-14T12:16:38.227953+0000","last_active":"2024-09-14T12:16:38.227953+0000","last_peered":"2024-09-14T12:16:38.227953+0000","last_clean":"2024-09-14T12:16:38.227953+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:16:38.227953+0000","last_undegraded":"2024-09-14T12:16:38.227953+0000","last_fullsized":"2024-09-14T12:16:38.227953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.227869+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:50.267903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.592874+0000","last_change":"2024-09-14T12:16:46.592874+0000","last_active":"2024-09-14T12:16:46.592874+0000","last_peered":"2024-09-14T12:16:46.592874+0000","last_clean":"2024-09-14T12:16:46.592874+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:16:46.592874+0000","last_undegraded":"2024-09-14T12:16:46.592874+0000","last_fullsized":"2024-09-14T12:16:46.592874+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.592758+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:46.826509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1227,"num_write":442,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.130512+0000","last_change":"2024-09-14T12:16:52.130512+0000","last_active":"2024-09-14T12:16:52.130512+0000","last_peered":"2024-09-14T12:16:52.130512+0000","last_clean":"2024-09-14T12:16:52.130512+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:16:52.130512+0000","last_undegraded":"2024-09-14T12:16:52.130512+0000","last_fullsized":"2024-09-14T12:16:52.130512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.130423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:21.040185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'101","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.641136+0000","last_change":"2024-09-14T12:16:53.641136+0000","last_active":"2024-09-14T12:16:53.641136+0000","last_peered":"2024-09-14T12:16:53.641136+0000","last_clean":"2024-09-14T12:16:53.641136+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:16:53.641136+0000","last_undegraded":"2024-09-14T12:16:53.641136+0000","last_fullsized":"2024-09-14T12:16:53.641136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.641038+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:10.270684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'541","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.161351+0000","last_change":"2024-09-14T12:16:35.161351+0000","last_active":"2024-09-14T12:16:35.161351+0000","last_peered":"2024-09-14T12:16:35.161351+0000","last_clean":"2024-09-14T12:16:35.161351+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:16:35.161351+0000","last_undegraded":"2024-09-14T12:16:35.161351+0000","last_fullsized":"2024-09-14T12:16:35.161351+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.161259+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:47.150238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'399","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.437493+0000","last_change":"2024-09-14T12:16:26.437493+0000","last_active":"2024-09-14T12:16:26.437493+0000","last_peered":"2024-09-14T12:16:26.437493+0000","last_clean":"2024-09-14T12:16:26.437493+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:16:26.437493+0000","last_undegraded":"2024-09-14T12:16:26.437493+0000","last_fullsized":"2024-09-14T12:16:26.437493+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.437376+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:56.164832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":657,"num_read_kb":34326,"num_write":1264,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'836","reported_seq":2425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.160886+0000","last_change":"2024-09-14T12:16:34.160886+0000","last_active":"2024-09-14T12:16:34.160886+0000","last_peered":"2024-09-14T12:16:34.160886+0000","last_clean":"2024-09-14T12:16:34.160886+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:16:34.160886+0000","last_undegraded":"2024-09-14T12:16:34.160886+0000","last_fullsized":"2024-09-14T12:16:34.160886+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.160775+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:02.536094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'458","reported_seq":1177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.178320+0000","last_change":"2024-09-14T12:16:24.178320+0000","last_active":"2024-09-14T12:16:24.178320+0000","last_peered":"2024-09-14T12:16:24.178320+0000","last_clean":"2024-09-14T12:16:24.178320+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:16:24.178320+0000","last_undegraded":"2024-09-14T12:16:24.178320+0000","last_fullsized":"2024-09-14T12:16:24.178320+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.178222+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:00.886938+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":108296,"num_write":1392,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'491","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.910713+0000","last_change":"2024-09-14T12:16:38.910713+0000","last_active":"2024-09-14T12:16:38.910713+0000","last_peered":"2024-09-14T12:16:38.910713+0000","last_clean":"2024-09-14T12:16:38.910713+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:16:38.910713+0000","last_undegraded":"2024-09-14T12:16:38.910713+0000","last_fullsized":"2024-09-14T12:16:38.910713+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.910624+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.858404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'337","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.773355+0000","last_change":"2024-09-14T12:16:26.773355+0000","last_active":"2024-09-14T12:16:26.773355+0000","last_peered":"2024-09-14T12:16:26.773355+0000","last_clean":"2024-09-14T12:16:26.773355+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:16:26.773355+0000","last_undegraded":"2024-09-14T12:16:26.773355+0000","last_fullsized":"2024-09-14T12:16:26.773355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.773234+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:32.185869+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":31259,"num_write":1097,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1203","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.050987+0000","last_change":"2024-09-14T12:16:29.050987+0000","last_active":"2024-09-14T12:16:29.050987+0000","last_peered":"2024-09-14T12:16:29.050987+0000","last_clean":"2024-09-14T12:16:29.050987+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:16:29.050987+0000","last_undegraded":"2024-09-14T12:16:29.050987+0000","last_fullsized":"2024-09-14T12:16:29.050987+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1203","last_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_deep_scrub":"263'1203","last_deep_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.050902+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:27.737996+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.892822+0000","last_change":"2024-09-14T12:16:24.892822+0000","last_active":"2024-09-14T12:16:24.892822+0000","last_peered":"2024-09-14T12:16:24.892822+0000","last_clean":"2024-09-14T12:16:24.892822+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:16:24.892822+0000","last_undegraded":"2024-09-14T12:16:24.892822+0000","last_fullsized":"2024-09-14T12:16:24.892822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.892704+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:06.999544+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":15201,"num_write":1292,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'920","reported_seq":2583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.627418+0000","last_change":"2024-09-14T12:16:39.627418+0000","last_active":"2024-09-14T12:16:39.627418+0000","last_peered":"2024-09-14T12:16:39.627418+0000","last_clean":"2024-09-14T12:16:39.627418+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:16:39.627418+0000","last_undegraded":"2024-09-14T12:16:39.627418+0000","last_fullsized":"2024-09-14T12:16:39.627418+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'920","last_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_deep_scrub":"263'920","last_deep_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.627337+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:59.027510+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'308","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.509875+0000","last_change":"2024-09-14T12:16:26.509875+0000","last_active":"2024-09-14T12:16:26.509875+0000","last_peered":"2024-09-14T12:16:26.509875+0000","last_clean":"2024-09-14T12:16:26.509875+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:16:26.509875+0000","last_undegraded":"2024-09-14T12:16:26.509875+0000","last_fullsized":"2024-09-14T12:16:26.509875+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.509772+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.441645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306882,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":547,"num_read_kb":7710,"num_write":947,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'504","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.650472+0000","last_change":"2024-09-14T12:16:32.650472+0000","last_active":"2024-09-14T12:16:32.650472+0000","last_peered":"2024-09-14T12:16:32.650472+0000","last_clean":"2024-09-14T12:16:32.650472+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:16:32.650472+0000","last_undegraded":"2024-09-14T12:16:32.650472+0000","last_fullsized":"2024-09-14T12:16:32.650472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.650377+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:57.980647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'416","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.053960+0000","last_change":"2024-09-14T12:16:28.053960+0000","last_active":"2024-09-14T12:16:28.053960+0000","last_peered":"2024-09-14T12:16:28.053960+0000","last_clean":"2024-09-14T12:16:28.053960+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:16:28.053960+0000","last_undegraded":"2024-09-14T12:16:28.053960+0000","last_fullsized":"2024-09-14T12:16:28.053960+0000","mapping_epoch":25,"log_start":"263'401","ondisk_log_start":"263'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.053860+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.211944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":680,"num_read_kb":78819,"num_write":1261,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'834","reported_seq":2551,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.564900+0000","last_change":"2024-09-14T12:16:37.564900+0000","last_active":"2024-09-14T12:16:37.564900+0000","last_peered":"2024-09-14T12:16:37.564900+0000","last_clean":"2024-09-14T12:16:37.564900+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:16:37.564900+0000","last_undegraded":"2024-09-14T12:16:37.564900+0000","last_fullsized":"2024-09-14T12:16:37.564900+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'834","last_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_deep_scrub":"263'834","last_deep_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.564799+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:22.157858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'453","reported_seq":1138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.477694+0000","last_change":"2024-09-14T12:16:23.477694+0000","last_active":"2024-09-14T12:16:23.477694+0000","last_peered":"2024-09-14T12:16:23.477694+0000","last_clean":"2024-09-14T12:16:23.477694+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:16:23.477694+0000","last_undegraded":"2024-09-14T12:16:23.477694+0000","last_fullsized":"2024-09-14T12:16:23.477694+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.477569+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.655283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":42747,"num_write":1601,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.510021+0000","last_change":"2024-09-14T12:16:32.510021+0000","last_active":"2024-09-14T12:16:32.510021+0000","last_peered":"2024-09-14T12:16:32.510021+0000","last_clean":"2024-09-14T12:16:32.510021+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:16:32.510021+0000","last_undegraded":"2024-09-14T12:16:32.510021+0000","last_fullsized":"2024-09-14T12:16:32.510021+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.509908+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:43.358006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'368","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.603639+0000","last_change":"2024-09-14T12:16:28.603639+0000","last_active":"2024-09-14T12:16:28.603639+0000","last_peered":"2024-09-14T12:16:28.603639+0000","last_clean":"2024-09-14T12:16:28.603639+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:16:28.603639+0000","last_undegraded":"2024-09-14T12:16:28.603639+0000","last_fullsized":"2024-09-14T12:16:28.603639+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.603520+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:07.583029+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":730,"num_read_kb":25685,"num_write":1212,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'725","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.853714+0000","last_change":"2024-09-14T12:16:34.853714+0000","last_active":"2024-09-14T12:16:34.853714+0000","last_peered":"2024-09-14T12:16:34.853714+0000","last_clean":"2024-09-14T12:16:34.853714+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:16:34.853714+0000","last_undegraded":"2024-09-14T12:16:34.853714+0000","last_fullsized":"2024-09-14T12:16:34.853714+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'725","last_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_deep_scrub":"263'725","last_deep_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.853630+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:40.766897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.783873+0000","last_change":"2024-09-14T12:16:27.783873+0000","last_active":"2024-09-14T12:16:27.783873+0000","last_peered":"2024-09-14T12:16:27.783873+0000","last_clean":"2024-09-14T12:16:27.783873+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:16:27.783873+0000","last_undegraded":"2024-09-14T12:16:27.783873+0000","last_fullsized":"2024-09-14T12:16:27.783873+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.783754+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:26.128419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":13781,"num_write":973,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'544","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.617175+0000","last_change":"2024-09-14T12:16:35.617175+0000","last_active":"2024-09-14T12:16:35.617175+0000","last_peered":"2024-09-14T12:16:35.617175+0000","last_clean":"2024-09-14T12:16:35.617175+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:16:35.617175+0000","last_undegraded":"2024-09-14T12:16:35.617175+0000","last_fullsized":"2024-09-14T12:16:35.617175+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.617088+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:52.504033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'378","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.560326+0000","last_change":"2024-09-14T12:16:29.560326+0000","last_active":"2024-09-14T12:16:29.560326+0000","last_peered":"2024-09-14T12:16:29.560326+0000","last_clean":"2024-09-14T12:16:29.560326+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:16:29.560326+0000","last_undegraded":"2024-09-14T12:16:29.560326+0000","last_fullsized":"2024-09-14T12:16:29.560326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.560203+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.633237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":24861,"num_write":1154,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'887","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.214957+0000","last_change":"2024-09-14T12:16:25.214957+0000","last_active":"2024-09-14T12:16:25.214957+0000","last_peered":"2024-09-14T12:16:25.214957+0000","last_clean":"2024-09-14T12:16:25.214957+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:16:25.214957+0000","last_undegraded":"2024-09-14T12:16:25.214957+0000","last_fullsized":"2024-09-14T12:16:25.214957+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'887","last_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_deep_scrub":"263'887","last_deep_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.214874+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:03.118395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'399","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.777956+0000","last_change":"2024-09-14T12:16:28.777956+0000","last_active":"2024-09-14T12:16:28.777956+0000","last_peered":"2024-09-14T12:16:28.777956+0000","last_clean":"2024-09-14T12:16:28.777956+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:16:28.777956+0000","last_undegraded":"2024-09-14T12:16:28.777956+0000","last_fullsized":"2024-09-14T12:16:28.777956+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.777834+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:20.454980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":50704,"num_write":1241,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'684","reported_seq":2459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.605611+0000","last_change":"2024-09-14T12:16:34.605611+0000","last_active":"2024-09-14T12:16:34.605611+0000","last_peered":"2024-09-14T12:16:34.605611+0000","last_clean":"2024-09-14T12:16:34.605611+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:16:34.605611+0000","last_undegraded":"2024-09-14T12:16:34.605611+0000","last_fullsized":"2024-09-14T12:16:34.605611+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.605515+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:49.073360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'359","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.891383+0000","last_change":"2024-09-14T12:16:25.891383+0000","last_active":"2024-09-14T12:16:25.891383+0000","last_peered":"2024-09-14T12:16:25.891383+0000","last_clean":"2024-09-14T12:16:25.891383+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:16:25.891383+0000","last_undegraded":"2024-09-14T12:16:25.891383+0000","last_fullsized":"2024-09-14T12:16:25.891383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.891261+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:39.670161+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":2146,"num_write":1056,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'755","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.405692+0000","last_change":"2024-09-14T12:16:36.405692+0000","last_active":"2024-09-14T12:16:36.405692+0000","last_peered":"2024-09-14T12:16:36.405692+0000","last_clean":"2024-09-14T12:16:36.405692+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:16:36.405692+0000","last_undegraded":"2024-09-14T12:16:36.405692+0000","last_fullsized":"2024-09-14T12:16:36.405692+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.405559+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:19.573245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'333","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.520197+0000","last_change":"2024-09-14T12:16:24.520197+0000","last_active":"2024-09-14T12:16:24.520197+0000","last_peered":"2024-09-14T12:16:24.520197+0000","last_clean":"2024-09-14T12:16:24.520197+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:16:24.520197+0000","last_undegraded":"2024-09-14T12:16:24.520197+0000","last_fullsized":"2024-09-14T12:16:24.520197+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.520092+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:01.332103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":46679,"num_write":958,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'471","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.895312+0000","last_change":"2024-09-14T12:16:33.895312+0000","last_active":"2024-09-14T12:16:33.895312+0000","last_peered":"2024-09-14T12:16:33.895312+0000","last_clean":"2024-09-14T12:16:33.895312+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:16:33.895312+0000","last_undegraded":"2024-09-14T12:16:33.895312+0000","last_fullsized":"2024-09-14T12:16:33.895312+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.895220+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.754997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'348","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.097196+0000","last_change":"2024-09-14T12:16:31.097130+0000","last_active":"2024-09-14T12:16:31.097196+0000","last_peered":"2024-09-14T12:16:31.097196+0000","last_clean":"2024-09-14T12:16:31.097196+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:16:31.097196+0000","last_undegraded":"2024-09-14T12:16:31.097196+0000","last_fullsized":"2024-09-14T12:16:31.097196+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.097044+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:55.804352+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":19021,"num_write":1018,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'444","reported_seq":2081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.596230+0000","last_change":"2024-09-14T12:16:38.596230+0000","last_active":"2024-09-14T12:16:38.596230+0000","last_peered":"2024-09-14T12:16:38.596230+0000","last_clean":"2024-09-14T12:16:38.596230+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:16:38.596230+0000","last_undegraded":"2024-09-14T12:16:38.596230+0000","last_fullsized":"2024-09-14T12:16:38.596230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.596131+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:53.904204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4594,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'400","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.185633+0000","last_change":"2024-09-14T12:16:21.185633+0000","last_active":"2024-09-14T12:16:21.185633+0000","last_peered":"2024-09-14T12:16:21.185633+0000","last_clean":"2024-09-14T12:16:21.185633+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:16:21.185633+0000","last_undegraded":"2024-09-14T12:16:21.185633+0000","last_fullsized":"2024-09-14T12:16:21.185633+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.185559+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:24.059335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":76781,"num_write":1270,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'460","reported_seq":2085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.432720+0000","last_change":"2024-09-14T12:16:35.432720+0000","last_active":"2024-09-14T12:16:35.432720+0000","last_peered":"2024-09-14T12:16:35.432720+0000","last_clean":"2024-09-14T12:16:35.432720+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:16:35.432720+0000","last_undegraded":"2024-09-14T12:16:35.432720+0000","last_fullsized":"2024-09-14T12:16:35.432720+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.432637+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:31.011136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'375","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.890775+0000","last_change":"2024-09-14T12:16:32.890775+0000","last_active":"2024-09-14T12:16:32.890775+0000","last_peered":"2024-09-14T12:16:32.890775+0000","last_clean":"2024-09-14T12:16:32.890775+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:16:32.890775+0000","last_undegraded":"2024-09-14T12:16:32.890775+0000","last_fullsized":"2024-09-14T12:16:32.890775+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.890669+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:26.033762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":6459,"num_write":1212,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'316","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.839863+0000","last_change":"2024-09-14T12:16:31.839863+0000","last_active":"2024-09-14T12:16:31.839863+0000","last_peered":"2024-09-14T12:16:31.839863+0000","last_clean":"2024-09-14T12:16:31.839863+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:16:31.839863+0000","last_undegraded":"2024-09-14T12:16:31.839863+0000","last_fullsized":"2024-09-14T12:16:31.839863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.839755+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:18.749494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":1699,"num_write":1024,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'564","reported_seq":2268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.882132+0000","last_change":"2024-09-14T12:16:35.882132+0000","last_active":"2024-09-14T12:16:35.882132+0000","last_peered":"2024-09-14T12:16:35.882132+0000","last_clean":"2024-09-14T12:16:35.882132+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:16:35.882132+0000","last_undegraded":"2024-09-14T12:16:35.882132+0000","last_fullsized":"2024-09-14T12:16:35.882132+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.882034+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:28.610668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'411","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.093411+0000","last_change":"2024-09-14T12:16:32.093411+0000","last_active":"2024-09-14T12:16:32.093411+0000","last_peered":"2024-09-14T12:16:32.093411+0000","last_clean":"2024-09-14T12:16:32.093411+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:16:32.093411+0000","last_undegraded":"2024-09-14T12:16:32.093411+0000","last_fullsized":"2024-09-14T12:16:32.093411+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.093316+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:14.969406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":16758,"num_write":1274,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'916","reported_seq":2589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.894057+0000","last_change":"2024-09-14T12:16:36.894057+0000","last_active":"2024-09-14T12:16:36.894057+0000","last_peered":"2024-09-14T12:16:36.894057+0000","last_clean":"2024-09-14T12:16:36.894057+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:16:36.894057+0000","last_undegraded":"2024-09-14T12:16:36.894057+0000","last_fullsized":"2024-09-14T12:16:36.894057+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'916","last_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_deep_scrub":"263'916","last_deep_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.893938+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:11.186412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1392,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1775,"ondisk_log_size":1775,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":590,"ondisk_log_size":590,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1705796,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18087,"num_read_kb":37833,"num_write":15249,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713408,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1989,"ondisk_log_size":1989,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35482,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3802,"ondisk_log_size":3802,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22160993,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44528,"num_read_kb":1801342,"num_write":73962,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45277184,"data_stored":44321986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4060,"ondisk_log_size":4060,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":187942,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":186673,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510164,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277484,"kb_used_data":11676,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094356,"statfs":{"total":96636764160,"available":96352620544,"internally_reserved":0,"allocated":11956224,"data_stored":10288647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510164,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249308,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94122532,"statfs":{"total":96636764160,"available":96381472768,"internally_reserved":0,"allocated":5844992,"data_stored":4296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510165,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133556,"kb_used_data":12196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94238284,"statfs":{"total":96636764160,"available":96500002816,"internally_reserved":0,"allocated":12488704,"data_stored":10779353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510164,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98696,"kb_used_data":9208,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94273144,"statfs":{"total":96636764160,"available":96535699456,"internally_reserved":0,"allocated":9428992,"data_stored":7842152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510163,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256288,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115552,"statfs":{"total":96636764160,"available":96374325248,"internally_reserved":0,"allocated":12992512,"data_stored":11338592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510164,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92020,"kb_used_data":6756,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279820,"statfs":{"total":96636764160,"available":96542535680,"internally_reserved":0,"allocated":6918144,"data_stored":5375493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510163,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147548,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94224292,"statfs":{"total":96636764160,"available":96485675008,"internally_reserved":0,"allocated":8335360,"data_stored":6711727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575573,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263468,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94108372,"statfs":{"total":96636764160,"available":96366972928,"internally_reserved":0,"allocated":7630848,"data_stored":5968019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262142408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3240346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":4574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330048,"data_stored":3240066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":9200737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5706939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8773632,"data_stored":8639695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2236416,"data_stored":2160102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7680000,"data_stored":7559766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:17:02.872 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.872 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.872 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.873 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.874 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.875 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.876 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.877 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.878 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:31:46.434147+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=31, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.879 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.880 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.881 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.882 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.882 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:34:59.419693+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=34, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.882 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.882 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.882 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:35:02.447518+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=35, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.883 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:17:28.616433+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.883 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.884 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.884 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:17:30.634857+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=17, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:02.885 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:17:22.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:17:23.218 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:17:23.229 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:17:23.231 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2066,"stamp":"2024-09-14T12:17:21.284278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24474050,"num_objects":732,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":313127,"num_read_kb":2443510,"num_write":166195,"num_write_kb":2394098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752415,"num_omap_keys":1802,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13591,"ondisk_log_size":13591,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1522528,"kb_used_data":73824,"kb_used_omap":12,"kb_used_meta":1448563,"kb_avail":753452192,"statfs":{"total":773094113280,"available":771535044608,"internally_reserved":0,"allocated":75595776,"data_stored":62600240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1483329075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005670"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.019269+0000","last_change":"2024-09-14T12:17:07.019269+0000","last_active":"2024-09-14T12:17:07.019269+0000","last_peered":"2024-09-14T12:17:07.019269+0000","last_clean":"2024-09-14T12:17:07.019269+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:17:07.019269+0000","last_undegraded":"2024-09-14T12:17:07.019269+0000","last_fullsized":"2024-09-14T12:17:07.019269+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:07.019177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:07.019177+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.019177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:19.933553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.063537+0000","last_change":"2024-09-14T12:17:08.063537+0000","last_active":"2024-09-14T12:17:08.063537+0000","last_peered":"2024-09-14T12:17:08.063537+0000","last_clean":"2024-09-14T12:17:08.063537+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:17:08.063537+0000","last_undegraded":"2024-09-14T12:17:08.063537+0000","last_fullsized":"2024-09-14T12:17:08.063537+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:08.063428+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:08.063428+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.063428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:24.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.609151+0000","last_change":"2024-09-14T12:17:08.609151+0000","last_active":"2024-09-14T12:17:08.609151+0000","last_peered":"2024-09-14T12:17:08.609151+0000","last_clean":"2024-09-14T12:17:08.609151+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:17:08.609151+0000","last_undegraded":"2024-09-14T12:17:08.609151+0000","last_fullsized":"2024-09-14T12:17:08.609151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:17:08.609011+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:17:08.609011+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.609011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:37.229018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.134426+0000","last_change":"2024-09-14T12:17:05.134426+0000","last_active":"2024-09-14T12:17:05.134426+0000","last_peered":"2024-09-14T12:17:05.134426+0000","last_clean":"2024-09-14T12:17:05.134426+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:17:05.134426+0000","last_undegraded":"2024-09-14T12:17:05.134426+0000","last_fullsized":"2024-09-14T12:17:05.134426+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T12:17:05.134331+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T12:17:05.134331+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.134331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:04.118068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.229089+0000","last_change":"2024-09-14T12:16:50.229089+0000","last_active":"2024-09-14T12:16:50.229089+0000","last_peered":"2024-09-14T12:16:50.229089+0000","last_clean":"2024-09-14T12:16:50.229089+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:16:50.229089+0000","last_undegraded":"2024-09-14T12:16:50.229089+0000","last_fullsized":"2024-09-14T12:16:50.229089+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.228992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.581044+0000","last_change":"2024-09-14T12:17:07.581044+0000","last_active":"2024-09-14T12:17:07.581044+0000","last_peered":"2024-09-14T12:17:07.581044+0000","last_clean":"2024-09-14T12:17:07.581044+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:17:07.581044+0000","last_undegraded":"2024-09-14T12:17:07.581044+0000","last_fullsized":"2024-09-14T12:17:07.581044+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:17:07.580944+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:17:07.580944+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.580944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.659355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.028331+0000","last_change":"2024-09-14T12:16:55.028331+0000","last_active":"2024-09-14T12:16:55.028331+0000","last_peered":"2024-09-14T12:16:55.028331+0000","last_clean":"2024-09-14T12:16:55.028331+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:16:55.028331+0000","last_undegraded":"2024-09-14T12:16:55.028331+0000","last_fullsized":"2024-09-14T12:16:55.028331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.028237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:15.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.227547+0000","last_change":"2024-09-14T12:16:41.227547+0000","last_active":"2024-09-14T12:16:41.227547+0000","last_peered":"2024-09-14T12:16:41.227547+0000","last_clean":"2024-09-14T12:16:41.227547+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:16:41.227547+0000","last_undegraded":"2024-09-14T12:16:41.227547+0000","last_fullsized":"2024-09-14T12:16:41.227547+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.227460+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:49.105464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.342822+0000","last_change":"2024-09-14T12:16:58.342822+0000","last_active":"2024-09-14T12:16:58.342822+0000","last_peered":"2024-09-14T12:16:58.342822+0000","last_clean":"2024-09-14T12:16:58.342822+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:16:58.342822+0000","last_undegraded":"2024-09-14T12:16:58.342822+0000","last_fullsized":"2024-09-14T12:16:58.342822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.342708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:41.494086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.189743+0000","last_change":"2024-09-14T12:17:15.189743+0000","last_active":"2024-09-14T12:17:15.189743+0000","last_peered":"2024-09-14T12:17:15.189743+0000","last_clean":"2024-09-14T12:17:15.189743+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:17:15.189743+0000","last_undegraded":"2024-09-14T12:17:15.189743+0000","last_fullsized":"2024-09-14T12:17:15.189743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:15.189650+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:15.189650+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.189650+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:42.747957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.199822+0000","last_change":"2024-09-14T12:16:46.199719+0000","last_active":"2024-09-14T12:16:46.199822+0000","last_peered":"2024-09-14T12:16:46.199822+0000","last_clean":"2024-09-14T12:16:46.199822+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:16:46.199822+0000","last_undegraded":"2024-09-14T12:16:46.199822+0000","last_fullsized":"2024-09-14T12:16:46.199822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.199614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:24.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.169202+0000","last_change":"2024-09-14T12:17:04.169202+0000","last_active":"2024-09-14T12:17:04.169202+0000","last_peered":"2024-09-14T12:17:04.169202+0000","last_clean":"2024-09-14T12:17:04.169202+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:17:04.169202+0000","last_undegraded":"2024-09-14T12:17:04.169202+0000","last_fullsized":"2024-09-14T12:17:04.169202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:17:04.169083+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:17:04.169083+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.169083+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:33.708704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:58.213833+0000","last_change":"2024-09-14T11:51:07.033934+0000","last_active":"2024-09-14T12:12:58.213833+0000","last_peered":"2024-09-14T12:12:58.213833+0000","last_clean":"2024-09-14T12:12:58.213833+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:12:58.213833+0000","last_undegraded":"2024-09-14T12:12:58.213833+0000","last_fullsized":"2024-09-14T12:12:58.213833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:49.969224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.572461+0000","last_change":"2024-09-14T12:17:16.572461+0000","last_active":"2024-09-14T12:17:16.572461+0000","last_peered":"2024-09-14T12:17:16.572461+0000","last_clean":"2024-09-14T12:17:16.572461+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:17:16.572461+0000","last_undegraded":"2024-09-14T12:17:16.572461+0000","last_fullsized":"2024-09-14T12:17:16.572461+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:17:16.572372+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:17:16.572372+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.572372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:36.165562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.642353+0000","last_change":"2024-09-14T12:17:02.642353+0000","last_active":"2024-09-14T12:17:02.642353+0000","last_peered":"2024-09-14T12:17:02.642353+0000","last_clean":"2024-09-14T12:17:02.642353+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:17:02.642353+0000","last_undegraded":"2024-09-14T12:17:02.642353+0000","last_fullsized":"2024-09-14T12:17:02.642353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:02.642266+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:02.642266+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.642266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:17.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.598554+0000","last_change":"2024-09-14T12:17:06.598554+0000","last_active":"2024-09-14T12:17:06.598554+0000","last_peered":"2024-09-14T12:17:06.598554+0000","last_clean":"2024-09-14T12:17:06.598554+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:17:06.598554+0000","last_undegraded":"2024-09-14T12:17:06.598554+0000","last_fullsized":"2024-09-14T12:17:06.598554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T12:17:06.598461+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T12:17:06.598461+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.598461+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:00.166620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:15:13.231288+0000","last_change":"2024-09-14T11:51:07.034907+0000","last_active":"2024-09-14T12:15:13.231288+0000","last_peered":"2024-09-14T12:15:13.231288+0000","last_clean":"2024-09-14T12:15:13.231288+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:15:13.231288+0000","last_undegraded":"2024-09-14T12:15:13.231288+0000","last_fullsized":"2024-09-14T12:15:13.231288+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.944576+0000","last_change":"2024-09-14T12:17:03.944576+0000","last_active":"2024-09-14T12:17:03.944576+0000","last_peered":"2024-09-14T12:17:03.944576+0000","last_clean":"2024-09-14T12:17:03.944576+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:17:03.944576+0000","last_undegraded":"2024-09-14T12:17:03.944576+0000","last_fullsized":"2024-09-14T12:17:03.944576+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:03.944487+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:03.944487+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.944487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:58.024730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4136,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.195290+0000","last_change":"2024-09-14T12:17:10.195290+0000","last_active":"2024-09-14T12:17:10.195290+0000","last_peered":"2024-09-14T12:17:10.195290+0000","last_clean":"2024-09-14T12:17:10.195290+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:17:10.195290+0000","last_undegraded":"2024-09-14T12:17:10.195290+0000","last_fullsized":"2024-09-14T12:17:10.195290+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:10.195208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:10.195208+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.195208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:10.075402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.608858+0000","last_change":"2024-09-14T12:17:10.608858+0000","last_active":"2024-09-14T12:17:10.608858+0000","last_peered":"2024-09-14T12:17:10.608858+0000","last_clean":"2024-09-14T12:17:10.608858+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:17:10.608858+0000","last_undegraded":"2024-09-14T12:17:10.608858+0000","last_fullsized":"2024-09-14T12:17:10.608858+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T12:17:10.608758+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T12:17:10.608758+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.608758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:56.066682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.000001+0000","last_change":"2024-09-14T12:16:58.000001+0000","last_active":"2024-09-14T12:16:58.000001+0000","last_peered":"2024-09-14T12:16:58.000001+0000","last_clean":"2024-09-14T12:16:58.000001+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:16:58.000001+0000","last_undegraded":"2024-09-14T12:16:58.000001+0000","last_fullsized":"2024-09-14T12:16:58.000001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.999898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:38.804877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.417537+0000","last_change":"2024-09-14T12:16:55.417537+0000","last_active":"2024-09-14T12:16:55.417537+0000","last_peered":"2024-09-14T12:16:55.417537+0000","last_clean":"2024-09-14T12:16:55.417537+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:16:55.417537+0000","last_undegraded":"2024-09-14T12:16:55.417537+0000","last_fullsized":"2024-09-14T12:16:55.417537+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.417453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.938224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.688300+0000","last_change":"2024-09-14T12:17:00.688300+0000","last_active":"2024-09-14T12:17:00.688300+0000","last_peered":"2024-09-14T12:17:00.688300+0000","last_clean":"2024-09-14T12:17:00.688300+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:17:00.688300+0000","last_undegraded":"2024-09-14T12:17:00.688300+0000","last_fullsized":"2024-09-14T12:17:00.688300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:00.688205+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:00.688205+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.688205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:00.261789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.431266+0000","last_change":"2024-09-14T12:16:50.431266+0000","last_active":"2024-09-14T12:16:50.431266+0000","last_peered":"2024-09-14T12:16:50.431266+0000","last_clean":"2024-09-14T12:16:50.431266+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:16:50.431266+0000","last_undegraded":"2024-09-14T12:16:50.431266+0000","last_fullsized":"2024-09-14T12:16:50.431266+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'265","last_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_deep_scrub":"263'265","last_deep_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.431183+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.247620+0000","last_change":"2024-09-14T12:17:17.247620+0000","last_active":"2024-09-14T12:17:17.247620+0000","last_peered":"2024-09-14T12:17:17.247620+0000","last_clean":"2024-09-14T12:17:17.247620+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:17:17.247620+0000","last_undegraded":"2024-09-14T12:17:17.247620+0000","last_fullsized":"2024-09-14T12:17:17.247620+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:17.247529+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:17.247529+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.247529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:50.940674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.370761+0000","last_change":"2024-09-14T12:16:56.370761+0000","last_active":"2024-09-14T12:16:56.370761+0000","last_peered":"2024-09-14T12:16:56.370761+0000","last_clean":"2024-09-14T12:16:56.370761+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:16:56.370761+0000","last_undegraded":"2024-09-14T12:16:56.370761+0000","last_fullsized":"2024-09-14T12:16:56.370761+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.370676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.956462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.690828+0000","last_change":"2024-09-14T12:17:01.690828+0000","last_active":"2024-09-14T12:17:01.690828+0000","last_peered":"2024-09-14T12:17:01.690828+0000","last_clean":"2024-09-14T12:17:01.690828+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:17:01.690828+0000","last_undegraded":"2024-09-14T12:17:01.690828+0000","last_fullsized":"2024-09-14T12:17:01.690828+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T12:17:01.690712+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T12:17:01.690712+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.690712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:59.611639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":400,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.119461+0000","last_change":"2024-09-14T12:17:03.119461+0000","last_active":"2024-09-14T12:17:03.119461+0000","last_peered":"2024-09-14T12:17:03.119461+0000","last_clean":"2024-09-14T12:17:03.119461+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:17:03.119461+0000","last_undegraded":"2024-09-14T12:17:03.119461+0000","last_fullsized":"2024-09-14T12:17:03.119461+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-14T12:17:03.119395+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-14T12:17:03.119395+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.119395+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:02.567148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:18.249308+0000","last_change":"2024-09-14T12:17:18.249308+0000","last_active":"2024-09-14T12:17:18.249308+0000","last_peered":"2024-09-14T12:17:18.249308+0000","last_clean":"2024-09-14T12:17:18.249308+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:17:18.249308+0000","last_undegraded":"2024-09-14T12:17:18.249308+0000","last_fullsized":"2024-09-14T12:17:18.249308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:18.249217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:18.249217+0000","last_clean_scrub_stamp":"2024-09-14T12:17:18.249217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:38.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'14","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.598485+0000","last_change":"2024-09-14T12:17:17.598485+0000","last_active":"2024-09-14T12:17:17.598485+0000","last_peered":"2024-09-14T12:17:17.598485+0000","last_clean":"2024-09-14T12:17:17.598485+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:17:17.598485+0000","last_undegraded":"2024-09-14T12:17:17.598485+0000","last_fullsized":"2024-09-14T12:17:17.598485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T12:17:17.598364+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T12:17:17.598364+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.598364+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:54.486775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17412,"num_write":24,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.181898+0000","last_change":"2024-09-14T12:17:11.181898+0000","last_active":"2024-09-14T12:17:11.181898+0000","last_peered":"2024-09-14T12:17:11.181898+0000","last_clean":"2024-09-14T12:17:11.181898+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:17:11.181898+0000","last_undegraded":"2024-09-14T12:17:11.181898+0000","last_fullsized":"2024-09-14T12:17:11.181898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:11.181775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:11.181775+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.181775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:38.051954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.038191+0000","last_change":"2024-09-14T12:16:52.038191+0000","last_active":"2024-09-14T12:16:52.038191+0000","last_peered":"2024-09-14T12:16:52.038191+0000","last_clean":"2024-09-14T12:16:52.038191+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:16:52.038191+0000","last_undegraded":"2024-09-14T12:16:52.038191+0000","last_fullsized":"2024-09-14T12:16:52.038191+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.038107+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:18.125308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.972034+0000","last_change":"2024-09-14T12:16:58.972034+0000","last_active":"2024-09-14T12:16:58.972034+0000","last_peered":"2024-09-14T12:16:58.972034+0000","last_clean":"2024-09-14T12:16:58.972034+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:16:58.972034+0000","last_undegraded":"2024-09-14T12:16:58.972034+0000","last_fullsized":"2024-09-14T12:16:58.972034+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:58.971950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:58.971950+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.971950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:26.780169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.577501+0000","last_change":"2024-09-14T12:17:14.577501+0000","last_active":"2024-09-14T12:17:14.577501+0000","last_peered":"2024-09-14T12:17:14.577501+0000","last_clean":"2024-09-14T12:17:14.577501+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:17:14.577501+0000","last_undegraded":"2024-09-14T12:17:14.577501+0000","last_fullsized":"2024-09-14T12:17:14.577501+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.577357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.577357+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.577357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:47.870036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'6","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.944028+0000","last_change":"2024-09-14T12:16:59.943970+0000","last_active":"2024-09-14T12:16:59.944028+0000","last_peered":"2024-09-14T12:16:59.944028+0000","last_clean":"2024-09-14T12:16:59.944028+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:16:59.944028+0000","last_undegraded":"2024-09-14T12:16:59.944028+0000","last_fullsized":"2024-09-14T12:16:59.944028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:59.943885+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:59.943885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.943885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:15.267546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6146,"num_write":6,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.134072+0000","last_change":"2024-09-14T12:17:02.134072+0000","last_active":"2024-09-14T12:17:02.134072+0000","last_peered":"2024-09-14T12:17:02.134072+0000","last_clean":"2024-09-14T12:17:02.134072+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:17:02.134072+0000","last_undegraded":"2024-09-14T12:17:02.134072+0000","last_fullsized":"2024-09-14T12:17:02.134072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T12:17:02.133982+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T12:17:02.133982+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.133982+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:35.664857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.211985+0000","last_change":"2024-09-14T12:16:47.211908+0000","last_active":"2024-09-14T12:16:47.211985+0000","last_peered":"2024-09-14T12:16:47.211985+0000","last_clean":"2024-09-14T12:16:47.211985+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:16:47.211985+0000","last_undegraded":"2024-09-14T12:16:47.211985+0000","last_fullsized":"2024-09-14T12:16:47.211985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.211816+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:34.600918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.214066+0000","last_change":"2024-09-14T12:17:14.214066+0000","last_active":"2024-09-14T12:17:14.214066+0000","last_peered":"2024-09-14T12:17:14.214066+0000","last_clean":"2024-09-14T12:17:14.214066+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:17:14.214066+0000","last_undegraded":"2024-09-14T12:17:14.214066+0000","last_fullsized":"2024-09-14T12:17:14.214066+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.213970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.213970+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.213970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:48.729690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.224968+0000","last_change":"2024-09-14T12:17:06.224968+0000","last_active":"2024-09-14T12:17:06.224968+0000","last_peered":"2024-09-14T12:17:06.224968+0000","last_clean":"2024-09-14T12:17:06.224968+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:17:06.224968+0000","last_undegraded":"2024-09-14T12:17:06.224968+0000","last_fullsized":"2024-09-14T12:17:06.224968+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:06.224869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:06.224869+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.224869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:05.803432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.587073+0000","last_change":"2024-09-14T12:17:03.587073+0000","last_active":"2024-09-14T12:17:03.587073+0000","last_peered":"2024-09-14T12:17:03.587073+0000","last_clean":"2024-09-14T12:17:03.587073+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:17:03.587073+0000","last_undegraded":"2024-09-14T12:17:03.587073+0000","last_fullsized":"2024-09-14T12:17:03.587073+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-14T12:17:03.586996+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-14T12:17:03.586996+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.586996+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:16.699021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.246719+0000","last_change":"2024-09-14T12:17:16.246719+0000","last_active":"2024-09-14T12:17:16.246719+0000","last_peered":"2024-09-14T12:17:16.246719+0000","last_clean":"2024-09-14T12:17:16.246719+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:17:16.246719+0000","last_undegraded":"2024-09-14T12:17:16.246719+0000","last_fullsized":"2024-09-14T12:17:16.246719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:16.246628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:16.246628+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.246628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:53.876662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.621508+0000","last_change":"2024-09-14T12:17:15.621508+0000","last_active":"2024-09-14T12:17:15.621508+0000","last_peered":"2024-09-14T12:17:15.621508+0000","last_clean":"2024-09-14T12:17:15.621508+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:17:15.621508+0000","last_undegraded":"2024-09-14T12:17:15.621508+0000","last_fullsized":"2024-09-14T12:17:15.621508+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:15.621419+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:15.621419+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.621419+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.277512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":14,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.223174+0000","last_change":"2024-09-14T12:16:45.223174+0000","last_active":"2024-09-14T12:16:45.223174+0000","last_peered":"2024-09-14T12:16:45.223174+0000","last_clean":"2024-09-14T12:16:45.223174+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:16:45.223174+0000","last_undegraded":"2024-09-14T12:16:45.223174+0000","last_fullsized":"2024-09-14T12:16:45.223174+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.223090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.214548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.249068+0000","last_change":"2024-09-14T12:16:42.249068+0000","last_active":"2024-09-14T12:16:42.249068+0000","last_peered":"2024-09-14T12:16:42.249068+0000","last_clean":"2024-09-14T12:16:42.249068+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:16:42.249068+0000","last_undegraded":"2024-09-14T12:16:42.249068+0000","last_fullsized":"2024-09-14T12:16:42.249068+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.248991+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:14.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.984407+0000","last_change":"2024-09-14T12:17:05.984407+0000","last_active":"2024-09-14T12:17:05.984407+0000","last_peered":"2024-09-14T12:17:05.984407+0000","last_clean":"2024-09-14T12:17:05.984407+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:17:05.984407+0000","last_undegraded":"2024-09-14T12:17:05.984407+0000","last_fullsized":"2024-09-14T12:17:05.984407+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:05.984319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:05.984319+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.984319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:28.740340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.625185+0000","last_change":"2024-09-14T12:17:05.625185+0000","last_active":"2024-09-14T12:17:05.625185+0000","last_peered":"2024-09-14T12:17:05.625185+0000","last_clean":"2024-09-14T12:17:05.625185+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:17:05.625185+0000","last_undegraded":"2024-09-14T12:17:05.625185+0000","last_fullsized":"2024-09-14T12:17:05.625185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:05.625070+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:05.625070+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.625070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:26.975016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.200117+0000","last_change":"2024-09-14T12:17:09.200117+0000","last_active":"2024-09-14T12:17:09.200117+0000","last_peered":"2024-09-14T12:17:09.200117+0000","last_clean":"2024-09-14T12:17:09.200117+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:17:09.200117+0000","last_undegraded":"2024-09-14T12:17:09.200117+0000","last_fullsized":"2024-09-14T12:17:09.200117+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:09.199985+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:09.199985+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.199985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:39.696381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.227876+0000","last_change":"2024-09-14T12:17:01.227876+0000","last_active":"2024-09-14T12:17:01.227876+0000","last_peered":"2024-09-14T12:17:01.227876+0000","last_clean":"2024-09-14T12:17:01.227876+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:17:01.227876+0000","last_undegraded":"2024-09-14T12:17:01.227876+0000","last_fullsized":"2024-09-14T12:17:01.227876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:17:01.227773+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:17:01.227773+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.227773+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.528932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213306+0000","last_change":"2024-09-14T11:51:07.036196+0000","last_active":"2024-09-14T12:12:53.213306+0000","last_peered":"2024-09-14T12:12:53.213306+0000","last_clean":"2024-09-14T12:12:53.213306+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:12:53.213306+0000","last_undegraded":"2024-09-14T12:12:53.213306+0000","last_fullsized":"2024-09-14T12:12:53.213306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:27.860597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.921860+0000","last_change":"2024-09-14T12:17:02.921789+0000","last_active":"2024-09-14T12:17:02.921860+0000","last_peered":"2024-09-14T12:17:02.921860+0000","last_clean":"2024-09-14T12:17:02.921860+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:17:02.921860+0000","last_undegraded":"2024-09-14T12:17:02.921860+0000","last_fullsized":"2024-09-14T12:17:02.921860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:02.921718+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:02.921718+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.921718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:55.013116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.672300+0000","last_change":"2024-09-14T12:16:59.672229+0000","last_active":"2024-09-14T12:16:59.672300+0000","last_peered":"2024-09-14T12:16:59.672300+0000","last_clean":"2024-09-14T12:16:59.672300+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:16:59.672300+0000","last_undegraded":"2024-09-14T12:16:59.672300+0000","last_fullsized":"2024-09-14T12:16:59.672300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:59.672101+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:59.672101+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.672101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:03.829961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.186283+0000","last_change":"2024-09-14T12:17:00.186283+0000","last_active":"2024-09-14T12:17:00.186283+0000","last_peered":"2024-09-14T12:17:00.186283+0000","last_clean":"2024-09-14T12:17:00.186283+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:17:00.186283+0000","last_undegraded":"2024-09-14T12:17:00.186283+0000","last_fullsized":"2024-09-14T12:17:00.186283+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T12:17:00.186189+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T12:17:00.186189+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.186189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:25.895425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:20.218734+0000","last_change":"2024-09-14T12:17:20.218734+0000","last_active":"2024-09-14T12:17:20.218734+0000","last_peered":"2024-09-14T12:17:20.218734+0000","last_clean":"2024-09-14T12:17:20.218734+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:17:20.218734+0000","last_undegraded":"2024-09-14T12:17:20.218734+0000","last_fullsized":"2024-09-14T12:17:20.218734+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:20.218615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:20.218615+0000","last_clean_scrub_stamp":"2024-09-14T12:17:20.218615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:27.676022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.009850+0000","last_change":"2024-09-14T12:16:57.009764+0000","last_active":"2024-09-14T12:16:57.009850+0000","last_peered":"2024-09-14T12:16:57.009850+0000","last_clean":"2024-09-14T12:16:57.009850+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:16:57.009850+0000","last_undegraded":"2024-09-14T12:16:57.009850+0000","last_fullsized":"2024-09-14T12:16:57.009850+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.009666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:55.446041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.603128+0000","last_change":"2024-09-14T12:17:07.603128+0000","last_active":"2024-09-14T12:17:07.603128+0000","last_peered":"2024-09-14T12:17:07.603128+0000","last_clean":"2024-09-14T12:17:07.603128+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:17:07.603128+0000","last_undegraded":"2024-09-14T12:17:07.603128+0000","last_fullsized":"2024-09-14T12:17:07.603128+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:07.603039+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:07.603039+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.603039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:06.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.146136+0000","last_change":"2024-09-14T12:17:01.146136+0000","last_active":"2024-09-14T12:17:01.146136+0000","last_peered":"2024-09-14T12:17:01.146136+0000","last_clean":"2024-09-14T12:17:01.146136+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:17:01.146136+0000","last_undegraded":"2024-09-14T12:17:01.146136+0000","last_fullsized":"2024-09-14T12:17:01.146136+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:17:01.146043+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:17:01.146043+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.146043+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:21.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:19.214673+0000","last_change":"2024-09-14T12:17:19.214673+0000","last_active":"2024-09-14T12:17:19.214673+0000","last_peered":"2024-09-14T12:17:19.214673+0000","last_clean":"2024-09-14T12:17:19.214673+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:17:19.214673+0000","last_undegraded":"2024-09-14T12:17:19.214673+0000","last_fullsized":"2024-09-14T12:17:19.214673+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:19.214591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:19.214591+0000","last_clean_scrub_stamp":"2024-09-14T12:17:19.214591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:24.407871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.606453+0000","last_change":"2024-09-14T12:17:13.606453+0000","last_active":"2024-09-14T12:17:13.606453+0000","last_peered":"2024-09-14T12:17:13.606453+0000","last_clean":"2024-09-14T12:17:13.606453+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:17:13.606453+0000","last_undegraded":"2024-09-14T12:17:13.606453+0000","last_fullsized":"2024-09-14T12:17:13.606453+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:13.606354+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:13.606354+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.606354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:03.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7286,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'13","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.486128+0000","last_change":"2024-09-14T12:16:52.486051+0000","last_active":"2024-09-14T12:16:52.486128+0000","last_peered":"2024-09-14T12:16:52.486128+0000","last_clean":"2024-09-14T12:16:52.486128+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:16:52.486128+0000","last_undegraded":"2024-09-14T12:16:52.486128+0000","last_fullsized":"2024-09-14T12:16:52.486128+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.485960+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.159924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16386,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.654524+0000","last_change":"2024-09-14T12:16:58.654524+0000","last_active":"2024-09-14T12:16:58.654524+0000","last_peered":"2024-09-14T12:16:58.654524+0000","last_clean":"2024-09-14T12:16:58.654524+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:16:58.654524+0000","last_undegraded":"2024-09-14T12:16:58.654524+0000","last_fullsized":"2024-09-14T12:16:58.654524+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-14T12:16:58.654417+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-14T12:16:58.654417+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.654417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:14.309793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:12:53.213270+0000","last_change":"2024-09-14T11:51:07.032542+0000","last_active":"2024-09-14T12:12:53.213270+0000","last_peered":"2024-09-14T12:12:53.213270+0000","last_clean":"2024-09-14T12:12:53.213270+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:12:53.213270+0000","last_undegraded":"2024-09-14T12:12:53.213270+0000","last_fullsized":"2024-09-14T12:12:53.213270+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:03.356486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.452148+0000","last_change":"2024-09-14T12:16:53.452074+0000","last_active":"2024-09-14T12:16:53.452148+0000","last_peered":"2024-09-14T12:16:53.452148+0000","last_clean":"2024-09-14T12:16:53.452148+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:16:53.452148+0000","last_undegraded":"2024-09-14T12:16:53.452148+0000","last_fullsized":"2024-09-14T12:16:53.452148+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.451986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:58.732860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.920534+0000","last_change":"2024-09-14T12:17:00.920440+0000","last_active":"2024-09-14T12:17:00.920534+0000","last_peered":"2024-09-14T12:17:00.920534+0000","last_clean":"2024-09-14T12:17:00.920534+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:17:00.920534+0000","last_undegraded":"2024-09-14T12:17:00.920534+0000","last_fullsized":"2024-09-14T12:17:00.920534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:17:00.920346+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:17:00.920346+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.920346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:46.070865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.552445+0000","last_change":"2024-09-14T12:17:02.552445+0000","last_active":"2024-09-14T12:17:02.552445+0000","last_peered":"2024-09-14T12:17:02.552445+0000","last_clean":"2024-09-14T12:17:02.552445+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:17:02.552445+0000","last_undegraded":"2024-09-14T12:17:02.552445+0000","last_fullsized":"2024-09-14T12:17:02.552445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"252'22","last_scrub_stamp":"2024-09-14T12:17:02.552354+0000","last_deep_scrub":"252'22","last_deep_scrub_stamp":"2024-09-14T12:17:02.552354+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.552354+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:10.699433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.228850+0000","last_change":"2024-09-14T12:16:43.228751+0000","last_active":"2024-09-14T12:16:43.228850+0000","last_peered":"2024-09-14T12:16:43.228850+0000","last_clean":"2024-09-14T12:16:43.228850+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:16:43.228850+0000","last_undegraded":"2024-09-14T12:16:43.228850+0000","last_fullsized":"2024-09-14T12:16:43.228850+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.228673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:31.730916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.620312+0000","last_change":"2024-09-14T12:17:11.620312+0000","last_active":"2024-09-14T12:17:11.620312+0000","last_peered":"2024-09-14T12:17:11.620312+0000","last_clean":"2024-09-14T12:17:11.620312+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:17:11.620312+0000","last_undegraded":"2024-09-14T12:17:11.620312+0000","last_fullsized":"2024-09-14T12:17:11.620312+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:17:11.620222+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:17:11.620222+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.620222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:11.712906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.272435+0000","last_change":"2024-09-14T12:17:05.272435+0000","last_active":"2024-09-14T12:17:05.272435+0000","last_peered":"2024-09-14T12:17:05.272435+0000","last_clean":"2024-09-14T12:17:05.272435+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:17:05.272435+0000","last_undegraded":"2024-09-14T12:17:05.272435+0000","last_fullsized":"2024-09-14T12:17:05.272435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T12:17:05.272343+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T12:17:05.272343+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.272343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:00.474493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.614121+0000","last_change":"2024-09-14T12:17:04.614121+0000","last_active":"2024-09-14T12:17:04.614121+0000","last_peered":"2024-09-14T12:17:04.614121+0000","last_clean":"2024-09-14T12:17:04.614121+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:17:04.614121+0000","last_undegraded":"2024-09-14T12:17:04.614121+0000","last_fullsized":"2024-09-14T12:17:04.614121+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'48","last_scrub_stamp":"2024-09-14T12:17:04.614030+0000","last_deep_scrub":"263'48","last_deep_scrub_stamp":"2024-09-14T12:17:04.614030+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.614030+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:44.773185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.159736+0000","last_change":"2024-09-14T12:17:13.159736+0000","last_active":"2024-09-14T12:17:13.159736+0000","last_peered":"2024-09-14T12:17:13.159736+0000","last_clean":"2024-09-14T12:17:13.159736+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:17:13.159736+0000","last_undegraded":"2024-09-14T12:17:13.159736+0000","last_fullsized":"2024-09-14T12:17:13.159736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:13.159651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:13.159651+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.159651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:00.979980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.567286+0000","last_change":"2024-09-14T12:17:09.567286+0000","last_active":"2024-09-14T12:17:09.567286+0000","last_peered":"2024-09-14T12:17:09.567286+0000","last_clean":"2024-09-14T12:17:09.567286+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:17:09.567286+0000","last_undegraded":"2024-09-14T12:17:09.567286+0000","last_fullsized":"2024-09-14T12:17:09.567286+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:09.567203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:09.567203+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.567203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:10.474914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.239047+0000","last_change":"2024-09-14T12:16:48.239047+0000","last_active":"2024-09-14T12:16:48.239047+0000","last_peered":"2024-09-14T12:16:48.239047+0000","last_clean":"2024-09-14T12:16:48.239047+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:16:48.239047+0000","last_undegraded":"2024-09-14T12:16:48.239047+0000","last_fullsized":"2024-09-14T12:16:48.239047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.238958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:48.498973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.915365+0000","last_change":"2024-09-14T12:16:58.915365+0000","last_active":"2024-09-14T12:16:58.915365+0000","last_peered":"2024-09-14T12:16:58.915365+0000","last_clean":"2024-09-14T12:16:58.915365+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:16:58.915365+0000","last_undegraded":"2024-09-14T12:16:58.915365+0000","last_fullsized":"2024-09-14T12:16:58.915365+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-14T12:16:58.915279+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-14T12:16:58.915279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.915279+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:15.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.356193+0000","last_change":"2024-09-14T12:16:57.356091+0000","last_active":"2024-09-14T12:16:57.356193+0000","last_peered":"2024-09-14T12:16:57.356193+0000","last_clean":"2024-09-14T12:16:57.356193+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:16:57.356193+0000","last_undegraded":"2024-09-14T12:16:57.356193+0000","last_fullsized":"2024-09-14T12:16:57.356193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.355955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:36.110361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.055519+0000","last_change":"2024-09-14T12:16:56.055519+0000","last_active":"2024-09-14T12:16:56.055519+0000","last_peered":"2024-09-14T12:16:56.055519+0000","last_clean":"2024-09-14T12:16:56.055519+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:16:56.055519+0000","last_undegraded":"2024-09-14T12:16:56.055519+0000","last_fullsized":"2024-09-14T12:16:56.055519+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.055430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:58.544259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.210624+0000","last_change":"2024-09-14T12:17:08.210624+0000","last_active":"2024-09-14T12:17:08.210624+0000","last_peered":"2024-09-14T12:17:08.210624+0000","last_clean":"2024-09-14T12:17:08.210624+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:17:08.210624+0000","last_undegraded":"2024-09-14T12:17:08.210624+0000","last_fullsized":"2024-09-14T12:17:08.210624+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:08.210533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:08.210533+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.210533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:09.236096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.418419+0000","last_change":"2024-09-14T12:16:49.418419+0000","last_active":"2024-09-14T12:16:49.418419+0000","last_peered":"2024-09-14T12:16:49.418419+0000","last_clean":"2024-09-14T12:16:49.418419+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:16:49.418419+0000","last_undegraded":"2024-09-14T12:16:49.418419+0000","last_fullsized":"2024-09-14T12:16:49.418419+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.418336+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.489845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.184652+0000","last_change":"2024-09-14T12:17:12.184652+0000","last_active":"2024-09-14T12:17:12.184652+0000","last_peered":"2024-09-14T12:17:12.184652+0000","last_clean":"2024-09-14T12:17:12.184652+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:17:12.184652+0000","last_undegraded":"2024-09-14T12:17:12.184652+0000","last_fullsized":"2024-09-14T12:17:12.184652+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:12.184560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:12.184560+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.184560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:08.001019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.615380+0000","last_change":"2024-09-14T12:17:12.615380+0000","last_active":"2024-09-14T12:17:12.615380+0000","last_peered":"2024-09-14T12:17:12.615380+0000","last_clean":"2024-09-14T12:17:12.615380+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:17:12.615380+0000","last_undegraded":"2024-09-14T12:17:12.615380+0000","last_fullsized":"2024-09-14T12:17:12.615380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:12.615255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:12.615255+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.615255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:10.596908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.029184+0000","last_change":"2024-09-14T12:16:53.029184+0000","last_active":"2024-09-14T12:16:53.029184+0000","last_peered":"2024-09-14T12:16:53.029184+0000","last_clean":"2024-09-14T12:16:53.029184+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:16:53.029184+0000","last_undegraded":"2024-09-14T12:16:53.029184+0000","last_fullsized":"2024-09-14T12:16:53.029184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.029084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:57.527264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.212969+0000","last_change":"2024-09-14T12:16:39.212912+0000","last_active":"2024-09-14T12:16:39.212969+0000","last_peered":"2024-09-14T12:16:39.212969+0000","last_clean":"2024-09-14T12:16:39.212969+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:16:39.212969+0000","last_undegraded":"2024-09-14T12:16:39.212969+0000","last_fullsized":"2024-09-14T12:16:39.212969+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.212821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:58.488819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:13:38.218841+0000","last_change":"2024-09-14T11:51:07.034921+0000","last_active":"2024-09-14T12:13:38.218841+0000","last_peered":"2024-09-14T12:13:38.218841+0000","last_clean":"2024-09-14T12:13:38.218841+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:13:38.218841+0000","last_undegraded":"2024-09-14T12:13:38.218841+0000","last_fullsized":"2024-09-14T12:13:38.218841+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:51:06.009856+0000","last_clean_scrub_stamp":"2024-09-14T11:51:06.009856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:25.237253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.592499+0000","last_change":"2024-09-14T12:17:06.592499+0000","last_active":"2024-09-14T12:17:06.592499+0000","last_peered":"2024-09-14T12:17:06.592499+0000","last_clean":"2024-09-14T12:17:06.592499+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:17:06.592499+0000","last_undegraded":"2024-09-14T12:17:06.592499+0000","last_fullsized":"2024-09-14T12:17:06.592499+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:06.592372+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:06.592372+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.592372+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:38.536535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9588,"num_write":6,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.157748+0000","last_change":"2024-09-14T12:17:06.157748+0000","last_active":"2024-09-14T12:17:06.157748+0000","last_peered":"2024-09-14T12:17:06.157748+0000","last_clean":"2024-09-14T12:17:06.157748+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:17:06.157748+0000","last_undegraded":"2024-09-14T12:17:06.157748+0000","last_fullsized":"2024-09-14T12:17:06.157748+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:06.157663+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:06.157663+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.157663+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:59.796913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.158587+0000","last_change":"2024-09-14T12:16:59.158587+0000","last_active":"2024-09-14T12:16:59.158587+0000","last_peered":"2024-09-14T12:16:59.158587+0000","last_clean":"2024-09-14T12:16:59.158587+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:16:59.158587+0000","last_undegraded":"2024-09-14T12:16:59.158587+0000","last_fullsized":"2024-09-14T12:16:59.158587+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.158491+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:35.267689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.202383+0000","last_change":"2024-09-14T12:17:14.202383+0000","last_active":"2024-09-14T12:17:14.202383+0000","last_peered":"2024-09-14T12:17:14.202383+0000","last_clean":"2024-09-14T12:17:14.202383+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:17:14.202383+0000","last_undegraded":"2024-09-14T12:17:14.202383+0000","last_fullsized":"2024-09-14T12:17:14.202383+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.202292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.202292+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.202292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:23.280210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.183727+0000","last_change":"2024-09-14T12:17:07.183727+0000","last_active":"2024-09-14T12:17:07.183727+0000","last_peered":"2024-09-14T12:17:07.183727+0000","last_clean":"2024-09-14T12:17:07.183727+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:17:07.183727+0000","last_undegraded":"2024-09-14T12:17:07.183727+0000","last_fullsized":"2024-09-14T12:17:07.183727+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:17:07.183635+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:17:07.183635+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.183635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:07.455512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.950514+0000","last_change":"2024-09-14T12:17:00.950514+0000","last_active":"2024-09-14T12:17:00.950514+0000","last_peered":"2024-09-14T12:17:00.950514+0000","last_clean":"2024-09-14T12:17:00.950514+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:17:00.950514+0000","last_undegraded":"2024-09-14T12:17:00.950514+0000","last_fullsized":"2024-09-14T12:17:00.950514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:17:00.950432+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:17:00.950432+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.950432+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:48.161571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.205563+0000","last_change":"2024-09-14T12:16:58.205563+0000","last_active":"2024-09-14T12:16:58.205563+0000","last_peered":"2024-09-14T12:16:58.205563+0000","last_clean":"2024-09-14T12:16:58.205563+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:16:58.205563+0000","last_undegraded":"2024-09-14T12:16:58.205563+0000","last_fullsized":"2024-09-14T12:16:58.205563+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.205482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:05.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.217929+0000","last_change":"2024-09-14T12:17:15.217929+0000","last_active":"2024-09-14T12:17:15.217929+0000","last_peered":"2024-09-14T12:17:15.217929+0000","last_clean":"2024-09-14T12:17:15.217929+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:17:15.217929+0000","last_undegraded":"2024-09-14T12:17:15.217929+0000","last_fullsized":"2024-09-14T12:17:15.217929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:15.217832+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:15.217832+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.217832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:17.283468+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.990589+0000","last_change":"2024-09-14T12:16:53.990589+0000","last_active":"2024-09-14T12:16:53.990589+0000","last_peered":"2024-09-14T12:16:53.990589+0000","last_clean":"2024-09-14T12:16:53.990589+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:16:53.990589+0000","last_undegraded":"2024-09-14T12:16:53.990589+0000","last_fullsized":"2024-09-14T12:16:53.990589+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.990505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:38.600472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.169621+0000","last_change":"2024-09-14T12:17:07.169621+0000","last_active":"2024-09-14T12:17:07.169621+0000","last_peered":"2024-09-14T12:17:07.169621+0000","last_clean":"2024-09-14T12:17:07.169621+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:17:07.169621+0000","last_undegraded":"2024-09-14T12:17:07.169621+0000","last_fullsized":"2024-09-14T12:17:07.169621+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:07.169491+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:07.169491+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.169491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:45.160313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.554717+0000","last_change":"2024-09-14T12:17:01.554660+0000","last_active":"2024-09-14T12:17:01.554717+0000","last_peered":"2024-09-14T12:17:01.554717+0000","last_clean":"2024-09-14T12:17:01.554717+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:17:01.554717+0000","last_undegraded":"2024-09-14T12:17:01.554717+0000","last_fullsized":"2024-09-14T12:17:01.554717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T12:17:01.554575+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T12:17:01.554575+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.554575+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:10.108408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:18.231298+0000","last_change":"2024-09-14T12:17:18.231298+0000","last_active":"2024-09-14T12:17:18.231298+0000","last_peered":"2024-09-14T12:17:18.231298+0000","last_clean":"2024-09-14T12:17:18.231298+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:17:18.231298+0000","last_undegraded":"2024-09-14T12:17:18.231298+0000","last_fullsized":"2024-09-14T12:17:18.231298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:18.231180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:18.231180+0000","last_clean_scrub_stamp":"2024-09-14T12:17:18.231180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.224290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.162085+0000","last_change":"2024-09-14T12:17:08.162085+0000","last_active":"2024-09-14T12:17:08.162085+0000","last_peered":"2024-09-14T12:17:08.162085+0000","last_clean":"2024-09-14T12:17:08.162085+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:17:08.162085+0000","last_undegraded":"2024-09-14T12:17:08.162085+0000","last_fullsized":"2024-09-14T12:17:08.162085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:17:08.161996+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:17:08.161996+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.161996+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.933575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.686308+0000","last_change":"2024-09-14T12:16:57.686308+0000","last_active":"2024-09-14T12:16:57.686308+0000","last_peered":"2024-09-14T12:16:57.686308+0000","last_clean":"2024-09-14T12:16:57.686308+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:16:57.686308+0000","last_undegraded":"2024-09-14T12:16:57.686308+0000","last_fullsized":"2024-09-14T12:16:57.686308+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.686213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:26.967385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.448367+0000","last_change":"2024-09-14T12:16:48.448296+0000","last_active":"2024-09-14T12:16:48.448367+0000","last_peered":"2024-09-14T12:16:48.448367+0000","last_clean":"2024-09-14T12:16:48.448367+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:16:48.448367+0000","last_undegraded":"2024-09-14T12:16:48.448367+0000","last_fullsized":"2024-09-14T12:16:48.448367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.448209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:26.636696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.201567+0000","last_change":"2024-09-14T12:17:10.201567+0000","last_active":"2024-09-14T12:17:10.201567+0000","last_peered":"2024-09-14T12:17:10.201567+0000","last_clean":"2024-09-14T12:17:10.201567+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:17:10.201567+0000","last_undegraded":"2024-09-14T12:17:10.201567+0000","last_fullsized":"2024-09-14T12:17:10.201567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:10.201485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:10.201485+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.201485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.337625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.180380+0000","last_change":"2024-09-14T12:17:13.180380+0000","last_active":"2024-09-14T12:17:13.180380+0000","last_peered":"2024-09-14T12:17:13.180380+0000","last_clean":"2024-09-14T12:17:13.180380+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:17:13.180380+0000","last_undegraded":"2024-09-14T12:17:13.180380+0000","last_fullsized":"2024-09-14T12:17:13.180380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:17:13.180298+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:17:13.180298+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.180298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:43.987181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.220764+0000","last_change":"2024-09-14T12:17:02.220764+0000","last_active":"2024-09-14T12:17:02.220764+0000","last_peered":"2024-09-14T12:17:02.220764+0000","last_clean":"2024-09-14T12:17:02.220764+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:17:02.220764+0000","last_undegraded":"2024-09-14T12:17:02.220764+0000","last_fullsized":"2024-09-14T12:17:02.220764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:17:02.220677+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:17:02.220677+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.220677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:34.511947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12294,"num_write":18,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.141640+0000","last_change":"2024-09-14T12:17:00.141579+0000","last_active":"2024-09-14T12:17:00.141640+0000","last_peered":"2024-09-14T12:17:00.141640+0000","last_clean":"2024-09-14T12:17:00.141640+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:17:00.141640+0000","last_undegraded":"2024-09-14T12:17:00.141640+0000","last_fullsized":"2024-09-14T12:17:00.141640+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.141488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.683293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.957091+0000","last_change":"2024-09-14T12:17:04.957091+0000","last_active":"2024-09-14T12:17:04.957091+0000","last_peered":"2024-09-14T12:17:04.957091+0000","last_clean":"2024-09-14T12:17:04.957091+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:17:04.957091+0000","last_undegraded":"2024-09-14T12:17:04.957091+0000","last_fullsized":"2024-09-14T12:17:04.957091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:04.956999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:04.956999+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.956999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:23.117021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.184197+0000","last_change":"2024-09-14T12:17:12.184197+0000","last_active":"2024-09-14T12:17:12.184197+0000","last_peered":"2024-09-14T12:17:12.184197+0000","last_clean":"2024-09-14T12:17:12.184197+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:17:12.184197+0000","last_undegraded":"2024-09-14T12:17:12.184197+0000","last_fullsized":"2024-09-14T12:17:12.184197+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T12:17:12.184106+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T12:17:12.184106+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.184106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:57.292304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.230945+0000","last_change":"2024-09-14T12:16:44.230855+0000","last_active":"2024-09-14T12:16:44.230945+0000","last_peered":"2024-09-14T12:16:44.230945+0000","last_clean":"2024-09-14T12:16:44.230945+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:16:44.230945+0000","last_undegraded":"2024-09-14T12:16:44.230945+0000","last_fullsized":"2024-09-14T12:16:44.230945+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.230752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:11.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.488102+0000","last_change":"2024-09-14T12:16:47.487986+0000","last_active":"2024-09-14T12:16:47.488102+0000","last_peered":"2024-09-14T12:16:47.488102+0000","last_clean":"2024-09-14T12:16:47.488102+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:16:47.488102+0000","last_undegraded":"2024-09-14T12:16:47.488102+0000","last_fullsized":"2024-09-14T12:16:47.488102+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.487890+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:34.728943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.977344+0000","last_change":"2024-09-14T12:16:59.977243+0000","last_active":"2024-09-14T12:16:59.977344+0000","last_peered":"2024-09-14T12:16:59.977344+0000","last_clean":"2024-09-14T12:16:59.977344+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:16:59.977344+0000","last_undegraded":"2024-09-14T12:16:59.977344+0000","last_fullsized":"2024-09-14T12:16:59.977344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:59.977131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:59.977131+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.977131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:44.084906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.176420+0000","last_change":"2024-09-14T12:17:09.176420+0000","last_active":"2024-09-14T12:17:09.176420+0000","last_peered":"2024-09-14T12:17:09.176420+0000","last_clean":"2024-09-14T12:17:09.176420+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:17:09.176420+0000","last_undegraded":"2024-09-14T12:17:09.176420+0000","last_fullsized":"2024-09-14T12:17:09.176420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:09.176331+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:09.176331+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.176331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:33.569699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.964149+0000","last_change":"2024-09-14T12:17:02.964149+0000","last_active":"2024-09-14T12:17:02.964149+0000","last_peered":"2024-09-14T12:17:02.964149+0000","last_clean":"2024-09-14T12:17:02.964149+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:17:02.964149+0000","last_undegraded":"2024-09-14T12:17:02.964149+0000","last_fullsized":"2024-09-14T12:17:02.964149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:02.964032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:02.964032+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.964032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:40.725961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.211375+0000","last_change":"2024-09-14T12:16:57.211375+0000","last_active":"2024-09-14T12:16:57.211375+0000","last_peered":"2024-09-14T12:16:57.211375+0000","last_clean":"2024-09-14T12:16:57.211375+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:16:57.211375+0000","last_undegraded":"2024-09-14T12:16:57.211375+0000","last_fullsized":"2024-09-14T12:16:57.211375+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.211282+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:58.100464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.548758+0000","last_change":"2024-09-14T12:17:08.548758+0000","last_active":"2024-09-14T12:17:08.548758+0000","last_peered":"2024-09-14T12:17:08.548758+0000","last_clean":"2024-09-14T12:17:08.548758+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:17:08.548758+0000","last_undegraded":"2024-09-14T12:17:08.548758+0000","last_fullsized":"2024-09-14T12:17:08.548758+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:08.548671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:08.548671+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.548671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.669512+0000","last_change":"2024-09-14T12:17:04.669512+0000","last_active":"2024-09-14T12:17:04.669512+0000","last_peered":"2024-09-14T12:17:04.669512+0000","last_clean":"2024-09-14T12:17:04.669512+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:17:04.669512+0000","last_undegraded":"2024-09-14T12:17:04.669512+0000","last_fullsized":"2024-09-14T12:17:04.669512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:17:04.669399+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:17:04.669399+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.669399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:26.639741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.218121+0000","last_change":"2024-09-14T12:17:03.218121+0000","last_active":"2024-09-14T12:17:03.218121+0000","last_peered":"2024-09-14T12:17:03.218121+0000","last_clean":"2024-09-14T12:17:03.218121+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:17:03.218121+0000","last_undegraded":"2024-09-14T12:17:03.218121+0000","last_fullsized":"2024-09-14T12:17:03.218121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:03.218033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:03.218033+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.218033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:08.024041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.030749+0000","last_change":"2024-09-14T12:16:49.030749+0000","last_active":"2024-09-14T12:16:49.030749+0000","last_peered":"2024-09-14T12:16:49.030749+0000","last_clean":"2024-09-14T12:16:49.030749+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:16:49.030749+0000","last_undegraded":"2024-09-14T12:16:49.030749+0000","last_fullsized":"2024-09-14T12:16:49.030749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.030667+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:33.596870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.224633+0000","last_change":"2024-09-14T12:16:49.224573+0000","last_active":"2024-09-14T12:16:49.224633+0000","last_peered":"2024-09-14T12:16:49.224633+0000","last_clean":"2024-09-14T12:16:49.224633+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:16:49.224633+0000","last_undegraded":"2024-09-14T12:16:49.224633+0000","last_fullsized":"2024-09-14T12:16:49.224633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.224477+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:40.222740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.928046+0000","last_change":"2024-09-14T12:17:01.928046+0000","last_active":"2024-09-14T12:17:01.928046+0000","last_peered":"2024-09-14T12:17:01.928046+0000","last_clean":"2024-09-14T12:17:01.928046+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:17:01.928046+0000","last_undegraded":"2024-09-14T12:17:01.928046+0000","last_fullsized":"2024-09-14T12:17:01.928046+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:01.927938+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:01.927938+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.927938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:54.511387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.184429+0000","last_change":"2024-09-14T12:16:59.184361+0000","last_active":"2024-09-14T12:16:59.184429+0000","last_peered":"2024-09-14T12:16:59.184429+0000","last_clean":"2024-09-14T12:16:59.184429+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:16:59.184429+0000","last_undegraded":"2024-09-14T12:16:59.184429+0000","last_fullsized":"2024-09-14T12:16:59.184429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:59.184280+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:59.184280+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.184280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:01.083442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.895946+0000","last_change":"2024-09-14T12:16:57.895946+0000","last_active":"2024-09-14T12:16:57.895946+0000","last_peered":"2024-09-14T12:16:57.895946+0000","last_clean":"2024-09-14T12:16:57.895946+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:16:57.895946+0000","last_undegraded":"2024-09-14T12:16:57.895946+0000","last_fullsized":"2024-09-14T12:16:57.895946+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.895851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.309184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.183409+0000","last_change":"2024-09-14T12:17:17.183409+0000","last_active":"2024-09-14T12:17:17.183409+0000","last_peered":"2024-09-14T12:17:17.183409+0000","last_clean":"2024-09-14T12:17:17.183409+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:17:17.183409+0000","last_undegraded":"2024-09-14T12:17:17.183409+0000","last_fullsized":"2024-09-14T12:17:17.183409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:17.183277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:17.183277+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.183277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:03.626249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.932975+0000","last_change":"2024-09-14T12:17:01.932875+0000","last_active":"2024-09-14T12:17:01.932975+0000","last_peered":"2024-09-14T12:17:01.932975+0000","last_clean":"2024-09-14T12:17:01.932975+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:17:01.932975+0000","last_undegraded":"2024-09-14T12:17:01.932975+0000","last_fullsized":"2024-09-14T12:17:01.932975+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:01.932754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:01.932754+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.932754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.598772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.256740+0000","last_change":"2024-09-14T12:17:04.256740+0000","last_active":"2024-09-14T12:17:04.256740+0000","last_peered":"2024-09-14T12:17:04.256740+0000","last_clean":"2024-09-14T12:17:04.256740+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:17:04.256740+0000","last_undegraded":"2024-09-14T12:17:04.256740+0000","last_fullsized":"2024-09-14T12:17:04.256740+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:04.256660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:04.256660+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.256660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.658184+0000","last_change":"2024-09-14T12:16:56.658184+0000","last_active":"2024-09-14T12:16:56.658184+0000","last_peered":"2024-09-14T12:16:56.658184+0000","last_clean":"2024-09-14T12:16:56.658184+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:16:56.658184+0000","last_undegraded":"2024-09-14T12:16:56.658184+0000","last_fullsized":"2024-09-14T12:16:56.658184+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.658093+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:09.745831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.212948+0000","last_change":"2024-09-14T12:17:16.212948+0000","last_active":"2024-09-14T12:17:16.212948+0000","last_peered":"2024-09-14T12:17:16.212948+0000","last_clean":"2024-09-14T12:17:16.212948+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:17:16.212948+0000","last_undegraded":"2024-09-14T12:17:16.212948+0000","last_fullsized":"2024-09-14T12:17:16.212948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:16.212845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:16.212845+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.212845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:51.880130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.462662+0000","last_change":"2024-09-14T12:16:54.462662+0000","last_active":"2024-09-14T12:16:54.462662+0000","last_peered":"2024-09-14T12:16:54.462662+0000","last_clean":"2024-09-14T12:16:54.462662+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:16:54.462662+0000","last_undegraded":"2024-09-14T12:16:54.462662+0000","last_fullsized":"2024-09-14T12:16:54.462662+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.462562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:19.119324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.022371+0000","last_change":"2024-09-14T12:16:51.022371+0000","last_active":"2024-09-14T12:16:51.022371+0000","last_peered":"2024-09-14T12:16:51.022371+0000","last_clean":"2024-09-14T12:16:51.022371+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:16:51.022371+0000","last_undegraded":"2024-09-14T12:16:51.022371+0000","last_fullsized":"2024-09-14T12:16:51.022371+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.022279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:56.027562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.485749+0000","last_change":"2024-09-14T12:16:46.485749+0000","last_active":"2024-09-14T12:16:46.485749+0000","last_peered":"2024-09-14T12:16:46.485749+0000","last_clean":"2024-09-14T12:16:46.485749+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:16:46.485749+0000","last_undegraded":"2024-09-14T12:16:46.485749+0000","last_fullsized":"2024-09-14T12:16:46.485749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.485637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:50.770891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.208324+0000","last_change":"2024-09-14T12:17:11.208324+0000","last_active":"2024-09-14T12:17:11.208324+0000","last_peered":"2024-09-14T12:17:11.208324+0000","last_clean":"2024-09-14T12:17:11.208324+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:17:11.208324+0000","last_undegraded":"2024-09-14T12:17:11.208324+0000","last_fullsized":"2024-09-14T12:17:11.208324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:11.208205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:11.208205+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.208205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:39.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.688569+0000","last_change":"2024-09-14T12:17:03.688569+0000","last_active":"2024-09-14T12:17:03.688569+0000","last_peered":"2024-09-14T12:17:03.688569+0000","last_clean":"2024-09-14T12:17:03.688569+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:17:03.688569+0000","last_undegraded":"2024-09-14T12:17:03.688569+0000","last_fullsized":"2024-09-14T12:17:03.688569+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:03.688483+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:03.688483+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.688483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:49.911218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.470151+0000","last_change":"2024-09-14T12:16:51.470151+0000","last_active":"2024-09-14T12:16:51.470151+0000","last_peered":"2024-09-14T12:16:51.470151+0000","last_clean":"2024-09-14T12:16:51.470151+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:16:51.470151+0000","last_undegraded":"2024-09-14T12:16:51.470151+0000","last_fullsized":"2024-09-14T12:16:51.470151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.470054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:40.419580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.213866+0000","last_change":"2024-09-14T12:16:56.213866+0000","last_active":"2024-09-14T12:16:56.213866+0000","last_peered":"2024-09-14T12:16:56.213866+0000","last_clean":"2024-09-14T12:16:56.213866+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:16:56.213866+0000","last_undegraded":"2024-09-14T12:16:56.213866+0000","last_fullsized":"2024-09-14T12:16:56.213866+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.213760+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.580078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'382","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.421319+0000","last_change":"2024-09-14T12:16:34.421319+0000","last_active":"2024-09-14T12:16:34.421319+0000","last_peered":"2024-09-14T12:16:34.421319+0000","last_clean":"2024-09-14T12:16:34.421319+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:16:34.421319+0000","last_undegraded":"2024-09-14T12:16:34.421319+0000","last_fullsized":"2024-09-14T12:16:34.421319+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.421201+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:14.328374+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":629,"num_read_kb":9737,"num_write":1248,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'481","reported_seq":1935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.932313+0000","last_change":"2024-09-14T12:16:37.932313+0000","last_active":"2024-09-14T12:16:37.932313+0000","last_peered":"2024-09-14T12:16:37.932313+0000","last_clean":"2024-09-14T12:16:37.932313+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:16:37.932313+0000","last_undegraded":"2024-09-14T12:16:37.932313+0000","last_fullsized":"2024-09-14T12:16:37.932313+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.932203+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:41.524216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'342","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.075044+0000","last_change":"2024-09-14T12:16:24.075044+0000","last_active":"2024-09-14T12:16:24.075044+0000","last_peered":"2024-09-14T12:16:24.075044+0000","last_clean":"2024-09-14T12:16:24.075044+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:16:24.075044+0000","last_undegraded":"2024-09-14T12:16:24.075044+0000","last_fullsized":"2024-09-14T12:16:24.075044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.074907+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:57.224200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":22753,"num_write":1016,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.399657+0000","last_change":"2024-09-14T12:16:38.399657+0000","last_active":"2024-09-14T12:16:38.399657+0000","last_peered":"2024-09-14T12:16:38.399657+0000","last_clean":"2024-09-14T12:16:38.399657+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:16:38.399657+0000","last_undegraded":"2024-09-14T12:16:38.399657+0000","last_fullsized":"2024-09-14T12:16:38.399657+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.399570+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:31.558475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'369","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.917158+0000","last_change":"2024-09-14T12:16:27.917158+0000","last_active":"2024-09-14T12:16:27.917158+0000","last_peered":"2024-09-14T12:16:27.917158+0000","last_clean":"2024-09-14T12:16:27.917158+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:16:27.917158+0000","last_undegraded":"2024-09-14T12:16:27.917158+0000","last_fullsized":"2024-09-14T12:16:27.917158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.917052+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.304387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":8099,"num_write":1164,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'831","reported_seq":2484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.599551+0000","last_change":"2024-09-14T12:16:38.599551+0000","last_active":"2024-09-14T12:16:38.599551+0000","last_peered":"2024-09-14T12:16:38.599551+0000","last_clean":"2024-09-14T12:16:38.599551+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:16:38.599551+0000","last_undegraded":"2024-09-14T12:16:38.599551+0000","last_fullsized":"2024-09-14T12:16:38.599551+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.599465+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:41.116547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'398","reported_seq":1076,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.842121+0000","last_change":"2024-09-14T12:16:30.842121+0000","last_active":"2024-09-14T12:16:30.842121+0000","last_peered":"2024-09-14T12:16:30.842121+0000","last_clean":"2024-09-14T12:16:30.842121+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:16:30.842121+0000","last_undegraded":"2024-09-14T12:16:30.842121+0000","last_fullsized":"2024-09-14T12:16:30.842121+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.842017+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:52.781230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":69334,"num_write":1242,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'480","reported_seq":2211,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.894365+0000","last_change":"2024-09-14T12:16:38.894365+0000","last_active":"2024-09-14T12:16:38.894365+0000","last_peered":"2024-09-14T12:16:38.894365+0000","last_clean":"2024-09-14T12:16:38.894365+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:16:38.894365+0000","last_undegraded":"2024-09-14T12:16:38.894365+0000","last_fullsized":"2024-09-14T12:16:38.894365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.894277+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:07.704197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'345","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.396720+0000","last_change":"2024-09-14T12:16:33.396720+0000","last_active":"2024-09-14T12:16:33.396720+0000","last_peered":"2024-09-14T12:16:33.396720+0000","last_clean":"2024-09-14T12:16:33.396720+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:16:33.396720+0000","last_undegraded":"2024-09-14T12:16:33.396720+0000","last_fullsized":"2024-09-14T12:16:33.396720+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.396612+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:50.383330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8504,"num_write":1105,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'931","reported_seq":2506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.470843+0000","last_change":"2024-09-14T12:16:33.470843+0000","last_active":"2024-09-14T12:16:33.470843+0000","last_peered":"2024-09-14T12:16:33.470843+0000","last_clean":"2024-09-14T12:16:33.470843+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:16:33.470843+0000","last_undegraded":"2024-09-14T12:16:33.470843+0000","last_fullsized":"2024-09-14T12:16:33.470843+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'931","last_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_deep_scrub":"263'931","last_deep_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.470747+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:53.569158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'339","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.824033+0000","last_change":"2024-09-14T12:16:29.824033+0000","last_active":"2024-09-14T12:16:29.824033+0000","last_peered":"2024-09-14T12:16:29.824033+0000","last_clean":"2024-09-14T12:16:29.824033+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:16:29.824033+0000","last_undegraded":"2024-09-14T12:16:29.824033+0000","last_fullsized":"2024-09-14T12:16:29.824033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.823921+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.850213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":13223,"num_write":1062,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'323","reported_seq":1686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.645228+0000","last_change":"2024-09-14T12:16:39.645228+0000","last_active":"2024-09-14T12:16:39.645228+0000","last_peered":"2024-09-14T12:16:39.645228+0000","last_clean":"2024-09-14T12:16:39.645228+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:16:39.645228+0000","last_undegraded":"2024-09-14T12:16:39.645228+0000","last_fullsized":"2024-09-14T12:16:39.645228+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.645135+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.959759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'337","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.350810+0000","last_change":"2024-09-14T12:16:32.350810+0000","last_active":"2024-09-14T12:16:32.350810+0000","last_peered":"2024-09-14T12:16:32.350810+0000","last_clean":"2024-09-14T12:16:32.350810+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:16:32.350810+0000","last_undegraded":"2024-09-14T12:16:32.350810+0000","last_fullsized":"2024-09-14T12:16:32.350810+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.350698+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.629745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":13115,"num_write":1013,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'407","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.868085+0000","last_change":"2024-09-14T12:16:39.868085+0000","last_active":"2024-09-14T12:16:39.868085+0000","last_peered":"2024-09-14T12:16:39.868085+0000","last_clean":"2024-09-14T12:16:39.868085+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:16:39.868085+0000","last_undegraded":"2024-09-14T12:16:39.868085+0000","last_fullsized":"2024-09-14T12:16:39.868085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.867997+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.305924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'358","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.244252+0000","last_change":"2024-09-14T12:16:28.244252+0000","last_active":"2024-09-14T12:16:28.244252+0000","last_peered":"2024-09-14T12:16:28.244252+0000","last_clean":"2024-09-14T12:16:28.244252+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:16:28.244252+0000","last_undegraded":"2024-09-14T12:16:28.244252+0000","last_fullsized":"2024-09-14T12:16:28.244252+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.244160+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.741764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":594,"num_read_kb":3517,"num_write":1114,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'929","reported_seq":2505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.227870+0000","last_change":"2024-09-14T12:16:29.227870+0000","last_active":"2024-09-14T12:16:29.227870+0000","last_peered":"2024-09-14T12:16:29.227870+0000","last_clean":"2024-09-14T12:16:29.227870+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:16:29.227870+0000","last_undegraded":"2024-09-14T12:16:29.227870+0000","last_fullsized":"2024-09-14T12:16:29.227870+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'929","last_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_deep_scrub":"263'929","last_deep_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.227765+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:23.885174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'888","reported_seq":2517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.593824+0000","last_change":"2024-09-14T12:16:36.593824+0000","last_active":"2024-09-14T12:16:36.593824+0000","last_peered":"2024-09-14T12:16:36.593824+0000","last_clean":"2024-09-14T12:16:36.593824+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:16:36.593824+0000","last_undegraded":"2024-09-14T12:16:36.593824+0000","last_fullsized":"2024-09-14T12:16:36.593824+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'888","last_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_deep_scrub":"263'888","last_deep_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.593729+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:47.300409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'374","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.359854+0000","last_change":"2024-09-14T12:16:31.359854+0000","last_active":"2024-09-14T12:16:31.359854+0000","last_peered":"2024-09-14T12:16:31.359854+0000","last_clean":"2024-09-14T12:16:31.359854+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:16:31.359854+0000","last_undegraded":"2024-09-14T12:16:31.359854+0000","last_fullsized":"2024-09-14T12:16:31.359854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'374","last_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_deep_scrub":"263'374","last_deep_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.359749+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:50.234169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":33506,"num_write":1216,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'724","reported_seq":2275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.385574+0000","last_change":"2024-09-14T12:16:37.385574+0000","last_active":"2024-09-14T12:16:37.385574+0000","last_peered":"2024-09-14T12:16:37.385574+0000","last_clean":"2024-09-14T12:16:37.385574+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:16:37.385574+0000","last_undegraded":"2024-09-14T12:16:37.385574+0000","last_fullsized":"2024-09-14T12:16:37.385574+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.385484+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:48.262117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'479","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402397+0000","last_change":"2024-09-14T12:16:28.402397+0000","last_active":"2024-09-14T12:16:28.402397+0000","last_peered":"2024-09-14T12:16:28.402397+0000","last_clean":"2024-09-14T12:16:28.402397+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:16:28.402397+0000","last_undegraded":"2024-09-14T12:16:28.402397+0000","last_fullsized":"2024-09-14T12:16:28.402397+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402248+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:10.326854+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":934,"num_read_kb":10641,"num_write":1221,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'768","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.917096+0000","last_change":"2024-09-14T12:16:34.917096+0000","last_active":"2024-09-14T12:16:34.917096+0000","last_peered":"2024-09-14T12:16:34.917096+0000","last_clean":"2024-09-14T12:16:34.917096+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:16:34.917096+0000","last_undegraded":"2024-09-14T12:16:34.917096+0000","last_fullsized":"2024-09-14T12:16:34.917096+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.917005+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.725565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2731,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'393","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.429189+0000","last_change":"2024-09-14T12:16:27.429189+0000","last_active":"2024-09-14T12:16:27.429189+0000","last_peered":"2024-09-14T12:16:27.429189+0000","last_clean":"2024-09-14T12:16:27.429189+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:16:27.429189+0000","last_undegraded":"2024-09-14T12:16:27.429189+0000","last_fullsized":"2024-09-14T12:16:27.429189+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.429104+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.207355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":671,"num_read_kb":6370,"num_write":1079,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.267509+0000","last_change":"2024-09-14T12:16:27.267509+0000","last_active":"2024-09-14T12:16:27.267509+0000","last_peered":"2024-09-14T12:16:27.267509+0000","last_clean":"2024-09-14T12:16:27.267509+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:16:27.267509+0000","last_undegraded":"2024-09-14T12:16:27.267509+0000","last_fullsized":"2024-09-14T12:16:27.267509+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'608","last_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_deep_scrub":"263'608","last_deep_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.267429+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'328","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.529800+0000","last_change":"2024-09-14T12:16:23.529800+0000","last_active":"2024-09-14T12:16:23.529800+0000","last_peered":"2024-09-14T12:16:23.529800+0000","last_clean":"2024-09-14T12:16:23.529800+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:16:23.529800+0000","last_undegraded":"2024-09-14T12:16:23.529800+0000","last_fullsized":"2024-09-14T12:16:23.529800+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.529693+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:47.093569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":17017,"num_write":957,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'904","reported_seq":2620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.232914+0000","last_change":"2024-09-14T12:16:30.232914+0000","last_active":"2024-09-14T12:16:30.232914+0000","last_peered":"2024-09-14T12:16:30.232914+0000","last_clean":"2024-09-14T12:16:30.232914+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:16:30.232914+0000","last_undegraded":"2024-09-14T12:16:30.232914+0000","last_fullsized":"2024-09-14T12:16:30.232914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'904","last_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_deep_scrub":"263'904","last_deep_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.232832+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:17.647079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.551085+0000","last_change":"2024-09-14T12:16:27.551085+0000","last_active":"2024-09-14T12:16:27.551085+0000","last_peered":"2024-09-14T12:16:27.551085+0000","last_clean":"2024-09-14T12:16:27.551085+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:16:27.551085+0000","last_undegraded":"2024-09-14T12:16:27.551085+0000","last_fullsized":"2024-09-14T12:16:27.551085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.551001+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:40.128897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":19406,"num_write":864,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1147","reported_seq":2706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.559648+0000","last_change":"2024-09-14T12:16:37.559648+0000","last_active":"2024-09-14T12:16:37.559648+0000","last_peered":"2024-09-14T12:16:37.559648+0000","last_clean":"2024-09-14T12:16:37.559648+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:16:37.559648+0000","last_undegraded":"2024-09-14T12:16:37.559648+0000","last_fullsized":"2024-09-14T12:16:37.559648+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1147","last_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_deep_scrub":"263'1147","last_deep_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.559541+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:26.343620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'342","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.928565+0000","last_change":"2024-09-14T12:16:26.928565+0000","last_active":"2024-09-14T12:16:26.928565+0000","last_peered":"2024-09-14T12:16:26.928565+0000","last_clean":"2024-09-14T12:16:26.928565+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:16:26.928565+0000","last_undegraded":"2024-09-14T12:16:26.928565+0000","last_fullsized":"2024-09-14T12:16:26.928565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.928480+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:10.385752+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":705,"num_read_kb":10760,"num_write":996,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'126","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.677663+0000","last_change":"2024-09-14T12:16:54.677663+0000","last_active":"2024-09-14T12:16:54.677663+0000","last_peered":"2024-09-14T12:16:54.677663+0000","last_clean":"2024-09-14T12:16:54.677663+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:16:54.677663+0000","last_undegraded":"2024-09-14T12:16:54.677663+0000","last_fullsized":"2024-09-14T12:16:54.677663+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.677580+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:34.005917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'525","reported_seq":2474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.537472+0000","last_change":"2024-09-14T12:16:30.537472+0000","last_active":"2024-09-14T12:16:30.537472+0000","last_peered":"2024-09-14T12:16:30.537472+0000","last_clean":"2024-09-14T12:16:30.537472+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:16:30.537472+0000","last_undegraded":"2024-09-14T12:16:30.537472+0000","last_fullsized":"2024-09-14T12:16:30.537472+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.537378+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:15.507796+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6633,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'294","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.359063+0000","last_change":"2024-09-14T12:16:30.359063+0000","last_active":"2024-09-14T12:16:30.359063+0000","last_peered":"2024-09-14T12:16:30.359063+0000","last_clean":"2024-09-14T12:16:30.359063+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:16:30.359063+0000","last_undegraded":"2024-09-14T12:16:30.359063+0000","last_fullsized":"2024-09-14T12:16:30.359063+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.358952+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:21.930313+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":3402,"num_write":873,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.860022+0000","last_change":"2024-09-14T12:16:41.860022+0000","last_active":"2024-09-14T12:16:41.860022+0000","last_peered":"2024-09-14T12:16:41.860022+0000","last_clean":"2024-09-14T12:16:41.860022+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:16:41.860022+0000","last_undegraded":"2024-09-14T12:16:41.860022+0000","last_fullsized":"2024-09-14T12:16:41.860022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.859933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:06.116453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'349","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.883151+0000","last_change":"2024-09-14T12:16:42.883151+0000","last_active":"2024-09-14T12:16:42.883151+0000","last_peered":"2024-09-14T12:16:42.883151+0000","last_clean":"2024-09-14T12:16:42.883151+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:16:42.883151+0000","last_undegraded":"2024-09-14T12:16:42.883151+0000","last_fullsized":"2024-09-14T12:16:42.883151+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.883082+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:19.400996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":1214,"num_write":454,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.302668+0000","last_change":"2024-09-14T12:16:52.302668+0000","last_active":"2024-09-14T12:16:52.302668+0000","last_peered":"2024-09-14T12:16:52.302668+0000","last_clean":"2024-09-14T12:16:52.302668+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:16:52.302668+0000","last_undegraded":"2024-09-14T12:16:52.302668+0000","last_fullsized":"2024-09-14T12:16:52.302668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.302584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:43.381958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'128","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.905972+0000","last_change":"2024-09-14T12:16:55.905972+0000","last_active":"2024-09-14T12:16:55.905972+0000","last_peered":"2024-09-14T12:16:55.905972+0000","last_clean":"2024-09-14T12:16:55.905972+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:16:55.905972+0000","last_undegraded":"2024-09-14T12:16:55.905972+0000","last_fullsized":"2024-09-14T12:16:55.905972+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.905879+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:00.503553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'408","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.893645+0000","last_change":"2024-09-14T12:16:35.893645+0000","last_active":"2024-09-14T12:16:35.893645+0000","last_peered":"2024-09-14T12:16:35.893645+0000","last_clean":"2024-09-14T12:16:35.893645+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:16:35.893645+0000","last_undegraded":"2024-09-14T12:16:35.893645+0000","last_fullsized":"2024-09-14T12:16:35.893645+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.893533+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:50.859418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'384","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:18.857599+0000","last_change":"2024-09-14T12:16:18.857599+0000","last_active":"2024-09-14T12:16:18.857599+0000","last_peered":"2024-09-14T12:16:18.857599+0000","last_clean":"2024-09-14T12:16:18.857599+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:16:18.857599+0000","last_undegraded":"2024-09-14T12:16:18.857599+0000","last_fullsized":"2024-09-14T12:16:18.857599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_clean_scrub_stamp":"2024-09-14T12:16:18.857499+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:10.889774+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":9438,"num_write":1138,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.549387+0000","last_change":"2024-09-14T12:16:41.549387+0000","last_active":"2024-09-14T12:16:41.549387+0000","last_peered":"2024-09-14T12:16:41.549387+0000","last_clean":"2024-09-14T12:16:41.549387+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:16:41.549387+0000","last_undegraded":"2024-09-14T12:16:41.549387+0000","last_fullsized":"2024-09-14T12:16:41.549387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.549287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:55.365473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.555911+0000","last_change":"2024-09-14T12:16:48.555911+0000","last_active":"2024-09-14T12:16:48.555911+0000","last_peered":"2024-09-14T12:16:48.555911+0000","last_clean":"2024-09-14T12:16:48.555911+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:16:48.555911+0000","last_undegraded":"2024-09-14T12:16:48.555911+0000","last_fullsized":"2024-09-14T12:16:48.555911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.555817+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:34.096081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.589732+0000","last_change":"2024-09-14T12:16:50.589732+0000","last_active":"2024-09-14T12:16:50.589732+0000","last_peered":"2024-09-14T12:16:50.589732+0000","last_clean":"2024-09-14T12:16:50.589732+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:16:50.589732+0000","last_undegraded":"2024-09-14T12:16:50.589732+0000","last_fullsized":"2024-09-14T12:16:50.589732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.589634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:28.546997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.107623+0000","last_change":"2024-09-14T12:16:54.107623+0000","last_active":"2024-09-14T12:16:54.107623+0000","last_peered":"2024-09-14T12:16:54.107623+0000","last_clean":"2024-09-14T12:16:54.107623+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:16:54.107623+0000","last_undegraded":"2024-09-14T12:16:54.107623+0000","last_fullsized":"2024-09-14T12:16:54.107623+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.107518+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:01.171946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'519","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.928397+0000","last_change":"2024-09-14T12:16:31.928397+0000","last_active":"2024-09-14T12:16:31.928397+0000","last_peered":"2024-09-14T12:16:31.928397+0000","last_clean":"2024-09-14T12:16:31.928397+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:16:31.928397+0000","last_undegraded":"2024-09-14T12:16:31.928397+0000","last_fullsized":"2024-09-14T12:16:31.928397+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.928310+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:24.464818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'451","reported_seq":1174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402865+0000","last_change":"2024-09-14T12:16:28.402865+0000","last_active":"2024-09-14T12:16:28.402865+0000","last_peered":"2024-09-14T12:16:28.402865+0000","last_clean":"2024-09-14T12:16:28.402865+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:16:28.402865+0000","last_undegraded":"2024-09-14T12:16:28.402865+0000","last_fullsized":"2024-09-14T12:16:28.402865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402734+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:14.475372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1029,"num_read_kb":13380,"num_write":1416,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.588891+0000","last_change":"2024-09-14T12:16:43.588891+0000","last_active":"2024-09-14T12:16:43.588891+0000","last_peered":"2024-09-14T12:16:43.588891+0000","last_clean":"2024-09-14T12:16:43.588891+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:16:43.588891+0000","last_undegraded":"2024-09-14T12:16:43.588891+0000","last_fullsized":"2024-09-14T12:16:43.588891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.588791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:40.236472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'120","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.190637+0000","last_change":"2024-09-14T12:16:36.190637+0000","last_active":"2024-09-14T12:16:36.190637+0000","last_peered":"2024-09-14T12:16:36.190637+0000","last_clean":"2024-09-14T12:16:36.190637+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:16:36.190637+0000","last_undegraded":"2024-09-14T12:16:36.190637+0000","last_fullsized":"2024-09-14T12:16:36.190637+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.190540+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:19.260626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'764","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.274685+0000","last_change":"2024-09-14T12:16:51.274685+0000","last_active":"2024-09-14T12:16:51.274685+0000","last_peered":"2024-09-14T12:16:51.274685+0000","last_clean":"2024-09-14T12:16:51.274685+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:16:51.274685+0000","last_undegraded":"2024-09-14T12:16:51.274685+0000","last_fullsized":"2024-09-14T12:16:51.274685+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'764","last_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_deep_scrub":"263'764","last_deep_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.274603+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:39.300185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'201","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.659882+0000","last_change":"2024-09-14T12:16:55.659882+0000","last_active":"2024-09-14T12:16:55.659882+0000","last_peered":"2024-09-14T12:16:55.659882+0000","last_clean":"2024-09-14T12:16:55.659882+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:16:55.659882+0000","last_undegraded":"2024-09-14T12:16:55.659882+0000","last_fullsized":"2024-09-14T12:16:55.659882+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.659760+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:36.216083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1037","reported_seq":2664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.534133+0000","last_change":"2024-09-14T12:16:31.534133+0000","last_active":"2024-09-14T12:16:31.534133+0000","last_peered":"2024-09-14T12:16:31.534133+0000","last_clean":"2024-09-14T12:16:31.534133+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:16:31.534133+0000","last_undegraded":"2024-09-14T12:16:31.534133+0000","last_fullsized":"2024-09-14T12:16:31.534133+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1037","last_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_deep_scrub":"263'1037","last_deep_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.534041+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:18.670329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'353","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.487007+0000","last_change":"2024-09-14T12:16:25.487007+0000","last_active":"2024-09-14T12:16:25.487007+0000","last_peered":"2024-09-14T12:16:25.487007+0000","last_clean":"2024-09-14T12:16:25.487007+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:16:25.487007+0000","last_undegraded":"2024-09-14T12:16:25.487007+0000","last_fullsized":"2024-09-14T12:16:25.487007+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.486896+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:43.830472+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":31887,"num_write":1106,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.909083+0000","last_change":"2024-09-14T12:16:43.909083+0000","last_active":"2024-09-14T12:16:43.909083+0000","last_peered":"2024-09-14T12:16:43.909083+0000","last_clean":"2024-09-14T12:16:43.909083+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:16:43.909083+0000","last_undegraded":"2024-09-14T12:16:43.909083+0000","last_fullsized":"2024-09-14T12:16:43.909083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.908989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:42.037972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'275","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.386812+0000","last_change":"2024-09-14T12:16:45.386812+0000","last_active":"2024-09-14T12:16:45.386812+0000","last_peered":"2024-09-14T12:16:45.386812+0000","last_clean":"2024-09-14T12:16:45.386812+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:16:45.386812+0000","last_undegraded":"2024-09-14T12:16:45.386812+0000","last_fullsized":"2024-09-14T12:16:45.386812+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.386711+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:51.799127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1100,"num_write":378,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'804","reported_seq":2965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.492291+0000","last_change":"2024-09-14T12:16:52.492291+0000","last_active":"2024-09-14T12:16:52.492291+0000","last_peered":"2024-09-14T12:16:52.492291+0000","last_clean":"2024-09-14T12:16:52.492291+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:16:52.492291+0000","last_undegraded":"2024-09-14T12:16:52.492291+0000","last_fullsized":"2024-09-14T12:16:52.492291+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.492206+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:03.160461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'783","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.907394+0000","last_change":"2024-09-14T12:16:33.907394+0000","last_active":"2024-09-14T12:16:33.907394+0000","last_peered":"2024-09-14T12:16:33.907394+0000","last_clean":"2024-09-14T12:16:33.907394+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:16:33.907394+0000","last_undegraded":"2024-09-14T12:16:33.907394+0000","last_fullsized":"2024-09-14T12:16:33.907394+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.907284+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:14.084827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'401","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.415684+0000","last_change":"2024-09-14T12:16:26.415684+0000","last_active":"2024-09-14T12:16:26.415684+0000","last_peered":"2024-09-14T12:16:26.415684+0000","last_clean":"2024-09-14T12:16:26.415684+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:16:26.415684+0000","last_undegraded":"2024-09-14T12:16:26.415684+0000","last_fullsized":"2024-09-14T12:16:26.415684+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.415569+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.364031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":683,"num_read_kb":56115,"num_write":1123,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.392134+0000","last_change":"2024-09-14T12:16:40.392134+0000","last_active":"2024-09-14T12:16:40.392134+0000","last_peered":"2024-09-14T12:16:40.392134+0000","last_clean":"2024-09-14T12:16:40.392134+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:16:40.392134+0000","last_undegraded":"2024-09-14T12:16:40.392134+0000","last_fullsized":"2024-09-14T12:16:40.392134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.392039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:46.721248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'363","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.958094+0000","last_change":"2024-09-14T12:16:46.958094+0000","last_active":"2024-09-14T12:16:46.958094+0000","last_peered":"2024-09-14T12:16:46.958094+0000","last_clean":"2024-09-14T12:16:46.958094+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:16:46.958094+0000","last_undegraded":"2024-09-14T12:16:46.958094+0000","last_fullsized":"2024-09-14T12:16:46.958094+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.957991+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.598522+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":1208,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.095966+0000","last_change":"2024-09-14T12:16:46.095966+0000","last_active":"2024-09-14T12:16:46.095966+0000","last_peered":"2024-09-14T12:16:46.095966+0000","last_clean":"2024-09-14T12:16:46.095966+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:16:46.095966+0000","last_undegraded":"2024-09-14T12:16:46.095966+0000","last_fullsized":"2024-09-14T12:16:46.095966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.095876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.747404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'552","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.997043+0000","last_change":"2024-09-14T12:16:51.997043+0000","last_active":"2024-09-14T12:16:51.997043+0000","last_peered":"2024-09-14T12:16:51.997043+0000","last_clean":"2024-09-14T12:16:51.997043+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:16:51.997043+0000","last_undegraded":"2024-09-14T12:16:51.997043+0000","last_fullsized":"2024-09-14T12:16:51.997043+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'552","last_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_deep_scrub":"263'552","last_deep_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.996944+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.908296+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'388","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.589366+0000","last_change":"2024-09-14T12:16:27.589366+0000","last_active":"2024-09-14T12:16:27.589366+0000","last_peered":"2024-09-14T12:16:27.589366+0000","last_clean":"2024-09-14T12:16:27.589366+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:16:27.589366+0000","last_undegraded":"2024-09-14T12:16:27.589366+0000","last_fullsized":"2024-09-14T12:16:27.589366+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.589279+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:02.284167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'393","reported_seq":1157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.373988+0000","last_change":"2024-09-14T12:16:27.373988+0000","last_active":"2024-09-14T12:16:27.373988+0000","last_peered":"2024-09-14T12:16:27.373988+0000","last_clean":"2024-09-14T12:16:27.373988+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:16:27.373988+0000","last_undegraded":"2024-09-14T12:16:27.373988+0000","last_fullsized":"2024-09-14T12:16:27.373988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.373835+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:53.729046+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079941,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1043,"num_read_kb":12713,"num_write":1259,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.264334+0000","last_change":"2024-09-14T12:16:32.264334+0000","last_active":"2024-09-14T12:16:32.264334+0000","last_peered":"2024-09-14T12:16:32.264334+0000","last_clean":"2024-09-14T12:16:32.264334+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:16:32.264334+0000","last_undegraded":"2024-09-14T12:16:32.264334+0000","last_fullsized":"2024-09-14T12:16:32.264334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:13.721660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'256","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.562418+0000","last_change":"2024-09-14T12:16:48.562418+0000","last_active":"2024-09-14T12:16:48.562418+0000","last_peered":"2024-09-14T12:16:48.562418+0000","last_clean":"2024-09-14T12:16:48.562418+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:16:48.562418+0000","last_undegraded":"2024-09-14T12:16:48.562418+0000","last_fullsized":"2024-09-14T12:16:48.562418+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.562275+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.348621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":973,"num_write":336,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.630480+0000","last_change":"2024-09-14T12:17:05.630480+0000","last_active":"2024-09-14T12:17:05.630480+0000","last_peered":"2024-09-14T12:17:05.630480+0000","last_clean":"2024-09-14T12:17:05.630480+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:17:05.630480+0000","last_undegraded":"2024-09-14T12:17:05.630480+0000","last_fullsized":"2024-09-14T12:17:05.630480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:05.630356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:05.630356+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.630356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:49.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2528","reported_seq":4372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.464633+0000","last_change":"2024-09-14T12:16:43.464633+0000","last_active":"2024-09-14T12:16:43.464633+0000","last_peered":"2024-09-14T12:16:43.464633+0000","last_clean":"2024-09-14T12:16:43.464633+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:16:43.464633+0000","last_undegraded":"2024-09-14T12:16:43.464633+0000","last_fullsized":"2024-09-14T12:16:43.464633+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.464554+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:41.993155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1158","reported_seq":2800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.464675+0000","last_change":"2024-09-14T12:16:30.464675+0000","last_active":"2024-09-14T12:16:30.464675+0000","last_peered":"2024-09-14T12:16:30.464675+0000","last_clean":"2024-09-14T12:16:30.464675+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:16:30.464675+0000","last_undegraded":"2024-09-14T12:16:30.464675+0000","last_fullsized":"2024-09-14T12:16:30.464675+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.464582+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:39.530289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'378","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.366637+0000","last_change":"2024-09-14T12:16:25.366637+0000","last_active":"2024-09-14T12:16:25.366637+0000","last_peered":"2024-09-14T12:16:25.366637+0000","last_clean":"2024-09-14T12:16:25.366637+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:16:25.366637+0000","last_undegraded":"2024-09-14T12:16:25.366637+0000","last_fullsized":"2024-09-14T12:16:25.366637+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.366516+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:07.861044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":648,"num_read_kb":71361,"num_write":1111,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.201858+0000","last_change":"2024-09-14T12:16:34.201858+0000","last_active":"2024-09-14T12:16:34.201858+0000","last_peered":"2024-09-14T12:16:34.201858+0000","last_clean":"2024-09-14T12:16:34.201858+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:16:34.201858+0000","last_undegraded":"2024-09-14T12:16:34.201858+0000","last_fullsized":"2024-09-14T12:16:34.201858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.201763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.946713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'315","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.398295+0000","last_change":"2024-09-14T12:16:46.398295+0000","last_active":"2024-09-14T12:16:46.398295+0000","last_peered":"2024-09-14T12:16:46.398295+0000","last_clean":"2024-09-14T12:16:46.398295+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:16:46.398295+0000","last_undegraded":"2024-09-14T12:16:46.398295+0000","last_fullsized":"2024-09-14T12:16:46.398295+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.398188+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:49.529445+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":517,"num_read_kb":1149,"num_write":414,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'797","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.995107+0000","last_change":"2024-09-14T12:16:47.995107+0000","last_active":"2024-09-14T12:16:47.995107+0000","last_peered":"2024-09-14T12:16:47.995107+0000","last_clean":"2024-09-14T12:16:47.995107+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:16:47.995107+0000","last_undegraded":"2024-09-14T12:16:47.995107+0000","last_fullsized":"2024-09-14T12:16:47.995107+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'797","last_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_deep_scrub":"263'797","last_deep_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.995029+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:26.627644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.129168+0000","last_change":"2024-09-14T12:16:53.129168+0000","last_active":"2024-09-14T12:16:53.129168+0000","last_peered":"2024-09-14T12:16:53.129168+0000","last_clean":"2024-09-14T12:16:53.129168+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:16:53.129168+0000","last_undegraded":"2024-09-14T12:16:53.129168+0000","last_fullsized":"2024-09-14T12:16:53.129168+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.129089+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:25.226244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'584","reported_seq":2161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.905808+0000","last_change":"2024-09-14T12:16:30.905808+0000","last_active":"2024-09-14T12:16:30.905808+0000","last_peered":"2024-09-14T12:16:30.905808+0000","last_clean":"2024-09-14T12:16:30.905808+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:16:30.905808+0000","last_undegraded":"2024-09-14T12:16:30.905808+0000","last_fullsized":"2024-09-14T12:16:30.905808+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'584","last_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_deep_scrub":"263'584","last_deep_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.905703+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:35.243549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":769,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'426","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.190429+0000","last_change":"2024-09-14T12:16:20.190380+0000","last_active":"2024-09-14T12:16:20.190429+0000","last_peered":"2024-09-14T12:16:20.190429+0000","last_clean":"2024-09-14T12:16:20.190429+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:16:20.190429+0000","last_undegraded":"2024-09-14T12:16:20.190429+0000","last_fullsized":"2024-09-14T12:16:20.190429+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.190319+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:02.075520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":58896,"num_write":1397,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.229371+0000","last_change":"2024-09-14T12:16:33.229371+0000","last_active":"2024-09-14T12:16:33.229371+0000","last_peered":"2024-09-14T12:16:33.229371+0000","last_clean":"2024-09-14T12:16:33.229371+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:16:33.229371+0000","last_undegraded":"2024-09-14T12:16:33.229371+0000","last_fullsized":"2024-09-14T12:16:33.229371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.229270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:28.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'493","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.926750+0000","last_change":"2024-09-14T12:16:41.926750+0000","last_active":"2024-09-14T12:16:41.926750+0000","last_peered":"2024-09-14T12:16:41.926750+0000","last_clean":"2024-09-14T12:16:41.926750+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:16:41.926750+0000","last_undegraded":"2024-09-14T12:16:41.926750+0000","last_fullsized":"2024-09-14T12:16:41.926750+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.926660+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:07.959468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94670,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":854,"num_read_kb":2046,"num_write":706,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.249723+0000","last_change":"2024-09-14T12:16:38.249723+0000","last_active":"2024-09-14T12:16:38.249723+0000","last_peered":"2024-09-14T12:16:38.249723+0000","last_clean":"2024-09-14T12:16:38.249723+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:16:38.249723+0000","last_undegraded":"2024-09-14T12:16:38.249723+0000","last_fullsized":"2024-09-14T12:16:38.249723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.249638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:30.373505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.053669+0000","last_change":"2024-09-14T12:16:47.053669+0000","last_active":"2024-09-14T12:16:47.053669+0000","last_peered":"2024-09-14T12:16:47.053669+0000","last_clean":"2024-09-14T12:16:47.053669+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:16:47.053669+0000","last_undegraded":"2024-09-14T12:16:47.053669+0000","last_fullsized":"2024-09-14T12:16:47.053669+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.053583+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:20.332007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'492","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.619063+0000","last_change":"2024-09-14T12:16:31.619063+0000","last_active":"2024-09-14T12:16:31.619063+0000","last_peered":"2024-09-14T12:16:31.619063+0000","last_clean":"2024-09-14T12:16:31.619063+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:16:31.619063+0000","last_undegraded":"2024-09-14T12:16:31.619063+0000","last_fullsized":"2024-09-14T12:16:31.619063+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'492","last_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_deep_scrub":"263'492","last_deep_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.618980+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.751585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'356","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.428532+0000","last_change":"2024-09-14T12:16:22.428532+0000","last_active":"2024-09-14T12:16:22.428532+0000","last_peered":"2024-09-14T12:16:22.428532+0000","last_clean":"2024-09-14T12:16:22.428532+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:16:22.428532+0000","last_undegraded":"2024-09-14T12:16:22.428532+0000","last_fullsized":"2024-09-14T12:16:22.428532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.428437+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:49.436320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":23428,"num_write":1121,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.152681+0000","last_change":"2024-09-14T12:16:35.152681+0000","last_active":"2024-09-14T12:16:35.152681+0000","last_peered":"2024-09-14T12:16:35.152681+0000","last_clean":"2024-09-14T12:16:35.152681+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:16:35.152681+0000","last_undegraded":"2024-09-14T12:16:35.152681+0000","last_fullsized":"2024-09-14T12:16:35.152681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.152591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:03.738990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'294","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.591487+0000","last_change":"2024-09-14T12:16:45.591487+0000","last_active":"2024-09-14T12:16:45.591487+0000","last_peered":"2024-09-14T12:16:45.591487+0000","last_clean":"2024-09-14T12:16:45.591487+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:16:45.591487+0000","last_undegraded":"2024-09-14T12:16:45.591487+0000","last_fullsized":"2024-09-14T12:16:45.591487+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.591348+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:31.602741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53607,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":516,"num_read_kb":1139,"num_write":462,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.034027+0000","last_change":"2024-09-14T12:16:49.034027+0000","last_active":"2024-09-14T12:16:49.034027+0000","last_peered":"2024-09-14T12:16:49.034027+0000","last_clean":"2024-09-14T12:16:49.034027+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:16:49.034027+0000","last_undegraded":"2024-09-14T12:16:49.034027+0000","last_fullsized":"2024-09-14T12:16:49.034027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.033929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:16.318566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'114","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.484733+0000","last_change":"2024-09-14T12:16:54.484733+0000","last_active":"2024-09-14T12:16:54.484733+0000","last_peered":"2024-09-14T12:16:54.484733+0000","last_clean":"2024-09-14T12:16:54.484733+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:16:54.484733+0000","last_undegraded":"2024-09-14T12:16:54.484733+0000","last_fullsized":"2024-09-14T12:16:54.484733+0000","mapping_epoch":35,"log_start":"263'101","ondisk_log_start":"263'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.484636+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":101,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:22.339169+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'543","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.579010+0000","last_change":"2024-09-14T12:16:25.579010+0000","last_active":"2024-09-14T12:16:25.579010+0000","last_peered":"2024-09-14T12:16:25.579010+0000","last_clean":"2024-09-14T12:16:25.579010+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:16:25.579010+0000","last_undegraded":"2024-09-14T12:16:25.579010+0000","last_fullsized":"2024-09-14T12:16:25.579010+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'543","last_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_deep_scrub":"263'543","last_deep_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.578907+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:02.855337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1110,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'412","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.444164+0000","last_change":"2024-09-14T12:16:22.444164+0000","last_active":"2024-09-14T12:16:22.444164+0000","last_peered":"2024-09-14T12:16:22.444164+0000","last_clean":"2024-09-14T12:16:22.444164+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:16:22.444164+0000","last_undegraded":"2024-09-14T12:16:22.444164+0000","last_fullsized":"2024-09-14T12:16:22.444164+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.444058+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:52.547807+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":761,"num_read_kb":21492,"num_write":1380,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.158786+0000","last_change":"2024-09-14T12:16:36.158786+0000","last_active":"2024-09-14T12:16:36.158786+0000","last_peered":"2024-09-14T12:16:36.158786+0000","last_clean":"2024-09-14T12:16:36.158786+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:16:36.158786+0000","last_undegraded":"2024-09-14T12:16:36.158786+0000","last_fullsized":"2024-09-14T12:16:36.158786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.158693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'312","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.241522+0000","last_change":"2024-09-14T12:16:40.241522+0000","last_active":"2024-09-14T12:16:40.241522+0000","last_peered":"2024-09-14T12:16:40.241522+0000","last_clean":"2024-09-14T12:16:40.241522+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:16:40.241522+0000","last_undegraded":"2024-09-14T12:16:40.241522+0000","last_fullsized":"2024-09-14T12:16:40.241522+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.241411+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:41.593606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":1085,"num_write":392,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'748","reported_seq":2443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.218331+0000","last_change":"2024-09-14T12:16:37.218331+0000","last_active":"2024-09-14T12:16:37.218331+0000","last_peered":"2024-09-14T12:16:37.218331+0000","last_clean":"2024-09-14T12:16:37.218331+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:16:37.218331+0000","last_undegraded":"2024-09-14T12:16:37.218331+0000","last_fullsized":"2024-09-14T12:16:37.218331+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.218240+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":701,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.806696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'186","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.145740+0000","last_change":"2024-09-14T12:16:43.145740+0000","last_active":"2024-09-14T12:16:43.145740+0000","last_peered":"2024-09-14T12:16:43.145740+0000","last_clean":"2024-09-14T12:16:43.145740+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:16:43.145740+0000","last_undegraded":"2024-09-14T12:16:43.145740+0000","last_fullsized":"2024-09-14T12:16:43.145740+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.145658+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:05.792206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'788","reported_seq":2327,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.550891+0000","last_change":"2024-09-14T12:16:24.550891+0000","last_active":"2024-09-14T12:16:24.550891+0000","last_peered":"2024-09-14T12:16:24.550891+0000","last_clean":"2024-09-14T12:16:24.550891+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:16:24.550891+0000","last_undegraded":"2024-09-14T12:16:24.550891+0000","last_fullsized":"2024-09-14T12:16:24.550891+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.550810+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:52.077298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.516595+0000","last_change":"2024-09-14T12:16:20.516595+0000","last_active":"2024-09-14T12:16:20.516595+0000","last_peered":"2024-09-14T12:16:20.516595+0000","last_clean":"2024-09-14T12:16:20.516595+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:16:20.516595+0000","last_undegraded":"2024-09-14T12:16:20.516595+0000","last_fullsized":"2024-09-14T12:16:20.516595+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.516495+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.683715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":54223,"num_write":971,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.906954+0000","last_change":"2024-09-14T12:16:42.906954+0000","last_active":"2024-09-14T12:16:42.906954+0000","last_peered":"2024-09-14T12:16:42.906954+0000","last_clean":"2024-09-14T12:16:42.906954+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:16:42.906954+0000","last_undegraded":"2024-09-14T12:16:42.906954+0000","last_fullsized":"2024-09-14T12:16:42.906954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.906839+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:05.333521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'89","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.625482+0000","last_change":"2024-09-14T12:16:44.625482+0000","last_active":"2024-09-14T12:16:44.625482+0000","last_peered":"2024-09-14T12:16:44.625482+0000","last_clean":"2024-09-14T12:16:44.625482+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:16:44.625482+0000","last_undegraded":"2024-09-14T12:16:44.625482+0000","last_fullsized":"2024-09-14T12:16:44.625482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.625381+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:00.052025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'782","reported_seq":2464,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.525981+0000","last_change":"2024-09-14T12:16:39.525981+0000","last_active":"2024-09-14T12:16:39.525981+0000","last_peered":"2024-09-14T12:16:39.525981+0000","last_clean":"2024-09-14T12:16:39.525981+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:16:39.525981+0000","last_undegraded":"2024-09-14T12:16:39.525981+0000","last_fullsized":"2024-09-14T12:16:39.525981+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.525886+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":702,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.113925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.659466+0000","last_change":"2024-09-14T12:16:52.659466+0000","last_active":"2024-09-14T12:16:52.659466+0000","last_peered":"2024-09-14T12:16:52.659466+0000","last_clean":"2024-09-14T12:16:52.659466+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:16:52.659466+0000","last_undegraded":"2024-09-14T12:16:52.659466+0000","last_fullsized":"2024-09-14T12:16:52.659466+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.659374+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.223342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'448","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.122847+0000","last_change":"2024-09-14T12:16:33.122847+0000","last_active":"2024-09-14T12:16:33.122847+0000","last_peered":"2024-09-14T12:16:33.122847+0000","last_clean":"2024-09-14T12:16:33.122847+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:16:33.122847+0000","last_undegraded":"2024-09-14T12:16:33.122847+0000","last_fullsized":"2024-09-14T12:16:33.122847+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.122743+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:16.368922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'335","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.471275+0000","last_change":"2024-09-14T12:16:23.471275+0000","last_active":"2024-09-14T12:16:23.471275+0000","last_peered":"2024-09-14T12:16:23.471275+0000","last_clean":"2024-09-14T12:16:23.471275+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:16:23.471275+0000","last_undegraded":"2024-09-14T12:16:23.471275+0000","last_fullsized":"2024-09-14T12:16:23.471275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.471155+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:57.341077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254166,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":11146,"num_write":1071,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.670140+0000","last_change":"2024-09-14T12:16:40.670140+0000","last_active":"2024-09-14T12:16:40.670140+0000","last_peered":"2024-09-14T12:16:40.670140+0000","last_clean":"2024-09-14T12:16:40.670140+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:16:40.670140+0000","last_undegraded":"2024-09-14T12:16:40.670140+0000","last_fullsized":"2024-09-14T12:16:40.670140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.670043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:21.707903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'372","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.966676+0000","last_change":"2024-09-14T12:16:47.966676+0000","last_active":"2024-09-14T12:16:47.966676+0000","last_peered":"2024-09-14T12:16:47.966676+0000","last_clean":"2024-09-14T12:16:47.966676+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:16:47.966676+0000","last_undegraded":"2024-09-14T12:16:47.966676+0000","last_fullsized":"2024-09-14T12:16:47.966676+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.966585+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:21.699551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":1225,"num_write":466,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.534552+0000","last_change":"2024-09-14T12:16:38.534552+0000","last_active":"2024-09-14T12:16:38.534552+0000","last_peered":"2024-09-14T12:16:38.534552+0000","last_clean":"2024-09-14T12:16:38.534552+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:16:38.534552+0000","last_undegraded":"2024-09-14T12:16:38.534552+0000","last_fullsized":"2024-09-14T12:16:38.534552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.534449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:17.580045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.038582+0000","last_change":"2024-09-14T12:16:50.038582+0000","last_active":"2024-09-14T12:16:50.038582+0000","last_peered":"2024-09-14T12:16:50.038582+0000","last_clean":"2024-09-14T12:16:50.038582+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:16:50.038582+0000","last_undegraded":"2024-09-14T12:16:50.038582+0000","last_fullsized":"2024-09-14T12:16:50.038582+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.038494+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.031187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'837","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.414190+0000","last_change":"2024-09-14T12:16:29.414190+0000","last_active":"2024-09-14T12:16:29.414190+0000","last_peered":"2024-09-14T12:16:29.414190+0000","last_clean":"2024-09-14T12:16:29.414190+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:16:29.414190+0000","last_undegraded":"2024-09-14T12:16:29.414190+0000","last_fullsized":"2024-09-14T12:16:29.414190+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'837","last_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_deep_scrub":"263'837","last_deep_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.414099+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:46.138941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.360340+0000","last_change":"2024-09-14T12:16:22.360268+0000","last_active":"2024-09-14T12:16:22.360340+0000","last_peered":"2024-09-14T12:16:22.360340+0000","last_clean":"2024-09-14T12:16:22.360340+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:16:22.360340+0000","last_undegraded":"2024-09-14T12:16:22.360340+0000","last_fullsized":"2024-09-14T12:16:22.360340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.360181+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":528,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.818652+0000","last_change":"2024-09-14T12:16:21.818652+0000","last_active":"2024-09-14T12:16:21.818652+0000","last_peered":"2024-09-14T12:16:21.818652+0000","last_clean":"2024-09-14T12:16:21.818652+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:16:21.818652+0000","last_undegraded":"2024-09-14T12:16:21.818652+0000","last_fullsized":"2024-09-14T12:16:21.818652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.818511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:14.072170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'359","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.414614+0000","last_change":"2024-09-14T12:16:20.414614+0000","last_active":"2024-09-14T12:16:20.414614+0000","last_peered":"2024-09-14T12:16:20.414614+0000","last_clean":"2024-09-14T12:16:20.414614+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:16:20.414614+0000","last_undegraded":"2024-09-14T12:16:20.414614+0000","last_fullsized":"2024-09-14T12:16:20.414614+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.414538+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:37.794945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":16922,"num_write":1091,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.408905+0000","last_change":"2024-09-14T12:16:39.408905+0000","last_active":"2024-09-14T12:16:39.408905+0000","last_peered":"2024-09-14T12:16:39.408905+0000","last_clean":"2024-09-14T12:16:39.408905+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:16:39.408905+0000","last_undegraded":"2024-09-14T12:16:39.408905+0000","last_fullsized":"2024-09-14T12:16:39.408905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.408812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:14.037956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'768","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.907046+0000","last_change":"2024-09-14T12:16:45.907046+0000","last_active":"2024-09-14T12:16:45.907046+0000","last_peered":"2024-09-14T12:16:45.907046+0000","last_clean":"2024-09-14T12:16:45.907046+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:16:45.907046+0000","last_undegraded":"2024-09-14T12:16:45.907046+0000","last_fullsized":"2024-09-14T12:16:45.907046+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.906955+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.165111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143710,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1487,"num_read_kb":3441,"num_write":1400,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89202,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.939891+0000","last_change":"2024-09-14T12:16:45.939891+0000","last_active":"2024-09-14T12:16:45.939891+0000","last_peered":"2024-09-14T12:16:45.939891+0000","last_clean":"2024-09-14T12:16:45.939891+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:16:45.939891+0000","last_undegraded":"2024-09-14T12:16:45.939891+0000","last_fullsized":"2024-09-14T12:16:45.939891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.939787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:47.502672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'172","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.447039+0000","last_change":"2024-09-14T12:16:45.447039+0000","last_active":"2024-09-14T12:16:45.447039+0000","last_peered":"2024-09-14T12:16:45.447039+0000","last_clean":"2024-09-14T12:16:45.447039+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:16:45.447039+0000","last_undegraded":"2024-09-14T12:16:45.447039+0000","last_fullsized":"2024-09-14T12:16:45.447039+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.446945+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:23.013556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'460","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.938707+0000","last_change":"2024-09-14T12:16:29.938707+0000","last_active":"2024-09-14T12:16:29.938707+0000","last_peered":"2024-09-14T12:16:29.938707+0000","last_clean":"2024-09-14T12:16:29.938707+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:16:29.938707+0000","last_undegraded":"2024-09-14T12:16:29.938707+0000","last_fullsized":"2024-09-14T12:16:29.938707+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.938619+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:25.975325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.365300+0000","last_change":"2024-09-14T12:16:23.365217+0000","last_active":"2024-09-14T12:16:23.365300+0000","last_peered":"2024-09-14T12:16:23.365300+0000","last_clean":"2024-09-14T12:16:23.365300+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:16:23.365300+0000","last_undegraded":"2024-09-14T12:16:23.365300+0000","last_fullsized":"2024-09-14T12:16:23.365300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.365091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.254811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'385","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.868893+0000","last_change":"2024-09-14T12:16:19.868893+0000","last_active":"2024-09-14T12:16:19.868893+0000","last_peered":"2024-09-14T12:16:19.868893+0000","last_clean":"2024-09-14T12:16:19.868893+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:16:19.868893+0000","last_undegraded":"2024-09-14T12:16:19.868893+0000","last_fullsized":"2024-09-14T12:16:19.868893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.868790+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.225391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":9086,"num_write":1281,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.832305+0000","last_change":"2024-09-14T12:16:40.832305+0000","last_active":"2024-09-14T12:16:40.832305+0000","last_peered":"2024-09-14T12:16:40.832305+0000","last_clean":"2024-09-14T12:16:40.832305+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:16:40.832305+0000","last_undegraded":"2024-09-14T12:16:40.832305+0000","last_fullsized":"2024-09-14T12:16:40.832305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.832190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.850016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1313","reported_seq":2959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.186119+0000","last_change":"2024-09-14T12:16:40.186119+0000","last_active":"2024-09-14T12:16:40.186119+0000","last_peered":"2024-09-14T12:16:40.186119+0000","last_clean":"2024-09-14T12:16:40.186119+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:40.186119+0000","last_undegraded":"2024-09-14T12:16:40.186119+0000","last_fullsized":"2024-09-14T12:16:40.186119+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1313","last_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_deep_scrub":"263'1313","last_deep_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.186008+0000","objects_scrubbed":12,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:59.234504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235088,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2047,"num_read_kb":3984,"num_write":1154,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.309899+0000","last_change":"2024-09-14T12:16:49.309899+0000","last_active":"2024-09-14T12:16:49.309899+0000","last_peered":"2024-09-14T12:16:49.309899+0000","last_clean":"2024-09-14T12:16:49.309899+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:16:49.309899+0000","last_undegraded":"2024-09-14T12:16:49.309899+0000","last_fullsized":"2024-09-14T12:16:49.309899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.309809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:41.869846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'218","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.081317+0000","last_change":"2024-09-14T12:16:48.081317+0000","last_active":"2024-09-14T12:16:48.081317+0000","last_peered":"2024-09-14T12:16:48.081317+0000","last_clean":"2024-09-14T12:16:48.081317+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:16:48.081317+0000","last_undegraded":"2024-09-14T12:16:48.081317+0000","last_fullsized":"2024-09-14T12:16:48.081317+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.081221+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.106916+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'658","reported_seq":2314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.055652+0000","last_change":"2024-09-14T12:16:30.055652+0000","last_active":"2024-09-14T12:16:30.055652+0000","last_peered":"2024-09-14T12:16:30.055652+0000","last_clean":"2024-09-14T12:16:30.055652+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:16:30.055652+0000","last_undegraded":"2024-09-14T12:16:30.055652+0000","last_fullsized":"2024-09-14T12:16:30.055652+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'658","last_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_deep_scrub":"263'658","last_deep_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.055562+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:55.630653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.219556+0000","last_change":"2024-09-14T12:16:22.219556+0000","last_active":"2024-09-14T12:16:22.219556+0000","last_peered":"2024-09-14T12:16:22.219556+0000","last_clean":"2024-09-14T12:16:22.219556+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:16:22.219556+0000","last_undegraded":"2024-09-14T12:16:22.219556+0000","last_fullsized":"2024-09-14T12:16:22.219556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.219484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:41.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'369","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.058930+0000","last_change":"2024-09-14T12:16:23.058930+0000","last_active":"2024-09-14T12:16:23.058930+0000","last_peered":"2024-09-14T12:16:23.058930+0000","last_clean":"2024-09-14T12:16:23.058930+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:16:23.058930+0000","last_undegraded":"2024-09-14T12:16:23.058930+0000","last_fullsized":"2024-09-14T12:16:23.058930+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.058848+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:55.317203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":678,"num_read_kb":56413,"num_write":1142,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.272785+0000","last_change":"2024-09-14T12:16:31.272785+0000","last_active":"2024-09-14T12:16:31.272785+0000","last_peered":"2024-09-14T12:16:31.272785+0000","last_clean":"2024-09-14T12:16:31.272785+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:16:31.272785+0000","last_undegraded":"2024-09-14T12:16:31.272785+0000","last_fullsized":"2024-09-14T12:16:31.272785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.272700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:53.072319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'267","reported_seq":1520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.415445+0000","last_change":"2024-09-14T12:16:44.415445+0000","last_active":"2024-09-14T12:16:44.415445+0000","last_peered":"2024-09-14T12:16:44.415445+0000","last_clean":"2024-09-14T12:16:44.415445+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:16:44.415445+0000","last_undegraded":"2024-09-14T12:16:44.415445+0000","last_fullsized":"2024-09-14T12:16:44.415445+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.415344+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:52.267747+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.890170+0000","last_change":"2024-09-14T12:16:44.890170+0000","last_active":"2024-09-14T12:16:44.890170+0000","last_peered":"2024-09-14T12:16:44.890170+0000","last_clean":"2024-09-14T12:16:44.890170+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:16:44.890170+0000","last_undegraded":"2024-09-14T12:16:44.890170+0000","last_fullsized":"2024-09-14T12:16:44.890170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.890089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:11.036712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.518031+0000","last_change":"2024-09-14T12:16:58.518031+0000","last_active":"2024-09-14T12:16:58.518031+0000","last_peered":"2024-09-14T12:16:58.518031+0000","last_clean":"2024-09-14T12:16:58.518031+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:16:58.518031+0000","last_undegraded":"2024-09-14T12:16:58.518031+0000","last_fullsized":"2024-09-14T12:16:58.518031+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T12:16:58.517942+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T12:16:58.517942+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.517942+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:51.264009+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'799","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.067463+0000","last_change":"2024-09-14T12:16:26.067463+0000","last_active":"2024-09-14T12:16:26.067463+0000","last_peered":"2024-09-14T12:16:26.067463+0000","last_clean":"2024-09-14T12:16:26.067463+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:16:26.067463+0000","last_undegraded":"2024-09-14T12:16:26.067463+0000","last_fullsized":"2024-09-14T12:16:26.067463+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.067346+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:40.289749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.828188+0000","last_change":"2024-09-14T12:16:20.828188+0000","last_active":"2024-09-14T12:16:20.828188+0000","last_peered":"2024-09-14T12:16:20.828188+0000","last_clean":"2024-09-14T12:16:20.828188+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:16:20.828188+0000","last_undegraded":"2024-09-14T12:16:20.828188+0000","last_fullsized":"2024-09-14T12:16:20.828188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.828073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:36.232253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'428","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.205035+0000","last_change":"2024-09-14T12:16:23.205035+0000","last_active":"2024-09-14T12:16:23.205035+0000","last_peered":"2024-09-14T12:16:23.205035+0000","last_clean":"2024-09-14T12:16:23.205035+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:16:23.205035+0000","last_undegraded":"2024-09-14T12:16:23.205035+0000","last_fullsized":"2024-09-14T12:16:23.205035+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.204951+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:51.476005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":100618,"num_write":1363,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"263'4","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.885003+0000","last_change":"2024-09-14T12:16:36.885003+0000","last_active":"2024-09-14T12:16:36.885003+0000","last_peered":"2024-09-14T12:16:36.885003+0000","last_clean":"2024-09-14T12:16:36.885003+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:16:36.885003+0000","last_undegraded":"2024-09-14T12:16:36.885003+0000","last_fullsized":"2024-09-14T12:16:36.885003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.884909+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:15.222253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":727,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'148","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.593588+0000","last_change":"2024-09-14T12:16:46.593588+0000","last_active":"2024-09-14T12:16:46.593588+0000","last_peered":"2024-09-14T12:16:46.593588+0000","last_clean":"2024-09-14T12:16:46.593588+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:16:46.593588+0000","last_undegraded":"2024-09-14T12:16:46.593588+0000","last_fullsized":"2024-09-14T12:16:46.593588+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.593480+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:01.417091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.529888+0000","last_change":"2024-09-14T12:16:37.529888+0000","last_active":"2024-09-14T12:16:37.529888+0000","last_peered":"2024-09-14T12:16:37.529888+0000","last_clean":"2024-09-14T12:16:37.529888+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:16:37.529888+0000","last_undegraded":"2024-09-14T12:16:37.529888+0000","last_fullsized":"2024-09-14T12:16:37.529888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.529798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:43.161355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'154","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.949519+0000","last_change":"2024-09-14T12:16:52.949519+0000","last_active":"2024-09-14T12:16:52.949519+0000","last_peered":"2024-09-14T12:16:52.949519+0000","last_clean":"2024-09-14T12:16:52.949519+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:16:52.949519+0000","last_undegraded":"2024-09-14T12:16:52.949519+0000","last_fullsized":"2024-09-14T12:16:52.949519+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.949406+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:56.125512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'541","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.067347+0000","last_change":"2024-09-14T12:16:25.067347+0000","last_active":"2024-09-14T12:16:25.067347+0000","last_peered":"2024-09-14T12:16:25.067347+0000","last_clean":"2024-09-14T12:16:25.067347+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:16:25.067347+0000","last_undegraded":"2024-09-14T12:16:25.067347+0000","last_fullsized":"2024-09-14T12:16:25.067347+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.067268+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:52.957237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'376","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.831672+0000","last_change":"2024-09-14T12:16:22.831672+0000","last_active":"2024-09-14T12:16:22.831672+0000","last_peered":"2024-09-14T12:16:22.831672+0000","last_clean":"2024-09-14T12:16:22.831672+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:16:22.831672+0000","last_undegraded":"2024-09-14T12:16:22.831672+0000","last_fullsized":"2024-09-14T12:16:22.831672+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.831568+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:25.922575+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":15898,"num_write":1178,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.046268+0000","last_change":"2024-09-14T12:16:21.046268+0000","last_active":"2024-09-14T12:16:21.046268+0000","last_peered":"2024-09-14T12:16:21.046268+0000","last_clean":"2024-09-14T12:16:21.046268+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:16:21.046268+0000","last_undegraded":"2024-09-14T12:16:21.046268+0000","last_fullsized":"2024-09-14T12:16:21.046268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.046203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:19.507992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.917486+0000","last_change":"2024-09-14T12:16:39.917486+0000","last_active":"2024-09-14T12:16:39.917486+0000","last_peered":"2024-09-14T12:16:39.917486+0000","last_clean":"2024-09-14T12:16:39.917486+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:16:39.917486+0000","last_undegraded":"2024-09-14T12:16:39.917486+0000","last_fullsized":"2024-09-14T12:16:39.917486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.917368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:02.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'604","reported_seq":1284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.886334+0000","last_change":"2024-09-14T12:16:40.886334+0000","last_active":"2024-09-14T12:16:40.886334+0000","last_peered":"2024-09-14T12:16:40.886334+0000","last_clean":"2024-09-14T12:16:40.886334+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:16:40.886334+0000","last_undegraded":"2024-09-14T12:16:40.886334+0000","last_fullsized":"2024-09-14T12:16:40.886334+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'604","last_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_deep_scrub":"263'604","last_deep_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.886241+0000","objects_scrubbed":10,"log_size":104,"log_dups_size":500,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:15.346475+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94377,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1665,"num_read_kb":2783,"num_write":2218,"num_write_kb":2033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537284,"num_omap_keys":1216,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.573449+0000","last_change":"2024-09-14T12:16:49.573449+0000","last_active":"2024-09-14T12:16:49.573449+0000","last_peered":"2024-09-14T12:16:49.573449+0000","last_clean":"2024-09-14T12:16:49.573449+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:16:49.573449+0000","last_undegraded":"2024-09-14T12:16:49.573449+0000","last_fullsized":"2024-09-14T12:16:49.573449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.573330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:10.996167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.144806+0000","last_change":"2024-09-14T12:16:55.144806+0000","last_active":"2024-09-14T12:16:55.144806+0000","last_peered":"2024-09-14T12:16:55.144806+0000","last_clean":"2024-09-14T12:16:55.144806+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:16:55.144806+0000","last_undegraded":"2024-09-14T12:16:55.144806+0000","last_fullsized":"2024-09-14T12:16:55.144806+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.144697+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:13.488584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'817","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.948833+0000","last_change":"2024-09-14T12:16:28.948833+0000","last_active":"2024-09-14T12:16:28.948833+0000","last_peered":"2024-09-14T12:16:28.948833+0000","last_clean":"2024-09-14T12:16:28.948833+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:16:28.948833+0000","last_undegraded":"2024-09-14T12:16:28.948833+0000","last_fullsized":"2024-09-14T12:16:28.948833+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.948726+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:45.026434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'370","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.036275+0000","last_change":"2024-09-14T12:16:20.036275+0000","last_active":"2024-09-14T12:16:20.036275+0000","last_peered":"2024-09-14T12:16:20.036275+0000","last_clean":"2024-09-14T12:16:20.036275+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:16:20.036275+0000","last_undegraded":"2024-09-14T12:16:20.036275+0000","last_fullsized":"2024-09-14T12:16:20.036275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.036170+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.821484+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159837,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":790,"num_read_kb":26393,"num_write":1261,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.388449+0000","last_change":"2024-09-14T12:16:24.388449+0000","last_active":"2024-09-14T12:16:24.388449+0000","last_peered":"2024-09-14T12:16:24.388449+0000","last_clean":"2024-09-14T12:16:24.388449+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:16:24.388449+0000","last_undegraded":"2024-09-14T12:16:24.388449+0000","last_fullsized":"2024-09-14T12:16:24.388449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.388360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:24.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.511200+0000","last_change":"2024-09-14T12:16:34.511200+0000","last_active":"2024-09-14T12:16:34.511200+0000","last_peered":"2024-09-14T12:16:34.511200+0000","last_clean":"2024-09-14T12:16:34.511200+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:16:34.511200+0000","last_undegraded":"2024-09-14T12:16:34.511200+0000","last_fullsized":"2024-09-14T12:16:34.511200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.511111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:08.764095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'170","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.152901+0000","last_change":"2024-09-14T12:16:41.152901+0000","last_active":"2024-09-14T12:16:41.152901+0000","last_peered":"2024-09-14T12:16:41.152901+0000","last_clean":"2024-09-14T12:16:41.152901+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:16:41.152901+0000","last_undegraded":"2024-09-14T12:16:41.152901+0000","last_fullsized":"2024-09-14T12:16:41.152901+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.152803+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:51.429920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'814","reported_seq":6820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.987827+0000","last_change":"2024-09-14T12:16:49.987827+0000","last_active":"2024-09-14T12:16:49.987827+0000","last_peered":"2024-09-14T12:16:49.987827+0000","last_clean":"2024-09-14T12:16:49.987827+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:16:49.987827+0000","last_undegraded":"2024-09-14T12:16:49.987827+0000","last_fullsized":"2024-09-14T12:16:49.987827+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.987737+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:21.547053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.486856+0000","last_change":"2024-09-14T12:16:55.486856+0000","last_active":"2024-09-14T12:16:55.486856+0000","last_peered":"2024-09-14T12:16:55.486856+0000","last_clean":"2024-09-14T12:16:55.486856+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:16:55.486856+0000","last_undegraded":"2024-09-14T12:16:55.486856+0000","last_fullsized":"2024-09-14T12:16:55.486856+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.486751+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:56.365995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1162","reported_seq":2666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.564857+0000","last_change":"2024-09-14T12:16:32.564857+0000","last_active":"2024-09-14T12:16:32.564857+0000","last_peered":"2024-09-14T12:16:32.564857+0000","last_clean":"2024-09-14T12:16:32.564857+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:16:32.564857+0000","last_undegraded":"2024-09-14T12:16:32.564857+0000","last_fullsized":"2024-09-14T12:16:32.564857+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1162","last_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_deep_scrub":"263'1162","last_deep_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.564750+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.939513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.380483+0000","last_change":"2024-09-14T12:16:21.380483+0000","last_active":"2024-09-14T12:16:21.380483+0000","last_peered":"2024-09-14T12:16:21.380483+0000","last_clean":"2024-09-14T12:16:21.380483+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:16:21.380483+0000","last_undegraded":"2024-09-14T12:16:21.380483+0000","last_fullsized":"2024-09-14T12:16:21.380483+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.380404+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:16.067361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":24953,"num_write":917,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.057317+0000","last_change":"2024-09-14T12:16:19.057317+0000","last_active":"2024-09-14T12:16:19.057317+0000","last_peered":"2024-09-14T12:16:19.057317+0000","last_clean":"2024-09-14T12:16:19.057317+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:16:19.057317+0000","last_undegraded":"2024-09-14T12:16:19.057317+0000","last_fullsized":"2024-09-14T12:16:19.057317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.057236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:56.674413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.626832+0000","last_change":"2024-09-14T12:16:41.626832+0000","last_active":"2024-09-14T12:16:41.626832+0000","last_peered":"2024-09-14T12:16:41.626832+0000","last_clean":"2024-09-14T12:16:41.626832+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:16:41.626832+0000","last_undegraded":"2024-09-14T12:16:41.626832+0000","last_fullsized":"2024-09-14T12:16:41.626832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.626734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:08.346841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'117","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.595797+0000","last_change":"2024-09-14T12:16:44.595797+0000","last_active":"2024-09-14T12:16:44.595797+0000","last_peered":"2024-09-14T12:16:44.595797+0000","last_clean":"2024-09-14T12:16:44.595797+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:16:44.595797+0000","last_undegraded":"2024-09-14T12:16:44.595797+0000","last_fullsized":"2024-09-14T12:16:44.595797+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.595693+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.936891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.514247+0000","last_change":"2024-09-14T12:16:56.514247+0000","last_active":"2024-09-14T12:16:56.514247+0000","last_peered":"2024-09-14T12:16:56.514247+0000","last_clean":"2024-09-14T12:16:56.514247+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:16:56.514247+0000","last_undegraded":"2024-09-14T12:16:56.514247+0000","last_fullsized":"2024-09-14T12:16:56.514247+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.514137+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.995492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.088408+0000","last_change":"2024-09-14T12:16:57.088408+0000","last_active":"2024-09-14T12:16:57.088408+0000","last_peered":"2024-09-14T12:16:57.088408+0000","last_clean":"2024-09-14T12:16:57.088408+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:16:57.088408+0000","last_undegraded":"2024-09-14T12:16:57.088408+0000","last_fullsized":"2024-09-14T12:16:57.088408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.088257+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:44.271140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2360,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.613914+0000","last_change":"2024-09-14T12:16:30.613914+0000","last_active":"2024-09-14T12:16:30.613914+0000","last_peered":"2024-09-14T12:16:30.613914+0000","last_clean":"2024-09-14T12:16:30.613914+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:16:30.613914+0000","last_undegraded":"2024-09-14T12:16:30.613914+0000","last_fullsized":"2024-09-14T12:16:30.613914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'873","last_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_deep_scrub":"263'873","last_deep_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.613828+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:47.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'407","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.862986+0000","last_change":"2024-09-14T12:16:20.862986+0000","last_active":"2024-09-14T12:16:20.862986+0000","last_peered":"2024-09-14T12:16:20.862986+0000","last_clean":"2024-09-14T12:16:20.862986+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:16:20.862986+0000","last_undegraded":"2024-09-14T12:16:20.862986+0000","last_fullsized":"2024-09-14T12:16:20.862986+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.862919+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:17.038200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":7690,"num_write":1106,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.452659+0000","last_change":"2024-09-14T12:16:21.452659+0000","last_active":"2024-09-14T12:16:21.452659+0000","last_peered":"2024-09-14T12:16:21.452659+0000","last_clean":"2024-09-14T12:16:21.452659+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:16:21.452659+0000","last_undegraded":"2024-09-14T12:16:21.452659+0000","last_fullsized":"2024-09-14T12:16:21.452659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.452570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:20.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.587319+0000","last_change":"2024-09-14T12:16:40.587319+0000","last_active":"2024-09-14T12:16:40.587319+0000","last_peered":"2024-09-14T12:16:40.587319+0000","last_clean":"2024-09-14T12:16:40.587319+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:16:40.587319+0000","last_undegraded":"2024-09-14T12:16:40.587319+0000","last_fullsized":"2024-09-14T12:16:40.587319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.587220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:50.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'724","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.390623+0000","last_change":"2024-09-14T12:16:43.390623+0000","last_active":"2024-09-14T12:16:43.390623+0000","last_peered":"2024-09-14T12:16:43.390623+0000","last_clean":"2024-09-14T12:16:43.390623+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:16:43.390623+0000","last_undegraded":"2024-09-14T12:16:43.390623+0000","last_fullsized":"2024-09-14T12:16:43.390623+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.390516+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:55.678494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149203,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1276,"num_read_kb":2979,"num_write":1030,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.547127+0000","last_change":"2024-09-14T12:16:50.547127+0000","last_active":"2024-09-14T12:16:50.547127+0000","last_peered":"2024-09-14T12:16:50.547127+0000","last_clean":"2024-09-14T12:16:50.547127+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:16:50.547127+0000","last_undegraded":"2024-09-14T12:16:50.547127+0000","last_fullsized":"2024-09-14T12:16:50.547127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.547030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:37.215198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'118","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.911032+0000","last_change":"2024-09-14T12:16:53.911032+0000","last_active":"2024-09-14T12:16:53.911032+0000","last_peered":"2024-09-14T12:16:53.911032+0000","last_clean":"2024-09-14T12:16:53.911032+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:16:53.911032+0000","last_undegraded":"2024-09-14T12:16:53.911032+0000","last_fullsized":"2024-09-14T12:16:53.911032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.910928+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:38.507193+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'155","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.121007+0000","last_change":"2024-09-14T12:16:58.121007+0000","last_active":"2024-09-14T12:16:58.121007+0000","last_peered":"2024-09-14T12:16:58.121007+0000","last_clean":"2024-09-14T12:16:58.121007+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:16:58.121007+0000","last_undegraded":"2024-09-14T12:16:58.121007+0000","last_fullsized":"2024-09-14T12:16:58.121007+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.120916+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:20.789699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'378","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.578669+0000","last_change":"2024-09-14T12:16:26.578669+0000","last_active":"2024-09-14T12:16:26.578669+0000","last_peered":"2024-09-14T12:16:26.578669+0000","last_clean":"2024-09-14T12:16:26.578669+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:16:26.578669+0000","last_undegraded":"2024-09-14T12:16:26.578669+0000","last_fullsized":"2024-09-14T12:16:26.578669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.578576+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:26.873670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'334","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.549518+0000","last_change":"2024-09-14T12:16:21.549518+0000","last_active":"2024-09-14T12:16:21.549518+0000","last_peered":"2024-09-14T12:16:21.549518+0000","last_clean":"2024-09-14T12:16:21.549518+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:16:21.549518+0000","last_undegraded":"2024-09-14T12:16:21.549518+0000","last_fullsized":"2024-09-14T12:16:21.549518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.549418+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:07.371079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":681,"num_read_kb":30194,"num_write":1111,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.196236+0000","last_change":"2024-09-14T12:16:37.196236+0000","last_active":"2024-09-14T12:16:37.196236+0000","last_peered":"2024-09-14T12:16:37.196236+0000","last_clean":"2024-09-14T12:16:37.196236+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:16:37.196236+0000","last_undegraded":"2024-09-14T12:16:37.196236+0000","last_fullsized":"2024-09-14T12:16:37.196236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.196124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:44.046644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.627395+0000","last_change":"2024-09-14T12:16:45.627395+0000","last_active":"2024-09-14T12:16:45.627395+0000","last_peered":"2024-09-14T12:16:45.627395+0000","last_clean":"2024-09-14T12:16:45.627395+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:16:45.627395+0000","last_undegraded":"2024-09-14T12:16:45.627395+0000","last_fullsized":"2024-09-14T12:16:45.627395+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.627286+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:15.850593+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55106,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1151,"num_write":410,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.538291+0000","last_change":"2024-09-14T12:16:51.538291+0000","last_active":"2024-09-14T12:16:51.538291+0000","last_peered":"2024-09-14T12:16:51.538291+0000","last_clean":"2024-09-14T12:16:51.538291+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:16:51.538291+0000","last_undegraded":"2024-09-14T12:16:51.538291+0000","last_fullsized":"2024-09-14T12:16:51.538291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.538191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:23.700459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.529037+0000","last_change":"2024-09-14T12:17:00.529037+0000","last_active":"2024-09-14T12:17:00.529037+0000","last_peered":"2024-09-14T12:17:00.529037+0000","last_clean":"2024-09-14T12:17:00.529037+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:17:00.529037+0000","last_undegraded":"2024-09-14T12:17:00.529037+0000","last_fullsized":"2024-09-14T12:17:00.529037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-14T12:17:00.528951+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-14T12:17:00.528951+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.528951+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:37.499497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.045329+0000","last_change":"2024-09-14T12:16:27.045329+0000","last_active":"2024-09-14T12:16:27.045329+0000","last_peered":"2024-09-14T12:16:27.045329+0000","last_clean":"2024-09-14T12:16:27.045329+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:16:27.045329+0000","last_undegraded":"2024-09-14T12:16:27.045329+0000","last_fullsized":"2024-09-14T12:16:27.045329+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.045215+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:32.784518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'400","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.377374+0000","last_change":"2024-09-14T12:16:29.377374+0000","last_active":"2024-09-14T12:16:29.377374+0000","last_peered":"2024-09-14T12:16:29.377374+0000","last_clean":"2024-09-14T12:16:29.377374+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:16:29.377374+0000","last_undegraded":"2024-09-14T12:16:29.377374+0000","last_fullsized":"2024-09-14T12:16:29.377374+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.377285+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:31.072073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":23223,"num_write":1213,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.564140+0000","last_change":"2024-09-14T12:16:42.564140+0000","last_active":"2024-09-14T12:16:42.564140+0000","last_peered":"2024-09-14T12:16:42.564140+0000","last_clean":"2024-09-14T12:16:42.564140+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:16:42.564140+0000","last_undegraded":"2024-09-14T12:16:42.564140+0000","last_fullsized":"2024-09-14T12:16:42.564140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.564074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.344761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'64","reported_seq":578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.866020+0000","last_change":"2024-09-14T12:16:43.866020+0000","last_active":"2024-09-14T12:16:43.866020+0000","last_peered":"2024-09-14T12:16:43.866020+0000","last_clean":"2024-09-14T12:16:43.866020+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:16:43.866020+0000","last_undegraded":"2024-09-14T12:16:43.866020+0000","last_fullsized":"2024-09-14T12:16:43.866020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.865930+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:19.821383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.259687+0000","last_change":"2024-09-14T12:16:50.259687+0000","last_active":"2024-09-14T12:16:50.259687+0000","last_peered":"2024-09-14T12:16:50.259687+0000","last_clean":"2024-09-14T12:16:50.259687+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:16:50.259687+0000","last_undegraded":"2024-09-14T12:16:50.259687+0000","last_fullsized":"2024-09-14T12:16:50.259687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.259609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:13.804578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'220","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.097630+0000","last_change":"2024-09-14T12:16:56.097630+0000","last_active":"2024-09-14T12:16:56.097630+0000","last_peered":"2024-09-14T12:16:56.097630+0000","last_clean":"2024-09-14T12:16:56.097630+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:16:56.097630+0000","last_undegraded":"2024-09-14T12:16:56.097630+0000","last_fullsized":"2024-09-14T12:16:56.097630+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.097543+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:57:00.542228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'493","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.522624+0000","last_change":"2024-09-14T12:16:34.522624+0000","last_active":"2024-09-14T12:16:34.522624+0000","last_peered":"2024-09-14T12:16:34.522624+0000","last_clean":"2024-09-14T12:16:34.522624+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:16:34.522624+0000","last_undegraded":"2024-09-14T12:16:34.522624+0000","last_fullsized":"2024-09-14T12:16:34.522624+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.522537+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:24.965499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'366","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.762267+0000","last_change":"2024-09-14T12:16:24.762267+0000","last_active":"2024-09-14T12:16:24.762267+0000","last_peered":"2024-09-14T12:16:24.762267+0000","last_clean":"2024-09-14T12:16:24.762267+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:16:24.762267+0000","last_undegraded":"2024-09-14T12:16:24.762267+0000","last_fullsized":"2024-09-14T12:16:24.762267+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.762175+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.783635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":658,"num_read_kb":51938,"num_write":1111,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.436681+0000","last_change":"2024-09-14T12:16:41.436681+0000","last_active":"2024-09-14T12:16:41.436681+0000","last_peered":"2024-09-14T12:16:41.436681+0000","last_clean":"2024-09-14T12:16:41.436681+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:16:41.436681+0000","last_undegraded":"2024-09-14T12:16:41.436681+0000","last_fullsized":"2024-09-14T12:16:41.436681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.436586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:34.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'334","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.568525+0000","last_change":"2024-09-14T12:16:49.568525+0000","last_active":"2024-09-14T12:16:49.568525+0000","last_peered":"2024-09-14T12:16:49.568525+0000","last_clean":"2024-09-14T12:16:49.568525+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:16:49.568525+0000","last_undegraded":"2024-09-14T12:16:49.568525+0000","last_fullsized":"2024-09-14T12:16:49.568525+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.568425+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:19.040053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51654,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1212,"num_write":436,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.505488+0000","last_change":"2024-09-14T12:16:40.505488+0000","last_active":"2024-09-14T12:16:40.505488+0000","last_peered":"2024-09-14T12:16:40.505488+0000","last_clean":"2024-09-14T12:16:40.505488+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:16:40.505488+0000","last_undegraded":"2024-09-14T12:16:40.505488+0000","last_fullsized":"2024-09-14T12:16:40.505488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.505400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.146164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'144","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.940108+0000","last_change":"2024-09-14T12:16:56.940108+0000","last_active":"2024-09-14T12:16:56.940108+0000","last_peered":"2024-09-14T12:16:56.940108+0000","last_clean":"2024-09-14T12:16:56.940108+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:16:56.940108+0000","last_undegraded":"2024-09-14T12:16:56.940108+0000","last_fullsized":"2024-09-14T12:16:56.940108+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.940008+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:04.385514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'928","reported_seq":2579,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.519388+0000","last_change":"2024-09-14T12:16:33.519388+0000","last_active":"2024-09-14T12:16:33.519388+0000","last_peered":"2024-09-14T12:16:33.519388+0000","last_clean":"2024-09-14T12:16:33.519388+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:16:33.519388+0000","last_undegraded":"2024-09-14T12:16:33.519388+0000","last_fullsized":"2024-09-14T12:16:33.519388+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'928","last_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_deep_scrub":"263'928","last_deep_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.519304+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.269882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'348","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.882011+0000","last_change":"2024-09-14T12:16:22.882011+0000","last_active":"2024-09-14T12:16:22.882011+0000","last_peered":"2024-09-14T12:16:22.882011+0000","last_clean":"2024-09-14T12:16:22.882011+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:16:22.882011+0000","last_undegraded":"2024-09-14T12:16:22.882011+0000","last_fullsized":"2024-09-14T12:16:22.882011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.881926+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:26.520282+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":18794,"num_write":1109,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.503912+0000","last_change":"2024-09-14T12:16:35.503912+0000","last_active":"2024-09-14T12:16:35.503912+0000","last_peered":"2024-09-14T12:16:35.503912+0000","last_clean":"2024-09-14T12:16:35.503912+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:16:35.503912+0000","last_undegraded":"2024-09-14T12:16:35.503912+0000","last_fullsized":"2024-09-14T12:16:35.503912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.503820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.750327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'307","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.382617+0000","last_change":"2024-09-14T12:16:47.382617+0000","last_active":"2024-09-14T12:16:47.382617+0000","last_peered":"2024-09-14T12:16:47.382617+0000","last_clean":"2024-09-14T12:16:47.382617+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:16:47.382617+0000","last_undegraded":"2024-09-14T12:16:47.382617+0000","last_fullsized":"2024-09-14T12:16:47.382617+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.382533+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:00.688987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1246,"num_write":418,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.069438+0000","last_change":"2024-09-14T12:16:50.069438+0000","last_active":"2024-09-14T12:16:50.069438+0000","last_peered":"2024-09-14T12:16:50.069438+0000","last_clean":"2024-09-14T12:16:50.069438+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:16:50.069438+0000","last_undegraded":"2024-09-14T12:16:50.069438+0000","last_fullsized":"2024-09-14T12:16:50.069438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.069325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:11.352276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'449","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.477989+0000","last_change":"2024-09-14T12:16:31.477989+0000","last_active":"2024-09-14T12:16:31.477989+0000","last_peered":"2024-09-14T12:16:31.477989+0000","last_clean":"2024-09-14T12:16:31.477989+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:16:31.477989+0000","last_undegraded":"2024-09-14T12:16:31.477989+0000","last_fullsized":"2024-09-14T12:16:31.477989+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.477885+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:41.643421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.509398+0000","last_change":"2024-09-14T12:16:24.509398+0000","last_active":"2024-09-14T12:16:24.509398+0000","last_peered":"2024-09-14T12:16:24.509398+0000","last_clean":"2024-09-14T12:16:24.509398+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:16:24.509398+0000","last_undegraded":"2024-09-14T12:16:24.509398+0000","last_fullsized":"2024-09-14T12:16:24.509398+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.509303+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:37.841214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":38674,"num_write":1067,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.862176+0000","last_change":"2024-09-14T12:16:37.862176+0000","last_active":"2024-09-14T12:16:37.862176+0000","last_peered":"2024-09-14T12:16:37.862176+0000","last_clean":"2024-09-14T12:16:37.862176+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:16:37.862176+0000","last_undegraded":"2024-09-14T12:16:37.862176+0000","last_fullsized":"2024-09-14T12:16:37.862176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.862072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:47.575762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'496","reported_seq":1134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.177068+0000","last_change":"2024-09-14T12:16:42.177068+0000","last_active":"2024-09-14T12:16:42.177068+0000","last_peered":"2024-09-14T12:16:42.177068+0000","last_clean":"2024-09-14T12:16:42.177068+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:16:42.177068+0000","last_undegraded":"2024-09-14T12:16:42.177068+0000","last_fullsized":"2024-09-14T12:16:42.177068+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.176992+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.979936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":2075,"num_write":756,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.024287+0000","last_change":"2024-09-14T12:16:51.024287+0000","last_active":"2024-09-14T12:16:51.024287+0000","last_peered":"2024-09-14T12:16:51.024287+0000","last_clean":"2024-09-14T12:16:51.024287+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:16:51.024287+0000","last_undegraded":"2024-09-14T12:16:51.024287+0000","last_fullsized":"2024-09-14T12:16:51.024287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.024168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.115991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'188","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.555763+0000","last_change":"2024-09-14T12:16:59.555763+0000","last_active":"2024-09-14T12:16:59.555763+0000","last_peered":"2024-09-14T12:16:59.555763+0000","last_clean":"2024-09-14T12:16:59.555763+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:16:59.555763+0000","last_undegraded":"2024-09-14T12:16:59.555763+0000","last_fullsized":"2024-09-14T12:16:59.555763+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T12:16:59.555653+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T12:16:59.555653+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.555653+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:37.213026+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'840","reported_seq":2544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.898323+0000","last_change":"2024-09-14T12:16:32.898323+0000","last_active":"2024-09-14T12:16:32.898323+0000","last_peered":"2024-09-14T12:16:32.898323+0000","last_clean":"2024-09-14T12:16:32.898323+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:16:32.898323+0000","last_undegraded":"2024-09-14T12:16:32.898323+0000","last_fullsized":"2024-09-14T12:16:32.898323+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'840","last_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_deep_scrub":"263'840","last_deep_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.898237+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:01.360421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'404","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.069459+0000","last_change":"2024-09-14T12:16:22.069459+0000","last_active":"2024-09-14T12:16:22.069459+0000","last_peered":"2024-09-14T12:16:22.069459+0000","last_clean":"2024-09-14T12:16:22.069459+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:16:22.069459+0000","last_undegraded":"2024-09-14T12:16:22.069459+0000","last_fullsized":"2024-09-14T12:16:22.069459+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.069380+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:18.179502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":5750,"num_write":1256,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.486620+0000","last_change":"2024-09-14T12:16:36.486620+0000","last_active":"2024-09-14T12:16:36.486620+0000","last_peered":"2024-09-14T12:16:36.486620+0000","last_clean":"2024-09-14T12:16:36.486620+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:16:36.486620+0000","last_undegraded":"2024-09-14T12:16:36.486620+0000","last_fullsized":"2024-09-14T12:16:36.486620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.486533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:47.840538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.350195+0000","last_change":"2024-09-14T12:16:48.350195+0000","last_active":"2024-09-14T12:16:48.350195+0000","last_peered":"2024-09-14T12:16:48.350195+0000","last_clean":"2024-09-14T12:16:48.350195+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:48.350195+0000","last_undegraded":"2024-09-14T12:16:48.350195+0000","last_fullsized":"2024-09-14T12:16:48.350195+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.350063+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:00.713091+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1111,"num_write":430,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.081996+0000","last_change":"2024-09-14T12:16:45.081996+0000","last_active":"2024-09-14T12:16:45.081996+0000","last_peered":"2024-09-14T12:16:45.081996+0000","last_clean":"2024-09-14T12:16:45.081996+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:16:45.081996+0000","last_undegraded":"2024-09-14T12:16:45.081996+0000","last_fullsized":"2024-09-14T12:16:45.081996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.081910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:44.716876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'205","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.455049+0000","last_change":"2024-09-14T12:16:44.455049+0000","last_active":"2024-09-14T12:16:44.455049+0000","last_peered":"2024-09-14T12:16:44.455049+0000","last_clean":"2024-09-14T12:16:44.455049+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:16:44.455049+0000","last_undegraded":"2024-09-14T12:16:44.455049+0000","last_fullsized":"2024-09-14T12:16:44.455049+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.454939+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:36.039287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'416","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.571028+0000","last_change":"2024-09-14T12:16:35.571028+0000","last_active":"2024-09-14T12:16:35.571028+0000","last_peered":"2024-09-14T12:16:35.571028+0000","last_clean":"2024-09-14T12:16:35.571028+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:16:35.571028+0000","last_undegraded":"2024-09-14T12:16:35.571028+0000","last_fullsized":"2024-09-14T12:16:35.571028+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.570946+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:00.910326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'367","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.510136+0000","last_change":"2024-09-14T12:16:22.510136+0000","last_active":"2024-09-14T12:16:22.510136+0000","last_peered":"2024-09-14T12:16:22.510136+0000","last_clean":"2024-09-14T12:16:22.510136+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:16:22.510136+0000","last_undegraded":"2024-09-14T12:16:22.510136+0000","last_fullsized":"2024-09-14T12:16:22.510136+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.510039+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:28.698454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":55641,"num_write":1285,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.617674+0000","last_change":"2024-09-14T12:16:43.617674+0000","last_active":"2024-09-14T12:16:43.617674+0000","last_peered":"2024-09-14T12:16:43.617674+0000","last_clean":"2024-09-14T12:16:43.617674+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:16:43.617674+0000","last_undegraded":"2024-09-14T12:16:43.617674+0000","last_fullsized":"2024-09-14T12:16:43.617674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.617596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:29.744676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.549558+0000","last_change":"2024-09-14T12:16:47.549558+0000","last_active":"2024-09-14T12:16:47.549558+0000","last_peered":"2024-09-14T12:16:47.549558+0000","last_clean":"2024-09-14T12:16:47.549558+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:16:47.549558+0000","last_undegraded":"2024-09-14T12:16:47.549558+0000","last_fullsized":"2024-09-14T12:16:47.549558+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.549469+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:38.899315+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53208,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":494,"num_read_kb":1139,"num_write":406,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.118086+0000","last_change":"2024-09-14T12:16:44.118086+0000","last_active":"2024-09-14T12:16:44.118086+0000","last_peered":"2024-09-14T12:16:44.118086+0000","last_clean":"2024-09-14T12:16:44.118086+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:16:44.118086+0000","last_undegraded":"2024-09-14T12:16:44.118086+0000","last_fullsized":"2024-09-14T12:16:44.118086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.117999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:36.635428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'103","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.865701+0000","last_change":"2024-09-14T12:16:54.865701+0000","last_active":"2024-09-14T12:16:54.865701+0000","last_peered":"2024-09-14T12:16:54.865701+0000","last_clean":"2024-09-14T12:16:54.865701+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:16:54.865701+0000","last_undegraded":"2024-09-14T12:16:54.865701+0000","last_fullsized":"2024-09-14T12:16:54.865701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.865614+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:23.014343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'485","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.218673+0000","last_change":"2024-09-14T12:16:26.218673+0000","last_active":"2024-09-14T12:16:26.218673+0000","last_peered":"2024-09-14T12:16:26.218673+0000","last_clean":"2024-09-14T12:16:26.218673+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:16:26.218673+0000","last_undegraded":"2024-09-14T12:16:26.218673+0000","last_fullsized":"2024-09-14T12:16:26.218673+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'485","last_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_deep_scrub":"263'485","last_deep_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.218577+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:32.733118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'441","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.912181+0000","last_change":"2024-09-14T12:16:21.912181+0000","last_active":"2024-09-14T12:16:21.912181+0000","last_peered":"2024-09-14T12:16:21.912181+0000","last_clean":"2024-09-14T12:16:21.912181+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:16:21.912181+0000","last_undegraded":"2024-09-14T12:16:21.912181+0000","last_fullsized":"2024-09-14T12:16:21.912181+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.912110+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:39.992075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1189,"num_read_kb":773,"num_write":1309,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.198180+0000","last_change":"2024-09-14T12:16:39.198180+0000","last_active":"2024-09-14T12:16:39.198180+0000","last_peered":"2024-09-14T12:16:39.198180+0000","last_clean":"2024-09-14T12:16:39.198180+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:16:39.198180+0000","last_undegraded":"2024-09-14T12:16:39.198180+0000","last_fullsized":"2024-09-14T12:16:39.198180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.198089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:04.354915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.599681+0000","last_change":"2024-09-14T12:16:47.599681+0000","last_active":"2024-09-14T12:16:47.599681+0000","last_peered":"2024-09-14T12:16:47.599681+0000","last_clean":"2024-09-14T12:16:47.599681+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:16:47.599681+0000","last_undegraded":"2024-09-14T12:16:47.599681+0000","last_fullsized":"2024-09-14T12:16:47.599681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.599583+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:21.557554+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'781","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.463071+0000","last_change":"2024-09-14T12:16:42.463071+0000","last_active":"2024-09-14T12:16:42.463071+0000","last_peered":"2024-09-14T12:16:42.463071+0000","last_clean":"2024-09-14T12:16:42.463071+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:16:42.463071+0000","last_undegraded":"2024-09-14T12:16:42.463071+0000","last_fullsized":"2024-09-14T12:16:42.463071+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.462978+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:02.034354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'127","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.281509+0000","last_change":"2024-09-14T12:16:53.281509+0000","last_active":"2024-09-14T12:16:53.281509+0000","last_peered":"2024-09-14T12:16:53.281509+0000","last_clean":"2024-09-14T12:16:53.281509+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:16:53.281509+0000","last_undegraded":"2024-09-14T12:16:53.281509+0000","last_fullsized":"2024-09-14T12:16:53.281509+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.281413+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:45.751283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'484","reported_seq":2012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.602934+0000","last_change":"2024-09-14T12:16:33.602934+0000","last_active":"2024-09-14T12:16:33.602934+0000","last_peered":"2024-09-14T12:16:33.602934+0000","last_clean":"2024-09-14T12:16:33.602934+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:16:33.602934+0000","last_undegraded":"2024-09-14T12:16:33.602934+0000","last_fullsized":"2024-09-14T12:16:33.602934+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'484","last_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_deep_scrub":"263'484","last_deep_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.602835+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:59.909062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3026,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.790342+0000","last_change":"2024-09-14T12:16:23.790342+0000","last_active":"2024-09-14T12:16:23.790342+0000","last_peered":"2024-09-14T12:16:23.790342+0000","last_clean":"2024-09-14T12:16:23.790342+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:16:23.790342+0000","last_undegraded":"2024-09-14T12:16:23.790342+0000","last_fullsized":"2024-09-14T12:16:23.790342+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.790199+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:45.806183+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":665,"num_read_kb":45610,"num_write":1043,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.390636+0000","last_change":"2024-09-14T12:16:42.390636+0000","last_active":"2024-09-14T12:16:42.390636+0000","last_peered":"2024-09-14T12:16:42.390636+0000","last_clean":"2024-09-14T12:16:42.390636+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:16:42.390636+0000","last_undegraded":"2024-09-14T12:16:42.390636+0000","last_fullsized":"2024-09-14T12:16:42.390636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.390528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:38.711595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'324","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.996393+0000","last_change":"2024-09-14T12:16:48.996393+0000","last_active":"2024-09-14T12:16:48.996393+0000","last_peered":"2024-09-14T12:16:48.996393+0000","last_clean":"2024-09-14T12:16:48.996393+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:16:48.996393+0000","last_undegraded":"2024-09-14T12:16:48.996393+0000","last_fullsized":"2024-09-14T12:16:48.996393+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.996286+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:54.778486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":989,"num_write":382,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.096297+0000","last_change":"2024-09-14T12:16:51.096297+0000","last_active":"2024-09-14T12:16:51.096297+0000","last_peered":"2024-09-14T12:16:51.096297+0000","last_clean":"2024-09-14T12:16:51.096297+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:16:51.096297+0000","last_undegraded":"2024-09-14T12:16:51.096297+0000","last_fullsized":"2024-09-14T12:16:51.096297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.096182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:46.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'168","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.228359+0000","last_change":"2024-09-14T12:16:55.228359+0000","last_active":"2024-09-14T12:16:55.228359+0000","last_peered":"2024-09-14T12:16:55.228359+0000","last_clean":"2024-09-14T12:16:55.228359+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:16:55.228359+0000","last_undegraded":"2024-09-14T12:16:55.228359+0000","last_fullsized":"2024-09-14T12:16:55.228359+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.228265+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:59.821910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'825","reported_seq":2439,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.565380+0000","last_change":"2024-09-14T12:16:28.565380+0000","last_active":"2024-09-14T12:16:28.565380+0000","last_peered":"2024-09-14T12:16:28.565380+0000","last_clean":"2024-09-14T12:16:28.565380+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:16:28.565380+0000","last_undegraded":"2024-09-14T12:16:28.565380+0000","last_fullsized":"2024-09-14T12:16:28.565380+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'825","last_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_deep_scrub":"263'825","last_deep_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.565300+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:29.751301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'403","reported_seq":1268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.799080+0000","last_change":"2024-09-14T12:16:25.799080+0000","last_active":"2024-09-14T12:16:25.799080+0000","last_peered":"2024-09-14T12:16:25.799080+0000","last_clean":"2024-09-14T12:16:25.799080+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:16:25.799080+0000","last_undegraded":"2024-09-14T12:16:25.799080+0000","last_fullsized":"2024-09-14T12:16:25.799080+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.798955+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.565631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1324,"num_read_kb":37458,"num_write":1300,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.862542+0000","last_change":"2024-09-14T12:16:44.862542+0000","last_active":"2024-09-14T12:16:44.862542+0000","last_peered":"2024-09-14T12:16:44.862542+0000","last_clean":"2024-09-14T12:16:44.862542+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:16:44.862542+0000","last_undegraded":"2024-09-14T12:16:44.862542+0000","last_fullsized":"2024-09-14T12:16:44.862542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.862406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:59.669337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.955854+0000","last_change":"2024-09-14T12:16:46.955854+0000","last_active":"2024-09-14T12:16:46.955854+0000","last_peered":"2024-09-14T12:16:46.955854+0000","last_clean":"2024-09-14T12:16:46.955854+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:16:46.955854+0000","last_undegraded":"2024-09-14T12:16:46.955854+0000","last_fullsized":"2024-09-14T12:16:46.955854+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.955737+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:59.807750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46067,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":1076,"num_write":376,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.482275+0000","last_change":"2024-09-14T12:16:41.482275+0000","last_active":"2024-09-14T12:16:41.482275+0000","last_peered":"2024-09-14T12:16:41.482275+0000","last_clean":"2024-09-14T12:16:41.482275+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:16:41.482275+0000","last_undegraded":"2024-09-14T12:16:41.482275+0000","last_fullsized":"2024-09-14T12:16:41.482275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.482182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:09.893270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'102","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.551081+0000","last_change":"2024-09-14T12:16:57.551081+0000","last_active":"2024-09-14T12:16:57.551081+0000","last_peered":"2024-09-14T12:16:57.551081+0000","last_clean":"2024-09-14T12:16:57.551081+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:16:57.551081+0000","last_undegraded":"2024-09-14T12:16:57.551081+0000","last_fullsized":"2024-09-14T12:16:57.551081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.550997+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:04.907290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'468","reported_seq":2032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.595539+0000","last_change":"2024-09-14T12:16:36.595539+0000","last_active":"2024-09-14T12:16:36.595539+0000","last_peered":"2024-09-14T12:16:36.595539+0000","last_clean":"2024-09-14T12:16:36.595539+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:16:36.595539+0000","last_undegraded":"2024-09-14T12:16:36.595539+0000","last_fullsized":"2024-09-14T12:16:36.595539+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.595458+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.327912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'363","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.520987+0000","last_change":"2024-09-14T12:16:25.520987+0000","last_active":"2024-09-14T12:16:25.520987+0000","last_peered":"2024-09-14T12:16:25.520987+0000","last_clean":"2024-09-14T12:16:25.520987+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:16:25.520987+0000","last_undegraded":"2024-09-14T12:16:25.520987+0000","last_fullsized":"2024-09-14T12:16:25.520987+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.520888+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.356077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":9738,"num_write":1164,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.633463+0000","last_change":"2024-09-14T12:16:42.633463+0000","last_active":"2024-09-14T12:16:42.633463+0000","last_peered":"2024-09-14T12:16:42.633463+0000","last_clean":"2024-09-14T12:16:42.633463+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:16:42.633463+0000","last_undegraded":"2024-09-14T12:16:42.633463+0000","last_fullsized":"2024-09-14T12:16:42.633463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.633379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:04.343825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'258","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.468390+0000","last_change":"2024-09-14T12:16:53.468390+0000","last_active":"2024-09-14T12:16:53.468390+0000","last_peered":"2024-09-14T12:16:53.468390+0000","last_clean":"2024-09-14T12:16:53.468390+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:16:53.468390+0000","last_undegraded":"2024-09-14T12:16:53.468390+0000","last_fullsized":"2024-09-14T12:16:53.468390+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.468286+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:55.124534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46060,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":1096,"num_write":366,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.613551+0000","last_change":"2024-09-14T12:16:51.613551+0000","last_active":"2024-09-14T12:16:51.613551+0000","last_peered":"2024-09-14T12:16:51.613551+0000","last_clean":"2024-09-14T12:16:51.613551+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:16:51.613551+0000","last_undegraded":"2024-09-14T12:16:51.613551+0000","last_fullsized":"2024-09-14T12:16:51.613551+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.613450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:42.650909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'191","reported_seq":1659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.260076+0000","last_change":"2024-09-14T12:16:54.260076+0000","last_active":"2024-09-14T12:16:54.260076+0000","last_peered":"2024-09-14T12:16:54.260076+0000","last_clean":"2024-09-14T12:16:54.260076+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:16:54.260076+0000","last_undegraded":"2024-09-14T12:16:54.260076+0000","last_fullsized":"2024-09-14T12:16:54.260076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.259974+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:28.566983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'591","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.580916+0000","last_change":"2024-09-14T12:16:29.580916+0000","last_active":"2024-09-14T12:16:29.580916+0000","last_peered":"2024-09-14T12:16:29.580916+0000","last_clean":"2024-09-14T12:16:29.580916+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:16:29.580916+0000","last_undegraded":"2024-09-14T12:16:29.580916+0000","last_fullsized":"2024-09-14T12:16:29.580916+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'591","last_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_deep_scrub":"263'591","last_deep_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.580819+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:36.205569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'359","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.913612+0000","last_change":"2024-09-14T12:16:23.913612+0000","last_active":"2024-09-14T12:16:23.913612+0000","last_peered":"2024-09-14T12:16:23.913612+0000","last_clean":"2024-09-14T12:16:23.913612+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:16:23.913612+0000","last_undegraded":"2024-09-14T12:16:23.913612+0000","last_fullsized":"2024-09-14T12:16:23.913612+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.913491+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:11.317852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":9181,"num_write":1146,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.227953+0000","last_change":"2024-09-14T12:16:38.227953+0000","last_active":"2024-09-14T12:16:38.227953+0000","last_peered":"2024-09-14T12:16:38.227953+0000","last_clean":"2024-09-14T12:16:38.227953+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:16:38.227953+0000","last_undegraded":"2024-09-14T12:16:38.227953+0000","last_fullsized":"2024-09-14T12:16:38.227953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.227869+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:50.267903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.592874+0000","last_change":"2024-09-14T12:16:46.592874+0000","last_active":"2024-09-14T12:16:46.592874+0000","last_peered":"2024-09-14T12:16:46.592874+0000","last_clean":"2024-09-14T12:16:46.592874+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:16:46.592874+0000","last_undegraded":"2024-09-14T12:16:46.592874+0000","last_fullsized":"2024-09-14T12:16:46.592874+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.592758+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:46.826509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1227,"num_write":442,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.130512+0000","last_change":"2024-09-14T12:16:52.130512+0000","last_active":"2024-09-14T12:16:52.130512+0000","last_peered":"2024-09-14T12:16:52.130512+0000","last_clean":"2024-09-14T12:16:52.130512+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:16:52.130512+0000","last_undegraded":"2024-09-14T12:16:52.130512+0000","last_fullsized":"2024-09-14T12:16:52.130512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.130423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:21.040185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'101","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.641136+0000","last_change":"2024-09-14T12:16:53.641136+0000","last_active":"2024-09-14T12:16:53.641136+0000","last_peered":"2024-09-14T12:16:53.641136+0000","last_clean":"2024-09-14T12:16:53.641136+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:16:53.641136+0000","last_undegraded":"2024-09-14T12:16:53.641136+0000","last_fullsized":"2024-09-14T12:16:53.641136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.641038+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:10.270684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'541","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.161351+0000","last_change":"2024-09-14T12:16:35.161351+0000","last_active":"2024-09-14T12:16:35.161351+0000","last_peered":"2024-09-14T12:16:35.161351+0000","last_clean":"2024-09-14T12:16:35.161351+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:16:35.161351+0000","last_undegraded":"2024-09-14T12:16:35.161351+0000","last_fullsized":"2024-09-14T12:16:35.161351+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.161259+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:47.150238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'399","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.437493+0000","last_change":"2024-09-14T12:16:26.437493+0000","last_active":"2024-09-14T12:16:26.437493+0000","last_peered":"2024-09-14T12:16:26.437493+0000","last_clean":"2024-09-14T12:16:26.437493+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:16:26.437493+0000","last_undegraded":"2024-09-14T12:16:26.437493+0000","last_fullsized":"2024-09-14T12:16:26.437493+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.437376+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:56.164832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":657,"num_read_kb":34326,"num_write":1264,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'836","reported_seq":2425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.160886+0000","last_change":"2024-09-14T12:16:34.160886+0000","last_active":"2024-09-14T12:16:34.160886+0000","last_peered":"2024-09-14T12:16:34.160886+0000","last_clean":"2024-09-14T12:16:34.160886+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:16:34.160886+0000","last_undegraded":"2024-09-14T12:16:34.160886+0000","last_fullsized":"2024-09-14T12:16:34.160886+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.160775+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:02.536094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'458","reported_seq":1177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.178320+0000","last_change":"2024-09-14T12:16:24.178320+0000","last_active":"2024-09-14T12:16:24.178320+0000","last_peered":"2024-09-14T12:16:24.178320+0000","last_clean":"2024-09-14T12:16:24.178320+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:16:24.178320+0000","last_undegraded":"2024-09-14T12:16:24.178320+0000","last_fullsized":"2024-09-14T12:16:24.178320+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.178222+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:00.886938+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":108296,"num_write":1392,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'491","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.910713+0000","last_change":"2024-09-14T12:16:38.910713+0000","last_active":"2024-09-14T12:16:38.910713+0000","last_peered":"2024-09-14T12:16:38.910713+0000","last_clean":"2024-09-14T12:16:38.910713+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:16:38.910713+0000","last_undegraded":"2024-09-14T12:16:38.910713+0000","last_fullsized":"2024-09-14T12:16:38.910713+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.910624+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.858404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'337","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.773355+0000","last_change":"2024-09-14T12:16:26.773355+0000","last_active":"2024-09-14T12:16:26.773355+0000","last_peered":"2024-09-14T12:16:26.773355+0000","last_clean":"2024-09-14T12:16:26.773355+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:16:26.773355+0000","last_undegraded":"2024-09-14T12:16:26.773355+0000","last_fullsized":"2024-09-14T12:16:26.773355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.773234+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:32.185869+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":31259,"num_write":1097,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1203","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.050987+0000","last_change":"2024-09-14T12:16:29.050987+0000","last_active":"2024-09-14T12:16:29.050987+0000","last_peered":"2024-09-14T12:16:29.050987+0000","last_clean":"2024-09-14T12:16:29.050987+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:16:29.050987+0000","last_undegraded":"2024-09-14T12:16:29.050987+0000","last_fullsized":"2024-09-14T12:16:29.050987+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1203","last_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_deep_scrub":"263'1203","last_deep_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.050902+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:27.737996+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.892822+0000","last_change":"2024-09-14T12:16:24.892822+0000","last_active":"2024-09-14T12:16:24.892822+0000","last_peered":"2024-09-14T12:16:24.892822+0000","last_clean":"2024-09-14T12:16:24.892822+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:16:24.892822+0000","last_undegraded":"2024-09-14T12:16:24.892822+0000","last_fullsized":"2024-09-14T12:16:24.892822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.892704+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:06.999544+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":15201,"num_write":1292,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'920","reported_seq":2583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.627418+0000","last_change":"2024-09-14T12:16:39.627418+0000","last_active":"2024-09-14T12:16:39.627418+0000","last_peered":"2024-09-14T12:16:39.627418+0000","last_clean":"2024-09-14T12:16:39.627418+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:16:39.627418+0000","last_undegraded":"2024-09-14T12:16:39.627418+0000","last_fullsized":"2024-09-14T12:16:39.627418+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'920","last_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_deep_scrub":"263'920","last_deep_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.627337+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:59.027510+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'308","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.509875+0000","last_change":"2024-09-14T12:16:26.509875+0000","last_active":"2024-09-14T12:16:26.509875+0000","last_peered":"2024-09-14T12:16:26.509875+0000","last_clean":"2024-09-14T12:16:26.509875+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:16:26.509875+0000","last_undegraded":"2024-09-14T12:16:26.509875+0000","last_fullsized":"2024-09-14T12:16:26.509875+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.509772+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.441645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306882,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":547,"num_read_kb":7710,"num_write":947,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'504","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.650472+0000","last_change":"2024-09-14T12:16:32.650472+0000","last_active":"2024-09-14T12:16:32.650472+0000","last_peered":"2024-09-14T12:16:32.650472+0000","last_clean":"2024-09-14T12:16:32.650472+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:16:32.650472+0000","last_undegraded":"2024-09-14T12:16:32.650472+0000","last_fullsized":"2024-09-14T12:16:32.650472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.650377+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:57.980647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'416","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.053960+0000","last_change":"2024-09-14T12:16:28.053960+0000","last_active":"2024-09-14T12:16:28.053960+0000","last_peered":"2024-09-14T12:16:28.053960+0000","last_clean":"2024-09-14T12:16:28.053960+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:16:28.053960+0000","last_undegraded":"2024-09-14T12:16:28.053960+0000","last_fullsized":"2024-09-14T12:16:28.053960+0000","mapping_epoch":25,"log_start":"263'401","ondisk_log_start":"263'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.053860+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.211944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":680,"num_read_kb":78819,"num_write":1261,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'834","reported_seq":2551,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.564900+0000","last_change":"2024-09-14T12:16:37.564900+0000","last_active":"2024-09-14T12:16:37.564900+0000","last_peered":"2024-09-14T12:16:37.564900+0000","last_clean":"2024-09-14T12:16:37.564900+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:16:37.564900+0000","last_undegraded":"2024-09-14T12:16:37.564900+0000","last_fullsized":"2024-09-14T12:16:37.564900+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'834","last_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_deep_scrub":"263'834","last_deep_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.564799+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:22.157858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'453","reported_seq":1138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.477694+0000","last_change":"2024-09-14T12:16:23.477694+0000","last_active":"2024-09-14T12:16:23.477694+0000","last_peered":"2024-09-14T12:16:23.477694+0000","last_clean":"2024-09-14T12:16:23.477694+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:16:23.477694+0000","last_undegraded":"2024-09-14T12:16:23.477694+0000","last_fullsized":"2024-09-14T12:16:23.477694+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.477569+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.655283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":42747,"num_write":1601,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.510021+0000","last_change":"2024-09-14T12:16:32.510021+0000","last_active":"2024-09-14T12:16:32.510021+0000","last_peered":"2024-09-14T12:16:32.510021+0000","last_clean":"2024-09-14T12:16:32.510021+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:16:32.510021+0000","last_undegraded":"2024-09-14T12:16:32.510021+0000","last_fullsized":"2024-09-14T12:16:32.510021+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.509908+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:43.358006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'368","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.603639+0000","last_change":"2024-09-14T12:16:28.603639+0000","last_active":"2024-09-14T12:16:28.603639+0000","last_peered":"2024-09-14T12:16:28.603639+0000","last_clean":"2024-09-14T12:16:28.603639+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:16:28.603639+0000","last_undegraded":"2024-09-14T12:16:28.603639+0000","last_fullsized":"2024-09-14T12:16:28.603639+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.603520+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:07.583029+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":730,"num_read_kb":25685,"num_write":1212,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'725","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.853714+0000","last_change":"2024-09-14T12:16:34.853714+0000","last_active":"2024-09-14T12:16:34.853714+0000","last_peered":"2024-09-14T12:16:34.853714+0000","last_clean":"2024-09-14T12:16:34.853714+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:16:34.853714+0000","last_undegraded":"2024-09-14T12:16:34.853714+0000","last_fullsized":"2024-09-14T12:16:34.853714+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'725","last_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_deep_scrub":"263'725","last_deep_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.853630+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:40.766897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.783873+0000","last_change":"2024-09-14T12:16:27.783873+0000","last_active":"2024-09-14T12:16:27.783873+0000","last_peered":"2024-09-14T12:16:27.783873+0000","last_clean":"2024-09-14T12:16:27.783873+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:16:27.783873+0000","last_undegraded":"2024-09-14T12:16:27.783873+0000","last_fullsized":"2024-09-14T12:16:27.783873+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.783754+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:26.128419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":13781,"num_write":973,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'544","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.617175+0000","last_change":"2024-09-14T12:16:35.617175+0000","last_active":"2024-09-14T12:16:35.617175+0000","last_peered":"2024-09-14T12:16:35.617175+0000","last_clean":"2024-09-14T12:16:35.617175+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:16:35.617175+0000","last_undegraded":"2024-09-14T12:16:35.617175+0000","last_fullsized":"2024-09-14T12:16:35.617175+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.617088+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:52.504033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'378","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.560326+0000","last_change":"2024-09-14T12:16:29.560326+0000","last_active":"2024-09-14T12:16:29.560326+0000","last_peered":"2024-09-14T12:16:29.560326+0000","last_clean":"2024-09-14T12:16:29.560326+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:16:29.560326+0000","last_undegraded":"2024-09-14T12:16:29.560326+0000","last_fullsized":"2024-09-14T12:16:29.560326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.560203+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.633237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":24861,"num_write":1154,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'887","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.214957+0000","last_change":"2024-09-14T12:16:25.214957+0000","last_active":"2024-09-14T12:16:25.214957+0000","last_peered":"2024-09-14T12:16:25.214957+0000","last_clean":"2024-09-14T12:16:25.214957+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:16:25.214957+0000","last_undegraded":"2024-09-14T12:16:25.214957+0000","last_fullsized":"2024-09-14T12:16:25.214957+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'887","last_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_deep_scrub":"263'887","last_deep_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.214874+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:03.118395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'399","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.777956+0000","last_change":"2024-09-14T12:16:28.777956+0000","last_active":"2024-09-14T12:16:28.777956+0000","last_peered":"2024-09-14T12:16:28.777956+0000","last_clean":"2024-09-14T12:16:28.777956+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:16:28.777956+0000","last_undegraded":"2024-09-14T12:16:28.777956+0000","last_fullsized":"2024-09-14T12:16:28.777956+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.777834+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:20.454980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":50704,"num_write":1241,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'684","reported_seq":2459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.605611+0000","last_change":"2024-09-14T12:16:34.605611+0000","last_active":"2024-09-14T12:16:34.605611+0000","last_peered":"2024-09-14T12:16:34.605611+0000","last_clean":"2024-09-14T12:16:34.605611+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:16:34.605611+0000","last_undegraded":"2024-09-14T12:16:34.605611+0000","last_fullsized":"2024-09-14T12:16:34.605611+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.605515+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:49.073360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'359","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.891383+0000","last_change":"2024-09-14T12:16:25.891383+0000","last_active":"2024-09-14T12:16:25.891383+0000","last_peered":"2024-09-14T12:16:25.891383+0000","last_clean":"2024-09-14T12:16:25.891383+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:16:25.891383+0000","last_undegraded":"2024-09-14T12:16:25.891383+0000","last_fullsized":"2024-09-14T12:16:25.891383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.891261+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:39.670161+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":2146,"num_write":1056,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'755","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.405692+0000","last_change":"2024-09-14T12:16:36.405692+0000","last_active":"2024-09-14T12:16:36.405692+0000","last_peered":"2024-09-14T12:16:36.405692+0000","last_clean":"2024-09-14T12:16:36.405692+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:16:36.405692+0000","last_undegraded":"2024-09-14T12:16:36.405692+0000","last_fullsized":"2024-09-14T12:16:36.405692+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.405559+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:19.573245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'333","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.520197+0000","last_change":"2024-09-14T12:16:24.520197+0000","last_active":"2024-09-14T12:16:24.520197+0000","last_peered":"2024-09-14T12:16:24.520197+0000","last_clean":"2024-09-14T12:16:24.520197+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:16:24.520197+0000","last_undegraded":"2024-09-14T12:16:24.520197+0000","last_fullsized":"2024-09-14T12:16:24.520197+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.520092+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:01.332103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":46679,"num_write":958,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'471","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.895312+0000","last_change":"2024-09-14T12:16:33.895312+0000","last_active":"2024-09-14T12:16:33.895312+0000","last_peered":"2024-09-14T12:16:33.895312+0000","last_clean":"2024-09-14T12:16:33.895312+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:16:33.895312+0000","last_undegraded":"2024-09-14T12:16:33.895312+0000","last_fullsized":"2024-09-14T12:16:33.895312+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.895220+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.754997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'348","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.097196+0000","last_change":"2024-09-14T12:16:31.097130+0000","last_active":"2024-09-14T12:16:31.097196+0000","last_peered":"2024-09-14T12:16:31.097196+0000","last_clean":"2024-09-14T12:16:31.097196+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:16:31.097196+0000","last_undegraded":"2024-09-14T12:16:31.097196+0000","last_fullsized":"2024-09-14T12:16:31.097196+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.097044+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:55.804352+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":19021,"num_write":1018,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'444","reported_seq":2081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.596230+0000","last_change":"2024-09-14T12:16:38.596230+0000","last_active":"2024-09-14T12:16:38.596230+0000","last_peered":"2024-09-14T12:16:38.596230+0000","last_clean":"2024-09-14T12:16:38.596230+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:16:38.596230+0000","last_undegraded":"2024-09-14T12:16:38.596230+0000","last_fullsized":"2024-09-14T12:16:38.596230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.596131+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:53.904204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4594,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'400","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.185633+0000","last_change":"2024-09-14T12:16:21.185633+0000","last_active":"2024-09-14T12:16:21.185633+0000","last_peered":"2024-09-14T12:16:21.185633+0000","last_clean":"2024-09-14T12:16:21.185633+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:16:21.185633+0000","last_undegraded":"2024-09-14T12:16:21.185633+0000","last_fullsized":"2024-09-14T12:16:21.185633+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.185559+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:24.059335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":76781,"num_write":1270,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'460","reported_seq":2085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.432720+0000","last_change":"2024-09-14T12:16:35.432720+0000","last_active":"2024-09-14T12:16:35.432720+0000","last_peered":"2024-09-14T12:16:35.432720+0000","last_clean":"2024-09-14T12:16:35.432720+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:16:35.432720+0000","last_undegraded":"2024-09-14T12:16:35.432720+0000","last_fullsized":"2024-09-14T12:16:35.432720+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.432637+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:31.011136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'375","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.890775+0000","last_change":"2024-09-14T12:16:32.890775+0000","last_active":"2024-09-14T12:16:32.890775+0000","last_peered":"2024-09-14T12:16:32.890775+0000","last_clean":"2024-09-14T12:16:32.890775+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:16:32.890775+0000","last_undegraded":"2024-09-14T12:16:32.890775+0000","last_fullsized":"2024-09-14T12:16:32.890775+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.890669+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:26.033762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":6459,"num_write":1212,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'316","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.839863+0000","last_change":"2024-09-14T12:16:31.839863+0000","last_active":"2024-09-14T12:16:31.839863+0000","last_peered":"2024-09-14T12:16:31.839863+0000","last_clean":"2024-09-14T12:16:31.839863+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:16:31.839863+0000","last_undegraded":"2024-09-14T12:16:31.839863+0000","last_fullsized":"2024-09-14T12:16:31.839863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.839755+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:18.749494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":1699,"num_write":1024,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'564","reported_seq":2268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.882132+0000","last_change":"2024-09-14T12:16:35.882132+0000","last_active":"2024-09-14T12:16:35.882132+0000","last_peered":"2024-09-14T12:16:35.882132+0000","last_clean":"2024-09-14T12:16:35.882132+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:16:35.882132+0000","last_undegraded":"2024-09-14T12:16:35.882132+0000","last_fullsized":"2024-09-14T12:16:35.882132+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.882034+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:28.610668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'411","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.093411+0000","last_change":"2024-09-14T12:16:32.093411+0000","last_active":"2024-09-14T12:16:32.093411+0000","last_peered":"2024-09-14T12:16:32.093411+0000","last_clean":"2024-09-14T12:16:32.093411+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:16:32.093411+0000","last_undegraded":"2024-09-14T12:16:32.093411+0000","last_fullsized":"2024-09-14T12:16:32.093411+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.093316+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:14.969406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":16758,"num_write":1274,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'916","reported_seq":2589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.894057+0000","last_change":"2024-09-14T12:16:36.894057+0000","last_active":"2024-09-14T12:16:36.894057+0000","last_peered":"2024-09-14T12:16:36.894057+0000","last_clean":"2024-09-14T12:16:36.894057+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:16:36.894057+0000","last_undegraded":"2024-09-14T12:16:36.894057+0000","last_fullsized":"2024-09-14T12:16:36.894057+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'916","last_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_deep_scrub":"263'916","last_deep_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.893938+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:11.186412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":590,"ondisk_log_size":590,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1705796,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18087,"num_read_kb":37833,"num_write":15249,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713408,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1989,"ondisk_log_size":1989,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35482,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3802,"ondisk_log_size":3802,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22160993,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44528,"num_read_kb":1801342,"num_write":73962,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45277184,"data_stored":44321986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4060,"ondisk_log_size":4060,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":187942,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":186673,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510168,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277484,"kb_used_data":11676,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094356,"statfs":{"total":96636764160,"available":96352620544,"internally_reserved":0,"allocated":11956224,"data_stored":10288647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510168,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249308,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94122532,"statfs":{"total":96636764160,"available":96381472768,"internally_reserved":0,"allocated":5844992,"data_stored":4296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510169,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137716,"kb_used_data":12196,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94234124,"statfs":{"total":96636764160,"available":96495742976,"internally_reserved":0,"allocated":12488704,"data_stored":10779353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510168,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98696,"kb_used_data":9208,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94273144,"statfs":{"total":96636764160,"available":96535699456,"internally_reserved":0,"allocated":9428992,"data_stored":7842152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510167,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256288,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115552,"statfs":{"total":96636764160,"available":96374325248,"internally_reserved":0,"allocated":12992512,"data_stored":11338592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510168,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92020,"kb_used_data":6756,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279820,"statfs":{"total":96636764160,"available":96542535680,"internally_reserved":0,"allocated":6918144,"data_stored":5375493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510167,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147548,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94224292,"statfs":{"total":96636764160,"available":96485675008,"internally_reserved":0,"allocated":8335360,"data_stored":6711727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575577,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263468,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94108372,"statfs":{"total":96636764160,"available":96366972928,"internally_reserved":0,"allocated":7630848,"data_stored":5968019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262142408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3240346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":4574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330048,"data_stored":3240066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":9200737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5706939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8773632,"data_stored":8639695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2236416,"data_stored":2160102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7680000,"data_stored":7559766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:17:23.245 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:23.245 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:23.246 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:23.246 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:23.246 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:51:06.009856+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=51, tm_sec=6, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=16, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:17:23.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:17:43.250 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:17:43.589 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T12:17:43.600 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T12:17:43.602 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2077,"stamp":"2024-09-14T12:17:43.293686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24474050,"num_objects":732,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":732,"num_whiteouts":0,"num_read":313127,"num_read_kb":2443510,"num_write":166195,"num_write_kb":2394098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752603,"num_omap_keys":1804,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13592,"ondisk_log_size":13592,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1522528,"kb_used_data":73824,"kb_used_omap":12,"kb_used_meta":1448563,"kb_avail":753452192,"statfs":{"total":773094113280,"available":771535044608,"internally_reserved":0,"allocated":75595776,"data_stored":62600240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1483329075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005021"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.019269+0000","last_change":"2024-09-14T12:17:07.019269+0000","last_active":"2024-09-14T12:17:07.019269+0000","last_peered":"2024-09-14T12:17:07.019269+0000","last_clean":"2024-09-14T12:17:07.019269+0000","last_became_active":"2024-09-14T11:51:07.032913+0000","last_became_peered":"2024-09-14T11:51:07.032913+0000","last_unstale":"2024-09-14T12:17:07.019269+0000","last_undegraded":"2024-09-14T12:17:07.019269+0000","last_fullsized":"2024-09-14T12:17:07.019269+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:07.019177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:07.019177+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.019177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:19.933553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.063655+0000","last_change":"2024-09-14T12:17:08.063537+0000","last_active":"2024-09-14T12:17:08.063655+0000","last_peered":"2024-09-14T12:17:08.063655+0000","last_clean":"2024-09-14T12:17:08.063655+0000","last_became_active":"2024-09-14T11:35:03.479068+0000","last_became_peered":"2024-09-14T11:35:03.479068+0000","last_unstale":"2024-09-14T12:17:08.063655+0000","last_undegraded":"2024-09-14T12:17:08.063655+0000","last_fullsized":"2024-09-14T12:17:08.063655+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:08.063428+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:08.063428+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.063428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:24.226120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"260'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.609237+0000","last_change":"2024-09-14T12:17:08.609151+0000","last_active":"2024-09-14T12:17:08.609237+0000","last_peered":"2024-09-14T12:17:08.609237+0000","last_clean":"2024-09-14T12:17:08.609237+0000","last_became_active":"2024-09-14T11:35:00.442021+0000","last_became_peered":"2024-09-14T11:35:00.442021+0000","last_unstale":"2024-09-14T12:17:08.609237+0000","last_undegraded":"2024-09-14T12:17:08.609237+0000","last_fullsized":"2024-09-14T12:17:08.609237+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:17:08.609011+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:17:08.609011+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.609011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:37.229018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'49","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.134486+0000","last_change":"2024-09-14T12:17:05.134426+0000","last_active":"2024-09-14T12:17:05.134486+0000","last_peered":"2024-09-14T12:17:05.134486+0000","last_clean":"2024-09-14T12:17:05.134486+0000","last_became_active":"2024-09-14T11:31:47.458305+0000","last_became_peered":"2024-09-14T11:31:47.458305+0000","last_unstale":"2024-09-14T12:17:05.134486+0000","last_undegraded":"2024-09-14T12:17:05.134486+0000","last_fullsized":"2024-09-14T12:17:05.134486+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T12:17:05.134331+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T12:17:05.134331+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.134331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:04.118068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":375,"num_read_kb":260,"num_write":123,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.229089+0000","last_change":"2024-09-14T12:16:50.229089+0000","last_active":"2024-09-14T12:16:50.229089+0000","last_peered":"2024-09-14T12:16:50.229089+0000","last_clean":"2024-09-14T12:16:50.229089+0000","last_became_active":"2024-09-14T11:51:07.025515+0000","last_became_peered":"2024-09-14T11:51:07.025515+0000","last_unstale":"2024-09-14T12:16:50.229089+0000","last_undegraded":"2024-09-14T12:16:50.229089+0000","last_fullsized":"2024-09-14T12:16:50.229089+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.228992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.228992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:36.706653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"260'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.581140+0000","last_change":"2024-09-14T12:17:07.581044+0000","last_active":"2024-09-14T12:17:07.581140+0000","last_peered":"2024-09-14T12:17:07.581140+0000","last_clean":"2024-09-14T12:17:07.581140+0000","last_became_active":"2024-09-14T11:35:03.478603+0000","last_became_peered":"2024-09-14T11:35:03.478603+0000","last_unstale":"2024-09-14T12:17:07.581140+0000","last_undegraded":"2024-09-14T12:17:07.581140+0000","last_fullsized":"2024-09-14T12:17:07.581140+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:17:07.580944+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:17:07.580944+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.580944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.659355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.028416+0000","last_change":"2024-09-14T12:16:55.028331+0000","last_active":"2024-09-14T12:16:55.028416+0000","last_peered":"2024-09-14T12:16:55.028416+0000","last_clean":"2024-09-14T12:16:55.028416+0000","last_became_active":"2024-09-14T11:35:00.448996+0000","last_became_peered":"2024-09-14T11:35:00.448996+0000","last_unstale":"2024-09-14T12:16:55.028416+0000","last_undegraded":"2024-09-14T12:16:55.028416+0000","last_fullsized":"2024-09-14T12:16:55.028416+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:55.028237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.028237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:15.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":4,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'31","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.227547+0000","last_change":"2024-09-14T12:16:41.227547+0000","last_active":"2024-09-14T12:16:41.227547+0000","last_peered":"2024-09-14T12:16:41.227547+0000","last_clean":"2024-09-14T12:16:41.227547+0000","last_became_active":"2024-09-14T11:31:47.462277+0000","last_became_peered":"2024-09-14T11:31:47.462277+0000","last_unstale":"2024-09-14T12:16:41.227547+0000","last_undegraded":"2024-09-14T12:16:41.227547+0000","last_fullsized":"2024-09-14T12:16:41.227547+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:41.227460+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.227460+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:49.105464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":136,"num_write":78,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.342822+0000","last_change":"2024-09-14T12:16:58.342822+0000","last_active":"2024-09-14T12:16:58.342822+0000","last_peered":"2024-09-14T12:16:58.342822+0000","last_clean":"2024-09-14T12:16:58.342822+0000","last_became_active":"2024-09-14T11:51:07.027786+0000","last_became_peered":"2024-09-14T11:51:07.027786+0000","last_unstale":"2024-09-14T12:16:58.342822+0000","last_undegraded":"2024-09-14T12:16:58.342822+0000","last_fullsized":"2024-09-14T12:16:58.342822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:58.342708+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.342708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:41.494086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.189743+0000","last_change":"2024-09-14T12:17:15.189743+0000","last_active":"2024-09-14T12:17:15.189743+0000","last_peered":"2024-09-14T12:17:15.189743+0000","last_clean":"2024-09-14T12:17:15.189743+0000","last_became_active":"2024-09-14T11:35:03.464408+0000","last_became_peered":"2024-09-14T11:35:03.464408+0000","last_unstale":"2024-09-14T12:17:15.189743+0000","last_undegraded":"2024-09-14T12:17:15.189743+0000","last_fullsized":"2024-09-14T12:17:15.189743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:15.189650+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:15.189650+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.189650+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:42.747957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"263'2","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.199822+0000","last_change":"2024-09-14T12:16:46.199719+0000","last_active":"2024-09-14T12:16:46.199822+0000","last_peered":"2024-09-14T12:16:46.199822+0000","last_clean":"2024-09-14T12:16:46.199822+0000","last_became_active":"2024-09-14T11:35:00.438464+0000","last_became_peered":"2024-09-14T11:35:00.438464+0000","last_unstale":"2024-09-14T12:16:46.199822+0000","last_undegraded":"2024-09-14T12:16:46.199822+0000","last_fullsized":"2024-09-14T12:16:46.199822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:46.199614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.199614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:24.508299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'51","reported_seq":201,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.169202+0000","last_change":"2024-09-14T12:17:04.169202+0000","last_active":"2024-09-14T12:17:04.169202+0000","last_peered":"2024-09-14T12:17:04.169202+0000","last_clean":"2024-09-14T12:17:04.169202+0000","last_became_active":"2024-09-14T11:31:47.448427+0000","last_became_peered":"2024-09-14T11:31:47.448427+0000","last_unstale":"2024-09-14T12:17:04.169202+0000","last_undegraded":"2024-09-14T12:17:04.169202+0000","last_fullsized":"2024-09-14T12:17:04.169202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:17:04.169083+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:17:04.169083+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.169083+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:33.708704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":244,"num_write":137,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:22.701350+0000","last_change":"2024-09-14T12:17:22.701350+0000","last_active":"2024-09-14T12:17:22.701350+0000","last_peered":"2024-09-14T12:17:22.701350+0000","last_clean":"2024-09-14T12:17:22.701350+0000","last_became_active":"2024-09-14T11:51:07.033617+0000","last_became_peered":"2024-09-14T11:51:07.033617+0000","last_unstale":"2024-09-14T12:17:22.701350+0000","last_undegraded":"2024-09-14T12:17:22.701350+0000","last_fullsized":"2024-09-14T12:17:22.701350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:22.701258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:22.701258+0000","last_clean_scrub_stamp":"2024-09-14T12:17:22.701258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:06.256597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.572461+0000","last_change":"2024-09-14T12:17:16.572461+0000","last_active":"2024-09-14T12:17:16.572461+0000","last_peered":"2024-09-14T12:17:16.572461+0000","last_clean":"2024-09-14T12:17:16.572461+0000","last_became_active":"2024-09-14T11:35:03.474640+0000","last_became_peered":"2024-09-14T11:35:03.474640+0000","last_unstale":"2024-09-14T12:17:16.572461+0000","last_undegraded":"2024-09-14T12:17:16.572461+0000","last_fullsized":"2024-09-14T12:17:16.572461+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:17:16.572372+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:17:16.572372+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.572372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:36.165562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.642353+0000","last_change":"2024-09-14T12:17:02.642353+0000","last_active":"2024-09-14T12:17:02.642353+0000","last_peered":"2024-09-14T12:17:02.642353+0000","last_clean":"2024-09-14T12:17:02.642353+0000","last_became_active":"2024-09-14T11:35:00.436444+0000","last_became_peered":"2024-09-14T11:35:00.436444+0000","last_unstale":"2024-09-14T12:17:02.642353+0000","last_undegraded":"2024-09-14T12:17:02.642353+0000","last_fullsized":"2024-09-14T12:17:02.642353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:02.642266+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:02.642266+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.642266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:17.107546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.598554+0000","last_change":"2024-09-14T12:17:06.598554+0000","last_active":"2024-09-14T12:17:06.598554+0000","last_peered":"2024-09-14T12:17:06.598554+0000","last_clean":"2024-09-14T12:17:06.598554+0000","last_became_active":"2024-09-14T11:31:47.456993+0000","last_became_peered":"2024-09-14T11:31:47.456993+0000","last_unstale":"2024-09-14T12:17:06.598554+0000","last_undegraded":"2024-09-14T12:17:06.598554+0000","last_fullsized":"2024-09-14T12:17:06.598554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T12:17:06.598461+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T12:17:06.598461+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.598461+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:00.166620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":80,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:19.624163+0000","last_change":"2024-09-14T12:17:19.624163+0000","last_active":"2024-09-14T12:17:19.624163+0000","last_peered":"2024-09-14T12:17:19.624163+0000","last_clean":"2024-09-14T12:17:19.624163+0000","last_became_active":"2024-09-14T11:51:07.034602+0000","last_became_peered":"2024-09-14T11:51:07.034602+0000","last_unstale":"2024-09-14T12:17:19.624163+0000","last_undegraded":"2024-09-14T12:17:19.624163+0000","last_fullsized":"2024-09-14T12:17:19.624163+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:19.624065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:19.624065+0000","last_clean_scrub_stamp":"2024-09-14T12:17:19.624065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:45.822905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'7","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.944576+0000","last_change":"2024-09-14T12:17:03.944576+0000","last_active":"2024-09-14T12:17:03.944576+0000","last_peered":"2024-09-14T12:17:03.944576+0000","last_clean":"2024-09-14T12:17:03.944576+0000","last_became_active":"2024-09-14T11:35:03.475756+0000","last_became_peered":"2024-09-14T11:35:03.475756+0000","last_unstale":"2024-09-14T12:17:03.944576+0000","last_undegraded":"2024-09-14T12:17:03.944576+0000","last_fullsized":"2024-09-14T12:17:03.944576+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:03.944487+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:03.944487+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.944487+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:58.024730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4136,"num_write":12,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.195290+0000","last_change":"2024-09-14T12:17:10.195290+0000","last_active":"2024-09-14T12:17:10.195290+0000","last_peered":"2024-09-14T12:17:10.195290+0000","last_clean":"2024-09-14T12:17:10.195290+0000","last_became_active":"2024-09-14T11:35:00.447772+0000","last_became_peered":"2024-09-14T11:35:00.447772+0000","last_unstale":"2024-09-14T12:17:10.195290+0000","last_undegraded":"2024-09-14T12:17:10.195290+0000","last_fullsized":"2024-09-14T12:17:10.195290+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:10.195208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:10.195208+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.195208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:10.075402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.608858+0000","last_change":"2024-09-14T12:17:10.608858+0000","last_active":"2024-09-14T12:17:10.608858+0000","last_peered":"2024-09-14T12:17:10.608858+0000","last_clean":"2024-09-14T12:17:10.608858+0000","last_became_active":"2024-09-14T11:31:47.461754+0000","last_became_peered":"2024-09-14T11:31:47.461754+0000","last_unstale":"2024-09-14T12:17:10.608858+0000","last_undegraded":"2024-09-14T12:17:10.608858+0000","last_fullsized":"2024-09-14T12:17:10.608858+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T12:17:10.608758+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T12:17:10.608758+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.608758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:56.066682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":87,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.000001+0000","last_change":"2024-09-14T12:16:58.000001+0000","last_active":"2024-09-14T12:16:58.000001+0000","last_peered":"2024-09-14T12:16:58.000001+0000","last_clean":"2024-09-14T12:16:58.000001+0000","last_became_active":"2024-09-14T11:51:07.022297+0000","last_became_peered":"2024-09-14T11:51:07.022297+0000","last_unstale":"2024-09-14T12:16:58.000001+0000","last_undegraded":"2024-09-14T12:16:58.000001+0000","last_fullsized":"2024-09-14T12:16:58.000001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.999898+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.999898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:38.804877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.417537+0000","last_change":"2024-09-14T12:16:55.417537+0000","last_active":"2024-09-14T12:16:55.417537+0000","last_peered":"2024-09-14T12:16:55.417537+0000","last_clean":"2024-09-14T12:16:55.417537+0000","last_became_active":"2024-09-14T11:35:03.471836+0000","last_became_peered":"2024-09-14T11:35:03.471836+0000","last_unstale":"2024-09-14T12:16:55.417537+0000","last_undegraded":"2024-09-14T12:16:55.417537+0000","last_fullsized":"2024-09-14T12:16:55.417537+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:55.417453+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.417453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:40.938224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.688300+0000","last_change":"2024-09-14T12:17:00.688300+0000","last_active":"2024-09-14T12:17:00.688300+0000","last_peered":"2024-09-14T12:17:00.688300+0000","last_clean":"2024-09-14T12:17:00.688300+0000","last_became_active":"2024-09-14T11:35:00.437615+0000","last_became_peered":"2024-09-14T11:35:00.437615+0000","last_unstale":"2024-09-14T12:17:00.688300+0000","last_undegraded":"2024-09-14T12:17:00.688300+0000","last_fullsized":"2024-09-14T12:17:00.688300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:00.688205+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:00.688205+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.688205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:00.261789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'265","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.431266+0000","last_change":"2024-09-14T12:16:50.431266+0000","last_active":"2024-09-14T12:16:50.431266+0000","last_peered":"2024-09-14T12:16:50.431266+0000","last_clean":"2024-09-14T12:16:50.431266+0000","last_became_active":"2024-09-14T11:31:47.462031+0000","last_became_peered":"2024-09-14T11:31:47.462031+0000","last_unstale":"2024-09-14T12:16:50.431266+0000","last_undegraded":"2024-09-14T12:16:50.431266+0000","last_fullsized":"2024-09-14T12:16:50.431266+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'265","last_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_deep_scrub":"263'265","last_deep_scrub_stamp":"2024-09-14T12:16:50.431183+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.431183+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.910341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2469,"num_read_kb":3125,"num_write":527,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.247620+0000","last_change":"2024-09-14T12:17:17.247620+0000","last_active":"2024-09-14T12:17:17.247620+0000","last_peered":"2024-09-14T12:17:17.247620+0000","last_clean":"2024-09-14T12:17:17.247620+0000","last_became_active":"2024-09-14T11:51:07.025200+0000","last_became_peered":"2024-09-14T11:51:07.025200+0000","last_unstale":"2024-09-14T12:17:17.247620+0000","last_undegraded":"2024-09-14T12:17:17.247620+0000","last_fullsized":"2024-09-14T12:17:17.247620+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:17.247529+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:17.247529+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.247529+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:50.940674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.370861+0000","last_change":"2024-09-14T12:16:56.370761+0000","last_active":"2024-09-14T12:16:56.370861+0000","last_peered":"2024-09-14T12:16:56.370861+0000","last_clean":"2024-09-14T12:16:56.370861+0000","last_became_active":"2024-09-14T11:35:03.473317+0000","last_became_peered":"2024-09-14T11:35:03.473317+0000","last_unstale":"2024-09-14T12:16:56.370861+0000","last_undegraded":"2024-09-14T12:16:56.370861+0000","last_fullsized":"2024-09-14T12:16:56.370861+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:56.370676+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.370676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:57.956462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"260'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.690908+0000","last_change":"2024-09-14T12:17:01.690828+0000","last_active":"2024-09-14T12:17:01.690908+0000","last_peered":"2024-09-14T12:17:01.690908+0000","last_clean":"2024-09-14T12:17:01.690908+0000","last_became_active":"2024-09-14T11:35:00.437501+0000","last_became_peered":"2024-09-14T11:35:00.437501+0000","last_unstale":"2024-09-14T12:17:01.690908+0000","last_undegraded":"2024-09-14T12:17:01.690908+0000","last_fullsized":"2024-09-14T12:17:01.690908+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T12:17:01.690712+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T12:17:01.690712+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.690712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:59.611639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'112","reported_seq":400,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.119461+0000","last_change":"2024-09-14T12:17:03.119461+0000","last_active":"2024-09-14T12:17:03.119461+0000","last_peered":"2024-09-14T12:17:03.119461+0000","last_clean":"2024-09-14T12:17:03.119461+0000","last_became_active":"2024-09-14T11:31:47.453505+0000","last_became_peered":"2024-09-14T11:31:47.453505+0000","last_unstale":"2024-09-14T12:17:03.119461+0000","last_undegraded":"2024-09-14T12:17:03.119461+0000","last_fullsized":"2024-09-14T12:17:03.119461+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-14T12:17:03.119395+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-14T12:17:03.119395+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.119395+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:02.567148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1057,"num_read_kb":1149,"num_write":217,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:18.249308+0000","last_change":"2024-09-14T12:17:18.249308+0000","last_active":"2024-09-14T12:17:18.249308+0000","last_peered":"2024-09-14T12:17:18.249308+0000","last_clean":"2024-09-14T12:17:18.249308+0000","last_became_active":"2024-09-14T11:51:07.024759+0000","last_became_peered":"2024-09-14T11:51:07.024759+0000","last_unstale":"2024-09-14T12:17:18.249308+0000","last_undegraded":"2024-09-14T12:17:18.249308+0000","last_fullsized":"2024-09-14T12:17:18.249308+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:18.249217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:18.249217+0000","last_clean_scrub_stamp":"2024-09-14T12:17:18.249217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:38.032590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'14","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.598576+0000","last_change":"2024-09-14T12:17:17.598485+0000","last_active":"2024-09-14T12:17:17.598576+0000","last_peered":"2024-09-14T12:17:17.598576+0000","last_clean":"2024-09-14T12:17:17.598576+0000","last_became_active":"2024-09-14T11:35:03.471155+0000","last_became_peered":"2024-09-14T11:35:03.471155+0000","last_unstale":"2024-09-14T12:17:17.598576+0000","last_undegraded":"2024-09-14T12:17:17.598576+0000","last_fullsized":"2024-09-14T12:17:17.598576+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T12:17:17.598364+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T12:17:17.598364+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.598364+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:54.486775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":17412,"num_write":24,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.181985+0000","last_change":"2024-09-14T12:17:11.181898+0000","last_active":"2024-09-14T12:17:11.181985+0000","last_peered":"2024-09-14T12:17:11.181985+0000","last_clean":"2024-09-14T12:17:11.181985+0000","last_became_active":"2024-09-14T11:35:00.442524+0000","last_became_peered":"2024-09-14T11:35:00.442524+0000","last_unstale":"2024-09-14T12:17:11.181985+0000","last_undegraded":"2024-09-14T12:17:11.181985+0000","last_fullsized":"2024-09-14T12:17:11.181985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:11.181775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:11.181775+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.181775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:38.051954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'29","reported_seq":143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.038268+0000","last_change":"2024-09-14T12:16:52.038191+0000","last_active":"2024-09-14T12:16:52.038268+0000","last_peered":"2024-09-14T12:16:52.038268+0000","last_clean":"2024-09-14T12:16:52.038268+0000","last_became_active":"2024-09-14T11:31:47.457241+0000","last_became_peered":"2024-09-14T11:31:47.457241+0000","last_unstale":"2024-09-14T12:16:52.038268+0000","last_undegraded":"2024-09-14T12:16:52.038268+0000","last_fullsized":"2024-09-14T12:16:52.038268+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T12:16:52.038107+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.038107+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:18.125308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":148,"num_write":71,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.972034+0000","last_change":"2024-09-14T12:16:58.972034+0000","last_active":"2024-09-14T12:16:58.972034+0000","last_peered":"2024-09-14T12:16:58.972034+0000","last_clean":"2024-09-14T12:16:58.972034+0000","last_became_active":"2024-09-14T11:51:07.033947+0000","last_became_peered":"2024-09-14T11:51:07.033947+0000","last_unstale":"2024-09-14T12:16:58.972034+0000","last_undegraded":"2024-09-14T12:16:58.972034+0000","last_fullsized":"2024-09-14T12:16:58.972034+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:58.971950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:58.971950+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.971950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:26.780169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.577501+0000","last_change":"2024-09-14T12:17:14.577501+0000","last_active":"2024-09-14T12:17:14.577501+0000","last_peered":"2024-09-14T12:17:14.577501+0000","last_clean":"2024-09-14T12:17:14.577501+0000","last_became_active":"2024-09-14T11:35:03.473256+0000","last_became_peered":"2024-09-14T11:35:03.473256+0000","last_unstale":"2024-09-14T12:17:14.577501+0000","last_undegraded":"2024-09-14T12:17:14.577501+0000","last_fullsized":"2024-09-14T12:17:14.577501+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.577357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.577357+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.577357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:47.870036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'6","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.944028+0000","last_change":"2024-09-14T12:16:59.943970+0000","last_active":"2024-09-14T12:16:59.944028+0000","last_peered":"2024-09-14T12:16:59.944028+0000","last_clean":"2024-09-14T12:16:59.944028+0000","last_became_active":"2024-09-14T11:35:00.440548+0000","last_became_peered":"2024-09-14T11:35:00.440548+0000","last_unstale":"2024-09-14T12:16:59.944028+0000","last_undegraded":"2024-09-14T12:16:59.944028+0000","last_fullsized":"2024-09-14T12:16:59.944028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:59.943885+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:59.943885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.943885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:15.267546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6146,"num_write":6,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.134072+0000","last_change":"2024-09-14T12:17:02.134072+0000","last_active":"2024-09-14T12:17:02.134072+0000","last_peered":"2024-09-14T12:17:02.134072+0000","last_clean":"2024-09-14T12:17:02.134072+0000","last_became_active":"2024-09-14T11:31:47.456052+0000","last_became_peered":"2024-09-14T11:31:47.456052+0000","last_unstale":"2024-09-14T12:17:02.134072+0000","last_undegraded":"2024-09-14T12:17:02.134072+0000","last_fullsized":"2024-09-14T12:17:02.134072+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T12:17:02.133982+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T12:17:02.133982+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.133982+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:35.664857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":184,"num_write":92,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.211985+0000","last_change":"2024-09-14T12:16:47.211908+0000","last_active":"2024-09-14T12:16:47.211985+0000","last_peered":"2024-09-14T12:16:47.211985+0000","last_clean":"2024-09-14T12:16:47.211985+0000","last_became_active":"2024-09-14T11:51:07.027752+0000","last_became_peered":"2024-09-14T11:51:07.027752+0000","last_unstale":"2024-09-14T12:16:47.211985+0000","last_undegraded":"2024-09-14T12:16:47.211985+0000","last_fullsized":"2024-09-14T12:16:47.211985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:47.211816+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.211816+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:34.600918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.214066+0000","last_change":"2024-09-14T12:17:14.214066+0000","last_active":"2024-09-14T12:17:14.214066+0000","last_peered":"2024-09-14T12:17:14.214066+0000","last_clean":"2024-09-14T12:17:14.214066+0000","last_became_active":"2024-09-14T11:35:56.551952+0000","last_became_peered":"2024-09-14T11:35:56.551952+0000","last_unstale":"2024-09-14T12:17:14.214066+0000","last_undegraded":"2024-09-14T12:17:14.214066+0000","last_fullsized":"2024-09-14T12:17:14.214066+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.213970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.213970+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.213970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:48.729690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.224968+0000","last_change":"2024-09-14T12:17:06.224968+0000","last_active":"2024-09-14T12:17:06.224968+0000","last_peered":"2024-09-14T12:17:06.224968+0000","last_clean":"2024-09-14T12:17:06.224968+0000","last_became_active":"2024-09-14T11:35:00.442696+0000","last_became_peered":"2024-09-14T11:35:00.442696+0000","last_unstale":"2024-09-14T12:17:06.224968+0000","last_undegraded":"2024-09-14T12:17:06.224968+0000","last_fullsized":"2024-09-14T12:17:06.224968+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:06.224869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:06.224869+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.224869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:05.803432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'19","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.587131+0000","last_change":"2024-09-14T12:17:03.587073+0000","last_active":"2024-09-14T12:17:03.587131+0000","last_peered":"2024-09-14T12:17:03.587131+0000","last_clean":"2024-09-14T12:17:03.587131+0000","last_became_active":"2024-09-14T11:31:47.462240+0000","last_became_peered":"2024-09-14T11:31:47.462240+0000","last_unstale":"2024-09-14T12:17:03.587131+0000","last_undegraded":"2024-09-14T12:17:03.587131+0000","last_fullsized":"2024-09-14T12:17:03.587131+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'19","last_scrub_stamp":"2024-09-14T12:17:03.586996+0000","last_deep_scrub":"263'19","last_deep_scrub_stamp":"2024-09-14T12:17:03.586996+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.586996+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:16.699021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":105,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.246719+0000","last_change":"2024-09-14T12:17:16.246719+0000","last_active":"2024-09-14T12:17:16.246719+0000","last_peered":"2024-09-14T12:17:16.246719+0000","last_clean":"2024-09-14T12:17:16.246719+0000","last_became_active":"2024-09-14T11:51:07.026048+0000","last_became_peered":"2024-09-14T11:51:07.026048+0000","last_unstale":"2024-09-14T12:17:16.246719+0000","last_undegraded":"2024-09-14T12:17:16.246719+0000","last_fullsized":"2024-09-14T12:17:16.246719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:16.246628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:16.246628+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.246628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:53.876662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.621508+0000","last_change":"2024-09-14T12:17:15.621508+0000","last_active":"2024-09-14T12:17:15.621508+0000","last_peered":"2024-09-14T12:17:15.621508+0000","last_clean":"2024-09-14T12:17:15.621508+0000","last_became_active":"2024-09-14T11:35:03.474720+0000","last_became_peered":"2024-09-14T11:35:03.474720+0000","last_unstale":"2024-09-14T12:17:15.621508+0000","last_undegraded":"2024-09-14T12:17:15.621508+0000","last_fullsized":"2024-09-14T12:17:15.621508+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:15.621419+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:15.621419+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.621419+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.277512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":14,"num_write_kb":7170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.223174+0000","last_change":"2024-09-14T12:16:45.223174+0000","last_active":"2024-09-14T12:16:45.223174+0000","last_peered":"2024-09-14T12:16:45.223174+0000","last_clean":"2024-09-14T12:16:45.223174+0000","last_became_active":"2024-09-14T11:35:00.443099+0000","last_became_peered":"2024-09-14T11:35:00.443099+0000","last_unstale":"2024-09-14T12:16:45.223174+0000","last_undegraded":"2024-09-14T12:16:45.223174+0000","last_fullsized":"2024-09-14T12:16:45.223174+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:16:45.223090+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.223090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.214548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'51","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.249068+0000","last_change":"2024-09-14T12:16:42.249068+0000","last_active":"2024-09-14T12:16:42.249068+0000","last_peered":"2024-09-14T12:16:42.249068+0000","last_clean":"2024-09-14T12:16:42.249068+0000","last_became_active":"2024-09-14T11:31:47.459577+0000","last_became_peered":"2024-09-14T11:31:47.459577+0000","last_unstale":"2024-09-14T12:16:42.249068+0000","last_undegraded":"2024-09-14T12:16:42.249068+0000","last_fullsized":"2024-09-14T12:16:42.249068+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-14T12:16:42.248991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.248991+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:14.635584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":299,"num_write":133,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.984407+0000","last_change":"2024-09-14T12:17:05.984407+0000","last_active":"2024-09-14T12:17:05.984407+0000","last_peered":"2024-09-14T12:17:05.984407+0000","last_clean":"2024-09-14T12:17:05.984407+0000","last_became_active":"2024-09-14T11:51:07.032949+0000","last_became_peered":"2024-09-14T11:51:07.032949+0000","last_unstale":"2024-09-14T12:17:05.984407+0000","last_undegraded":"2024-09-14T12:17:05.984407+0000","last_fullsized":"2024-09-14T12:17:05.984407+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:05.984319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:05.984319+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.984319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:28.740340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.625185+0000","last_change":"2024-09-14T12:17:05.625185+0000","last_active":"2024-09-14T12:17:05.625185+0000","last_peered":"2024-09-14T12:17:05.625185+0000","last_clean":"2024-09-14T12:17:05.625185+0000","last_became_active":"2024-09-14T11:35:03.471176+0000","last_became_peered":"2024-09-14T11:35:03.471176+0000","last_unstale":"2024-09-14T12:17:05.625185+0000","last_undegraded":"2024-09-14T12:17:05.625185+0000","last_fullsized":"2024-09-14T12:17:05.625185+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:05.625070+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:05.625070+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.625070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:26.975016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"260'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.200117+0000","last_change":"2024-09-14T12:17:09.200117+0000","last_active":"2024-09-14T12:17:09.200117+0000","last_peered":"2024-09-14T12:17:09.200117+0000","last_clean":"2024-09-14T12:17:09.200117+0000","last_became_active":"2024-09-14T11:35:00.444726+0000","last_became_peered":"2024-09-14T11:35:00.444726+0000","last_unstale":"2024-09-14T12:17:09.200117+0000","last_undegraded":"2024-09-14T12:17:09.200117+0000","last_fullsized":"2024-09-14T12:17:09.200117+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:09.199985+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:09.199985+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.199985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:39.696381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'32","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.227876+0000","last_change":"2024-09-14T12:17:01.227876+0000","last_active":"2024-09-14T12:17:01.227876+0000","last_peered":"2024-09-14T12:17:01.227876+0000","last_clean":"2024-09-14T12:17:01.227876+0000","last_became_active":"2024-09-14T11:31:47.455739+0000","last_became_peered":"2024-09-14T11:31:47.455739+0000","last_unstale":"2024-09-14T12:17:01.227876+0000","last_undegraded":"2024-09-14T12:17:01.227876+0000","last_fullsized":"2024-09-14T12:17:01.227876+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:17:01.227773+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:17:01.227773+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.227773+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.528932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":167,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:20.644651+0000","last_change":"2024-09-14T12:17:20.644595+0000","last_active":"2024-09-14T12:17:20.644651+0000","last_peered":"2024-09-14T12:17:20.644651+0000","last_clean":"2024-09-14T12:17:20.644651+0000","last_became_active":"2024-09-14T11:51:07.035925+0000","last_became_peered":"2024-09-14T11:51:07.035925+0000","last_unstale":"2024-09-14T12:17:20.644651+0000","last_undegraded":"2024-09-14T12:17:20.644651+0000","last_fullsized":"2024-09-14T12:17:20.644651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:20.644511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:20.644511+0000","last_clean_scrub_stamp":"2024-09-14T12:17:20.644511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:31.436500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.921860+0000","last_change":"2024-09-14T12:17:02.921789+0000","last_active":"2024-09-14T12:17:02.921860+0000","last_peered":"2024-09-14T12:17:02.921860+0000","last_clean":"2024-09-14T12:17:02.921860+0000","last_became_active":"2024-09-14T11:35:03.477180+0000","last_became_peered":"2024-09-14T11:35:03.477180+0000","last_unstale":"2024-09-14T12:17:02.921860+0000","last_undegraded":"2024-09-14T12:17:02.921860+0000","last_fullsized":"2024-09-14T12:17:02.921860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:02.921718+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:02.921718+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.921718+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:55.013116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.672300+0000","last_change":"2024-09-14T12:16:59.672229+0000","last_active":"2024-09-14T12:16:59.672300+0000","last_peered":"2024-09-14T12:16:59.672300+0000","last_clean":"2024-09-14T12:16:59.672300+0000","last_became_active":"2024-09-14T11:35:00.439539+0000","last_became_peered":"2024-09-14T11:35:00.439539+0000","last_unstale":"2024-09-14T12:16:59.672300+0000","last_undegraded":"2024-09-14T12:16:59.672300+0000","last_fullsized":"2024-09-14T12:16:59.672300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:59.672101+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:59.672101+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.672101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:03.829961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'41","reported_seq":175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.186283+0000","last_change":"2024-09-14T12:17:00.186283+0000","last_active":"2024-09-14T12:17:00.186283+0000","last_peered":"2024-09-14T12:17:00.186283+0000","last_clean":"2024-09-14T12:17:00.186283+0000","last_became_active":"2024-09-14T11:31:47.462112+0000","last_became_peered":"2024-09-14T11:31:47.462112+0000","last_unstale":"2024-09-14T12:17:00.186283+0000","last_undegraded":"2024-09-14T12:17:00.186283+0000","last_fullsized":"2024-09-14T12:17:00.186283+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T12:17:00.186189+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T12:17:00.186189+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.186189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:25.895425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":321,"num_read_kb":221,"num_write":102,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:20.218734+0000","last_change":"2024-09-14T12:17:20.218734+0000","last_active":"2024-09-14T12:17:20.218734+0000","last_peered":"2024-09-14T12:17:20.218734+0000","last_clean":"2024-09-14T12:17:20.218734+0000","last_became_active":"2024-09-14T11:51:07.030107+0000","last_became_peered":"2024-09-14T11:51:07.030107+0000","last_unstale":"2024-09-14T12:17:20.218734+0000","last_undegraded":"2024-09-14T12:17:20.218734+0000","last_fullsized":"2024-09-14T12:17:20.218734+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:20.218615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:20.218615+0000","last_clean_scrub_stamp":"2024-09-14T12:17:20.218615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:27.676022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.009850+0000","last_change":"2024-09-14T12:16:57.009764+0000","last_active":"2024-09-14T12:16:57.009850+0000","last_peered":"2024-09-14T12:16:57.009850+0000","last_clean":"2024-09-14T12:16:57.009850+0000","last_became_active":"2024-09-14T11:35:03.476234+0000","last_became_peered":"2024-09-14T11:35:03.476234+0000","last_unstale":"2024-09-14T12:16:57.009850+0000","last_undegraded":"2024-09-14T12:16:57.009850+0000","last_fullsized":"2024-09-14T12:16:57.009850+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:57.009666+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.009666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:55.446041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'9","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.603128+0000","last_change":"2024-09-14T12:17:07.603128+0000","last_active":"2024-09-14T12:17:07.603128+0000","last_peered":"2024-09-14T12:17:07.603128+0000","last_clean":"2024-09-14T12:17:07.603128+0000","last_became_active":"2024-09-14T11:35:00.441316+0000","last_became_peered":"2024-09-14T11:35:00.441316+0000","last_unstale":"2024-09-14T12:17:07.603128+0000","last_undegraded":"2024-09-14T12:17:07.603128+0000","last_fullsized":"2024-09-14T12:17:07.603128+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T12:17:07.603039+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T12:17:07.603039+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.603039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:06.030777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'33","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.146136+0000","last_change":"2024-09-14T12:17:01.146136+0000","last_active":"2024-09-14T12:17:01.146136+0000","last_peered":"2024-09-14T12:17:01.146136+0000","last_clean":"2024-09-14T12:17:01.146136+0000","last_became_active":"2024-09-14T11:31:47.450723+0000","last_became_peered":"2024-09-14T11:31:47.450723+0000","last_unstale":"2024-09-14T12:17:01.146136+0000","last_undegraded":"2024-09-14T12:17:01.146136+0000","last_fullsized":"2024-09-14T12:17:01.146136+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-14T12:17:01.146043+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-14T12:17:01.146043+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.146043+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:21.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":176,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:19.214673+0000","last_change":"2024-09-14T12:17:19.214673+0000","last_active":"2024-09-14T12:17:19.214673+0000","last_peered":"2024-09-14T12:17:19.214673+0000","last_clean":"2024-09-14T12:17:19.214673+0000","last_became_active":"2024-09-14T11:51:07.028129+0000","last_became_peered":"2024-09-14T11:51:07.028129+0000","last_unstale":"2024-09-14T12:17:19.214673+0000","last_undegraded":"2024-09-14T12:17:19.214673+0000","last_fullsized":"2024-09-14T12:17:19.214673+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:19.214591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:19.214591+0000","last_clean_scrub_stamp":"2024-09-14T12:17:19.214591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:24.407871+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.606453+0000","last_change":"2024-09-14T12:17:13.606453+0000","last_active":"2024-09-14T12:17:13.606453+0000","last_peered":"2024-09-14T12:17:13.606453+0000","last_clean":"2024-09-14T12:17:13.606453+0000","last_became_active":"2024-09-14T11:35:03.471273+0000","last_became_peered":"2024-09-14T11:35:03.471273+0000","last_unstale":"2024-09-14T12:17:13.606453+0000","last_undegraded":"2024-09-14T12:17:13.606453+0000","last_fullsized":"2024-09-14T12:17:13.606453+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:13.606354+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:13.606354+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.606354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:03.628277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7286,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"263'13","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.486128+0000","last_change":"2024-09-14T12:16:52.486051+0000","last_active":"2024-09-14T12:16:52.486128+0000","last_peered":"2024-09-14T12:16:52.486128+0000","last_clean":"2024-09-14T12:16:52.486128+0000","last_became_active":"2024-09-14T11:35:00.447204+0000","last_became_peered":"2024-09-14T11:35:00.447204+0000","last_unstale":"2024-09-14T12:16:52.486128+0000","last_undegraded":"2024-09-14T12:16:52.486128+0000","last_fullsized":"2024-09-14T12:16:52.486128+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:16:52.485960+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.485960+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.159924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16386,"num_write":18,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'52","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.654524+0000","last_change":"2024-09-14T12:16:58.654524+0000","last_active":"2024-09-14T12:16:58.654524+0000","last_peered":"2024-09-14T12:16:58.654524+0000","last_clean":"2024-09-14T12:16:58.654524+0000","last_became_active":"2024-09-14T11:31:47.456034+0000","last_became_peered":"2024-09-14T11:31:47.456034+0000","last_unstale":"2024-09-14T12:16:58.654524+0000","last_undegraded":"2024-09-14T12:16:58.654524+0000","last_fullsized":"2024-09-14T12:16:58.654524+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-14T12:16:58.654417+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-14T12:16:58.654417+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.654417+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:14.309793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":269,"num_write":130,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:21.674259+0000","last_change":"2024-09-14T12:17:21.674183+0000","last_active":"2024-09-14T12:17:21.674259+0000","last_peered":"2024-09-14T12:17:21.674259+0000","last_clean":"2024-09-14T12:17:21.674259+0000","last_became_active":"2024-09-14T11:51:07.032223+0000","last_became_peered":"2024-09-14T11:51:07.032223+0000","last_unstale":"2024-09-14T12:17:21.674259+0000","last_undegraded":"2024-09-14T12:17:21.674259+0000","last_fullsized":"2024-09-14T12:17:21.674259+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:21.674093+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:21.674093+0000","last_clean_scrub_stamp":"2024-09-14T12:17:21.674093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:52.357163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.452148+0000","last_change":"2024-09-14T12:16:53.452074+0000","last_active":"2024-09-14T12:16:53.452148+0000","last_peered":"2024-09-14T12:16:53.452148+0000","last_clean":"2024-09-14T12:16:53.452148+0000","last_became_active":"2024-09-14T11:35:03.479750+0000","last_became_peered":"2024-09-14T11:35:03.479750+0000","last_unstale":"2024-09-14T12:16:53.452148+0000","last_undegraded":"2024-09-14T12:16:53.452148+0000","last_fullsized":"2024-09-14T12:16:53.452148+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.451986+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.451986+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:58.732860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'8","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.920534+0000","last_change":"2024-09-14T12:17:00.920440+0000","last_active":"2024-09-14T12:17:00.920534+0000","last_peered":"2024-09-14T12:17:00.920534+0000","last_clean":"2024-09-14T12:17:00.920534+0000","last_became_active":"2024-09-14T11:35:00.447157+0000","last_became_peered":"2024-09-14T11:35:00.447157+0000","last_unstale":"2024-09-14T12:17:00.920534+0000","last_undegraded":"2024-09-14T12:17:00.920534+0000","last_fullsized":"2024-09-14T12:17:00.920534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T12:17:00.920346+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T12:17:00.920346+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.920346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:46.070865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":20480,"num_write":18,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"252'22","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.552445+0000","last_change":"2024-09-14T12:17:02.552445+0000","last_active":"2024-09-14T12:17:02.552445+0000","last_peered":"2024-09-14T12:17:02.552445+0000","last_clean":"2024-09-14T12:17:02.552445+0000","last_became_active":"2024-09-14T11:31:47.463903+0000","last_became_peered":"2024-09-14T11:31:47.463903+0000","last_unstale":"2024-09-14T12:17:02.552445+0000","last_undegraded":"2024-09-14T12:17:02.552445+0000","last_fullsized":"2024-09-14T12:17:02.552445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"252'22","last_scrub_stamp":"2024-09-14T12:17:02.552354+0000","last_deep_scrub":"252'22","last_deep_scrub_stamp":"2024-09-14T12:17:02.552354+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.552354+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:10.699433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":139,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.228850+0000","last_change":"2024-09-14T12:16:43.228751+0000","last_active":"2024-09-14T12:16:43.228850+0000","last_peered":"2024-09-14T12:16:43.228850+0000","last_clean":"2024-09-14T12:16:43.228850+0000","last_became_active":"2024-09-14T11:51:07.027446+0000","last_became_peered":"2024-09-14T11:51:07.027446+0000","last_unstale":"2024-09-14T12:16:43.228850+0000","last_undegraded":"2024-09-14T12:16:43.228850+0000","last_fullsized":"2024-09-14T12:16:43.228850+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.228673+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.228673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:31.730916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.620312+0000","last_change":"2024-09-14T12:17:11.620312+0000","last_active":"2024-09-14T12:17:11.620312+0000","last_peered":"2024-09-14T12:17:11.620312+0000","last_clean":"2024-09-14T12:17:11.620312+0000","last_became_active":"2024-09-14T11:35:03.471175+0000","last_became_peered":"2024-09-14T11:35:03.471175+0000","last_unstale":"2024-09-14T12:17:11.620312+0000","last_undegraded":"2024-09-14T12:17:11.620312+0000","last_fullsized":"2024-09-14T12:17:11.620312+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:17:11.620222+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:17:11.620222+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.620222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:11.712906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'10","reported_seq":75,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.272435+0000","last_change":"2024-09-14T12:17:05.272435+0000","last_active":"2024-09-14T12:17:05.272435+0000","last_peered":"2024-09-14T12:17:05.272435+0000","last_clean":"2024-09-14T12:17:05.272435+0000","last_became_active":"2024-09-14T11:35:00.441178+0000","last_became_peered":"2024-09-14T11:35:00.441178+0000","last_unstale":"2024-09-14T12:17:05.272435+0000","last_undegraded":"2024-09-14T12:17:05.272435+0000","last_fullsized":"2024-09-14T12:17:05.272435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T12:17:05.272343+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T12:17:05.272343+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.272343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:00.474493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":23554,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'48","reported_seq":187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.614121+0000","last_change":"2024-09-14T12:17:04.614121+0000","last_active":"2024-09-14T12:17:04.614121+0000","last_peered":"2024-09-14T12:17:04.614121+0000","last_clean":"2024-09-14T12:17:04.614121+0000","last_became_active":"2024-09-14T11:31:47.463160+0000","last_became_peered":"2024-09-14T11:31:47.463160+0000","last_unstale":"2024-09-14T12:17:04.614121+0000","last_undegraded":"2024-09-14T12:17:04.614121+0000","last_fullsized":"2024-09-14T12:17:04.614121+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'48","last_scrub_stamp":"2024-09-14T12:17:04.614030+0000","last_deep_scrub":"263'48","last_deep_scrub_stamp":"2024-09-14T12:17:04.614030+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.614030+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:44.773185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":220,"num_write":120,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.159736+0000","last_change":"2024-09-14T12:17:13.159736+0000","last_active":"2024-09-14T12:17:13.159736+0000","last_peered":"2024-09-14T12:17:13.159736+0000","last_clean":"2024-09-14T12:17:13.159736+0000","last_became_active":"2024-09-14T11:51:07.025505+0000","last_became_peered":"2024-09-14T11:51:07.025505+0000","last_unstale":"2024-09-14T12:17:13.159736+0000","last_undegraded":"2024-09-14T12:17:13.159736+0000","last_fullsized":"2024-09-14T12:17:13.159736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:13.159651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:13.159651+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.159651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:00.979980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.567286+0000","last_change":"2024-09-14T12:17:09.567286+0000","last_active":"2024-09-14T12:17:09.567286+0000","last_peered":"2024-09-14T12:17:09.567286+0000","last_clean":"2024-09-14T12:17:09.567286+0000","last_became_active":"2024-09-14T11:35:03.474912+0000","last_became_peered":"2024-09-14T11:35:03.474912+0000","last_unstale":"2024-09-14T12:17:09.567286+0000","last_undegraded":"2024-09-14T12:17:09.567286+0000","last_fullsized":"2024-09-14T12:17:09.567286+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:09.567203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:09.567203+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.567203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:10.474914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.239047+0000","last_change":"2024-09-14T12:16:48.239047+0000","last_active":"2024-09-14T12:16:48.239047+0000","last_peered":"2024-09-14T12:16:48.239047+0000","last_clean":"2024-09-14T12:16:48.239047+0000","last_became_active":"2024-09-14T11:35:00.448643+0000","last_became_peered":"2024-09-14T11:35:00.448643+0000","last_unstale":"2024-09-14T12:16:48.239047+0000","last_undegraded":"2024-09-14T12:16:48.239047+0000","last_fullsized":"2024-09-14T12:16:48.239047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:48.238958+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.238958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:48.498973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'61","reported_seq":231,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.915365+0000","last_change":"2024-09-14T12:16:58.915365+0000","last_active":"2024-09-14T12:16:58.915365+0000","last_peered":"2024-09-14T12:16:58.915365+0000","last_clean":"2024-09-14T12:16:58.915365+0000","last_became_active":"2024-09-14T11:31:47.456197+0000","last_became_peered":"2024-09-14T11:31:47.456197+0000","last_unstale":"2024-09-14T12:16:58.915365+0000","last_undegraded":"2024-09-14T12:16:58.915365+0000","last_fullsized":"2024-09-14T12:16:58.915365+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-14T12:16:58.915279+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-14T12:16:58.915279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.915279+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:15.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":500,"num_read_kb":331,"num_write":156,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.356193+0000","last_change":"2024-09-14T12:16:57.356091+0000","last_active":"2024-09-14T12:16:57.356193+0000","last_peered":"2024-09-14T12:16:57.356193+0000","last_clean":"2024-09-14T12:16:57.356193+0000","last_became_active":"2024-09-14T11:51:07.026922+0000","last_became_peered":"2024-09-14T11:51:07.026922+0000","last_unstale":"2024-09-14T12:16:57.356193+0000","last_undegraded":"2024-09-14T12:16:57.356193+0000","last_fullsized":"2024-09-14T12:16:57.356193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.355955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.355955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:06:36.110361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"260'6","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.055519+0000","last_change":"2024-09-14T12:16:56.055519+0000","last_active":"2024-09-14T12:16:56.055519+0000","last_peered":"2024-09-14T12:16:56.055519+0000","last_clean":"2024-09-14T12:16:56.055519+0000","last_became_active":"2024-09-14T11:35:03.477278+0000","last_became_peered":"2024-09-14T11:35:03.477278+0000","last_unstale":"2024-09-14T12:16:56.055519+0000","last_undegraded":"2024-09-14T12:16:56.055519+0000","last_fullsized":"2024-09-14T12:16:56.055519+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T12:16:56.055430+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.055430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:58.544259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.210624+0000","last_change":"2024-09-14T12:17:08.210624+0000","last_active":"2024-09-14T12:17:08.210624+0000","last_peered":"2024-09-14T12:17:08.210624+0000","last_clean":"2024-09-14T12:17:08.210624+0000","last_became_active":"2024-09-14T11:35:00.446087+0000","last_became_peered":"2024-09-14T11:35:00.446087+0000","last_unstale":"2024-09-14T12:17:08.210624+0000","last_undegraded":"2024-09-14T12:17:08.210624+0000","last_fullsized":"2024-09-14T12:17:08.210624+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:08.210533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:08.210533+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.210533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:09.236096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'22","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.418419+0000","last_change":"2024-09-14T12:16:49.418419+0000","last_active":"2024-09-14T12:16:49.418419+0000","last_peered":"2024-09-14T12:16:49.418419+0000","last_clean":"2024-09-14T12:16:49.418419+0000","last_became_active":"2024-09-14T11:31:47.458755+0000","last_became_peered":"2024-09-14T11:31:47.458755+0000","last_unstale":"2024-09-14T12:16:49.418419+0000","last_undegraded":"2024-09-14T12:16:49.418419+0000","last_fullsized":"2024-09-14T12:16:49.418419+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-09-14T12:16:49.418336+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.418336+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.489845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.184652+0000","last_change":"2024-09-14T12:17:12.184652+0000","last_active":"2024-09-14T12:17:12.184652+0000","last_peered":"2024-09-14T12:17:12.184652+0000","last_clean":"2024-09-14T12:17:12.184652+0000","last_became_active":"2024-09-14T11:51:07.031885+0000","last_became_peered":"2024-09-14T11:51:07.031885+0000","last_unstale":"2024-09-14T12:17:12.184652+0000","last_undegraded":"2024-09-14T12:17:12.184652+0000","last_fullsized":"2024-09-14T12:17:12.184652+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:12.184560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:12.184560+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.184560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:08.001019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.615380+0000","last_change":"2024-09-14T12:17:12.615380+0000","last_active":"2024-09-14T12:17:12.615380+0000","last_peered":"2024-09-14T12:17:12.615380+0000","last_clean":"2024-09-14T12:17:12.615380+0000","last_became_active":"2024-09-14T11:35:03.472402+0000","last_became_peered":"2024-09-14T11:35:03.472402+0000","last_unstale":"2024-09-14T12:17:12.615380+0000","last_undegraded":"2024-09-14T12:17:12.615380+0000","last_fullsized":"2024-09-14T12:17:12.615380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:12.615255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:12.615255+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.615255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:10.596908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"263'7","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.029184+0000","last_change":"2024-09-14T12:16:53.029184+0000","last_active":"2024-09-14T12:16:53.029184+0000","last_peered":"2024-09-14T12:16:53.029184+0000","last_clean":"2024-09-14T12:16:53.029184+0000","last_became_active":"2024-09-14T11:35:00.446469+0000","last_became_peered":"2024-09-14T11:35:00.446469+0000","last_unstale":"2024-09-14T12:16:53.029184+0000","last_undegraded":"2024-09-14T12:16:53.029184+0000","last_fullsized":"2024-09-14T12:16:53.029184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:16:53.029084+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.029084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:57.527264+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'25","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.212969+0000","last_change":"2024-09-14T12:16:39.212912+0000","last_active":"2024-09-14T12:16:39.212969+0000","last_peered":"2024-09-14T12:16:39.212969+0000","last_clean":"2024-09-14T12:16:39.212969+0000","last_became_active":"2024-09-14T11:31:47.460901+0000","last_became_peered":"2024-09-14T11:31:47.460901+0000","last_unstale":"2024-09-14T12:16:39.212969+0000","last_undegraded":"2024-09-14T12:16:39.212969+0000","last_fullsized":"2024-09-14T12:16:39.212969+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T12:16:39.212821+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.212821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:58.488819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":113,"num_write":65,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:18.640177+0000","last_change":"2024-09-14T12:17:18.640177+0000","last_active":"2024-09-14T12:17:18.640177+0000","last_peered":"2024-09-14T12:17:18.640177+0000","last_clean":"2024-09-14T12:17:18.640177+0000","last_became_active":"2024-09-14T11:51:07.034551+0000","last_became_peered":"2024-09-14T11:51:07.034551+0000","last_unstale":"2024-09-14T12:17:18.640177+0000","last_undegraded":"2024-09-14T12:17:18.640177+0000","last_fullsized":"2024-09-14T12:17:18.640177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:18.640088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:18.640088+0000","last_clean_scrub_stamp":"2024-09-14T12:17:18.640088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:59.638932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.592499+0000","last_change":"2024-09-14T12:17:06.592499+0000","last_active":"2024-09-14T12:17:06.592499+0000","last_peered":"2024-09-14T12:17:06.592499+0000","last_clean":"2024-09-14T12:17:06.592499+0000","last_became_active":"2024-09-14T11:35:03.476861+0000","last_became_peered":"2024-09-14T11:35:03.476861+0000","last_unstale":"2024-09-14T12:17:06.592499+0000","last_undegraded":"2024-09-14T12:17:06.592499+0000","last_fullsized":"2024-09-14T12:17:06.592499+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:06.592372+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:06.592372+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.592372+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:38.536535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9588,"num_write":6,"num_write_kb":8890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:06.157748+0000","last_change":"2024-09-14T12:17:06.157748+0000","last_active":"2024-09-14T12:17:06.157748+0000","last_peered":"2024-09-14T12:17:06.157748+0000","last_clean":"2024-09-14T12:17:06.157748+0000","last_became_active":"2024-09-14T11:35:00.446899+0000","last_became_peered":"2024-09-14T11:35:00.446899+0000","last_unstale":"2024-09-14T12:17:06.157748+0000","last_undegraded":"2024-09-14T12:17:06.157748+0000","last_fullsized":"2024-09-14T12:17:06.157748+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:06.157663+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:06.157663+0000","last_clean_scrub_stamp":"2024-09-14T12:17:06.157663+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:59.796913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7168,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.158587+0000","last_change":"2024-09-14T12:16:59.158587+0000","last_active":"2024-09-14T12:16:59.158587+0000","last_peered":"2024-09-14T12:16:59.158587+0000","last_clean":"2024-09-14T12:16:59.158587+0000","last_became_active":"2024-09-14T11:31:47.454843+0000","last_became_peered":"2024-09-14T11:31:47.454843+0000","last_unstale":"2024-09-14T12:16:59.158587+0000","last_undegraded":"2024-09-14T12:16:59.158587+0000","last_fullsized":"2024-09-14T12:16:59.158587+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T12:16:59.158491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.158491+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:35.267689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:14.202383+0000","last_change":"2024-09-14T12:17:14.202383+0000","last_active":"2024-09-14T12:17:14.202383+0000","last_peered":"2024-09-14T12:17:14.202383+0000","last_clean":"2024-09-14T12:17:14.202383+0000","last_became_active":"2024-09-14T11:51:07.031131+0000","last_became_peered":"2024-09-14T11:51:07.031131+0000","last_unstale":"2024-09-14T12:17:14.202383+0000","last_undegraded":"2024-09-14T12:17:14.202383+0000","last_fullsized":"2024-09-14T12:17:14.202383+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:14.202292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:14.202292+0000","last_clean_scrub_stamp":"2024-09-14T12:17:14.202292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:23.280210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.183727+0000","last_change":"2024-09-14T12:17:07.183727+0000","last_active":"2024-09-14T12:17:07.183727+0000","last_peered":"2024-09-14T12:17:07.183727+0000","last_clean":"2024-09-14T12:17:07.183727+0000","last_became_active":"2024-09-14T11:35:03.469000+0000","last_became_peered":"2024-09-14T11:35:03.469000+0000","last_unstale":"2024-09-14T12:17:07.183727+0000","last_undegraded":"2024-09-14T12:17:07.183727+0000","last_fullsized":"2024-09-14T12:17:07.183727+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:17:07.183635+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:17:07.183635+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.183635+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:07.455512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.950514+0000","last_change":"2024-09-14T12:17:00.950514+0000","last_active":"2024-09-14T12:17:00.950514+0000","last_peered":"2024-09-14T12:17:00.950514+0000","last_clean":"2024-09-14T12:17:00.950514+0000","last_became_active":"2024-09-14T11:35:00.445669+0000","last_became_peered":"2024-09-14T11:35:00.445669+0000","last_unstale":"2024-09-14T12:17:00.950514+0000","last_undegraded":"2024-09-14T12:17:00.950514+0000","last_fullsized":"2024-09-14T12:17:00.950514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:17:00.950432+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:17:00.950432+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.950432+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:48.161571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'14","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.205628+0000","last_change":"2024-09-14T12:16:58.205563+0000","last_active":"2024-09-14T12:16:58.205628+0000","last_peered":"2024-09-14T12:16:58.205628+0000","last_clean":"2024-09-14T12:16:58.205628+0000","last_became_active":"2024-09-14T11:31:47.453892+0000","last_became_peered":"2024-09-14T11:31:47.453892+0000","last_unstale":"2024-09-14T12:16:58.205628+0000","last_undegraded":"2024-09-14T12:16:58.205628+0000","last_fullsized":"2024-09-14T12:16:58.205628+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T12:16:58.205482+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.205482+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:05.081978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":60,"num_write":39,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:15.217929+0000","last_change":"2024-09-14T12:17:15.217929+0000","last_active":"2024-09-14T12:17:15.217929+0000","last_peered":"2024-09-14T12:17:15.217929+0000","last_clean":"2024-09-14T12:17:15.217929+0000","last_became_active":"2024-09-14T11:51:07.027532+0000","last_became_peered":"2024-09-14T11:51:07.027532+0000","last_unstale":"2024-09-14T12:17:15.217929+0000","last_undegraded":"2024-09-14T12:17:15.217929+0000","last_fullsized":"2024-09-14T12:17:15.217929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:15.217832+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:15.217832+0000","last_clean_scrub_stamp":"2024-09-14T12:17:15.217832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:17.283468+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.990589+0000","last_change":"2024-09-14T12:16:53.990589+0000","last_active":"2024-09-14T12:16:53.990589+0000","last_peered":"2024-09-14T12:16:53.990589+0000","last_clean":"2024-09-14T12:16:53.990589+0000","last_became_active":"2024-09-14T11:35:03.477187+0000","last_became_peered":"2024-09-14T11:35:03.477187+0000","last_unstale":"2024-09-14T12:16:53.990589+0000","last_undegraded":"2024-09-14T12:16:53.990589+0000","last_fullsized":"2024-09-14T12:16:53.990589+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:53.990505+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.990505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:38.600472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:07.169621+0000","last_change":"2024-09-14T12:17:07.169621+0000","last_active":"2024-09-14T12:17:07.169621+0000","last_peered":"2024-09-14T12:17:07.169621+0000","last_clean":"2024-09-14T12:17:07.169621+0000","last_became_active":"2024-09-14T11:35:00.446201+0000","last_became_peered":"2024-09-14T11:35:00.446201+0000","last_unstale":"2024-09-14T12:17:07.169621+0000","last_undegraded":"2024-09-14T12:17:07.169621+0000","last_fullsized":"2024-09-14T12:17:07.169621+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:07.169491+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:07.169491+0000","last_clean_scrub_stamp":"2024-09-14T12:17:07.169491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:45.160313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.554717+0000","last_change":"2024-09-14T12:17:01.554660+0000","last_active":"2024-09-14T12:17:01.554717+0000","last_peered":"2024-09-14T12:17:01.554717+0000","last_clean":"2024-09-14T12:17:01.554717+0000","last_became_active":"2024-09-14T11:31:47.457237+0000","last_became_peered":"2024-09-14T11:31:47.457237+0000","last_unstale":"2024-09-14T12:17:01.554717+0000","last_undegraded":"2024-09-14T12:17:01.554717+0000","last_fullsized":"2024-09-14T12:17:01.554717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T12:17:01.554575+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T12:17:01.554575+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.554575+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:10.108408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":57,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:18.231298+0000","last_change":"2024-09-14T12:17:18.231298+0000","last_active":"2024-09-14T12:17:18.231298+0000","last_peered":"2024-09-14T12:17:18.231298+0000","last_clean":"2024-09-14T12:17:18.231298+0000","last_became_active":"2024-09-14T11:51:07.030257+0000","last_became_peered":"2024-09-14T11:51:07.030257+0000","last_unstale":"2024-09-14T12:17:18.231298+0000","last_undegraded":"2024-09-14T12:17:18.231298+0000","last_fullsized":"2024-09-14T12:17:18.231298+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:18.231180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:18.231180+0000","last_clean_scrub_stamp":"2024-09-14T12:17:18.231180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:54.224290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.162085+0000","last_change":"2024-09-14T12:17:08.162085+0000","last_active":"2024-09-14T12:17:08.162085+0000","last_peered":"2024-09-14T12:17:08.162085+0000","last_clean":"2024-09-14T12:17:08.162085+0000","last_became_active":"2024-09-14T11:35:03.472598+0000","last_became_peered":"2024-09-14T11:35:03.472598+0000","last_unstale":"2024-09-14T12:17:08.162085+0000","last_undegraded":"2024-09-14T12:17:08.162085+0000","last_fullsized":"2024-09-14T12:17:08.162085+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T12:17:08.161996+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T12:17:08.161996+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.161996+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:46.933575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.686308+0000","last_change":"2024-09-14T12:16:57.686308+0000","last_active":"2024-09-14T12:16:57.686308+0000","last_peered":"2024-09-14T12:16:57.686308+0000","last_clean":"2024-09-14T12:16:57.686308+0000","last_became_active":"2024-09-14T11:35:00.437422+0000","last_became_peered":"2024-09-14T11:35:00.437422+0000","last_unstale":"2024-09-14T12:16:57.686308+0000","last_undegraded":"2024-09-14T12:16:57.686308+0000","last_fullsized":"2024-09-14T12:16:57.686308+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:57.686213+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.686213+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:26.967385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'28","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.448367+0000","last_change":"2024-09-14T12:16:48.448296+0000","last_active":"2024-09-14T12:16:48.448367+0000","last_peered":"2024-09-14T12:16:48.448367+0000","last_clean":"2024-09-14T12:16:48.448367+0000","last_became_active":"2024-09-14T11:31:47.454432+0000","last_became_peered":"2024-09-14T11:31:47.454432+0000","last_unstale":"2024-09-14T12:16:48.448367+0000","last_undegraded":"2024-09-14T12:16:48.448367+0000","last_fullsized":"2024-09-14T12:16:48.448367+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T12:16:48.448209+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.448209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:26.636696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":166,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:10.201567+0000","last_change":"2024-09-14T12:17:10.201567+0000","last_active":"2024-09-14T12:17:10.201567+0000","last_peered":"2024-09-14T12:17:10.201567+0000","last_clean":"2024-09-14T12:17:10.201567+0000","last_became_active":"2024-09-14T11:51:07.030005+0000","last_became_peered":"2024-09-14T11:51:07.030005+0000","last_unstale":"2024-09-14T12:17:10.201567+0000","last_undegraded":"2024-09-14T12:17:10.201567+0000","last_fullsized":"2024-09-14T12:17:10.201567+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:10.201485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:10.201485+0000","last_clean_scrub_stamp":"2024-09-14T12:17:10.201485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.337625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:13.180380+0000","last_change":"2024-09-14T12:17:13.180380+0000","last_active":"2024-09-14T12:17:13.180380+0000","last_peered":"2024-09-14T12:17:13.180380+0000","last_clean":"2024-09-14T12:17:13.180380+0000","last_became_active":"2024-09-14T11:35:03.477304+0000","last_became_peered":"2024-09-14T11:35:03.477304+0000","last_unstale":"2024-09-14T12:17:13.180380+0000","last_undegraded":"2024-09-14T12:17:13.180380+0000","last_fullsized":"2024-09-14T12:17:13.180380+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T12:17:13.180298+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T12:17:13.180298+0000","last_clean_scrub_stamp":"2024-09-14T12:17:13.180298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:43.987181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.220764+0000","last_change":"2024-09-14T12:17:02.220764+0000","last_active":"2024-09-14T12:17:02.220764+0000","last_peered":"2024-09-14T12:17:02.220764+0000","last_clean":"2024-09-14T12:17:02.220764+0000","last_became_active":"2024-09-14T11:35:00.441822+0000","last_became_peered":"2024-09-14T11:35:00.441822+0000","last_unstale":"2024-09-14T12:17:02.220764+0000","last_undegraded":"2024-09-14T12:17:02.220764+0000","last_fullsized":"2024-09-14T12:17:02.220764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T12:17:02.220677+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T12:17:02.220677+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.220677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:34.511947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12294,"num_write":18,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'6","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.141640+0000","last_change":"2024-09-14T12:17:00.141579+0000","last_active":"2024-09-14T12:17:00.141640+0000","last_peered":"2024-09-14T12:17:00.141640+0000","last_clean":"2024-09-14T12:17:00.141640+0000","last_became_active":"2024-09-14T11:31:47.456400+0000","last_became_peered":"2024-09-14T11:31:47.456400+0000","last_unstale":"2024-09-14T12:17:00.141640+0000","last_undegraded":"2024-09-14T12:17:00.141640+0000","last_fullsized":"2024-09-14T12:17:00.141640+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:17:00.141488+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.141488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:34.683293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.957091+0000","last_change":"2024-09-14T12:17:04.957091+0000","last_active":"2024-09-14T12:17:04.957091+0000","last_peered":"2024-09-14T12:17:04.957091+0000","last_clean":"2024-09-14T12:17:04.957091+0000","last_became_active":"2024-09-14T11:51:07.036612+0000","last_became_peered":"2024-09-14T11:51:07.036612+0000","last_unstale":"2024-09-14T12:17:04.957091+0000","last_undegraded":"2024-09-14T12:17:04.957091+0000","last_fullsized":"2024-09-14T12:17:04.957091+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:04.956999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:04.956999+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.956999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:23.117021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"260'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:12.184197+0000","last_change":"2024-09-14T12:17:12.184197+0000","last_active":"2024-09-14T12:17:12.184197+0000","last_peered":"2024-09-14T12:17:12.184197+0000","last_clean":"2024-09-14T12:17:12.184197+0000","last_became_active":"2024-09-14T11:35:03.466748+0000","last_became_peered":"2024-09-14T11:35:03.466748+0000","last_unstale":"2024-09-14T12:17:12.184197+0000","last_undegraded":"2024-09-14T12:17:12.184197+0000","last_fullsized":"2024-09-14T12:17:12.184197+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T12:17:12.184106+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T12:17:12.184106+0000","last_clean_scrub_stamp":"2024-09-14T12:17:12.184106+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:57.292304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.230945+0000","last_change":"2024-09-14T12:16:44.230855+0000","last_active":"2024-09-14T12:16:44.230945+0000","last_peered":"2024-09-14T12:16:44.230945+0000","last_clean":"2024-09-14T12:16:44.230945+0000","last_became_active":"2024-09-14T11:35:00.449042+0000","last_became_peered":"2024-09-14T11:35:00.449042+0000","last_unstale":"2024-09-14T12:16:44.230945+0000","last_undegraded":"2024-09-14T12:16:44.230945+0000","last_fullsized":"2024-09-14T12:16:44.230945+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:44.230752+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.230752+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:42:11.820165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'23","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.488102+0000","last_change":"2024-09-14T12:16:47.487986+0000","last_active":"2024-09-14T12:16:47.488102+0000","last_peered":"2024-09-14T12:16:47.488102+0000","last_clean":"2024-09-14T12:16:47.488102+0000","last_became_active":"2024-09-14T11:31:47.457839+0000","last_became_peered":"2024-09-14T11:31:47.457839+0000","last_unstale":"2024-09-14T12:16:47.488102+0000","last_undegraded":"2024-09-14T12:16:47.488102+0000","last_fullsized":"2024-09-14T12:16:47.488102+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T12:16:47.487890+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.487890+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:34.728943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":116,"num_write":62,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.977344+0000","last_change":"2024-09-14T12:16:59.977243+0000","last_active":"2024-09-14T12:16:59.977344+0000","last_peered":"2024-09-14T12:16:59.977344+0000","last_clean":"2024-09-14T12:16:59.977344+0000","last_became_active":"2024-09-14T11:51:07.029309+0000","last_became_peered":"2024-09-14T11:51:07.029309+0000","last_unstale":"2024-09-14T12:16:59.977344+0000","last_undegraded":"2024-09-14T12:16:59.977344+0000","last_fullsized":"2024-09-14T12:16:59.977344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:59.977131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:59.977131+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.977131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:44.084906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:09.176420+0000","last_change":"2024-09-14T12:17:09.176420+0000","last_active":"2024-09-14T12:17:09.176420+0000","last_peered":"2024-09-14T12:17:09.176420+0000","last_clean":"2024-09-14T12:17:09.176420+0000","last_became_active":"2024-09-14T11:35:03.473433+0000","last_became_peered":"2024-09-14T11:35:03.473433+0000","last_unstale":"2024-09-14T12:17:09.176420+0000","last_undegraded":"2024-09-14T12:17:09.176420+0000","last_fullsized":"2024-09-14T12:17:09.176420+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:17:09.176331+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:17:09.176331+0000","last_clean_scrub_stamp":"2024-09-14T12:17:09.176331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:33.569699+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:02.964149+0000","last_change":"2024-09-14T12:17:02.964149+0000","last_active":"2024-09-14T12:17:02.964149+0000","last_peered":"2024-09-14T12:17:02.964149+0000","last_clean":"2024-09-14T12:17:02.964149+0000","last_became_active":"2024-09-14T11:35:00.438739+0000","last_became_peered":"2024-09-14T11:35:00.438739+0000","last_unstale":"2024-09-14T12:17:02.964149+0000","last_undegraded":"2024-09-14T12:17:02.964149+0000","last_fullsized":"2024-09-14T12:17:02.964149+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:02.964032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:02.964032+0000","last_clean_scrub_stamp":"2024-09-14T12:17:02.964032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:40.725961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'34","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.211375+0000","last_change":"2024-09-14T12:16:57.211375+0000","last_active":"2024-09-14T12:16:57.211375+0000","last_peered":"2024-09-14T12:16:57.211375+0000","last_clean":"2024-09-14T12:16:57.211375+0000","last_became_active":"2024-09-14T11:31:47.461385+0000","last_became_peered":"2024-09-14T11:31:47.461385+0000","last_unstale":"2024-09-14T12:16:57.211375+0000","last_undegraded":"2024-09-14T12:16:57.211375+0000","last_fullsized":"2024-09-14T12:16:57.211375+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T12:16:57.211282+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.211282+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:58.100464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":87,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:08.548758+0000","last_change":"2024-09-14T12:17:08.548758+0000","last_active":"2024-09-14T12:17:08.548758+0000","last_peered":"2024-09-14T12:17:08.548758+0000","last_clean":"2024-09-14T12:17:08.548758+0000","last_became_active":"2024-09-14T11:51:07.026581+0000","last_became_peered":"2024-09-14T11:51:07.026581+0000","last_unstale":"2024-09-14T12:17:08.548758+0000","last_undegraded":"2024-09-14T12:17:08.548758+0000","last_fullsized":"2024-09-14T12:17:08.548758+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:08.548671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:08.548671+0000","last_clean_scrub_stamp":"2024-09-14T12:17:08.548671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:53.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.669512+0000","last_change":"2024-09-14T12:17:04.669512+0000","last_active":"2024-09-14T12:17:04.669512+0000","last_peered":"2024-09-14T12:17:04.669512+0000","last_clean":"2024-09-14T12:17:04.669512+0000","last_became_active":"2024-09-14T11:35:03.473838+0000","last_became_peered":"2024-09-14T11:35:03.473838+0000","last_unstale":"2024-09-14T12:17:04.669512+0000","last_undegraded":"2024-09-14T12:17:04.669512+0000","last_fullsized":"2024-09-14T12:17:04.669512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T12:17:04.669399+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T12:17:04.669399+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.669399+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:26.639741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.218121+0000","last_change":"2024-09-14T12:17:03.218121+0000","last_active":"2024-09-14T12:17:03.218121+0000","last_peered":"2024-09-14T12:17:03.218121+0000","last_clean":"2024-09-14T12:17:03.218121+0000","last_became_active":"2024-09-14T11:35:00.444343+0000","last_became_peered":"2024-09-14T11:35:00.444343+0000","last_unstale":"2024-09-14T12:17:03.218121+0000","last_undegraded":"2024-09-14T12:17:03.218121+0000","last_fullsized":"2024-09-14T12:17:03.218121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:03.218033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:03.218033+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.218033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:08.024041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'76","reported_seq":275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.030836+0000","last_change":"2024-09-14T12:16:49.030749+0000","last_active":"2024-09-14T12:16:49.030836+0000","last_peered":"2024-09-14T12:16:49.030836+0000","last_clean":"2024-09-14T12:16:49.030836+0000","last_became_active":"2024-09-14T11:31:47.461849+0000","last_became_peered":"2024-09-14T11:31:47.461849+0000","last_unstale":"2024-09-14T12:16:49.030836+0000","last_undegraded":"2024-09-14T12:16:49.030836+0000","last_fullsized":"2024-09-14T12:16:49.030836+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T12:16:49.030667+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.030667+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:33.596870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":649,"num_read_kb":447,"num_write":182,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.224633+0000","last_change":"2024-09-14T12:16:49.224573+0000","last_active":"2024-09-14T12:16:49.224633+0000","last_peered":"2024-09-14T12:16:49.224633+0000","last_clean":"2024-09-14T12:16:49.224633+0000","last_became_active":"2024-09-14T11:51:07.031390+0000","last_became_peered":"2024-09-14T11:51:07.031390+0000","last_unstale":"2024-09-14T12:16:49.224633+0000","last_undegraded":"2024-09-14T12:16:49.224633+0000","last_fullsized":"2024-09-14T12:16:49.224633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:49.224477+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.224477+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:40.222740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.928046+0000","last_change":"2024-09-14T12:17:01.928046+0000","last_active":"2024-09-14T12:17:01.928046+0000","last_peered":"2024-09-14T12:17:01.928046+0000","last_clean":"2024-09-14T12:17:01.928046+0000","last_became_active":"2024-09-14T11:35:03.477161+0000","last_became_peered":"2024-09-14T11:35:03.477161+0000","last_unstale":"2024-09-14T12:17:01.928046+0000","last_undegraded":"2024-09-14T12:17:01.928046+0000","last_fullsized":"2024-09-14T12:17:01.928046+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T12:17:01.927938+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T12:17:01.927938+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.927938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:54.511387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24578,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.184429+0000","last_change":"2024-09-14T12:16:59.184361+0000","last_active":"2024-09-14T12:16:59.184429+0000","last_peered":"2024-09-14T12:16:59.184429+0000","last_clean":"2024-09-14T12:16:59.184429+0000","last_became_active":"2024-09-14T11:35:00.448914+0000","last_became_peered":"2024-09-14T11:35:00.448914+0000","last_unstale":"2024-09-14T12:16:59.184429+0000","last_undegraded":"2024-09-14T12:16:59.184429+0000","last_fullsized":"2024-09-14T12:16:59.184429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:59.184280+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:59.184280+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.184280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:01.083442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.896038+0000","last_change":"2024-09-14T12:16:57.895946+0000","last_active":"2024-09-14T12:16:57.896038+0000","last_peered":"2024-09-14T12:16:57.896038+0000","last_clean":"2024-09-14T12:16:57.896038+0000","last_became_active":"2024-09-14T11:31:47.454115+0000","last_became_peered":"2024-09-14T11:31:47.454115+0000","last_unstale":"2024-09-14T12:16:57.896038+0000","last_undegraded":"2024-09-14T12:16:57.896038+0000","last_fullsized":"2024-09-14T12:16:57.896038+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:57.895851+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.895851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:11.309184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:17.183409+0000","last_change":"2024-09-14T12:17:17.183409+0000","last_active":"2024-09-14T12:17:17.183409+0000","last_peered":"2024-09-14T12:17:17.183409+0000","last_clean":"2024-09-14T12:17:17.183409+0000","last_became_active":"2024-09-14T11:51:07.030473+0000","last_became_peered":"2024-09-14T11:51:07.030473+0000","last_unstale":"2024-09-14T12:17:17.183409+0000","last_undegraded":"2024-09-14T12:17:17.183409+0000","last_fullsized":"2024-09-14T12:17:17.183409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:17.183277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:17.183277+0000","last_clean_scrub_stamp":"2024-09-14T12:17:17.183277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:03.626249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:01.932975+0000","last_change":"2024-09-14T12:17:01.932875+0000","last_active":"2024-09-14T12:17:01.932975+0000","last_peered":"2024-09-14T12:17:01.932975+0000","last_clean":"2024-09-14T12:17:01.932975+0000","last_became_active":"2024-09-14T11:35:03.471960+0000","last_became_peered":"2024-09-14T11:35:03.471960+0000","last_unstale":"2024-09-14T12:17:01.932975+0000","last_undegraded":"2024-09-14T12:17:01.932975+0000","last_fullsized":"2024-09-14T12:17:01.932975+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:01.932754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:01.932754+0000","last_clean_scrub_stamp":"2024-09-14T12:17:01.932754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.598772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:04.256740+0000","last_change":"2024-09-14T12:17:04.256740+0000","last_active":"2024-09-14T12:17:04.256740+0000","last_peered":"2024-09-14T12:17:04.256740+0000","last_clean":"2024-09-14T12:17:04.256740+0000","last_became_active":"2024-09-14T11:35:00.439346+0000","last_became_peered":"2024-09-14T11:35:00.439346+0000","last_unstale":"2024-09-14T12:17:04.256740+0000","last_undegraded":"2024-09-14T12:17:04.256740+0000","last_fullsized":"2024-09-14T12:17:04.256740+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:04.256660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:04.256660+0000","last_clean_scrub_stamp":"2024-09-14T12:17:04.256660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:32.162739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'10","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.658255+0000","last_change":"2024-09-14T12:16:56.658184+0000","last_active":"2024-09-14T12:16:56.658255+0000","last_peered":"2024-09-14T12:16:56.658255+0000","last_clean":"2024-09-14T12:16:56.658255+0000","last_became_active":"2024-09-14T11:31:47.458214+0000","last_became_peered":"2024-09-14T11:31:47.458214+0000","last_unstale":"2024-09-14T12:16:56.658255+0000","last_undegraded":"2024-09-14T12:16:56.658255+0000","last_fullsized":"2024-09-14T12:16:56.658255+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T12:16:56.658093+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.658093+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:09.745831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":41,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:16.212948+0000","last_change":"2024-09-14T12:17:16.212948+0000","last_active":"2024-09-14T12:17:16.212948+0000","last_peered":"2024-09-14T12:17:16.212948+0000","last_clean":"2024-09-14T12:17:16.212948+0000","last_became_active":"2024-09-14T11:51:07.030729+0000","last_became_peered":"2024-09-14T11:51:07.030729+0000","last_unstale":"2024-09-14T12:17:16.212948+0000","last_undegraded":"2024-09-14T12:17:16.212948+0000","last_fullsized":"2024-09-14T12:17:16.212948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:16.212845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:16.212845+0000","last_clean_scrub_stamp":"2024-09-14T12:17:16.212845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:51.880130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.462662+0000","last_change":"2024-09-14T12:16:54.462662+0000","last_active":"2024-09-14T12:16:54.462662+0000","last_peered":"2024-09-14T12:16:54.462662+0000","last_clean":"2024-09-14T12:16:54.462662+0000","last_became_active":"2024-09-14T11:35:03.472257+0000","last_became_peered":"2024-09-14T11:35:03.472257+0000","last_unstale":"2024-09-14T12:16:54.462662+0000","last_undegraded":"2024-09-14T12:16:54.462662+0000","last_fullsized":"2024-09-14T12:16:54.462662+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:16:54.462562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.462562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:19.119324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"263'6","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.022371+0000","last_change":"2024-09-14T12:16:51.022371+0000","last_active":"2024-09-14T12:16:51.022371+0000","last_peered":"2024-09-14T12:16:51.022371+0000","last_clean":"2024-09-14T12:16:51.022371+0000","last_became_active":"2024-09-14T11:35:00.441221+0000","last_became_peered":"2024-09-14T11:35:00.441221+0000","last_unstale":"2024-09-14T12:16:51.022371+0000","last_undegraded":"2024-09-14T12:16:51.022371+0000","last_fullsized":"2024-09-14T12:16:51.022371+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:51.022279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.022279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:56.027562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'32","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.485849+0000","last_change":"2024-09-14T12:16:46.485749+0000","last_active":"2024-09-14T12:16:46.485849+0000","last_peered":"2024-09-14T12:16:46.485849+0000","last_clean":"2024-09-14T12:16:46.485849+0000","last_became_active":"2024-09-14T11:31:47.457121+0000","last_became_peered":"2024-09-14T11:31:47.457121+0000","last_unstale":"2024-09-14T12:16:46.485849+0000","last_undegraded":"2024-09-14T12:16:46.485849+0000","last_fullsized":"2024-09-14T12:16:46.485849+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-14T12:16:46.485637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.485637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:50.770891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":176,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:11.208324+0000","last_change":"2024-09-14T12:17:11.208324+0000","last_active":"2024-09-14T12:17:11.208324+0000","last_peered":"2024-09-14T12:17:11.208324+0000","last_clean":"2024-09-14T12:17:11.208324+0000","last_became_active":"2024-09-14T11:51:07.031836+0000","last_became_peered":"2024-09-14T11:51:07.031836+0000","last_unstale":"2024-09-14T12:17:11.208324+0000","last_undegraded":"2024-09-14T12:17:11.208324+0000","last_fullsized":"2024-09-14T12:17:11.208324+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:11.208205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:11.208205+0000","last_clean_scrub_stamp":"2024-09-14T12:17:11.208205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:39.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:03.688569+0000","last_change":"2024-09-14T12:17:03.688569+0000","last_active":"2024-09-14T12:17:03.688569+0000","last_peered":"2024-09-14T12:17:03.688569+0000","last_clean":"2024-09-14T12:17:03.688569+0000","last_became_active":"2024-09-14T11:35:03.471290+0000","last_became_peered":"2024-09-14T11:35:03.471290+0000","last_unstale":"2024-09-14T12:17:03.688569+0000","last_undegraded":"2024-09-14T12:17:03.688569+0000","last_fullsized":"2024-09-14T12:17:03.688569+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T12:17:03.688483+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T12:17:03.688483+0000","last_clean_scrub_stamp":"2024-09-14T12:17:03.688483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:49.911218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.470151+0000","last_change":"2024-09-14T12:16:51.470151+0000","last_active":"2024-09-14T12:16:51.470151+0000","last_peered":"2024-09-14T12:16:51.470151+0000","last_clean":"2024-09-14T12:16:51.470151+0000","last_became_active":"2024-09-14T11:35:00.438275+0000","last_became_peered":"2024-09-14T11:35:00.438275+0000","last_unstale":"2024-09-14T12:16:51.470151+0000","last_undegraded":"2024-09-14T12:16:51.470151+0000","last_fullsized":"2024-09-14T12:16:51.470151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.470054+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.470054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:40.419580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'31","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.213866+0000","last_change":"2024-09-14T12:16:56.213866+0000","last_active":"2024-09-14T12:16:56.213866+0000","last_peered":"2024-09-14T12:16:56.213866+0000","last_clean":"2024-09-14T12:16:56.213866+0000","last_became_active":"2024-09-14T11:31:47.457024+0000","last_became_peered":"2024-09-14T11:31:47.457024+0000","last_unstale":"2024-09-14T12:16:56.213866+0000","last_undegraded":"2024-09-14T12:16:56.213866+0000","last_fullsized":"2024-09-14T12:16:56.213866+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T12:16:56.213760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.213760+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:14.580078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":175,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'382","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.421319+0000","last_change":"2024-09-14T12:16:34.421319+0000","last_active":"2024-09-14T12:16:34.421319+0000","last_peered":"2024-09-14T12:16:34.421319+0000","last_clean":"2024-09-14T12:16:34.421319+0000","last_became_active":"2024-09-14T11:17:21.587475+0000","last_became_peered":"2024-09-14T11:17:21.587475+0000","last_unstale":"2024-09-14T12:16:34.421319+0000","last_undegraded":"2024-09-14T12:16:34.421319+0000","last_fullsized":"2024-09-14T12:16:34.421319+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T12:16:34.421201+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.421201+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:14.328374+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079918,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":629,"num_read_kb":9737,"num_write":1248,"num_write_kb":33828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'481","reported_seq":1936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.932399+0000","last_change":"2024-09-14T12:16:37.932313+0000","last_active":"2024-09-14T12:16:37.932399+0000","last_peered":"2024-09-14T12:16:37.932399+0000","last_clean":"2024-09-14T12:16:37.932399+0000","last_became_active":"2024-09-14T11:17:23.596022+0000","last_became_peered":"2024-09-14T11:17:23.596022+0000","last_unstale":"2024-09-14T12:16:37.932399+0000","last_undegraded":"2024-09-14T12:16:37.932399+0000","last_fullsized":"2024-09-14T12:16:37.932399+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'481","last_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_deep_scrub":"263'481","last_deep_scrub_stamp":"2024-09-14T12:16:37.932203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.932203+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:41.524216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2481,"num_read_kb":2274,"num_write":589,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'342","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.075044+0000","last_change":"2024-09-14T12:16:24.075044+0000","last_active":"2024-09-14T12:16:24.075044+0000","last_peered":"2024-09-14T12:16:24.075044+0000","last_clean":"2024-09-14T12:16:24.075044+0000","last_became_active":"2024-09-14T11:17:21.583769+0000","last_became_peered":"2024-09-14T11:17:21.583769+0000","last_unstale":"2024-09-14T12:16:24.075044+0000","last_undegraded":"2024-09-14T12:16:24.075044+0000","last_fullsized":"2024-09-14T12:16:24.075044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:24.074907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.074907+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:57.224200+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":22753,"num_write":1016,"num_write_kb":42564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.399742+0000","last_change":"2024-09-14T12:16:38.399657+0000","last_active":"2024-09-14T12:16:38.399742+0000","last_peered":"2024-09-14T12:16:38.399742+0000","last_clean":"2024-09-14T12:16:38.399742+0000","last_became_active":"2024-09-14T11:17:23.591067+0000","last_became_peered":"2024-09-14T11:17:23.591067+0000","last_unstale":"2024-09-14T12:16:38.399742+0000","last_undegraded":"2024-09-14T12:16:38.399742+0000","last_fullsized":"2024-09-14T12:16:38.399742+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:38.399570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.399570+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:31.558475+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2469,"num_read_kb":2338,"num_write":543,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'369","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.917158+0000","last_change":"2024-09-14T12:16:27.917158+0000","last_active":"2024-09-14T12:16:27.917158+0000","last_peered":"2024-09-14T12:16:27.917158+0000","last_clean":"2024-09-14T12:16:27.917158+0000","last_became_active":"2024-09-14T11:17:21.579997+0000","last_became_peered":"2024-09-14T11:17:21.579997+0000","last_unstale":"2024-09-14T12:16:27.917158+0000","last_undegraded":"2024-09-14T12:16:27.917158+0000","last_fullsized":"2024-09-14T12:16:27.917158+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:27.917052+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.917052+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.304387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":8099,"num_write":1164,"num_write_kb":28357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'831","reported_seq":2485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.599622+0000","last_change":"2024-09-14T12:16:38.599551+0000","last_active":"2024-09-14T12:16:38.599622+0000","last_peered":"2024-09-14T12:16:38.599622+0000","last_clean":"2024-09-14T12:16:38.599622+0000","last_became_active":"2024-09-14T11:17:23.598472+0000","last_became_peered":"2024-09-14T11:17:23.598472+0000","last_unstale":"2024-09-14T12:16:38.599622+0000","last_undegraded":"2024-09-14T12:16:38.599622+0000","last_fullsized":"2024-09-14T12:16:38.599622+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'831","last_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_deep_scrub":"263'831","last_deep_scrub_stamp":"2024-09-14T12:16:38.599465+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.599465+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:41.116547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3985,"num_read_kb":3608,"num_write":1083,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'398","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.842192+0000","last_change":"2024-09-14T12:16:30.842121+0000","last_active":"2024-09-14T12:16:30.842192+0000","last_peered":"2024-09-14T12:16:30.842192+0000","last_clean":"2024-09-14T12:16:30.842192+0000","last_became_active":"2024-09-14T11:17:21.587188+0000","last_became_peered":"2024-09-14T11:17:21.587188+0000","last_unstale":"2024-09-14T12:16:30.842192+0000","last_undegraded":"2024-09-14T12:16:30.842192+0000","last_fullsized":"2024-09-14T12:16:30.842192+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T12:16:30.842017+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.842017+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:52.781230+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":69334,"num_write":1242,"num_write_kb":39905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'480","reported_seq":2212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.894432+0000","last_change":"2024-09-14T12:16:38.894365+0000","last_active":"2024-09-14T12:16:38.894432+0000","last_peered":"2024-09-14T12:16:38.894432+0000","last_clean":"2024-09-14T12:16:38.894432+0000","last_became_active":"2024-09-14T11:17:23.604709+0000","last_became_peered":"2024-09-14T11:17:23.604709+0000","last_unstale":"2024-09-14T12:16:38.894432+0000","last_undegraded":"2024-09-14T12:16:38.894432+0000","last_fullsized":"2024-09-14T12:16:38.894432+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T12:16:38.894277+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.894277+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:07.704197+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2520,"num_read_kb":2411,"num_write":508,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'345","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.396829+0000","last_change":"2024-09-14T12:16:33.396720+0000","last_active":"2024-09-14T12:16:33.396829+0000","last_peered":"2024-09-14T12:16:33.396829+0000","last_clean":"2024-09-14T12:16:33.396829+0000","last_became_active":"2024-09-14T11:17:21.582118+0000","last_became_peered":"2024-09-14T11:17:21.582118+0000","last_unstale":"2024-09-14T12:16:33.396829+0000","last_undegraded":"2024-09-14T12:16:33.396829+0000","last_fullsized":"2024-09-14T12:16:33.396829+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-14T12:16:33.396612+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.396612+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:50.383330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":8504,"num_write":1105,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'931","reported_seq":2507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.470911+0000","last_change":"2024-09-14T12:16:33.470843+0000","last_active":"2024-09-14T12:16:33.470911+0000","last_peered":"2024-09-14T12:16:33.470911+0000","last_clean":"2024-09-14T12:16:33.470911+0000","last_became_active":"2024-09-14T11:17:23.598455+0000","last_became_peered":"2024-09-14T11:17:23.598455+0000","last_unstale":"2024-09-14T12:16:33.470911+0000","last_undegraded":"2024-09-14T12:16:33.470911+0000","last_fullsized":"2024-09-14T12:16:33.470911+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'931","last_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_deep_scrub":"263'931","last_deep_scrub_stamp":"2024-09-14T12:16:33.470747+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.470747+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:53.569158+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5051,"num_read_kb":4588,"num_write":1339,"num_write_kb":530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.824125+0000","last_change":"2024-09-14T12:16:29.824033+0000","last_active":"2024-09-14T12:16:29.824125+0000","last_peered":"2024-09-14T12:16:29.824125+0000","last_clean":"2024-09-14T12:16:29.824125+0000","last_became_active":"2024-09-14T11:17:21.585552+0000","last_became_peered":"2024-09-14T11:17:21.585552+0000","last_unstale":"2024-09-14T12:16:29.824125+0000","last_undegraded":"2024-09-14T12:16:29.824125+0000","last_fullsized":"2024-09-14T12:16:29.824125+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T12:16:29.823921+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.823921+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.850213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":13223,"num_write":1062,"num_write_kb":25097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'323","reported_seq":1686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.645228+0000","last_change":"2024-09-14T12:16:39.645228+0000","last_active":"2024-09-14T12:16:39.645228+0000","last_peered":"2024-09-14T12:16:39.645228+0000","last_clean":"2024-09-14T12:16:39.645228+0000","last_became_active":"2024-09-14T11:17:23.597948+0000","last_became_peered":"2024-09-14T11:17:23.597948+0000","last_unstale":"2024-09-14T12:16:39.645228+0000","last_undegraded":"2024-09-14T12:16:39.645228+0000","last_fullsized":"2024-09-14T12:16:39.645228+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'323","last_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_deep_scrub":"263'323","last_deep_scrub_stamp":"2024-09-14T12:16:39.645135+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.645135+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:10.959759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1787,"num_read_kb":1706,"num_write":352,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'337","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.350868+0000","last_change":"2024-09-14T12:16:32.350810+0000","last_active":"2024-09-14T12:16:32.350868+0000","last_peered":"2024-09-14T12:16:32.350868+0000","last_clean":"2024-09-14T12:16:32.350868+0000","last_became_active":"2024-09-14T11:17:21.582797+0000","last_became_peered":"2024-09-14T11:17:21.582797+0000","last_unstale":"2024-09-14T12:16:32.350868+0000","last_undegraded":"2024-09-14T12:16:32.350868+0000","last_fullsized":"2024-09-14T12:16:32.350868+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:32.350698+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.350698+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.629745+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":13115,"num_write":1013,"num_write_kb":41903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'407","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.868085+0000","last_change":"2024-09-14T12:16:39.868085+0000","last_active":"2024-09-14T12:16:39.868085+0000","last_peered":"2024-09-14T12:16:39.868085+0000","last_clean":"2024-09-14T12:16:39.868085+0000","last_became_active":"2024-09-14T11:17:23.594425+0000","last_became_peered":"2024-09-14T11:17:23.594425+0000","last_unstale":"2024-09-14T12:16:39.868085+0000","last_undegraded":"2024-09-14T12:16:39.868085+0000","last_fullsized":"2024-09-14T12:16:39.868085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:39.867997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.867997+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:21.305924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2096,"num_write":461,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'358","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.244252+0000","last_change":"2024-09-14T12:16:28.244252+0000","last_active":"2024-09-14T12:16:28.244252+0000","last_peered":"2024-09-14T12:16:28.244252+0000","last_clean":"2024-09-14T12:16:28.244252+0000","last_became_active":"2024-09-14T11:17:55.703341+0000","last_became_peered":"2024-09-14T11:17:55.703341+0000","last_unstale":"2024-09-14T12:16:28.244252+0000","last_undegraded":"2024-09-14T12:16:28.244252+0000","last_fullsized":"2024-09-14T12:16:28.244252+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T12:16:28.244160+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.244160+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.741764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":594,"num_read_kb":3517,"num_write":1114,"num_write_kb":21355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"263'929","reported_seq":2505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.227870+0000","last_change":"2024-09-14T12:16:29.227870+0000","last_active":"2024-09-14T12:16:29.227870+0000","last_peered":"2024-09-14T12:16:29.227870+0000","last_clean":"2024-09-14T12:16:29.227870+0000","last_became_active":"2024-09-14T11:17:23.601952+0000","last_became_peered":"2024-09-14T11:17:23.601952+0000","last_unstale":"2024-09-14T12:16:29.227870+0000","last_undegraded":"2024-09-14T12:16:29.227870+0000","last_fullsized":"2024-09-14T12:16:29.227870+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'929","last_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_deep_scrub":"263'929","last_deep_scrub_stamp":"2024-09-14T12:16:29.227765+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.227765+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:23.885174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4360,"num_read_kb":3873,"num_write":1297,"num_write_kb":499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'888","reported_seq":2517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.593824+0000","last_change":"2024-09-14T12:16:36.593824+0000","last_active":"2024-09-14T12:16:36.593824+0000","last_peered":"2024-09-14T12:16:36.593824+0000","last_clean":"2024-09-14T12:16:36.593824+0000","last_became_active":"2024-09-14T11:17:23.598765+0000","last_became_peered":"2024-09-14T11:17:23.598765+0000","last_unstale":"2024-09-14T12:16:36.593824+0000","last_undegraded":"2024-09-14T12:16:36.593824+0000","last_fullsized":"2024-09-14T12:16:36.593824+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'888","last_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_deep_scrub":"263'888","last_deep_scrub_stamp":"2024-09-14T12:16:36.593729+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.593729+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:47.300409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4217,"num_read_kb":3780,"num_write":1166,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'374","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.359854+0000","last_change":"2024-09-14T12:16:31.359854+0000","last_active":"2024-09-14T12:16:31.359854+0000","last_peered":"2024-09-14T12:16:31.359854+0000","last_clean":"2024-09-14T12:16:31.359854+0000","last_became_active":"2024-09-14T11:17:21.590690+0000","last_became_peered":"2024-09-14T11:17:21.590690+0000","last_unstale":"2024-09-14T12:16:31.359854+0000","last_undegraded":"2024-09-14T12:16:31.359854+0000","last_fullsized":"2024-09-14T12:16:31.359854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'374","last_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_deep_scrub":"263'374","last_deep_scrub_stamp":"2024-09-14T12:16:31.359749+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.359749+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:50.234169+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":33506,"num_write":1216,"num_write_kb":32432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'724","reported_seq":2275,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.385574+0000","last_change":"2024-09-14T12:16:37.385574+0000","last_active":"2024-09-14T12:16:37.385574+0000","last_peered":"2024-09-14T12:16:37.385574+0000","last_clean":"2024-09-14T12:16:37.385574+0000","last_became_active":"2024-09-14T11:17:55.874518+0000","last_became_peered":"2024-09-14T11:17:55.874518+0000","last_unstale":"2024-09-14T12:16:37.385574+0000","last_undegraded":"2024-09-14T12:16:37.385574+0000","last_fullsized":"2024-09-14T12:16:37.385574+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:37.385484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.385484+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:48.262117+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3499,"num_read_kb":3200,"num_write":951,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'479","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402397+0000","last_change":"2024-09-14T12:16:28.402397+0000","last_active":"2024-09-14T12:16:28.402397+0000","last_peered":"2024-09-14T12:16:28.402397+0000","last_clean":"2024-09-14T12:16:28.402397+0000","last_became_active":"2024-09-14T11:17:21.590532+0000","last_became_peered":"2024-09-14T11:17:21.590532+0000","last_unstale":"2024-09-14T12:16:28.402397+0000","last_undegraded":"2024-09-14T12:16:28.402397+0000","last_fullsized":"2024-09-14T12:16:28.402397+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T12:16:28.402248+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402248+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:10.326854+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":934,"num_read_kb":10641,"num_write":1221,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'768","reported_seq":2416,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.917096+0000","last_change":"2024-09-14T12:16:34.917096+0000","last_active":"2024-09-14T12:16:34.917096+0000","last_peered":"2024-09-14T12:16:34.917096+0000","last_clean":"2024-09-14T12:16:34.917096+0000","last_became_active":"2024-09-14T11:17:23.598782+0000","last_became_peered":"2024-09-14T11:17:23.598782+0000","last_unstale":"2024-09-14T12:16:34.917096+0000","last_undegraded":"2024-09-14T12:16:34.917096+0000","last_fullsized":"2024-09-14T12:16:34.917096+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:34.917005+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.917005+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.725565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3971,"num_read_kb":3617,"num_write":1019,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2731,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'393","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.429189+0000","last_change":"2024-09-14T12:16:27.429189+0000","last_active":"2024-09-14T12:16:27.429189+0000","last_peered":"2024-09-14T12:16:27.429189+0000","last_clean":"2024-09-14T12:16:27.429189+0000","last_became_active":"2024-09-14T11:17:21.590494+0000","last_became_peered":"2024-09-14T11:17:21.590494+0000","last_unstale":"2024-09-14T12:16:27.429189+0000","last_undegraded":"2024-09-14T12:16:27.429189+0000","last_fullsized":"2024-09-14T12:16:27.429189+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.429104+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.429104+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.207355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":671,"num_read_kb":6370,"num_write":1079,"num_write_kb":28401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'608","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.267509+0000","last_change":"2024-09-14T12:16:27.267509+0000","last_active":"2024-09-14T12:16:27.267509+0000","last_peered":"2024-09-14T12:16:27.267509+0000","last_clean":"2024-09-14T12:16:27.267509+0000","last_became_active":"2024-09-14T11:17:23.601928+0000","last_became_peered":"2024-09-14T11:17:23.601928+0000","last_unstale":"2024-09-14T12:16:27.267509+0000","last_undegraded":"2024-09-14T12:16:27.267509+0000","last_fullsized":"2024-09-14T12:16:27.267509+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'608","last_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_deep_scrub":"263'608","last_deep_scrub_stamp":"2024-09-14T12:16:27.267429+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.267429+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:19.830272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3092,"num_read_kb":2786,"num_write":806,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'328","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.529800+0000","last_change":"2024-09-14T12:16:23.529800+0000","last_active":"2024-09-14T12:16:23.529800+0000","last_peered":"2024-09-14T12:16:23.529800+0000","last_clean":"2024-09-14T12:16:23.529800+0000","last_became_active":"2024-09-14T11:17:21.580357+0000","last_became_peered":"2024-09-14T11:17:21.580357+0000","last_unstale":"2024-09-14T12:16:23.529800+0000","last_undegraded":"2024-09-14T12:16:23.529800+0000","last_fullsized":"2024-09-14T12:16:23.529800+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T12:16:23.529693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.529693+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:47.093569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":674,"num_read_kb":17017,"num_write":957,"num_write_kb":31469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'904","reported_seq":2620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.232914+0000","last_change":"2024-09-14T12:16:30.232914+0000","last_active":"2024-09-14T12:16:30.232914+0000","last_peered":"2024-09-14T12:16:30.232914+0000","last_clean":"2024-09-14T12:16:30.232914+0000","last_became_active":"2024-09-14T11:17:23.599353+0000","last_became_peered":"2024-09-14T11:17:23.599353+0000","last_unstale":"2024-09-14T12:16:30.232914+0000","last_undegraded":"2024-09-14T12:16:30.232914+0000","last_fullsized":"2024-09-14T12:16:30.232914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'904","last_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_deep_scrub":"263'904","last_deep_scrub_stamp":"2024-09-14T12:16:30.232832+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.232832+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:17.647079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4324,"num_read_kb":3917,"num_write":1203,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'302","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.551085+0000","last_change":"2024-09-14T12:16:27.551085+0000","last_active":"2024-09-14T12:16:27.551085+0000","last_peered":"2024-09-14T12:16:27.551085+0000","last_clean":"2024-09-14T12:16:27.551085+0000","last_became_active":"2024-09-14T11:17:21.585753+0000","last_became_peered":"2024-09-14T11:17:21.585753+0000","last_unstale":"2024-09-14T12:16:27.551085+0000","last_undegraded":"2024-09-14T12:16:27.551085+0000","last_fullsized":"2024-09-14T12:16:27.551085+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T12:16:27.551001+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.551001+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:40.128897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":441,"num_read_kb":19406,"num_write":864,"num_write_kb":21670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'1147","reported_seq":2706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.559648+0000","last_change":"2024-09-14T12:16:37.559648+0000","last_active":"2024-09-14T12:16:37.559648+0000","last_peered":"2024-09-14T12:16:37.559648+0000","last_clean":"2024-09-14T12:16:37.559648+0000","last_became_active":"2024-09-14T11:17:23.592505+0000","last_became_peered":"2024-09-14T11:17:23.592505+0000","last_unstale":"2024-09-14T12:16:37.559648+0000","last_undegraded":"2024-09-14T12:16:37.559648+0000","last_fullsized":"2024-09-14T12:16:37.559648+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1147","last_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_deep_scrub":"263'1147","last_deep_scrub_stamp":"2024-09-14T12:16:37.559541+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.559541+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:26.343620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5220,"num_read_kb":4629,"num_write":1552,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'342","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.928565+0000","last_change":"2024-09-14T12:16:26.928565+0000","last_active":"2024-09-14T12:16:26.928565+0000","last_peered":"2024-09-14T12:16:26.928565+0000","last_clean":"2024-09-14T12:16:26.928565+0000","last_became_active":"2024-09-14T11:17:21.581114+0000","last_became_peered":"2024-09-14T11:17:21.581114+0000","last_unstale":"2024-09-14T12:16:26.928565+0000","last_undegraded":"2024-09-14T12:16:26.928565+0000","last_fullsized":"2024-09-14T12:16:26.928565+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:26.928480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.928480+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:10.385752+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":705,"num_read_kb":10760,"num_write":996,"num_write_kb":36285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'126","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.677663+0000","last_change":"2024-09-14T12:16:54.677663+0000","last_active":"2024-09-14T12:16:54.677663+0000","last_peered":"2024-09-14T12:16:54.677663+0000","last_clean":"2024-09-14T12:16:54.677663+0000","last_became_active":"2024-09-14T11:17:31.654564+0000","last_became_peered":"2024-09-14T11:17:31.654564+0000","last_unstale":"2024-09-14T12:16:54.677663+0000","last_undegraded":"2024-09-14T12:16:54.677663+0000","last_fullsized":"2024-09-14T12:16:54.677663+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'126","last_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_deep_scrub":"263'126","last_deep_scrub_stamp":"2024-09-14T12:16:54.677580+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.677580+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:34.005917+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":128,"num_write":300,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'525","reported_seq":2474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.537472+0000","last_change":"2024-09-14T12:16:30.537472+0000","last_active":"2024-09-14T12:16:30.537472+0000","last_peered":"2024-09-14T12:16:30.537472+0000","last_clean":"2024-09-14T12:16:30.537472+0000","last_became_active":"2024-09-14T11:17:23.599463+0000","last_became_peered":"2024-09-14T11:17:23.599463+0000","last_unstale":"2024-09-14T12:16:30.537472+0000","last_undegraded":"2024-09-14T12:16:30.537472+0000","last_fullsized":"2024-09-14T12:16:30.537472+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'525","last_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_deep_scrub":"263'525","last_deep_scrub_stamp":"2024-09-14T12:16:30.537378+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.537378+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:15.507796+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3383,"num_read_kb":3202,"num_write":627,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6633,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'294","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.359063+0000","last_change":"2024-09-14T12:16:30.359063+0000","last_active":"2024-09-14T12:16:30.359063+0000","last_peered":"2024-09-14T12:16:30.359063+0000","last_clean":"2024-09-14T12:16:30.359063+0000","last_became_active":"2024-09-14T11:17:21.581291+0000","last_became_peered":"2024-09-14T11:17:21.581291+0000","last_unstale":"2024-09-14T12:16:30.359063+0000","last_undegraded":"2024-09-14T12:16:30.359063+0000","last_fullsized":"2024-09-14T12:16:30.359063+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:30.358952+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.358952+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:21.930313+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":3402,"num_write":873,"num_write_kb":35295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.860022+0000","last_change":"2024-09-14T12:16:41.860022+0000","last_active":"2024-09-14T12:16:41.860022+0000","last_peered":"2024-09-14T12:16:41.860022+0000","last_clean":"2024-09-14T12:16:41.860022+0000","last_became_active":"2024-09-14T11:17:25.615120+0000","last_became_peered":"2024-09-14T11:17:25.615120+0000","last_unstale":"2024-09-14T12:16:41.860022+0000","last_undegraded":"2024-09-14T12:16:41.860022+0000","last_fullsized":"2024-09-14T12:16:41.860022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.859933+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.859933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:06.116453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'349","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.883151+0000","last_change":"2024-09-14T12:16:42.883151+0000","last_active":"2024-09-14T12:16:42.883151+0000","last_peered":"2024-09-14T12:16:42.883151+0000","last_clean":"2024-09-14T12:16:42.883151+0000","last_became_active":"2024-09-14T11:17:27.634600+0000","last_became_peered":"2024-09-14T11:17:27.634600+0000","last_unstale":"2024-09-14T12:16:42.883151+0000","last_undegraded":"2024-09-14T12:16:42.883151+0000","last_fullsized":"2024-09-14T12:16:42.883151+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-14T12:16:42.883082+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.883082+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:19.400996+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":568,"num_read_kb":1214,"num_write":454,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.302668+0000","last_change":"2024-09-14T12:16:52.302668+0000","last_active":"2024-09-14T12:16:52.302668+0000","last_peered":"2024-09-14T12:16:52.302668+0000","last_clean":"2024-09-14T12:16:52.302668+0000","last_became_active":"2024-09-14T11:17:29.647937+0000","last_became_peered":"2024-09-14T11:17:29.647937+0000","last_unstale":"2024-09-14T12:16:52.302668+0000","last_undegraded":"2024-09-14T12:16:52.302668+0000","last_fullsized":"2024-09-14T12:16:52.302668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.302584+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.302584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:43.381958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'128","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.905972+0000","last_change":"2024-09-14T12:16:55.905972+0000","last_active":"2024-09-14T12:16:55.905972+0000","last_peered":"2024-09-14T12:16:55.905972+0000","last_clean":"2024-09-14T12:16:55.905972+0000","last_became_active":"2024-09-14T11:17:31.655655+0000","last_became_peered":"2024-09-14T11:17:31.655655+0000","last_unstale":"2024-09-14T12:16:55.905972+0000","last_undegraded":"2024-09-14T12:16:55.905972+0000","last_fullsized":"2024-09-14T12:16:55.905972+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T12:16:55.905879+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.905879+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:00.503553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":97,"num_write":283,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'408","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.893645+0000","last_change":"2024-09-14T12:16:35.893645+0000","last_active":"2024-09-14T12:16:35.893645+0000","last_peered":"2024-09-14T12:16:35.893645+0000","last_clean":"2024-09-14T12:16:35.893645+0000","last_became_active":"2024-09-14T11:17:23.593137+0000","last_became_peered":"2024-09-14T11:17:23.593137+0000","last_unstale":"2024-09-14T12:16:35.893645+0000","last_undegraded":"2024-09-14T12:16:35.893645+0000","last_fullsized":"2024-09-14T12:16:35.893645+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T12:16:35.893533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.893533+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:50.859418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2483,"num_read_kb":2404,"num_write":435,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'384","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:18.857599+0000","last_change":"2024-09-14T12:16:18.857599+0000","last_active":"2024-09-14T12:16:18.857599+0000","last_peered":"2024-09-14T12:16:18.857599+0000","last_clean":"2024-09-14T12:16:18.857599+0000","last_became_active":"2024-09-14T11:17:21.586391+0000","last_became_peered":"2024-09-14T11:17:21.586391+0000","last_unstale":"2024-09-14T12:16:18.857599+0000","last_undegraded":"2024-09-14T12:16:18.857599+0000","last_fullsized":"2024-09-14T12:16:18.857599+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'384","last_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_deep_scrub":"263'384","last_deep_scrub_stamp":"2024-09-14T12:16:18.857499+0000","last_clean_scrub_stamp":"2024-09-14T12:16:18.857499+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:10.889774+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":9438,"num_write":1138,"num_write_kb":33954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.549387+0000","last_change":"2024-09-14T12:16:41.549387+0000","last_active":"2024-09-14T12:16:41.549387+0000","last_peered":"2024-09-14T12:16:41.549387+0000","last_clean":"2024-09-14T12:16:41.549387+0000","last_became_active":"2024-09-14T11:17:25.616024+0000","last_became_peered":"2024-09-14T11:17:25.616024+0000","last_unstale":"2024-09-14T12:16:41.549387+0000","last_undegraded":"2024-09-14T12:16:41.549387+0000","last_fullsized":"2024-09-14T12:16:41.549387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.549287+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.549287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:55.365473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'101","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.555911+0000","last_change":"2024-09-14T12:16:48.555911+0000","last_active":"2024-09-14T12:16:48.555911+0000","last_peered":"2024-09-14T12:16:48.555911+0000","last_clean":"2024-09-14T12:16:48.555911+0000","last_became_active":"2024-09-14T11:17:27.625418+0000","last_became_peered":"2024-09-14T11:17:27.625418+0000","last_unstale":"2024-09-14T12:16:48.555911+0000","last_undegraded":"2024-09-14T12:16:48.555911+0000","last_fullsized":"2024-09-14T12:16:48.555911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:48.555817+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.555817+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:34.096081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.589732+0000","last_change":"2024-09-14T12:16:50.589732+0000","last_active":"2024-09-14T12:16:50.589732+0000","last_peered":"2024-09-14T12:16:50.589732+0000","last_clean":"2024-09-14T12:16:50.589732+0000","last_became_active":"2024-09-14T11:17:29.643665+0000","last_became_peered":"2024-09-14T11:17:29.643665+0000","last_unstale":"2024-09-14T12:16:50.589732+0000","last_undegraded":"2024-09-14T12:16:50.589732+0000","last_fullsized":"2024-09-14T12:16:50.589732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.589634+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.589634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:28.546997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.107683+0000","last_change":"2024-09-14T12:16:54.107623+0000","last_active":"2024-09-14T12:16:54.107683+0000","last_peered":"2024-09-14T12:16:54.107683+0000","last_clean":"2024-09-14T12:16:54.107683+0000","last_became_active":"2024-09-14T11:17:31.655804+0000","last_became_peered":"2024-09-14T11:17:31.655804+0000","last_unstale":"2024-09-14T12:16:54.107683+0000","last_undegraded":"2024-09-14T12:16:54.107683+0000","last_fullsized":"2024-09-14T12:16:54.107683+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T12:16:54.107518+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.107518+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:01.171946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'519","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.928397+0000","last_change":"2024-09-14T12:16:31.928397+0000","last_active":"2024-09-14T12:16:31.928397+0000","last_peered":"2024-09-14T12:16:31.928397+0000","last_clean":"2024-09-14T12:16:31.928397+0000","last_became_active":"2024-09-14T11:17:23.603093+0000","last_became_peered":"2024-09-14T11:17:23.603093+0000","last_unstale":"2024-09-14T12:16:31.928397+0000","last_undegraded":"2024-09-14T12:16:31.928397+0000","last_fullsized":"2024-09-14T12:16:31.928397+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'519","last_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_deep_scrub":"263'519","last_deep_scrub_stamp":"2024-09-14T12:16:31.928310+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.928310+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:24.464818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2865,"num_read_kb":2667,"num_write":641,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'451","reported_seq":1174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.402865+0000","last_change":"2024-09-14T12:16:28.402865+0000","last_active":"2024-09-14T12:16:28.402865+0000","last_peered":"2024-09-14T12:16:28.402865+0000","last_clean":"2024-09-14T12:16:28.402865+0000","last_became_active":"2024-09-14T11:17:21.580696+0000","last_became_peered":"2024-09-14T11:17:21.580696+0000","last_unstale":"2024-09-14T12:16:28.402865+0000","last_undegraded":"2024-09-14T12:16:28.402865+0000","last_fullsized":"2024-09-14T12:16:28.402865+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T12:16:28.402734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.402734+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:14.475372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1029,"num_read_kb":13380,"num_write":1416,"num_write_kb":57279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.588891+0000","last_change":"2024-09-14T12:16:43.588891+0000","last_active":"2024-09-14T12:16:43.588891+0000","last_peered":"2024-09-14T12:16:43.588891+0000","last_clean":"2024-09-14T12:16:43.588891+0000","last_became_active":"2024-09-14T11:17:25.616010+0000","last_became_peered":"2024-09-14T11:17:25.616010+0000","last_unstale":"2024-09-14T12:16:43.588891+0000","last_undegraded":"2024-09-14T12:16:43.588891+0000","last_fullsized":"2024-09-14T12:16:43.588891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.588791+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.588791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:40.236472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'120","reported_seq":671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.190637+0000","last_change":"2024-09-14T12:16:36.190637+0000","last_active":"2024-09-14T12:16:36.190637+0000","last_peered":"2024-09-14T12:16:36.190637+0000","last_clean":"2024-09-14T12:16:36.190637+0000","last_became_active":"2024-09-14T11:17:27.629243+0000","last_became_peered":"2024-09-14T11:17:27.629243+0000","last_unstale":"2024-09-14T12:16:36.190637+0000","last_undegraded":"2024-09-14T12:16:36.190637+0000","last_fullsized":"2024-09-14T12:16:36.190637+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T12:16:36.190540+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.190540+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:19.260626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'764","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.274685+0000","last_change":"2024-09-14T12:16:51.274685+0000","last_active":"2024-09-14T12:16:51.274685+0000","last_peered":"2024-09-14T12:16:51.274685+0000","last_clean":"2024-09-14T12:16:51.274685+0000","last_became_active":"2024-09-14T11:17:29.643792+0000","last_became_peered":"2024-09-14T11:17:29.643792+0000","last_unstale":"2024-09-14T12:16:51.274685+0000","last_undegraded":"2024-09-14T12:16:51.274685+0000","last_fullsized":"2024-09-14T12:16:51.274685+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'764","last_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_deep_scrub":"263'764","last_deep_scrub_stamp":"2024-09-14T12:16:51.274603+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.274603+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:39.300185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'201","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.659968+0000","last_change":"2024-09-14T12:16:55.659882+0000","last_active":"2024-09-14T12:16:55.659968+0000","last_peered":"2024-09-14T12:16:55.659968+0000","last_clean":"2024-09-14T12:16:55.659968+0000","last_became_active":"2024-09-14T11:17:31.652717+0000","last_became_peered":"2024-09-14T11:17:31.652717+0000","last_unstale":"2024-09-14T12:16:55.659968+0000","last_undegraded":"2024-09-14T12:16:55.659968+0000","last_fullsized":"2024-09-14T12:16:55.659968+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T12:16:55.659760+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.659760+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:36.216083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":614,"num_write":440,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'1037","reported_seq":2664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.534133+0000","last_change":"2024-09-14T12:16:31.534133+0000","last_active":"2024-09-14T12:16:31.534133+0000","last_peered":"2024-09-14T12:16:31.534133+0000","last_clean":"2024-09-14T12:16:31.534133+0000","last_became_active":"2024-09-14T11:17:23.594741+0000","last_became_peered":"2024-09-14T11:17:23.594741+0000","last_unstale":"2024-09-14T12:16:31.534133+0000","last_undegraded":"2024-09-14T12:16:31.534133+0000","last_fullsized":"2024-09-14T12:16:31.534133+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1037","last_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_deep_scrub":"263'1037","last_deep_scrub_stamp":"2024-09-14T12:16:31.534041+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.534041+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1000,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:18.670329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4945,"num_read_kb":4367,"num_write":1483,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'353","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.487007+0000","last_change":"2024-09-14T12:16:25.487007+0000","last_active":"2024-09-14T12:16:25.487007+0000","last_peered":"2024-09-14T12:16:25.487007+0000","last_clean":"2024-09-14T12:16:25.487007+0000","last_became_active":"2024-09-14T11:17:21.583778+0000","last_became_peered":"2024-09-14T11:17:21.583778+0000","last_unstale":"2024-09-14T12:16:25.487007+0000","last_undegraded":"2024-09-14T12:16:25.487007+0000","last_fullsized":"2024-09-14T12:16:25.487007+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T12:16:25.486896+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.486896+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:43.830472+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":727,"num_read_kb":31887,"num_write":1106,"num_write_kb":17824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.909083+0000","last_change":"2024-09-14T12:16:43.909083+0000","last_active":"2024-09-14T12:16:43.909083+0000","last_peered":"2024-09-14T12:16:43.909083+0000","last_clean":"2024-09-14T12:16:43.909083+0000","last_became_active":"2024-09-14T11:17:25.618414+0000","last_became_peered":"2024-09-14T11:17:25.618414+0000","last_unstale":"2024-09-14T12:16:43.909083+0000","last_undegraded":"2024-09-14T12:16:43.909083+0000","last_fullsized":"2024-09-14T12:16:43.909083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.908989+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.908989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:42.037972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'275","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.386812+0000","last_change":"2024-09-14T12:16:45.386812+0000","last_active":"2024-09-14T12:16:45.386812+0000","last_peered":"2024-09-14T12:16:45.386812+0000","last_clean":"2024-09-14T12:16:45.386812+0000","last_became_active":"2024-09-14T11:17:27.631279+0000","last_became_peered":"2024-09-14T11:17:27.631279+0000","last_unstale":"2024-09-14T12:16:45.386812+0000","last_undegraded":"2024-09-14T12:16:45.386812+0000","last_fullsized":"2024-09-14T12:16:45.386812+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-14T12:16:45.386711+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.386711+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:51.799127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1100,"num_write":378,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'804","reported_seq":2965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.492291+0000","last_change":"2024-09-14T12:16:52.492291+0000","last_active":"2024-09-14T12:16:52.492291+0000","last_peered":"2024-09-14T12:16:52.492291+0000","last_clean":"2024-09-14T12:16:52.492291+0000","last_became_active":"2024-09-14T11:17:29.645177+0000","last_became_peered":"2024-09-14T11:17:29.645177+0000","last_unstale":"2024-09-14T12:16:52.492291+0000","last_undegraded":"2024-09-14T12:16:52.492291+0000","last_fullsized":"2024-09-14T12:16:52.492291+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T12:16:52.492206+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.492206+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:03.160461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'783","reported_seq":2541,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.907394+0000","last_change":"2024-09-14T12:16:33.907394+0000","last_active":"2024-09-14T12:16:33.907394+0000","last_peered":"2024-09-14T12:16:33.907394+0000","last_clean":"2024-09-14T12:16:33.907394+0000","last_became_active":"2024-09-14T11:17:23.591602+0000","last_became_peered":"2024-09-14T11:17:23.591602+0000","last_unstale":"2024-09-14T12:16:33.907394+0000","last_undegraded":"2024-09-14T12:16:33.907394+0000","last_fullsized":"2024-09-14T12:16:33.907394+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'783","last_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_deep_scrub":"263'783","last_deep_scrub_stamp":"2024-09-14T12:16:33.907284+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.907284+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:14.084827+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3937,"num_read_kb":3620,"num_write":1001,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'401","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.415684+0000","last_change":"2024-09-14T12:16:26.415684+0000","last_active":"2024-09-14T12:16:26.415684+0000","last_peered":"2024-09-14T12:16:26.415684+0000","last_clean":"2024-09-14T12:16:26.415684+0000","last_became_active":"2024-09-14T11:17:21.584500+0000","last_became_peered":"2024-09-14T11:17:21.584500+0000","last_unstale":"2024-09-14T12:16:26.415684+0000","last_undegraded":"2024-09-14T12:16:26.415684+0000","last_fullsized":"2024-09-14T12:16:26.415684+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T12:16:26.415569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.415569+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:50.364031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":683,"num_read_kb":56115,"num_write":1123,"num_write_kb":40930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.392134+0000","last_change":"2024-09-14T12:16:40.392134+0000","last_active":"2024-09-14T12:16:40.392134+0000","last_peered":"2024-09-14T12:16:40.392134+0000","last_clean":"2024-09-14T12:16:40.392134+0000","last_became_active":"2024-09-14T11:17:25.611812+0000","last_became_peered":"2024-09-14T11:17:25.611812+0000","last_unstale":"2024-09-14T12:16:40.392134+0000","last_undegraded":"2024-09-14T12:16:40.392134+0000","last_fullsized":"2024-09-14T12:16:40.392134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.392039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.392039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:46.721248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'363","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.958094+0000","last_change":"2024-09-14T12:16:46.958094+0000","last_active":"2024-09-14T12:16:46.958094+0000","last_peered":"2024-09-14T12:16:46.958094+0000","last_clean":"2024-09-14T12:16:46.958094+0000","last_became_active":"2024-09-14T11:17:27.632092+0000","last_became_peered":"2024-09-14T11:17:27.632092+0000","last_unstale":"2024-09-14T12:16:46.958094+0000","last_undegraded":"2024-09-14T12:16:46.958094+0000","last_fullsized":"2024-09-14T12:16:46.958094+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:46.957991+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.957991+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:57.598522+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":1208,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.095966+0000","last_change":"2024-09-14T12:16:46.095966+0000","last_active":"2024-09-14T12:16:46.095966+0000","last_peered":"2024-09-14T12:16:46.095966+0000","last_clean":"2024-09-14T12:16:46.095966+0000","last_became_active":"2024-09-14T11:17:29.644149+0000","last_became_peered":"2024-09-14T11:17:29.644149+0000","last_unstale":"2024-09-14T12:16:46.095966+0000","last_undegraded":"2024-09-14T12:16:46.095966+0000","last_fullsized":"2024-09-14T12:16:46.095966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:46.095876+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.095876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:50.747404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'552","reported_seq":1365,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.997043+0000","last_change":"2024-09-14T12:16:51.997043+0000","last_active":"2024-09-14T12:16:51.997043+0000","last_peered":"2024-09-14T12:16:51.997043+0000","last_clean":"2024-09-14T12:16:51.997043+0000","last_became_active":"2024-09-14T11:17:31.656679+0000","last_became_peered":"2024-09-14T11:17:31.656679+0000","last_unstale":"2024-09-14T12:16:51.997043+0000","last_undegraded":"2024-09-14T12:16:51.997043+0000","last_fullsized":"2024-09-14T12:16:51.997043+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'552","last_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_deep_scrub":"263'552","last_deep_scrub_stamp":"2024-09-14T12:16:51.996944+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.996944+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:31.908296+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":690,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1262,"num_read_kb":1260,"num_write":1126,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'388","reported_seq":1901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.589366+0000","last_change":"2024-09-14T12:16:27.589366+0000","last_active":"2024-09-14T12:16:27.589366+0000","last_peered":"2024-09-14T12:16:27.589366+0000","last_clean":"2024-09-14T12:16:27.589366+0000","last_became_active":"2024-09-14T11:17:23.594207+0000","last_became_peered":"2024-09-14T11:17:23.594207+0000","last_unstale":"2024-09-14T12:16:27.589366+0000","last_undegraded":"2024-09-14T12:16:27.589366+0000","last_fullsized":"2024-09-14T12:16:27.589366+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'388","last_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_deep_scrub":"263'388","last_deep_scrub_stamp":"2024-09-14T12:16:27.589279+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.589279+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:02.284167+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2139,"num_read_kb":2044,"num_write":440,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'393","reported_seq":1157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.373988+0000","last_change":"2024-09-14T12:16:27.373988+0000","last_active":"2024-09-14T12:16:27.373988+0000","last_peered":"2024-09-14T12:16:27.373988+0000","last_clean":"2024-09-14T12:16:27.373988+0000","last_became_active":"2024-09-14T11:17:21.581585+0000","last_became_peered":"2024-09-14T11:17:21.581585+0000","last_unstale":"2024-09-14T12:16:27.373988+0000","last_undegraded":"2024-09-14T12:16:27.373988+0000","last_fullsized":"2024-09-14T12:16:27.373988+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'393","last_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_deep_scrub":"263'393","last_deep_scrub_stamp":"2024-09-14T12:16:27.373835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.373835+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:53.729046+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079941,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1043,"num_read_kb":12713,"num_write":1259,"num_write_kb":29237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.264334+0000","last_change":"2024-09-14T12:16:32.264334+0000","last_active":"2024-09-14T12:16:32.264334+0000","last_peered":"2024-09-14T12:16:32.264334+0000","last_clean":"2024-09-14T12:16:32.264334+0000","last_became_active":"2024-09-14T11:17:25.611050+0000","last_became_peered":"2024-09-14T11:17:25.611050+0000","last_unstale":"2024-09-14T12:16:32.264334+0000","last_undegraded":"2024-09-14T12:16:32.264334+0000","last_fullsized":"2024-09-14T12:16:32.264334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:32.264252+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:13.721660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'256","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.562418+0000","last_change":"2024-09-14T12:16:48.562418+0000","last_active":"2024-09-14T12:16:48.562418+0000","last_peered":"2024-09-14T12:16:48.562418+0000","last_clean":"2024-09-14T12:16:48.562418+0000","last_became_active":"2024-09-14T11:17:27.630704+0000","last_became_peered":"2024-09-14T11:17:27.630704+0000","last_unstale":"2024-09-14T12:16:48.562418+0000","last_undegraded":"2024-09-14T12:16:48.562418+0000","last_fullsized":"2024-09-14T12:16:48.562418+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-14T12:16:48.562275+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.562275+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.348621+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":421,"num_read_kb":973,"num_write":336,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:05.630480+0000","last_change":"2024-09-14T12:17:05.630480+0000","last_active":"2024-09-14T12:17:05.630480+0000","last_peered":"2024-09-14T12:17:05.630480+0000","last_clean":"2024-09-14T12:17:05.630480+0000","last_became_active":"2024-09-14T11:17:29.645346+0000","last_became_peered":"2024-09-14T11:17:29.645346+0000","last_unstale":"2024-09-14T12:17:05.630480+0000","last_undegraded":"2024-09-14T12:17:05.630480+0000","last_fullsized":"2024-09-14T12:17:05.630480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:17:05.630356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:17:05.630356+0000","last_clean_scrub_stamp":"2024-09-14T12:17:05.630356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:49.750485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'2528","reported_seq":4372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.464633+0000","last_change":"2024-09-14T12:16:43.464633+0000","last_active":"2024-09-14T12:16:43.464633+0000","last_peered":"2024-09-14T12:16:43.464633+0000","last_clean":"2024-09-14T12:16:43.464633+0000","last_became_active":"2024-09-14T11:17:31.655448+0000","last_became_peered":"2024-09-14T11:17:31.655448+0000","last_unstale":"2024-09-14T12:16:43.464633+0000","last_undegraded":"2024-09-14T12:16:43.464633+0000","last_fullsized":"2024-09-14T12:16:43.464633+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2528","last_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_deep_scrub":"263'2528","last_deep_scrub_stamp":"2024-09-14T12:16:43.464554+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.464554+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":2500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:41.993155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6299,"num_read_kb":6282,"num_write":5168,"num_write_kb":1879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'1158","reported_seq":2800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.464675+0000","last_change":"2024-09-14T12:16:30.464675+0000","last_active":"2024-09-14T12:16:30.464675+0000","last_peered":"2024-09-14T12:16:30.464675+0000","last_clean":"2024-09-14T12:16:30.464675+0000","last_became_active":"2024-09-14T11:17:23.605151+0000","last_became_peered":"2024-09-14T11:17:23.605151+0000","last_unstale":"2024-09-14T12:16:30.464675+0000","last_undegraded":"2024-09-14T12:16:30.464675+0000","last_fullsized":"2024-09-14T12:16:30.464675+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T12:16:30.464582+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.464582+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:39.530289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5329,"num_read_kb":4742,"num_write":1569,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'378","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.366637+0000","last_change":"2024-09-14T12:16:25.366637+0000","last_active":"2024-09-14T12:16:25.366637+0000","last_peered":"2024-09-14T12:16:25.366637+0000","last_clean":"2024-09-14T12:16:25.366637+0000","last_became_active":"2024-09-14T11:17:21.588953+0000","last_became_peered":"2024-09-14T11:17:21.588953+0000","last_unstale":"2024-09-14T12:16:25.366637+0000","last_undegraded":"2024-09-14T12:16:25.366637+0000","last_fullsized":"2024-09-14T12:16:25.366637+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:25.366516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.366516+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:07.861044+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":648,"num_read_kb":71361,"num_write":1111,"num_write_kb":49191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.201858+0000","last_change":"2024-09-14T12:16:34.201858+0000","last_active":"2024-09-14T12:16:34.201858+0000","last_peered":"2024-09-14T12:16:34.201858+0000","last_clean":"2024-09-14T12:16:34.201858+0000","last_became_active":"2024-09-14T11:17:25.610543+0000","last_became_peered":"2024-09-14T11:17:25.610543+0000","last_unstale":"2024-09-14T12:16:34.201858+0000","last_undegraded":"2024-09-14T12:16:34.201858+0000","last_fullsized":"2024-09-14T12:16:34.201858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.201763+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.201763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.946713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'315","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.398295+0000","last_change":"2024-09-14T12:16:46.398295+0000","last_active":"2024-09-14T12:16:46.398295+0000","last_peered":"2024-09-14T12:16:46.398295+0000","last_clean":"2024-09-14T12:16:46.398295+0000","last_became_active":"2024-09-14T11:17:27.635535+0000","last_became_peered":"2024-09-14T11:17:27.635535+0000","last_unstale":"2024-09-14T12:16:46.398295+0000","last_undegraded":"2024-09-14T12:16:46.398295+0000","last_fullsized":"2024-09-14T12:16:46.398295+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-14T12:16:46.398188+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.398188+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:49.529445+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50480,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":517,"num_read_kb":1149,"num_write":414,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'797","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.995107+0000","last_change":"2024-09-14T12:16:47.995107+0000","last_active":"2024-09-14T12:16:47.995107+0000","last_peered":"2024-09-14T12:16:47.995107+0000","last_clean":"2024-09-14T12:16:47.995107+0000","last_became_active":"2024-09-14T11:17:29.645184+0000","last_became_peered":"2024-09-14T11:17:29.645184+0000","last_unstale":"2024-09-14T12:16:47.995107+0000","last_undegraded":"2024-09-14T12:16:47.995107+0000","last_fullsized":"2024-09-14T12:16:47.995107+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'797","last_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_deep_scrub":"263'797","last_deep_scrub_stamp":"2024-09-14T12:16:47.995029+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.995029+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:26.627644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'138","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.129168+0000","last_change":"2024-09-14T12:16:53.129168+0000","last_active":"2024-09-14T12:16:53.129168+0000","last_peered":"2024-09-14T12:16:53.129168+0000","last_clean":"2024-09-14T12:16:53.129168+0000","last_became_active":"2024-09-14T11:17:31.656813+0000","last_became_peered":"2024-09-14T11:17:31.656813+0000","last_unstale":"2024-09-14T12:16:53.129168+0000","last_undegraded":"2024-09-14T12:16:53.129168+0000","last_fullsized":"2024-09-14T12:16:53.129168+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T12:16:53.129089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.129089+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:25.226244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":104,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'584","reported_seq":2161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.905808+0000","last_change":"2024-09-14T12:16:30.905808+0000","last_active":"2024-09-14T12:16:30.905808+0000","last_peered":"2024-09-14T12:16:30.905808+0000","last_clean":"2024-09-14T12:16:30.905808+0000","last_became_active":"2024-09-14T11:17:23.599618+0000","last_became_peered":"2024-09-14T11:17:23.599618+0000","last_unstale":"2024-09-14T12:16:30.905808+0000","last_undegraded":"2024-09-14T12:16:30.905808+0000","last_fullsized":"2024-09-14T12:16:30.905808+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'584","last_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_deep_scrub":"263'584","last_deep_scrub_stamp":"2024-09-14T12:16:30.905703+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.905703+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:35.243549+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2938,"num_read_kb":2674,"num_write":753,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":769,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'426","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.190429+0000","last_change":"2024-09-14T12:16:20.190380+0000","last_active":"2024-09-14T12:16:20.190429+0000","last_peered":"2024-09-14T12:16:20.190429+0000","last_clean":"2024-09-14T12:16:20.190429+0000","last_became_active":"2024-09-14T11:17:55.873859+0000","last_became_peered":"2024-09-14T11:17:55.873859+0000","last_unstale":"2024-09-14T12:16:20.190429+0000","last_undegraded":"2024-09-14T12:16:20.190429+0000","last_fullsized":"2024-09-14T12:16:20.190429+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T12:16:20.190319+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.190319+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:02.075520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":795,"num_read_kb":58896,"num_write":1397,"num_write_kb":35382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.229371+0000","last_change":"2024-09-14T12:16:33.229371+0000","last_active":"2024-09-14T12:16:33.229371+0000","last_peered":"2024-09-14T12:16:33.229371+0000","last_clean":"2024-09-14T12:16:33.229371+0000","last_became_active":"2024-09-14T11:17:25.606400+0000","last_became_peered":"2024-09-14T11:17:25.606400+0000","last_unstale":"2024-09-14T12:16:33.229371+0000","last_undegraded":"2024-09-14T12:16:33.229371+0000","last_fullsized":"2024-09-14T12:16:33.229371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:33.229270+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.229270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:28.252618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'493","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.926750+0000","last_change":"2024-09-14T12:16:41.926750+0000","last_active":"2024-09-14T12:16:41.926750+0000","last_peered":"2024-09-14T12:16:41.926750+0000","last_clean":"2024-09-14T12:16:41.926750+0000","last_became_active":"2024-09-14T11:17:27.632698+0000","last_became_peered":"2024-09-14T11:17:27.632698+0000","last_unstale":"2024-09-14T12:16:41.926750+0000","last_undegraded":"2024-09-14T12:16:41.926750+0000","last_fullsized":"2024-09-14T12:16:41.926750+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:41.926660+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.926660+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:07.959468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94670,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":854,"num_read_kb":2046,"num_write":706,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.249723+0000","last_change":"2024-09-14T12:16:38.249723+0000","last_active":"2024-09-14T12:16:38.249723+0000","last_peered":"2024-09-14T12:16:38.249723+0000","last_clean":"2024-09-14T12:16:38.249723+0000","last_became_active":"2024-09-14T11:17:29.642312+0000","last_became_peered":"2024-09-14T11:17:29.642312+0000","last_unstale":"2024-09-14T12:16:38.249723+0000","last_undegraded":"2024-09-14T12:16:38.249723+0000","last_fullsized":"2024-09-14T12:16:38.249723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.249638+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.249638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:30.373505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'141","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.053669+0000","last_change":"2024-09-14T12:16:47.053669+0000","last_active":"2024-09-14T12:16:47.053669+0000","last_peered":"2024-09-14T12:16:47.053669+0000","last_clean":"2024-09-14T12:16:47.053669+0000","last_became_active":"2024-09-14T11:17:31.660047+0000","last_became_peered":"2024-09-14T11:17:31.660047+0000","last_unstale":"2024-09-14T12:16:47.053669+0000","last_undegraded":"2024-09-14T12:16:47.053669+0000","last_fullsized":"2024-09-14T12:16:47.053669+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'141","last_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_deep_scrub":"263'141","last_deep_scrub_stamp":"2024-09-14T12:16:47.053583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.053583+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:20.332007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":164,"num_write":339,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'492","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.619063+0000","last_change":"2024-09-14T12:16:31.619063+0000","last_active":"2024-09-14T12:16:31.619063+0000","last_peered":"2024-09-14T12:16:31.619063+0000","last_clean":"2024-09-14T12:16:31.619063+0000","last_became_active":"2024-09-14T11:17:23.603042+0000","last_became_peered":"2024-09-14T11:17:23.603042+0000","last_unstale":"2024-09-14T12:16:31.619063+0000","last_undegraded":"2024-09-14T12:16:31.619063+0000","last_fullsized":"2024-09-14T12:16:31.619063+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'492","last_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_deep_scrub":"263'492","last_deep_scrub_stamp":"2024-09-14T12:16:31.618980+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.618980+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.751585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2612,"num_read_kb":2419,"num_write":623,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'356","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.428532+0000","last_change":"2024-09-14T12:16:22.428532+0000","last_active":"2024-09-14T12:16:22.428532+0000","last_peered":"2024-09-14T12:16:22.428532+0000","last_clean":"2024-09-14T12:16:22.428532+0000","last_became_active":"2024-09-14T11:17:21.580500+0000","last_became_peered":"2024-09-14T11:17:21.580500+0000","last_unstale":"2024-09-14T12:16:22.428532+0000","last_undegraded":"2024-09-14T12:16:22.428532+0000","last_fullsized":"2024-09-14T12:16:22.428532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T12:16:22.428437+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.428437+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:49.436320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":679,"num_read_kb":23428,"num_write":1121,"num_write_kb":16229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.152681+0000","last_change":"2024-09-14T12:16:35.152681+0000","last_active":"2024-09-14T12:16:35.152681+0000","last_peered":"2024-09-14T12:16:35.152681+0000","last_clean":"2024-09-14T12:16:35.152681+0000","last_became_active":"2024-09-14T11:17:25.614870+0000","last_became_peered":"2024-09-14T11:17:25.614870+0000","last_unstale":"2024-09-14T12:16:35.152681+0000","last_undegraded":"2024-09-14T12:16:35.152681+0000","last_fullsized":"2024-09-14T12:16:35.152681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.152591+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.152591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:03.738990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'294","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.591487+0000","last_change":"2024-09-14T12:16:45.591487+0000","last_active":"2024-09-14T12:16:45.591487+0000","last_peered":"2024-09-14T12:16:45.591487+0000","last_clean":"2024-09-14T12:16:45.591487+0000","last_became_active":"2024-09-14T11:17:27.633651+0000","last_became_peered":"2024-09-14T11:17:27.633651+0000","last_unstale":"2024-09-14T12:16:45.591487+0000","last_undegraded":"2024-09-14T12:16:45.591487+0000","last_fullsized":"2024-09-14T12:16:45.591487+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T12:16:45.591348+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.591348+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:31.602741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53607,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":516,"num_read_kb":1139,"num_write":462,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.034027+0000","last_change":"2024-09-14T12:16:49.034027+0000","last_active":"2024-09-14T12:16:49.034027+0000","last_peered":"2024-09-14T12:16:49.034027+0000","last_clean":"2024-09-14T12:16:49.034027+0000","last_became_active":"2024-09-14T11:17:29.647277+0000","last_became_peered":"2024-09-14T11:17:29.647277+0000","last_unstale":"2024-09-14T12:16:49.034027+0000","last_undegraded":"2024-09-14T12:16:49.034027+0000","last_fullsized":"2024-09-14T12:16:49.034027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.033929+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.033929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:16.318566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'114","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.484733+0000","last_change":"2024-09-14T12:16:54.484733+0000","last_active":"2024-09-14T12:16:54.484733+0000","last_peered":"2024-09-14T12:16:54.484733+0000","last_clean":"2024-09-14T12:16:54.484733+0000","last_became_active":"2024-09-14T11:17:31.655189+0000","last_became_peered":"2024-09-14T11:17:31.655189+0000","last_unstale":"2024-09-14T12:16:54.484733+0000","last_undegraded":"2024-09-14T12:16:54.484733+0000","last_fullsized":"2024-09-14T12:16:54.484733+0000","mapping_epoch":35,"log_start":"263'101","ondisk_log_start":"263'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T12:16:54.484636+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.484636+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":101,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:22.339169+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":82,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'543","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.579010+0000","last_change":"2024-09-14T12:16:25.579010+0000","last_active":"2024-09-14T12:16:25.579010+0000","last_peered":"2024-09-14T12:16:25.579010+0000","last_clean":"2024-09-14T12:16:25.579010+0000","last_became_active":"2024-09-14T11:17:23.598608+0000","last_became_peered":"2024-09-14T11:17:23.598608+0000","last_unstale":"2024-09-14T12:16:25.579010+0000","last_undegraded":"2024-09-14T12:16:25.579010+0000","last_fullsized":"2024-09-14T12:16:25.579010+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'543","last_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_deep_scrub":"263'543","last_deep_scrub_stamp":"2024-09-14T12:16:25.578907+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.578907+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:02.855337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2965,"num_read_kb":2742,"num_write":652,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1110,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'412","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.444164+0000","last_change":"2024-09-14T12:16:22.444164+0000","last_active":"2024-09-14T12:16:22.444164+0000","last_peered":"2024-09-14T12:16:22.444164+0000","last_clean":"2024-09-14T12:16:22.444164+0000","last_became_active":"2024-09-14T11:17:21.582205+0000","last_became_peered":"2024-09-14T11:17:21.582205+0000","last_unstale":"2024-09-14T12:16:22.444164+0000","last_undegraded":"2024-09-14T12:16:22.444164+0000","last_fullsized":"2024-09-14T12:16:22.444164+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'412","last_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_deep_scrub":"263'412","last_deep_scrub_stamp":"2024-09-14T12:16:22.444058+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.444058+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:52.547807+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":761,"num_read_kb":21492,"num_write":1380,"num_write_kb":34369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.158786+0000","last_change":"2024-09-14T12:16:36.158786+0000","last_active":"2024-09-14T12:16:36.158786+0000","last_peered":"2024-09-14T12:16:36.158786+0000","last_clean":"2024-09-14T12:16:36.158786+0000","last_became_active":"2024-09-14T11:17:25.604680+0000","last_became_peered":"2024-09-14T11:17:25.604680+0000","last_unstale":"2024-09-14T12:16:36.158786+0000","last_undegraded":"2024-09-14T12:16:36.158786+0000","last_fullsized":"2024-09-14T12:16:36.158786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.158693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.158693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'312","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.241522+0000","last_change":"2024-09-14T12:16:40.241522+0000","last_active":"2024-09-14T12:16:40.241522+0000","last_peered":"2024-09-14T12:16:40.241522+0000","last_clean":"2024-09-14T12:16:40.241522+0000","last_became_active":"2024-09-14T11:17:27.627471+0000","last_became_peered":"2024-09-14T11:17:27.627471+0000","last_unstale":"2024-09-14T12:16:40.241522+0000","last_undegraded":"2024-09-14T12:16:40.241522+0000","last_fullsized":"2024-09-14T12:16:40.241522+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'312","last_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_deep_scrub":"263'312","last_deep_scrub_stamp":"2024-09-14T12:16:40.241411+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.241411+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:41.593606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":496,"num_read_kb":1085,"num_write":392,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'748","reported_seq":2443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.218331+0000","last_change":"2024-09-14T12:16:37.218331+0000","last_active":"2024-09-14T12:16:37.218331+0000","last_peered":"2024-09-14T12:16:37.218331+0000","last_clean":"2024-09-14T12:16:37.218331+0000","last_became_active":"2024-09-14T11:17:29.638546+0000","last_became_peered":"2024-09-14T11:17:29.638546+0000","last_unstale":"2024-09-14T12:16:37.218331+0000","last_undegraded":"2024-09-14T12:16:37.218331+0000","last_fullsized":"2024-09-14T12:16:37.218331+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T12:16:37.218240+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.218240+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":701,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:36.806696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'186","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.145740+0000","last_change":"2024-09-14T12:16:43.145740+0000","last_active":"2024-09-14T12:16:43.145740+0000","last_peered":"2024-09-14T12:16:43.145740+0000","last_clean":"2024-09-14T12:16:43.145740+0000","last_became_active":"2024-09-14T11:17:31.655471+0000","last_became_peered":"2024-09-14T11:17:31.655471+0000","last_unstale":"2024-09-14T12:16:43.145740+0000","last_undegraded":"2024-09-14T12:16:43.145740+0000","last_fullsized":"2024-09-14T12:16:43.145740+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T12:16:43.145658+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.145658+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:05.792206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":212,"num_write":372,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'788","reported_seq":2327,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.550891+0000","last_change":"2024-09-14T12:16:24.550891+0000","last_active":"2024-09-14T12:16:24.550891+0000","last_peered":"2024-09-14T12:16:24.550891+0000","last_clean":"2024-09-14T12:16:24.550891+0000","last_became_active":"2024-09-14T11:17:23.594504+0000","last_became_peered":"2024-09-14T11:17:23.594504+0000","last_unstale":"2024-09-14T12:16:24.550891+0000","last_undegraded":"2024-09-14T12:16:24.550891+0000","last_fullsized":"2024-09-14T12:16:24.550891+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'788","last_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_deep_scrub":"263'788","last_deep_scrub_stamp":"2024-09-14T12:16:24.550810+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.550810+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:52.077298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3753,"num_read_kb":3388,"num_write":1035,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":705,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'342","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.516595+0000","last_change":"2024-09-14T12:16:20.516595+0000","last_active":"2024-09-14T12:16:20.516595+0000","last_peered":"2024-09-14T12:16:20.516595+0000","last_clean":"2024-09-14T12:16:20.516595+0000","last_became_active":"2024-09-14T11:17:21.571720+0000","last_became_peered":"2024-09-14T11:17:21.571720+0000","last_unstale":"2024-09-14T12:16:20.516595+0000","last_undegraded":"2024-09-14T12:16:20.516595+0000","last_fullsized":"2024-09-14T12:16:20.516595+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T12:16:20.516495+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.516495+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:20.683715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":54223,"num_write":971,"num_write_kb":38288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.906954+0000","last_change":"2024-09-14T12:16:42.906954+0000","last_active":"2024-09-14T12:16:42.906954+0000","last_peered":"2024-09-14T12:16:42.906954+0000","last_clean":"2024-09-14T12:16:42.906954+0000","last_became_active":"2024-09-14T11:17:25.619265+0000","last_became_peered":"2024-09-14T11:17:25.619265+0000","last_unstale":"2024-09-14T12:16:42.906954+0000","last_undegraded":"2024-09-14T12:16:42.906954+0000","last_fullsized":"2024-09-14T12:16:42.906954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:42.906839+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.906839+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:05.333521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'89","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.625482+0000","last_change":"2024-09-14T12:16:44.625482+0000","last_active":"2024-09-14T12:16:44.625482+0000","last_peered":"2024-09-14T12:16:44.625482+0000","last_clean":"2024-09-14T12:16:44.625482+0000","last_became_active":"2024-09-14T11:17:27.631584+0000","last_became_peered":"2024-09-14T11:17:27.631584+0000","last_unstale":"2024-09-14T12:16:44.625482+0000","last_undegraded":"2024-09-14T12:16:44.625482+0000","last_fullsized":"2024-09-14T12:16:44.625482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-14T12:16:44.625381+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.625381+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:00.052025+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'782","reported_seq":2464,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.525981+0000","last_change":"2024-09-14T12:16:39.525981+0000","last_active":"2024-09-14T12:16:39.525981+0000","last_peered":"2024-09-14T12:16:39.525981+0000","last_clean":"2024-09-14T12:16:39.525981+0000","last_became_active":"2024-09-14T11:17:29.640646+0000","last_became_peered":"2024-09-14T11:17:29.640646+0000","last_unstale":"2024-09-14T12:16:39.525981+0000","last_undegraded":"2024-09-14T12:16:39.525981+0000","last_fullsized":"2024-09-14T12:16:39.525981+0000","mapping_epoch":33,"log_start":"263'702","ondisk_log_start":"263'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T12:16:39.525886+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.525886+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":702,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:10.113925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'148","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.659466+0000","last_change":"2024-09-14T12:16:52.659466+0000","last_active":"2024-09-14T12:16:52.659466+0000","last_peered":"2024-09-14T12:16:52.659466+0000","last_clean":"2024-09-14T12:16:52.659466+0000","last_became_active":"2024-09-14T11:17:31.655818+0000","last_became_peered":"2024-09-14T11:17:31.655818+0000","last_unstale":"2024-09-14T12:16:52.659466+0000","last_undegraded":"2024-09-14T12:16:52.659466+0000","last_fullsized":"2024-09-14T12:16:52.659466+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:52.659374+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.659374+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:42.223342+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":206,"num_write":372,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'448","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.122847+0000","last_change":"2024-09-14T12:16:33.122847+0000","last_active":"2024-09-14T12:16:33.122847+0000","last_peered":"2024-09-14T12:16:33.122847+0000","last_clean":"2024-09-14T12:16:33.122847+0000","last_became_active":"2024-09-14T11:17:23.603496+0000","last_became_peered":"2024-09-14T11:17:23.603496+0000","last_unstale":"2024-09-14T12:16:33.122847+0000","last_undegraded":"2024-09-14T12:16:33.122847+0000","last_fullsized":"2024-09-14T12:16:33.122847+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-14T12:16:33.122743+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.122743+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:16.368922+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2537,"num_read_kb":2412,"num_write":572,"num_write_kb":181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'335","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.471275+0000","last_change":"2024-09-14T12:16:23.471275+0000","last_active":"2024-09-14T12:16:23.471275+0000","last_peered":"2024-09-14T12:16:23.471275+0000","last_clean":"2024-09-14T12:16:23.471275+0000","last_became_active":"2024-09-14T11:17:21.585070+0000","last_became_peered":"2024-09-14T11:17:21.585070+0000","last_unstale":"2024-09-14T12:16:23.471275+0000","last_undegraded":"2024-09-14T12:16:23.471275+0000","last_fullsized":"2024-09-14T12:16:23.471275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-14T12:16:23.471155+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.471155+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:57.341077+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254166,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":11146,"num_write":1071,"num_write_kb":29735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.670140+0000","last_change":"2024-09-14T12:16:40.670140+0000","last_active":"2024-09-14T12:16:40.670140+0000","last_peered":"2024-09-14T12:16:40.670140+0000","last_clean":"2024-09-14T12:16:40.670140+0000","last_became_active":"2024-09-14T11:17:25.616482+0000","last_became_peered":"2024-09-14T11:17:25.616482+0000","last_unstale":"2024-09-14T12:16:40.670140+0000","last_undegraded":"2024-09-14T12:16:40.670140+0000","last_fullsized":"2024-09-14T12:16:40.670140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.670043+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.670043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:21.707903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'372","reported_seq":988,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.966676+0000","last_change":"2024-09-14T12:16:47.966676+0000","last_active":"2024-09-14T12:16:47.966676+0000","last_peered":"2024-09-14T12:16:47.966676+0000","last_clean":"2024-09-14T12:16:47.966676+0000","last_became_active":"2024-09-14T11:17:27.635465+0000","last_became_peered":"2024-09-14T11:17:27.635465+0000","last_unstale":"2024-09-14T12:16:47.966676+0000","last_undegraded":"2024-09-14T12:16:47.966676+0000","last_fullsized":"2024-09-14T12:16:47.966676+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:47.966585+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.966585+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:21.699551+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":589,"num_read_kb":1225,"num_write":466,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.534552+0000","last_change":"2024-09-14T12:16:38.534552+0000","last_active":"2024-09-14T12:16:38.534552+0000","last_peered":"2024-09-14T12:16:38.534552+0000","last_clean":"2024-09-14T12:16:38.534552+0000","last_became_active":"2024-09-14T11:17:29.646135+0000","last_became_peered":"2024-09-14T11:17:29.646135+0000","last_unstale":"2024-09-14T12:16:38.534552+0000","last_undegraded":"2024-09-14T12:16:38.534552+0000","last_fullsized":"2024-09-14T12:16:38.534552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:38.534449+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.534449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:17.580045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'155","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.038582+0000","last_change":"2024-09-14T12:16:50.038582+0000","last_active":"2024-09-14T12:16:50.038582+0000","last_peered":"2024-09-14T12:16:50.038582+0000","last_clean":"2024-09-14T12:16:50.038582+0000","last_became_active":"2024-09-14T11:17:31.656864+0000","last_became_peered":"2024-09-14T11:17:31.656864+0000","last_unstale":"2024-09-14T12:16:50.038582+0000","last_undegraded":"2024-09-14T12:16:50.038582+0000","last_fullsized":"2024-09-14T12:16:50.038582+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:50.038494+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.038494+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.031187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":190,"num_write":368,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'837","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.414190+0000","last_change":"2024-09-14T12:16:29.414190+0000","last_active":"2024-09-14T12:16:29.414190+0000","last_peered":"2024-09-14T12:16:29.414190+0000","last_clean":"2024-09-14T12:16:29.414190+0000","last_became_active":"2024-09-14T11:17:23.598380+0000","last_became_peered":"2024-09-14T11:17:23.598380+0000","last_unstale":"2024-09-14T12:16:29.414190+0000","last_undegraded":"2024-09-14T12:16:29.414190+0000","last_fullsized":"2024-09-14T12:16:29.414190+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'837","last_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_deep_scrub":"263'837","last_deep_scrub_stamp":"2024-09-14T12:16:29.414099+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.414099+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:46.138941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3992,"num_read_kb":3573,"num_write":1119,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.360340+0000","last_change":"2024-09-14T12:16:22.360268+0000","last_active":"2024-09-14T12:16:22.360340+0000","last_peered":"2024-09-14T12:16:22.360340+0000","last_clean":"2024-09-14T12:16:22.360340+0000","last_became_active":"2024-09-14T11:17:05.878103+0000","last_became_peered":"2024-09-14T11:17:05.878103+0000","last_unstale":"2024-09-14T12:16:22.360340+0000","last_undegraded":"2024-09-14T12:16:22.360340+0000","last_fullsized":"2024-09-14T12:16:22.360340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T12:16:22.360181+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.360181+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.829892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.818710+0000","last_change":"2024-09-14T12:16:21.818652+0000","last_active":"2024-09-14T12:16:21.818710+0000","last_peered":"2024-09-14T12:16:21.818710+0000","last_clean":"2024-09-14T12:16:21.818710+0000","last_became_active":"2024-09-14T11:17:10.913795+0000","last_became_peered":"2024-09-14T11:17:10.913795+0000","last_unstale":"2024-09-14T12:16:21.818710+0000","last_undegraded":"2024-09-14T12:16:21.818710+0000","last_fullsized":"2024-09-14T12:16:21.818710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:21.818511+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.818511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:14.072170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00054289400000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'359","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.414614+0000","last_change":"2024-09-14T12:16:20.414614+0000","last_active":"2024-09-14T12:16:20.414614+0000","last_peered":"2024-09-14T12:16:20.414614+0000","last_clean":"2024-09-14T12:16:20.414614+0000","last_became_active":"2024-09-14T11:17:21.590964+0000","last_became_peered":"2024-09-14T11:17:21.590964+0000","last_unstale":"2024-09-14T12:16:20.414614+0000","last_undegraded":"2024-09-14T12:16:20.414614+0000","last_fullsized":"2024-09-14T12:16:20.414614+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:20.414538+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.414538+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:37.794945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":16922,"num_write":1091,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.408905+0000","last_change":"2024-09-14T12:16:39.408905+0000","last_active":"2024-09-14T12:16:39.408905+0000","last_peered":"2024-09-14T12:16:39.408905+0000","last_clean":"2024-09-14T12:16:39.408905+0000","last_became_active":"2024-09-14T11:17:25.613046+0000","last_became_peered":"2024-09-14T11:17:25.613046+0000","last_unstale":"2024-09-14T12:16:39.408905+0000","last_undegraded":"2024-09-14T12:16:39.408905+0000","last_fullsized":"2024-09-14T12:16:39.408905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.408812+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.408812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:14.037956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'768","reported_seq":1477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.907046+0000","last_change":"2024-09-14T12:16:45.907046+0000","last_active":"2024-09-14T12:16:45.907046+0000","last_peered":"2024-09-14T12:16:45.907046+0000","last_clean":"2024-09-14T12:16:45.907046+0000","last_became_active":"2024-09-14T11:17:27.633320+0000","last_became_peered":"2024-09-14T11:17:27.633320+0000","last_unstale":"2024-09-14T12:16:45.907046+0000","last_undegraded":"2024-09-14T12:16:45.907046+0000","last_fullsized":"2024-09-14T12:16:45.907046+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T12:16:45.906955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.906955+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:57.165111+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143710,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1487,"num_read_kb":3441,"num_write":1400,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89202,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.939891+0000","last_change":"2024-09-14T12:16:45.939891+0000","last_active":"2024-09-14T12:16:45.939891+0000","last_peered":"2024-09-14T12:16:45.939891+0000","last_clean":"2024-09-14T12:16:45.939891+0000","last_became_active":"2024-09-14T11:17:29.646023+0000","last_became_peered":"2024-09-14T11:17:29.646023+0000","last_unstale":"2024-09-14T12:16:45.939891+0000","last_undegraded":"2024-09-14T12:16:45.939891+0000","last_fullsized":"2024-09-14T12:16:45.939891+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.939787+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.939787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:47.502672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'172","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.447039+0000","last_change":"2024-09-14T12:16:45.447039+0000","last_active":"2024-09-14T12:16:45.447039+0000","last_peered":"2024-09-14T12:16:45.447039+0000","last_clean":"2024-09-14T12:16:45.447039+0000","last_became_active":"2024-09-14T11:17:31.654739+0000","last_became_peered":"2024-09-14T11:17:31.654739+0000","last_unstale":"2024-09-14T12:16:45.447039+0000","last_undegraded":"2024-09-14T12:16:45.447039+0000","last_fullsized":"2024-09-14T12:16:45.447039+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-14T12:16:45.446945+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.446945+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:23.013556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":395,"num_write":338,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'460","reported_seq":2059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.938707+0000","last_change":"2024-09-14T12:16:29.938707+0000","last_active":"2024-09-14T12:16:29.938707+0000","last_peered":"2024-09-14T12:16:29.938707+0000","last_clean":"2024-09-14T12:16:29.938707+0000","last_became_active":"2024-09-14T11:17:23.599637+0000","last_became_peered":"2024-09-14T11:17:23.599637+0000","last_unstale":"2024-09-14T12:16:29.938707+0000","last_undegraded":"2024-09-14T12:16:29.938707+0000","last_fullsized":"2024-09-14T12:16:29.938707+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:29.938619+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.938619+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:25.975325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2617,"num_read_kb":2466,"num_write":560,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.365300+0000","last_change":"2024-09-14T12:16:23.365217+0000","last_active":"2024-09-14T12:16:23.365300+0000","last_peered":"2024-09-14T12:16:23.365300+0000","last_clean":"2024-09-14T12:16:23.365300+0000","last_became_active":"2024-09-14T11:17:10.918239+0000","last_became_peered":"2024-09-14T11:17:10.918239+0000","last_unstale":"2024-09-14T12:16:23.365300+0000","last_undegraded":"2024-09-14T12:16:23.365300+0000","last_fullsized":"2024-09-14T12:16:23.365300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:23.365091+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.365091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:02.254811+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045890900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'385","reported_seq":1053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.868893+0000","last_change":"2024-09-14T12:16:19.868893+0000","last_active":"2024-09-14T12:16:19.868893+0000","last_peered":"2024-09-14T12:16:19.868893+0000","last_clean":"2024-09-14T12:16:19.868893+0000","last_became_active":"2024-09-14T11:17:21.582158+0000","last_became_peered":"2024-09-14T11:17:21.582158+0000","last_unstale":"2024-09-14T12:16:19.868893+0000","last_undegraded":"2024-09-14T12:16:19.868893+0000","last_fullsized":"2024-09-14T12:16:19.868893+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'385","last_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_deep_scrub":"263'385","last_deep_scrub_stamp":"2024-09-14T12:16:19.868790+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.868790+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.225391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":9086,"num_write":1281,"num_write_kb":27345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.832305+0000","last_change":"2024-09-14T12:16:40.832305+0000","last_active":"2024-09-14T12:16:40.832305+0000","last_peered":"2024-09-14T12:16:40.832305+0000","last_clean":"2024-09-14T12:16:40.832305+0000","last_became_active":"2024-09-14T11:17:25.617021+0000","last_became_peered":"2024-09-14T11:17:25.617021+0000","last_unstale":"2024-09-14T12:16:40.832305+0000","last_undegraded":"2024-09-14T12:16:40.832305+0000","last_fullsized":"2024-09-14T12:16:40.832305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.832190+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.832190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:36.850016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1313","reported_seq":2959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.186119+0000","last_change":"2024-09-14T12:16:40.186119+0000","last_active":"2024-09-14T12:16:40.186119+0000","last_peered":"2024-09-14T12:16:40.186119+0000","last_clean":"2024-09-14T12:16:40.186119+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:40.186119+0000","last_undegraded":"2024-09-14T12:16:40.186119+0000","last_fullsized":"2024-09-14T12:16:40.186119+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1313","last_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_deep_scrub":"263'1313","last_deep_scrub_stamp":"2024-09-14T12:16:40.186008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.186008+0000","objects_scrubbed":12,"log_size":13,"log_dups_size":1300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:59.234504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235088,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2047,"num_read_kb":3984,"num_write":1154,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.309899+0000","last_change":"2024-09-14T12:16:49.309899+0000","last_active":"2024-09-14T12:16:49.309899+0000","last_peered":"2024-09-14T12:16:49.309899+0000","last_clean":"2024-09-14T12:16:49.309899+0000","last_became_active":"2024-09-14T11:17:29.644806+0000","last_became_peered":"2024-09-14T11:17:29.644806+0000","last_unstale":"2024-09-14T12:16:49.309899+0000","last_undegraded":"2024-09-14T12:16:49.309899+0000","last_fullsized":"2024-09-14T12:16:49.309899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.309809+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.309809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:41.869846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'218","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.081317+0000","last_change":"2024-09-14T12:16:48.081317+0000","last_active":"2024-09-14T12:16:48.081317+0000","last_peered":"2024-09-14T12:16:48.081317+0000","last_clean":"2024-09-14T12:16:48.081317+0000","last_became_active":"2024-09-14T11:17:31.658601+0000","last_became_peered":"2024-09-14T11:17:31.658601+0000","last_unstale":"2024-09-14T12:16:48.081317+0000","last_undegraded":"2024-09-14T12:16:48.081317+0000","last_fullsized":"2024-09-14T12:16:48.081317+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'218","last_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_deep_scrub":"263'218","last_deep_scrub_stamp":"2024-09-14T12:16:48.081221+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.081221+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:54.106916+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":340,"num_read_kb":334,"num_write":491,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'658","reported_seq":2314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.055652+0000","last_change":"2024-09-14T12:16:30.055652+0000","last_active":"2024-09-14T12:16:30.055652+0000","last_peered":"2024-09-14T12:16:30.055652+0000","last_clean":"2024-09-14T12:16:30.055652+0000","last_became_active":"2024-09-14T11:17:23.596975+0000","last_became_peered":"2024-09-14T11:17:23.596975+0000","last_unstale":"2024-09-14T12:16:30.055652+0000","last_undegraded":"2024-09-14T12:16:30.055652+0000","last_fullsized":"2024-09-14T12:16:30.055652+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'658","last_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_deep_scrub":"263'658","last_deep_scrub_stamp":"2024-09-14T12:16:30.055562+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.055562+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:55.630653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3450,"num_read_kb":3150,"num_write":915,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.219605+0000","last_change":"2024-09-14T12:16:22.219556+0000","last_active":"2024-09-14T12:16:22.219605+0000","last_peered":"2024-09-14T12:16:22.219605+0000","last_clean":"2024-09-14T12:16:22.219605+0000","last_became_active":"2024-09-14T11:17:10.910814+0000","last_became_peered":"2024-09-14T11:17:10.910814+0000","last_unstale":"2024-09-14T12:16:22.219605+0000","last_undegraded":"2024-09-14T12:16:22.219605+0000","last_fullsized":"2024-09-14T12:16:22.219605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:22.219484+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.219484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:41.559635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043798699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'369","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.059021+0000","last_change":"2024-09-14T12:16:23.058930+0000","last_active":"2024-09-14T12:16:23.059021+0000","last_peered":"2024-09-14T12:16:23.059021+0000","last_clean":"2024-09-14T12:16:23.059021+0000","last_became_active":"2024-09-14T11:17:21.573491+0000","last_became_peered":"2024-09-14T11:17:21.573491+0000","last_unstale":"2024-09-14T12:16:23.059021+0000","last_undegraded":"2024-09-14T12:16:23.059021+0000","last_fullsized":"2024-09-14T12:16:23.059021+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-14T12:16:23.058848+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.058848+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:55.317203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":678,"num_read_kb":56413,"num_write":1142,"num_write_kb":44833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.272785+0000","last_change":"2024-09-14T12:16:31.272785+0000","last_active":"2024-09-14T12:16:31.272785+0000","last_peered":"2024-09-14T12:16:31.272785+0000","last_clean":"2024-09-14T12:16:31.272785+0000","last_became_active":"2024-09-14T11:17:25.616086+0000","last_became_peered":"2024-09-14T11:17:25.616086+0000","last_unstale":"2024-09-14T12:16:31.272785+0000","last_undegraded":"2024-09-14T12:16:31.272785+0000","last_fullsized":"2024-09-14T12:16:31.272785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:31.272700+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.272700+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:53.072319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'267","reported_seq":1520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.415445+0000","last_change":"2024-09-14T12:16:44.415445+0000","last_active":"2024-09-14T12:16:44.415445+0000","last_peered":"2024-09-14T12:16:44.415445+0000","last_clean":"2024-09-14T12:16:44.415445+0000","last_became_active":"2024-09-14T11:17:27.631750+0000","last_became_peered":"2024-09-14T11:17:27.631750+0000","last_unstale":"2024-09-14T12:16:44.415445+0000","last_undegraded":"2024-09-14T12:16:44.415445+0000","last_fullsized":"2024-09-14T12:16:44.415445+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'267","last_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_deep_scrub":"263'267","last_deep_scrub_stamp":"2024-09-14T12:16:44.415344+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.415344+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:52.267747+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":214,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.890170+0000","last_change":"2024-09-14T12:16:44.890170+0000","last_active":"2024-09-14T12:16:44.890170+0000","last_peered":"2024-09-14T12:16:44.890170+0000","last_clean":"2024-09-14T12:16:44.890170+0000","last_became_active":"2024-09-14T11:17:29.647172+0000","last_became_peered":"2024-09-14T11:17:29.647172+0000","last_unstale":"2024-09-14T12:16:44.890170+0000","last_undegraded":"2024-09-14T12:16:44.890170+0000","last_fullsized":"2024-09-14T12:16:44.890170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.890089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.890089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:11.036712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.518031+0000","last_change":"2024-09-14T12:16:58.518031+0000","last_active":"2024-09-14T12:16:58.518031+0000","last_peered":"2024-09-14T12:16:58.518031+0000","last_clean":"2024-09-14T12:16:58.518031+0000","last_became_active":"2024-09-14T11:17:31.662247+0000","last_became_peered":"2024-09-14T11:17:31.662247+0000","last_unstale":"2024-09-14T12:16:58.518031+0000","last_undegraded":"2024-09-14T12:16:58.518031+0000","last_fullsized":"2024-09-14T12:16:58.518031+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T12:16:58.517942+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T12:16:58.517942+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.517942+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:51.264009+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":495,"num_write":553,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'799","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.067463+0000","last_change":"2024-09-14T12:16:26.067463+0000","last_active":"2024-09-14T12:16:26.067463+0000","last_peered":"2024-09-14T12:16:26.067463+0000","last_clean":"2024-09-14T12:16:26.067463+0000","last_became_active":"2024-09-14T11:17:23.592930+0000","last_became_peered":"2024-09-14T11:17:23.592930+0000","last_unstale":"2024-09-14T12:16:26.067463+0000","last_undegraded":"2024-09-14T12:16:26.067463+0000","last_fullsized":"2024-09-14T12:16:26.067463+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T12:16:26.067346+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.067346+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:40.289749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3776,"num_read_kb":3397,"num_write":1042,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.828263+0000","last_change":"2024-09-14T12:16:20.828188+0000","last_active":"2024-09-14T12:16:20.828263+0000","last_peered":"2024-09-14T12:16:20.828263+0000","last_clean":"2024-09-14T12:16:20.828263+0000","last_became_active":"2024-09-14T11:17:10.915816+0000","last_became_peered":"2024-09-14T11:17:10.915816+0000","last_unstale":"2024-09-14T12:16:20.828263+0000","last_undegraded":"2024-09-14T12:16:20.828263+0000","last_fullsized":"2024-09-14T12:16:20.828263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T12:16:20.828073+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.828073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:36.232253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011304780000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'428","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.205035+0000","last_change":"2024-09-14T12:16:23.205035+0000","last_active":"2024-09-14T12:16:23.205035+0000","last_peered":"2024-09-14T12:16:23.205035+0000","last_clean":"2024-09-14T12:16:23.205035+0000","last_became_active":"2024-09-14T11:17:55.703238+0000","last_became_peered":"2024-09-14T11:17:55.703238+0000","last_unstale":"2024-09-14T12:16:23.205035+0000","last_undegraded":"2024-09-14T12:16:23.205035+0000","last_fullsized":"2024-09-14T12:16:23.205035+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T12:16:23.204951+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.204951+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:51.476005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":100618,"num_write":1363,"num_write_kb":36197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"263'4","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.885003+0000","last_change":"2024-09-14T12:16:36.885003+0000","last_active":"2024-09-14T12:16:36.885003+0000","last_peered":"2024-09-14T12:16:36.885003+0000","last_clean":"2024-09-14T12:16:36.885003+0000","last_became_active":"2024-09-14T11:17:25.612319+0000","last_became_peered":"2024-09-14T11:17:25.612319+0000","last_unstale":"2024-09-14T12:16:36.885003+0000","last_undegraded":"2024-09-14T12:16:36.885003+0000","last_fullsized":"2024-09-14T12:16:36.885003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T12:16:36.884909+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.884909+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:15.222253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":727,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'148","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.593588+0000","last_change":"2024-09-14T12:16:46.593588+0000","last_active":"2024-09-14T12:16:46.593588+0000","last_peered":"2024-09-14T12:16:46.593588+0000","last_clean":"2024-09-14T12:16:46.593588+0000","last_became_active":"2024-09-14T11:17:27.629106+0000","last_became_peered":"2024-09-14T11:17:27.629106+0000","last_unstale":"2024-09-14T12:16:46.593588+0000","last_undegraded":"2024-09-14T12:16:46.593588+0000","last_fullsized":"2024-09-14T12:16:46.593588+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:46.593480+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.593480+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:01.417091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":168,"num_read_kb":159,"num_write":126,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.529888+0000","last_change":"2024-09-14T12:16:37.529888+0000","last_active":"2024-09-14T12:16:37.529888+0000","last_peered":"2024-09-14T12:16:37.529888+0000","last_clean":"2024-09-14T12:16:37.529888+0000","last_became_active":"2024-09-14T11:17:29.643007+0000","last_became_peered":"2024-09-14T11:17:29.643007+0000","last_unstale":"2024-09-14T12:16:37.529888+0000","last_undegraded":"2024-09-14T12:16:37.529888+0000","last_fullsized":"2024-09-14T12:16:37.529888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.529798+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.529798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:43.161355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'154","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.949519+0000","last_change":"2024-09-14T12:16:52.949519+0000","last_active":"2024-09-14T12:16:52.949519+0000","last_peered":"2024-09-14T12:16:52.949519+0000","last_clean":"2024-09-14T12:16:52.949519+0000","last_became_active":"2024-09-14T11:17:31.658075+0000","last_became_peered":"2024-09-14T11:17:31.658075+0000","last_unstale":"2024-09-14T12:16:52.949519+0000","last_undegraded":"2024-09-14T12:16:52.949519+0000","last_fullsized":"2024-09-14T12:16:52.949519+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T12:16:52.949406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.949406+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:56.125512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":393,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'541","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.067347+0000","last_change":"2024-09-14T12:16:25.067347+0000","last_active":"2024-09-14T12:16:25.067347+0000","last_peered":"2024-09-14T12:16:25.067347+0000","last_clean":"2024-09-14T12:16:25.067347+0000","last_became_active":"2024-09-14T11:17:23.595496+0000","last_became_peered":"2024-09-14T11:17:23.595496+0000","last_unstale":"2024-09-14T12:16:25.067347+0000","last_undegraded":"2024-09-14T12:16:25.067347+0000","last_fullsized":"2024-09-14T12:16:25.067347+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:25.067268+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.067268+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:52.957237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2753,"num_read_kb":2585,"num_write":609,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'376","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.831672+0000","last_change":"2024-09-14T12:16:22.831672+0000","last_active":"2024-09-14T12:16:22.831672+0000","last_peered":"2024-09-14T12:16:22.831672+0000","last_clean":"2024-09-14T12:16:22.831672+0000","last_became_active":"2024-09-14T11:17:21.586933+0000","last_became_peered":"2024-09-14T11:17:21.586933+0000","last_unstale":"2024-09-14T12:16:22.831672+0000","last_undegraded":"2024-09-14T12:16:22.831672+0000","last_fullsized":"2024-09-14T12:16:22.831672+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T12:16:22.831568+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.831568+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:25.922575+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159823,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":15898,"num_write":1178,"num_write_kb":22021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.046315+0000","last_change":"2024-09-14T12:16:21.046268+0000","last_active":"2024-09-14T12:16:21.046315+0000","last_peered":"2024-09-14T12:16:21.046315+0000","last_clean":"2024-09-14T12:16:21.046315+0000","last_became_active":"2024-09-14T11:17:10.910017+0000","last_became_peered":"2024-09-14T11:17:10.910017+0000","last_unstale":"2024-09-14T12:16:21.046315+0000","last_undegraded":"2024-09-14T12:16:21.046315+0000","last_fullsized":"2024-09-14T12:16:21.046315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.046203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.046203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:19.507992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052690099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.917486+0000","last_change":"2024-09-14T12:16:39.917486+0000","last_active":"2024-09-14T12:16:39.917486+0000","last_peered":"2024-09-14T12:16:39.917486+0000","last_clean":"2024-09-14T12:16:39.917486+0000","last_became_active":"2024-09-14T11:17:25.613470+0000","last_became_peered":"2024-09-14T11:17:25.613470+0000","last_unstale":"2024-09-14T12:16:39.917486+0000","last_undegraded":"2024-09-14T12:16:39.917486+0000","last_fullsized":"2024-09-14T12:16:39.917486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.917368+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.917368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:02.362730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'604","reported_seq":1285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.886393+0000","last_change":"2024-09-14T12:16:40.886334+0000","last_active":"2024-09-14T12:16:40.886393+0000","last_peered":"2024-09-14T12:16:40.886393+0000","last_clean":"2024-09-14T12:16:40.886393+0000","last_became_active":"2024-09-14T11:17:27.638523+0000","last_became_peered":"2024-09-14T11:17:27.638523+0000","last_unstale":"2024-09-14T12:16:40.886393+0000","last_undegraded":"2024-09-14T12:16:40.886393+0000","last_fullsized":"2024-09-14T12:16:40.886393+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'604","last_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_deep_scrub":"263'604","last_deep_scrub_stamp":"2024-09-14T12:16:40.886241+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.886241+0000","objects_scrubbed":10,"log_size":104,"log_dups_size":500,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:15.346475+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94377,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1665,"num_read_kb":2783,"num_write":2218,"num_write_kb":2033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537284,"num_omap_keys":1216,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.573449+0000","last_change":"2024-09-14T12:16:49.573449+0000","last_active":"2024-09-14T12:16:49.573449+0000","last_peered":"2024-09-14T12:16:49.573449+0000","last_clean":"2024-09-14T12:16:49.573449+0000","last_became_active":"2024-09-14T11:17:29.647191+0000","last_became_peered":"2024-09-14T11:17:29.647191+0000","last_unstale":"2024-09-14T12:16:49.573449+0000","last_undegraded":"2024-09-14T12:16:49.573449+0000","last_fullsized":"2024-09-14T12:16:49.573449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:49.573330+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.573330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:10.996167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.144806+0000","last_change":"2024-09-14T12:16:55.144806+0000","last_active":"2024-09-14T12:16:55.144806+0000","last_peered":"2024-09-14T12:16:55.144806+0000","last_clean":"2024-09-14T12:16:55.144806+0000","last_became_active":"2024-09-14T11:17:31.650304+0000","last_became_peered":"2024-09-14T11:17:31.650304+0000","last_unstale":"2024-09-14T12:16:55.144806+0000","last_undegraded":"2024-09-14T12:16:55.144806+0000","last_fullsized":"2024-09-14T12:16:55.144806+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-14T12:16:55.144697+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.144697+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:13.488584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":138,"num_write":359,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'817","reported_seq":2381,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.948833+0000","last_change":"2024-09-14T12:16:28.948833+0000","last_active":"2024-09-14T12:16:28.948833+0000","last_peered":"2024-09-14T12:16:28.948833+0000","last_clean":"2024-09-14T12:16:28.948833+0000","last_became_active":"2024-09-14T11:17:23.596830+0000","last_became_peered":"2024-09-14T11:17:23.596830+0000","last_unstale":"2024-09-14T12:16:28.948833+0000","last_undegraded":"2024-09-14T12:16:28.948833+0000","last_fullsized":"2024-09-14T12:16:28.948833+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'817","last_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_deep_scrub":"263'817","last_deep_scrub_stamp":"2024-09-14T12:16:28.948726+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.948726+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:45.026434+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3837,"num_read_kb":3458,"num_write":1052,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'370","reported_seq":1072,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.036275+0000","last_change":"2024-09-14T12:16:20.036275+0000","last_active":"2024-09-14T12:16:20.036275+0000","last_peered":"2024-09-14T12:16:20.036275+0000","last_clean":"2024-09-14T12:16:20.036275+0000","last_became_active":"2024-09-14T11:17:21.571915+0000","last_became_peered":"2024-09-14T11:17:21.571915+0000","last_unstale":"2024-09-14T12:16:20.036275+0000","last_undegraded":"2024-09-14T12:16:20.036275+0000","last_fullsized":"2024-09-14T12:16:20.036275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T12:16:20.036170+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.036170+0000","objects_scrubbed":9,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.821484+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159837,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":790,"num_read_kb":26393,"num_write":1261,"num_write_kb":30048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.388449+0000","last_change":"2024-09-14T12:16:24.388449+0000","last_active":"2024-09-14T12:16:24.388449+0000","last_peered":"2024-09-14T12:16:24.388449+0000","last_clean":"2024-09-14T12:16:24.388449+0000","last_became_active":"2024-09-14T11:17:10.918330+0000","last_became_peered":"2024-09-14T11:17:10.918330+0000","last_unstale":"2024-09-14T12:16:24.388449+0000","last_undegraded":"2024-09-14T12:16:24.388449+0000","last_fullsized":"2024-09-14T12:16:24.388449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:24.388360+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.388360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:24.586979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044713899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.511200+0000","last_change":"2024-09-14T12:16:34.511200+0000","last_active":"2024-09-14T12:16:34.511200+0000","last_peered":"2024-09-14T12:16:34.511200+0000","last_clean":"2024-09-14T12:16:34.511200+0000","last_became_active":"2024-09-14T11:17:25.613638+0000","last_became_peered":"2024-09-14T11:17:25.613638+0000","last_unstale":"2024-09-14T12:16:34.511200+0000","last_undegraded":"2024-09-14T12:16:34.511200+0000","last_fullsized":"2024-09-14T12:16:34.511200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:34.511111+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.511111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:08.764095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'170","reported_seq":747,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.152901+0000","last_change":"2024-09-14T12:16:41.152901+0000","last_active":"2024-09-14T12:16:41.152901+0000","last_peered":"2024-09-14T12:16:41.152901+0000","last_clean":"2024-09-14T12:16:41.152901+0000","last_became_active":"2024-09-14T11:17:27.629779+0000","last_became_peered":"2024-09-14T11:17:27.629779+0000","last_unstale":"2024-09-14T12:16:41.152901+0000","last_undegraded":"2024-09-14T12:16:41.152901+0000","last_fullsized":"2024-09-14T12:16:41.152901+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'170","last_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_deep_scrub":"263'170","last_deep_scrub_stamp":"2024-09-14T12:16:41.152803+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.152803+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:51.429920+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":209,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'814","reported_seq":6820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.987827+0000","last_change":"2024-09-14T12:16:49.987827+0000","last_active":"2024-09-14T12:16:49.987827+0000","last_peered":"2024-09-14T12:16:49.987827+0000","last_clean":"2024-09-14T12:16:49.987827+0000","last_became_active":"2024-09-14T11:17:29.642234+0000","last_became_peered":"2024-09-14T11:17:29.642234+0000","last_unstale":"2024-09-14T12:16:49.987827+0000","last_undegraded":"2024-09-14T12:16:49.987827+0000","last_fullsized":"2024-09-14T12:16:49.987827+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T12:16:49.987737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.987737+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:21.547053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'142","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.486856+0000","last_change":"2024-09-14T12:16:55.486856+0000","last_active":"2024-09-14T12:16:55.486856+0000","last_peered":"2024-09-14T12:16:55.486856+0000","last_clean":"2024-09-14T12:16:55.486856+0000","last_became_active":"2024-09-14T11:17:31.658239+0000","last_became_peered":"2024-09-14T11:17:31.658239+0000","last_unstale":"2024-09-14T12:16:55.486856+0000","last_undegraded":"2024-09-14T12:16:55.486856+0000","last_fullsized":"2024-09-14T12:16:55.486856+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T12:16:55.486751+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.486751+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:56.365995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":215,"num_read_kb":193,"num_write":346,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'1162","reported_seq":2667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.564918+0000","last_change":"2024-09-14T12:16:32.564857+0000","last_active":"2024-09-14T12:16:32.564918+0000","last_peered":"2024-09-14T12:16:32.564918+0000","last_clean":"2024-09-14T12:16:32.564918+0000","last_became_active":"2024-09-14T11:17:23.594549+0000","last_became_peered":"2024-09-14T11:17:23.594549+0000","last_unstale":"2024-09-14T12:16:32.564918+0000","last_undegraded":"2024-09-14T12:16:32.564918+0000","last_fullsized":"2024-09-14T12:16:32.564918+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1162","last_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_deep_scrub":"263'1162","last_deep_scrub_stamp":"2024-09-14T12:16:32.564750+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.564750+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.939513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5299,"num_read_kb":4681,"num_write":1628,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.380483+0000","last_change":"2024-09-14T12:16:21.380483+0000","last_active":"2024-09-14T12:16:21.380483+0000","last_peered":"2024-09-14T12:16:21.380483+0000","last_clean":"2024-09-14T12:16:21.380483+0000","last_became_active":"2024-09-14T11:17:21.588352+0000","last_became_peered":"2024-09-14T11:17:21.588352+0000","last_unstale":"2024-09-14T12:16:21.380483+0000","last_undegraded":"2024-09-14T12:16:21.380483+0000","last_fullsized":"2024-09-14T12:16:21.380483+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'310","last_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_deep_scrub":"263'310","last_deep_scrub_stamp":"2024-09-14T12:16:21.380404+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.380404+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:16.067361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":24953,"num_write":917,"num_write_kb":41682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:19.057317+0000","last_change":"2024-09-14T12:16:19.057317+0000","last_active":"2024-09-14T12:16:19.057317+0000","last_peered":"2024-09-14T12:16:19.057317+0000","last_clean":"2024-09-14T12:16:19.057317+0000","last_became_active":"2024-09-14T11:17:10.914880+0000","last_became_peered":"2024-09-14T11:17:10.914880+0000","last_unstale":"2024-09-14T12:16:19.057317+0000","last_undegraded":"2024-09-14T12:16:19.057317+0000","last_fullsized":"2024-09-14T12:16:19.057317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:19.057236+0000","last_clean_scrub_stamp":"2024-09-14T12:16:19.057236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:56.674413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045435700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.626832+0000","last_change":"2024-09-14T12:16:41.626832+0000","last_active":"2024-09-14T12:16:41.626832+0000","last_peered":"2024-09-14T12:16:41.626832+0000","last_clean":"2024-09-14T12:16:41.626832+0000","last_became_active":"2024-09-14T11:17:25.612676+0000","last_became_peered":"2024-09-14T11:17:25.612676+0000","last_unstale":"2024-09-14T12:16:41.626832+0000","last_undegraded":"2024-09-14T12:16:41.626832+0000","last_fullsized":"2024-09-14T12:16:41.626832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.626734+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.626734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:08.346841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'117","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.595797+0000","last_change":"2024-09-14T12:16:44.595797+0000","last_active":"2024-09-14T12:16:44.595797+0000","last_peered":"2024-09-14T12:16:44.595797+0000","last_clean":"2024-09-14T12:16:44.595797+0000","last_became_active":"2024-09-14T11:17:27.628365+0000","last_became_peered":"2024-09-14T11:17:27.628365+0000","last_unstale":"2024-09-14T12:16:44.595797+0000","last_undegraded":"2024-09-14T12:16:44.595797+0000","last_fullsized":"2024-09-14T12:16:44.595797+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T12:16:44.595693+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.595693+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:57.936891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.514247+0000","last_change":"2024-09-14T12:16:56.514247+0000","last_active":"2024-09-14T12:16:56.514247+0000","last_peered":"2024-09-14T12:16:56.514247+0000","last_clean":"2024-09-14T12:16:56.514247+0000","last_became_active":"2024-09-14T11:17:29.645390+0000","last_became_peered":"2024-09-14T11:17:29.645390+0000","last_unstale":"2024-09-14T12:16:56.514247+0000","last_undegraded":"2024-09-14T12:16:56.514247+0000","last_fullsized":"2024-09-14T12:16:56.514247+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T12:16:56.514137+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.514137+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.995492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'198","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.088408+0000","last_change":"2024-09-14T12:16:57.088408+0000","last_active":"2024-09-14T12:16:57.088408+0000","last_peered":"2024-09-14T12:16:57.088408+0000","last_clean":"2024-09-14T12:16:57.088408+0000","last_became_active":"2024-09-14T11:17:31.656698+0000","last_became_peered":"2024-09-14T11:17:31.656698+0000","last_unstale":"2024-09-14T12:16:57.088408+0000","last_undegraded":"2024-09-14T12:16:57.088408+0000","last_fullsized":"2024-09-14T12:16:57.088408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T12:16:57.088257+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.088257+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:44.271140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":149,"num_write":436,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'873","reported_seq":2360,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:30.613914+0000","last_change":"2024-09-14T12:16:30.613914+0000","last_active":"2024-09-14T12:16:30.613914+0000","last_peered":"2024-09-14T12:16:30.613914+0000","last_clean":"2024-09-14T12:16:30.613914+0000","last_became_active":"2024-09-14T11:17:23.593362+0000","last_became_peered":"2024-09-14T11:17:23.593362+0000","last_unstale":"2024-09-14T12:16:30.613914+0000","last_undegraded":"2024-09-14T12:16:30.613914+0000","last_fullsized":"2024-09-14T12:16:30.613914+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'873","last_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_deep_scrub":"263'873","last_deep_scrub_stamp":"2024-09-14T12:16:30.613828+0000","last_clean_scrub_stamp":"2024-09-14T12:16:30.613828+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":800,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:47.700434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":3613,"num_write":1193,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'407","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:20.862986+0000","last_change":"2024-09-14T12:16:20.862986+0000","last_active":"2024-09-14T12:16:20.862986+0000","last_peered":"2024-09-14T12:16:20.862986+0000","last_clean":"2024-09-14T12:16:20.862986+0000","last_became_active":"2024-09-14T11:17:21.581284+0000","last_became_peered":"2024-09-14T11:17:21.581284+0000","last_unstale":"2024-09-14T12:16:20.862986+0000","last_undegraded":"2024-09-14T12:16:20.862986+0000","last_fullsized":"2024-09-14T12:16:20.862986+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T12:16:20.862919+0000","last_clean_scrub_stamp":"2024-09-14T12:16:20.862919+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:17.038200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":626,"num_read_kb":7690,"num_write":1106,"num_write_kb":27743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.452659+0000","last_change":"2024-09-14T12:16:21.452659+0000","last_active":"2024-09-14T12:16:21.452659+0000","last_peered":"2024-09-14T12:16:21.452659+0000","last_clean":"2024-09-14T12:16:21.452659+0000","last_became_active":"2024-09-14T11:17:10.915283+0000","last_became_peered":"2024-09-14T11:17:10.915283+0000","last_unstale":"2024-09-14T12:16:21.452659+0000","last_undegraded":"2024-09-14T12:16:21.452659+0000","last_fullsized":"2024-09-14T12:16:21.452659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:21.452570+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.452570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:20.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000483883,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.587421+0000","last_change":"2024-09-14T12:16:40.587319+0000","last_active":"2024-09-14T12:16:40.587421+0000","last_peered":"2024-09-14T12:16:40.587421+0000","last_clean":"2024-09-14T12:16:40.587421+0000","last_became_active":"2024-09-14T11:17:25.617492+0000","last_became_peered":"2024-09-14T11:17:25.617492+0000","last_unstale":"2024-09-14T12:16:40.587421+0000","last_undegraded":"2024-09-14T12:16:40.587421+0000","last_fullsized":"2024-09-14T12:16:40.587421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.587220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.587220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:50.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'724","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.390623+0000","last_change":"2024-09-14T12:16:43.390623+0000","last_active":"2024-09-14T12:16:43.390623+0000","last_peered":"2024-09-14T12:16:43.390623+0000","last_clean":"2024-09-14T12:16:43.390623+0000","last_became_active":"2024-09-14T11:17:27.628446+0000","last_became_peered":"2024-09-14T11:17:27.628446+0000","last_unstale":"2024-09-14T12:16:43.390623+0000","last_undegraded":"2024-09-14T12:16:43.390623+0000","last_fullsized":"2024-09-14T12:16:43.390623+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'724","last_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_deep_scrub":"263'724","last_deep_scrub_stamp":"2024-09-14T12:16:43.390516+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.390516+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:55.678494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149203,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1276,"num_read_kb":2979,"num_write":1030,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.547127+0000","last_change":"2024-09-14T12:16:50.547127+0000","last_active":"2024-09-14T12:16:50.547127+0000","last_peered":"2024-09-14T12:16:50.547127+0000","last_clean":"2024-09-14T12:16:50.547127+0000","last_became_active":"2024-09-14T11:17:29.643572+0000","last_became_peered":"2024-09-14T11:17:29.643572+0000","last_unstale":"2024-09-14T12:16:50.547127+0000","last_undegraded":"2024-09-14T12:16:50.547127+0000","last_fullsized":"2024-09-14T12:16:50.547127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.547030+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.547030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:37.215198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'118","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.911032+0000","last_change":"2024-09-14T12:16:53.911032+0000","last_active":"2024-09-14T12:16:53.911032+0000","last_peered":"2024-09-14T12:16:53.911032+0000","last_clean":"2024-09-14T12:16:53.911032+0000","last_became_active":"2024-09-14T11:17:31.658644+0000","last_became_peered":"2024-09-14T11:17:31.658644+0000","last_unstale":"2024-09-14T12:16:53.911032+0000","last_undegraded":"2024-09-14T12:16:53.911032+0000","last_fullsized":"2024-09-14T12:16:53.911032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-14T12:16:53.910928+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.910928+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:15:38.507193+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":269,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'155","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:58.121007+0000","last_change":"2024-09-14T12:16:58.121007+0000","last_active":"2024-09-14T12:16:58.121007+0000","last_peered":"2024-09-14T12:16:58.121007+0000","last_clean":"2024-09-14T12:16:58.121007+0000","last_became_active":"2024-09-14T11:17:31.657260+0000","last_became_peered":"2024-09-14T11:17:31.657260+0000","last_unstale":"2024-09-14T12:16:58.121007+0000","last_undegraded":"2024-09-14T12:16:58.121007+0000","last_fullsized":"2024-09-14T12:16:58.121007+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T12:16:58.120916+0000","last_clean_scrub_stamp":"2024-09-14T12:16:58.120916+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:20.789699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":251,"num_read_kb":241,"num_write":364,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'378","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.578669+0000","last_change":"2024-09-14T12:16:26.578669+0000","last_active":"2024-09-14T12:16:26.578669+0000","last_peered":"2024-09-14T12:16:26.578669+0000","last_clean":"2024-09-14T12:16:26.578669+0000","last_became_active":"2024-09-14T11:17:23.593014+0000","last_became_peered":"2024-09-14T11:17:23.593014+0000","last_unstale":"2024-09-14T12:16:26.578669+0000","last_undegraded":"2024-09-14T12:16:26.578669+0000","last_fullsized":"2024-09-14T12:16:26.578669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:26.578576+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.578576+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:26.873670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2138,"num_read_kb":2059,"num_write":400,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'334","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.549518+0000","last_change":"2024-09-14T12:16:21.549518+0000","last_active":"2024-09-14T12:16:21.549518+0000","last_peered":"2024-09-14T12:16:21.549518+0000","last_clean":"2024-09-14T12:16:21.549518+0000","last_became_active":"2024-09-14T11:17:21.585143+0000","last_became_peered":"2024-09-14T11:17:21.585143+0000","last_unstale":"2024-09-14T12:16:21.549518+0000","last_undegraded":"2024-09-14T12:16:21.549518+0000","last_fullsized":"2024-09-14T12:16:21.549518+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:21.549418+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.549418+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:07.371079+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":681,"num_read_kb":30194,"num_write":1111,"num_write_kb":25953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"263'6","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.196236+0000","last_change":"2024-09-14T12:16:37.196236+0000","last_active":"2024-09-14T12:16:37.196236+0000","last_peered":"2024-09-14T12:16:37.196236+0000","last_clean":"2024-09-14T12:16:37.196236+0000","last_became_active":"2024-09-14T11:17:25.612717+0000","last_became_peered":"2024-09-14T11:17:25.612717+0000","last_unstale":"2024-09-14T12:16:37.196236+0000","last_undegraded":"2024-09-14T12:16:37.196236+0000","last_fullsized":"2024-09-14T12:16:37.196236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T12:16:37.196124+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.196124+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:44.046644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'305","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.627395+0000","last_change":"2024-09-14T12:16:45.627395+0000","last_active":"2024-09-14T12:16:45.627395+0000","last_peered":"2024-09-14T12:16:45.627395+0000","last_clean":"2024-09-14T12:16:45.627395+0000","last_became_active":"2024-09-14T11:17:27.630163+0000","last_became_peered":"2024-09-14T11:17:27.630163+0000","last_unstale":"2024-09-14T12:16:45.627395+0000","last_undegraded":"2024-09-14T12:16:45.627395+0000","last_fullsized":"2024-09-14T12:16:45.627395+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T12:16:45.627286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.627286+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:15.850593+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55106,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":1151,"num_write":410,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.538291+0000","last_change":"2024-09-14T12:16:51.538291+0000","last_active":"2024-09-14T12:16:51.538291+0000","last_peered":"2024-09-14T12:16:51.538291+0000","last_clean":"2024-09-14T12:16:51.538291+0000","last_became_active":"2024-09-14T11:17:29.644937+0000","last_became_peered":"2024-09-14T11:17:29.644937+0000","last_unstale":"2024-09-14T12:16:51.538291+0000","last_undegraded":"2024-09-14T12:16:51.538291+0000","last_fullsized":"2024-09-14T12:16:51.538291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.538191+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.538191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:23.700459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:17:00.529037+0000","last_change":"2024-09-14T12:17:00.529037+0000","last_active":"2024-09-14T12:17:00.529037+0000","last_peered":"2024-09-14T12:17:00.529037+0000","last_clean":"2024-09-14T12:17:00.529037+0000","last_became_active":"2024-09-14T11:17:31.652950+0000","last_became_peered":"2024-09-14T11:17:31.652950+0000","last_unstale":"2024-09-14T12:17:00.529037+0000","last_undegraded":"2024-09-14T12:17:00.529037+0000","last_fullsized":"2024-09-14T12:17:00.529037+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-14T12:17:00.528951+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-14T12:17:00.528951+0000","last_clean_scrub_stamp":"2024-09-14T12:17:00.528951+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:37.499497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":96,"num_write":279,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.045329+0000","last_change":"2024-09-14T12:16:27.045329+0000","last_active":"2024-09-14T12:16:27.045329+0000","last_peered":"2024-09-14T12:16:27.045329+0000","last_clean":"2024-09-14T12:16:27.045329+0000","last_became_active":"2024-09-14T11:17:23.600501+0000","last_became_peered":"2024-09-14T11:17:23.600501+0000","last_unstale":"2024-09-14T12:16:27.045329+0000","last_undegraded":"2024-09-14T12:16:27.045329+0000","last_fullsized":"2024-09-14T12:16:27.045329+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'434","last_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_deep_scrub":"263'434","last_deep_scrub_stamp":"2024-09-14T12:16:27.045215+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.045215+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:32.784518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2389,"num_read_kb":2273,"num_write":480,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'400","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.377374+0000","last_change":"2024-09-14T12:16:29.377374+0000","last_active":"2024-09-14T12:16:29.377374+0000","last_peered":"2024-09-14T12:16:29.377374+0000","last_clean":"2024-09-14T12:16:29.377374+0000","last_became_active":"2024-09-14T11:17:21.580710+0000","last_became_peered":"2024-09-14T11:17:21.580710+0000","last_unstale":"2024-09-14T12:16:29.377374+0000","last_undegraded":"2024-09-14T12:16:29.377374+0000","last_fullsized":"2024-09-14T12:16:29.377374+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:29.377285+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.377285+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:31.072073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":592,"num_read_kb":23223,"num_write":1213,"num_write_kb":48933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.564140+0000","last_change":"2024-09-14T12:16:42.564140+0000","last_active":"2024-09-14T12:16:42.564140+0000","last_peered":"2024-09-14T12:16:42.564140+0000","last_clean":"2024-09-14T12:16:42.564140+0000","last_became_active":"2024-09-14T11:17:25.615047+0000","last_became_peered":"2024-09-14T11:17:25.615047+0000","last_unstale":"2024-09-14T12:16:42.564140+0000","last_undegraded":"2024-09-14T12:16:42.564140+0000","last_fullsized":"2024-09-14T12:16:42.564140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.564074+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.564074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.344761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'64","reported_seq":578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.866020+0000","last_change":"2024-09-14T12:16:43.866020+0000","last_active":"2024-09-14T12:16:43.866020+0000","last_peered":"2024-09-14T12:16:43.866020+0000","last_clean":"2024-09-14T12:16:43.866020+0000","last_became_active":"2024-09-14T11:17:27.635218+0000","last_became_peered":"2024-09-14T11:17:27.635218+0000","last_unstale":"2024-09-14T12:16:43.866020+0000","last_undegraded":"2024-09-14T12:16:43.866020+0000","last_fullsized":"2024-09-14T12:16:43.866020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-14T12:16:43.865930+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.865930+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:19.821383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.259687+0000","last_change":"2024-09-14T12:16:50.259687+0000","last_active":"2024-09-14T12:16:50.259687+0000","last_peered":"2024-09-14T12:16:50.259687+0000","last_clean":"2024-09-14T12:16:50.259687+0000","last_became_active":"2024-09-14T11:17:29.642197+0000","last_became_peered":"2024-09-14T11:17:29.642197+0000","last_unstale":"2024-09-14T12:16:50.259687+0000","last_undegraded":"2024-09-14T12:16:50.259687+0000","last_fullsized":"2024-09-14T12:16:50.259687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.259609+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.259609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:13.804578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'220","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.097690+0000","last_change":"2024-09-14T12:16:56.097630+0000","last_active":"2024-09-14T12:16:56.097690+0000","last_peered":"2024-09-14T12:16:56.097690+0000","last_clean":"2024-09-14T12:16:56.097690+0000","last_became_active":"2024-09-14T11:17:31.655428+0000","last_became_peered":"2024-09-14T11:17:31.655428+0000","last_unstale":"2024-09-14T12:16:56.097690+0000","last_undegraded":"2024-09-14T12:16:56.097690+0000","last_fullsized":"2024-09-14T12:16:56.097690+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T12:16:56.097543+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.097543+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:57:00.542228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":332,"num_read_kb":319,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'493","reported_seq":2250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.522624+0000","last_change":"2024-09-14T12:16:34.522624+0000","last_active":"2024-09-14T12:16:34.522624+0000","last_peered":"2024-09-14T12:16:34.522624+0000","last_clean":"2024-09-14T12:16:34.522624+0000","last_became_active":"2024-09-14T11:17:23.601542+0000","last_became_peered":"2024-09-14T11:17:23.601542+0000","last_unstale":"2024-09-14T12:16:34.522624+0000","last_undegraded":"2024-09-14T12:16:34.522624+0000","last_fullsized":"2024-09-14T12:16:34.522624+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'493","last_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_deep_scrub":"263'493","last_deep_scrub_stamp":"2024-09-14T12:16:34.522537+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.522537+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:24.965499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2629,"num_write":575,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'366","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.762267+0000","last_change":"2024-09-14T12:16:24.762267+0000","last_active":"2024-09-14T12:16:24.762267+0000","last_peered":"2024-09-14T12:16:24.762267+0000","last_clean":"2024-09-14T12:16:24.762267+0000","last_became_active":"2024-09-14T11:17:21.587992+0000","last_became_peered":"2024-09-14T11:17:21.587992+0000","last_unstale":"2024-09-14T12:16:24.762267+0000","last_undegraded":"2024-09-14T12:16:24.762267+0000","last_fullsized":"2024-09-14T12:16:24.762267+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-14T12:16:24.762175+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.762175+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.783635+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":658,"num_read_kb":51938,"num_write":1111,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.436681+0000","last_change":"2024-09-14T12:16:41.436681+0000","last_active":"2024-09-14T12:16:41.436681+0000","last_peered":"2024-09-14T12:16:41.436681+0000","last_clean":"2024-09-14T12:16:41.436681+0000","last_became_active":"2024-09-14T11:17:25.617068+0000","last_became_peered":"2024-09-14T11:17:25.617068+0000","last_unstale":"2024-09-14T12:16:41.436681+0000","last_undegraded":"2024-09-14T12:16:41.436681+0000","last_fullsized":"2024-09-14T12:16:41.436681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.436586+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.436586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:49:34.771480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'334","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:49.568525+0000","last_change":"2024-09-14T12:16:49.568525+0000","last_active":"2024-09-14T12:16:49.568525+0000","last_peered":"2024-09-14T12:16:49.568525+0000","last_clean":"2024-09-14T12:16:49.568525+0000","last_became_active":"2024-09-14T11:17:27.635702+0000","last_became_peered":"2024-09-14T11:17:27.635702+0000","last_unstale":"2024-09-14T12:16:49.568525+0000","last_undegraded":"2024-09-14T12:16:49.568525+0000","last_fullsized":"2024-09-14T12:16:49.568525+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-14T12:16:49.568425+0000","last_clean_scrub_stamp":"2024-09-14T12:16:49.568425+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:19.040053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51654,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":1212,"num_write":436,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:40.505488+0000","last_change":"2024-09-14T12:16:40.505488+0000","last_active":"2024-09-14T12:16:40.505488+0000","last_peered":"2024-09-14T12:16:40.505488+0000","last_clean":"2024-09-14T12:16:40.505488+0000","last_became_active":"2024-09-14T11:17:29.642973+0000","last_became_peered":"2024-09-14T11:17:29.642973+0000","last_unstale":"2024-09-14T12:16:40.505488+0000","last_undegraded":"2024-09-14T12:16:40.505488+0000","last_fullsized":"2024-09-14T12:16:40.505488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:40.505400+0000","last_clean_scrub_stamp":"2024-09-14T12:16:40.505400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:26.146164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'144","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:56.940198+0000","last_change":"2024-09-14T12:16:56.940108+0000","last_active":"2024-09-14T12:16:56.940198+0000","last_peered":"2024-09-14T12:16:56.940198+0000","last_clean":"2024-09-14T12:16:56.940198+0000","last_became_active":"2024-09-14T11:17:31.658590+0000","last_became_peered":"2024-09-14T11:17:31.658590+0000","last_unstale":"2024-09-14T12:16:56.940198+0000","last_undegraded":"2024-09-14T12:16:56.940198+0000","last_fullsized":"2024-09-14T12:16:56.940198+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T12:16:56.940008+0000","last_clean_scrub_stamp":"2024-09-14T12:16:56.940008+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:04.385514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":184,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'928","reported_seq":2579,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.519388+0000","last_change":"2024-09-14T12:16:33.519388+0000","last_active":"2024-09-14T12:16:33.519388+0000","last_peered":"2024-09-14T12:16:33.519388+0000","last_clean":"2024-09-14T12:16:33.519388+0000","last_became_active":"2024-09-14T11:17:23.598181+0000","last_became_peered":"2024-09-14T11:17:23.598181+0000","last_unstale":"2024-09-14T12:16:33.519388+0000","last_undegraded":"2024-09-14T12:16:33.519388+0000","last_fullsized":"2024-09-14T12:16:33.519388+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'928","last_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_deep_scrub":"263'928","last_deep_scrub_stamp":"2024-09-14T12:16:33.519304+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.519304+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.269882+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4499,"num_read_kb":4032,"num_write":1256,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'348","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.882011+0000","last_change":"2024-09-14T12:16:22.882011+0000","last_active":"2024-09-14T12:16:22.882011+0000","last_peered":"2024-09-14T12:16:22.882011+0000","last_clean":"2024-09-14T12:16:22.882011+0000","last_became_active":"2024-09-14T11:17:21.587052+0000","last_became_peered":"2024-09-14T11:17:21.587052+0000","last_unstale":"2024-09-14T12:16:22.882011+0000","last_undegraded":"2024-09-14T12:16:22.882011+0000","last_fullsized":"2024-09-14T12:16:22.882011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:22.881926+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.881926+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:26.520282+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":661,"num_read_kb":18794,"num_write":1109,"num_write_kb":31617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.503912+0000","last_change":"2024-09-14T12:16:35.503912+0000","last_active":"2024-09-14T12:16:35.503912+0000","last_peered":"2024-09-14T12:16:35.503912+0000","last_clean":"2024-09-14T12:16:35.503912+0000","last_became_active":"2024-09-14T11:17:25.614496+0000","last_became_peered":"2024-09-14T11:17:25.614496+0000","last_unstale":"2024-09-14T12:16:35.503912+0000","last_undegraded":"2024-09-14T12:16:35.503912+0000","last_fullsized":"2024-09-14T12:16:35.503912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:35.503820+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.503820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:28.750327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'307","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.382617+0000","last_change":"2024-09-14T12:16:47.382617+0000","last_active":"2024-09-14T12:16:47.382617+0000","last_peered":"2024-09-14T12:16:47.382617+0000","last_clean":"2024-09-14T12:16:47.382617+0000","last_became_active":"2024-09-14T11:17:27.628176+0000","last_became_peered":"2024-09-14T11:17:27.628176+0000","last_unstale":"2024-09-14T12:16:47.382617+0000","last_undegraded":"2024-09-14T12:16:47.382617+0000","last_fullsized":"2024-09-14T12:16:47.382617+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-14T12:16:47.382533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.382533+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:00.688987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77460,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":502,"num_read_kb":1246,"num_write":418,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:50.069438+0000","last_change":"2024-09-14T12:16:50.069438+0000","last_active":"2024-09-14T12:16:50.069438+0000","last_peered":"2024-09-14T12:16:50.069438+0000","last_clean":"2024-09-14T12:16:50.069438+0000","last_became_active":"2024-09-14T11:17:29.646754+0000","last_became_peered":"2024-09-14T11:17:29.646754+0000","last_unstale":"2024-09-14T12:16:50.069438+0000","last_undegraded":"2024-09-14T12:16:50.069438+0000","last_fullsized":"2024-09-14T12:16:50.069438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:50.069325+0000","last_clean_scrub_stamp":"2024-09-14T12:16:50.069325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:11.352276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'449","reported_seq":2083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.477989+0000","last_change":"2024-09-14T12:16:31.477989+0000","last_active":"2024-09-14T12:16:31.477989+0000","last_peered":"2024-09-14T12:16:31.477989+0000","last_clean":"2024-09-14T12:16:31.477989+0000","last_became_active":"2024-09-14T11:17:23.593618+0000","last_became_peered":"2024-09-14T11:17:23.593618+0000","last_unstale":"2024-09-14T12:16:31.477989+0000","last_undegraded":"2024-09-14T12:16:31.477989+0000","last_fullsized":"2024-09-14T12:16:31.477989+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T12:16:31.477885+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.477885+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:41.643421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2584,"num_read_kb":2440,"num_write":525,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2805,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'340","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.509398+0000","last_change":"2024-09-14T12:16:24.509398+0000","last_active":"2024-09-14T12:16:24.509398+0000","last_peered":"2024-09-14T12:16:24.509398+0000","last_clean":"2024-09-14T12:16:24.509398+0000","last_became_active":"2024-09-14T11:17:21.580555+0000","last_became_peered":"2024-09-14T11:17:21.580555+0000","last_unstale":"2024-09-14T12:16:24.509398+0000","last_undegraded":"2024-09-14T12:16:24.509398+0000","last_fullsized":"2024-09-14T12:16:24.509398+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-14T12:16:24.509303+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.509303+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:37.841214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":777,"num_read_kb":38674,"num_write":1067,"num_write_kb":31186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.862261+0000","last_change":"2024-09-14T12:16:37.862176+0000","last_active":"2024-09-14T12:16:37.862261+0000","last_peered":"2024-09-14T12:16:37.862261+0000","last_clean":"2024-09-14T12:16:37.862261+0000","last_became_active":"2024-09-14T11:17:25.615928+0000","last_became_peered":"2024-09-14T11:17:25.615928+0000","last_unstale":"2024-09-14T12:16:37.862261+0000","last_undegraded":"2024-09-14T12:16:37.862261+0000","last_fullsized":"2024-09-14T12:16:37.862261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:37.862072+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.862072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:47.575762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'496","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.177124+0000","last_change":"2024-09-14T12:16:42.177068+0000","last_active":"2024-09-14T12:16:42.177124+0000","last_peered":"2024-09-14T12:16:42.177124+0000","last_clean":"2024-09-14T12:16:42.177124+0000","last_became_active":"2024-09-14T11:17:27.633285+0000","last_became_peered":"2024-09-14T11:17:27.633285+0000","last_unstale":"2024-09-14T12:16:42.177124+0000","last_undegraded":"2024-09-14T12:16:42.177124+0000","last_fullsized":"2024-09-14T12:16:42.177124+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T12:16:42.176992+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.176992+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.979936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98458,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":878,"num_read_kb":2075,"num_write":756,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.024350+0000","last_change":"2024-09-14T12:16:51.024287+0000","last_active":"2024-09-14T12:16:51.024350+0000","last_peered":"2024-09-14T12:16:51.024350+0000","last_clean":"2024-09-14T12:16:51.024350+0000","last_became_active":"2024-09-14T11:17:29.645332+0000","last_became_peered":"2024-09-14T11:17:29.645332+0000","last_unstale":"2024-09-14T12:16:51.024350+0000","last_undegraded":"2024-09-14T12:16:51.024350+0000","last_fullsized":"2024-09-14T12:16:51.024350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.024168+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.024168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:45.115991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'188","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:59.555763+0000","last_change":"2024-09-14T12:16:59.555763+0000","last_active":"2024-09-14T12:16:59.555763+0000","last_peered":"2024-09-14T12:16:59.555763+0000","last_clean":"2024-09-14T12:16:59.555763+0000","last_became_active":"2024-09-14T11:17:31.657922+0000","last_became_peered":"2024-09-14T11:17:31.657922+0000","last_unstale":"2024-09-14T12:16:59.555763+0000","last_undegraded":"2024-09-14T12:16:59.555763+0000","last_fullsized":"2024-09-14T12:16:59.555763+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T12:16:59.555653+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T12:16:59.555653+0000","last_clean_scrub_stamp":"2024-09-14T12:16:59.555653+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:37.213026+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":236,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'840","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.898390+0000","last_change":"2024-09-14T12:16:32.898323+0000","last_active":"2024-09-14T12:16:32.898390+0000","last_peered":"2024-09-14T12:16:32.898390+0000","last_clean":"2024-09-14T12:16:32.898390+0000","last_became_active":"2024-09-14T11:17:23.593454+0000","last_became_peered":"2024-09-14T11:17:23.593454+0000","last_unstale":"2024-09-14T12:16:32.898390+0000","last_undegraded":"2024-09-14T12:16:32.898390+0000","last_fullsized":"2024-09-14T12:16:32.898390+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'840","last_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_deep_scrub":"263'840","last_deep_scrub_stamp":"2024-09-14T12:16:32.898237+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.898237+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:01.360421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4188,"num_read_kb":3802,"num_write":1093,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'404","reported_seq":1061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.069459+0000","last_change":"2024-09-14T12:16:22.069459+0000","last_active":"2024-09-14T12:16:22.069459+0000","last_peered":"2024-09-14T12:16:22.069459+0000","last_clean":"2024-09-14T12:16:22.069459+0000","last_became_active":"2024-09-14T11:17:21.579493+0000","last_became_peered":"2024-09-14T11:17:21.579493+0000","last_unstale":"2024-09-14T12:16:22.069459+0000","last_undegraded":"2024-09-14T12:16:22.069459+0000","last_fullsized":"2024-09-14T12:16:22.069459+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T12:16:22.069380+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.069380+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:18.179502+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":5750,"num_write":1256,"num_write_kb":35454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.486620+0000","last_change":"2024-09-14T12:16:36.486620+0000","last_active":"2024-09-14T12:16:36.486620+0000","last_peered":"2024-09-14T12:16:36.486620+0000","last_clean":"2024-09-14T12:16:36.486620+0000","last_became_active":"2024-09-14T11:17:25.614863+0000","last_became_peered":"2024-09-14T11:17:25.614863+0000","last_unstale":"2024-09-14T12:16:36.486620+0000","last_undegraded":"2024-09-14T12:16:36.486620+0000","last_fullsized":"2024-09-14T12:16:36.486620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:36.486533+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.486533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:47.840538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'321","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.350267+0000","last_change":"2024-09-14T12:16:48.350195+0000","last_active":"2024-09-14T12:16:48.350267+0000","last_peered":"2024-09-14T12:16:48.350267+0000","last_clean":"2024-09-14T12:16:48.350267+0000","last_became_active":"2024-09-14T11:17:27.631543+0000","last_became_peered":"2024-09-14T11:17:27.631543+0000","last_unstale":"2024-09-14T12:16:48.350267+0000","last_undegraded":"2024-09-14T12:16:48.350267+0000","last_fullsized":"2024-09-14T12:16:48.350267+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T12:16:48.350063+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.350063+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:00.713091+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":518,"num_read_kb":1111,"num_write":430,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:45.082063+0000","last_change":"2024-09-14T12:16:45.081996+0000","last_active":"2024-09-14T12:16:45.082063+0000","last_peered":"2024-09-14T12:16:45.082063+0000","last_clean":"2024-09-14T12:16:45.082063+0000","last_became_active":"2024-09-14T11:17:29.638437+0000","last_became_peered":"2024-09-14T11:17:29.638437+0000","last_unstale":"2024-09-14T12:16:45.082063+0000","last_undegraded":"2024-09-14T12:16:45.082063+0000","last_fullsized":"2024-09-14T12:16:45.082063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:45.081910+0000","last_clean_scrub_stamp":"2024-09-14T12:16:45.081910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:44.716876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'205","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.455049+0000","last_change":"2024-09-14T12:16:44.455049+0000","last_active":"2024-09-14T12:16:44.455049+0000","last_peered":"2024-09-14T12:16:44.455049+0000","last_clean":"2024-09-14T12:16:44.455049+0000","last_became_active":"2024-09-14T11:17:31.654243+0000","last_became_peered":"2024-09-14T11:17:31.654243+0000","last_unstale":"2024-09-14T12:16:44.455049+0000","last_undegraded":"2024-09-14T12:16:44.455049+0000","last_fullsized":"2024-09-14T12:16:44.455049+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T12:16:44.454939+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.454939+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:36.039287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":267,"num_read_kb":251,"num_write":565,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'416","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.571088+0000","last_change":"2024-09-14T12:16:35.571028+0000","last_active":"2024-09-14T12:16:35.571088+0000","last_peered":"2024-09-14T12:16:35.571088+0000","last_clean":"2024-09-14T12:16:35.571088+0000","last_became_active":"2024-09-14T11:17:23.597460+0000","last_became_peered":"2024-09-14T11:17:23.597460+0000","last_unstale":"2024-09-14T12:16:35.571088+0000","last_undegraded":"2024-09-14T12:16:35.571088+0000","last_fullsized":"2024-09-14T12:16:35.571088+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:35.570946+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.570946+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:00.910326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2245,"num_read_kb":2127,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'367","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:22.510204+0000","last_change":"2024-09-14T12:16:22.510136+0000","last_active":"2024-09-14T12:16:22.510204+0000","last_peered":"2024-09-14T12:16:22.510204+0000","last_clean":"2024-09-14T12:16:22.510204+0000","last_became_active":"2024-09-14T11:17:21.572421+0000","last_became_peered":"2024-09-14T11:17:21.572421+0000","last_unstale":"2024-09-14T12:16:22.510204+0000","last_undegraded":"2024-09-14T12:16:22.510204+0000","last_fullsized":"2024-09-14T12:16:22.510204+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T12:16:22.510039+0000","last_clean_scrub_stamp":"2024-09-14T12:16:22.510039+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:28.698454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":55641,"num_write":1285,"num_write_kb":34167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:43.617725+0000","last_change":"2024-09-14T12:16:43.617674+0000","last_active":"2024-09-14T12:16:43.617725+0000","last_peered":"2024-09-14T12:16:43.617725+0000","last_clean":"2024-09-14T12:16:43.617725+0000","last_became_active":"2024-09-14T11:17:25.614953+0000","last_became_peered":"2024-09-14T11:17:25.614953+0000","last_unstale":"2024-09-14T12:16:43.617725+0000","last_undegraded":"2024-09-14T12:16:43.617725+0000","last_fullsized":"2024-09-14T12:16:43.617725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:43.617596+0000","last_clean_scrub_stamp":"2024-09-14T12:16:43.617596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:29.744676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'308","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.549558+0000","last_change":"2024-09-14T12:16:47.549558+0000","last_active":"2024-09-14T12:16:47.549558+0000","last_peered":"2024-09-14T12:16:47.549558+0000","last_clean":"2024-09-14T12:16:47.549558+0000","last_became_active":"2024-09-14T11:17:27.631281+0000","last_became_peered":"2024-09-14T11:17:27.631281+0000","last_unstale":"2024-09-14T12:16:47.549558+0000","last_undegraded":"2024-09-14T12:16:47.549558+0000","last_fullsized":"2024-09-14T12:16:47.549558+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:47.549469+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.549469+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:38.899315+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53208,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":494,"num_read_kb":1139,"num_write":406,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.118138+0000","last_change":"2024-09-14T12:16:44.118086+0000","last_active":"2024-09-14T12:16:44.118138+0000","last_peered":"2024-09-14T12:16:44.118138+0000","last_clean":"2024-09-14T12:16:44.118138+0000","last_became_active":"2024-09-14T11:17:29.642750+0000","last_became_peered":"2024-09-14T11:17:29.642750+0000","last_unstale":"2024-09-14T12:16:44.118138+0000","last_undegraded":"2024-09-14T12:16:44.118138+0000","last_fullsized":"2024-09-14T12:16:44.118138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.117999+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.117999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:36.635428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'103","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.865701+0000","last_change":"2024-09-14T12:16:54.865701+0000","last_active":"2024-09-14T12:16:54.865701+0000","last_peered":"2024-09-14T12:16:54.865701+0000","last_clean":"2024-09-14T12:16:54.865701+0000","last_became_active":"2024-09-14T11:17:31.657409+0000","last_became_peered":"2024-09-14T11:17:31.657409+0000","last_unstale":"2024-09-14T12:16:54.865701+0000","last_undegraded":"2024-09-14T12:16:54.865701+0000","last_fullsized":"2024-09-14T12:16:54.865701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'103","last_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_deep_scrub":"263'103","last_deep_scrub_stamp":"2024-09-14T12:16:54.865614+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.865614+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:23.014343+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":229,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'485","reported_seq":2031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.218763+0000","last_change":"2024-09-14T12:16:26.218673+0000","last_active":"2024-09-14T12:16:26.218763+0000","last_peered":"2024-09-14T12:16:26.218763+0000","last_clean":"2024-09-14T12:16:26.218763+0000","last_became_active":"2024-09-14T11:17:23.593731+0000","last_became_peered":"2024-09-14T11:17:23.593731+0000","last_unstale":"2024-09-14T12:16:26.218763+0000","last_undegraded":"2024-09-14T12:16:26.218763+0000","last_fullsized":"2024-09-14T12:16:26.218763+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'485","last_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_deep_scrub":"263'485","last_deep_scrub_stamp":"2024-09-14T12:16:26.218577+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.218577+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:32.733118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2384,"num_write":595,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'441","reported_seq":1184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.912233+0000","last_change":"2024-09-14T12:16:21.912181+0000","last_active":"2024-09-14T12:16:21.912233+0000","last_peered":"2024-09-14T12:16:21.912233+0000","last_clean":"2024-09-14T12:16:21.912233+0000","last_became_active":"2024-09-14T11:17:21.582593+0000","last_became_peered":"2024-09-14T11:17:21.582593+0000","last_unstale":"2024-09-14T12:16:21.912233+0000","last_undegraded":"2024-09-14T12:16:21.912233+0000","last_fullsized":"2024-09-14T12:16:21.912233+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T12:16:21.912110+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.912110+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:39.992075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1189,"num_read_kb":773,"num_write":1309,"num_write_kb":32758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.198249+0000","last_change":"2024-09-14T12:16:39.198180+0000","last_active":"2024-09-14T12:16:39.198249+0000","last_peered":"2024-09-14T12:16:39.198249+0000","last_clean":"2024-09-14T12:16:39.198249+0000","last_became_active":"2024-09-14T11:17:25.605712+0000","last_became_peered":"2024-09-14T11:17:25.605712+0000","last_unstale":"2024-09-14T12:16:39.198249+0000","last_undegraded":"2024-09-14T12:16:39.198249+0000","last_fullsized":"2024-09-14T12:16:39.198249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:39.198089+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.198089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:04.354915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:47.599746+0000","last_change":"2024-09-14T12:16:47.599681+0000","last_active":"2024-09-14T12:16:47.599746+0000","last_peered":"2024-09-14T12:16:47.599746+0000","last_clean":"2024-09-14T12:16:47.599746+0000","last_became_active":"2024-09-14T11:17:27.625350+0000","last_became_peered":"2024-09-14T11:17:27.625350+0000","last_unstale":"2024-09-14T12:16:47.599746+0000","last_undegraded":"2024-09-14T12:16:47.599746+0000","last_fullsized":"2024-09-14T12:16:47.599746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T12:16:47.599583+0000","last_clean_scrub_stamp":"2024-09-14T12:16:47.599583+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:21.557554+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'781","reported_seq":2545,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.463071+0000","last_change":"2024-09-14T12:16:42.463071+0000","last_active":"2024-09-14T12:16:42.463071+0000","last_peered":"2024-09-14T12:16:42.463071+0000","last_clean":"2024-09-14T12:16:42.463071+0000","last_became_active":"2024-09-14T11:17:29.641323+0000","last_became_peered":"2024-09-14T11:17:29.641323+0000","last_unstale":"2024-09-14T12:16:42.463071+0000","last_undegraded":"2024-09-14T12:16:42.463071+0000","last_fullsized":"2024-09-14T12:16:42.463071+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'781","last_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_deep_scrub":"263'781","last_deep_scrub_stamp":"2024-09-14T12:16:42.462978+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.462978+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:02.034354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'127","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.281509+0000","last_change":"2024-09-14T12:16:53.281509+0000","last_active":"2024-09-14T12:16:53.281509+0000","last_peered":"2024-09-14T12:16:53.281509+0000","last_clean":"2024-09-14T12:16:53.281509+0000","last_became_active":"2024-09-14T11:17:31.654633+0000","last_became_peered":"2024-09-14T11:17:31.654633+0000","last_unstale":"2024-09-14T12:16:53.281509+0000","last_undegraded":"2024-09-14T12:16:53.281509+0000","last_fullsized":"2024-09-14T12:16:53.281509+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T12:16:53.281413+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.281413+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:45.751283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":122,"num_write":324,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'484","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.602985+0000","last_change":"2024-09-14T12:16:33.602934+0000","last_active":"2024-09-14T12:16:33.602985+0000","last_peered":"2024-09-14T12:16:33.602985+0000","last_clean":"2024-09-14T12:16:33.602985+0000","last_became_active":"2024-09-14T11:17:23.603054+0000","last_became_peered":"2024-09-14T11:17:23.603054+0000","last_unstale":"2024-09-14T12:16:33.602985+0000","last_undegraded":"2024-09-14T12:16:33.602985+0000","last_fullsized":"2024-09-14T12:16:33.602985+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'484","last_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_deep_scrub":"263'484","last_deep_scrub_stamp":"2024-09-14T12:16:33.602835+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.602835+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:59.909062+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2462,"num_write":614,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3026,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'372","reported_seq":1113,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.790422+0000","last_change":"2024-09-14T12:16:23.790342+0000","last_active":"2024-09-14T12:16:23.790422+0000","last_peered":"2024-09-14T12:16:23.790422+0000","last_clean":"2024-09-14T12:16:23.790422+0000","last_became_active":"2024-09-14T11:17:21.583987+0000","last_became_peered":"2024-09-14T11:17:21.583987+0000","last_unstale":"2024-09-14T12:16:23.790422+0000","last_undegraded":"2024-09-14T12:16:23.790422+0000","last_fullsized":"2024-09-14T12:16:23.790422+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:23.790199+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.790199+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:45.806183+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079967,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":665,"num_read_kb":45610,"num_write":1043,"num_write_kb":33264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.390722+0000","last_change":"2024-09-14T12:16:42.390636+0000","last_active":"2024-09-14T12:16:42.390722+0000","last_peered":"2024-09-14T12:16:42.390722+0000","last_clean":"2024-09-14T12:16:42.390722+0000","last_became_active":"2024-09-14T11:17:25.617877+0000","last_became_peered":"2024-09-14T11:17:25.617877+0000","last_unstale":"2024-09-14T12:16:42.390722+0000","last_undegraded":"2024-09-14T12:16:42.390722+0000","last_fullsized":"2024-09-14T12:16:42.390722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.390528+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.390528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:38.711595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'324","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:48.996393+0000","last_change":"2024-09-14T12:16:48.996393+0000","last_active":"2024-09-14T12:16:48.996393+0000","last_peered":"2024-09-14T12:16:48.996393+0000","last_clean":"2024-09-14T12:16:48.996393+0000","last_became_active":"2024-09-14T11:17:27.631704+0000","last_became_peered":"2024-09-14T11:17:27.631704+0000","last_unstale":"2024-09-14T12:16:48.996393+0000","last_undegraded":"2024-09-14T12:16:48.996393+0000","last_fullsized":"2024-09-14T12:16:48.996393+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T12:16:48.996286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:48.996286+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:54.778486+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46956,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":989,"num_write":382,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.096297+0000","last_change":"2024-09-14T12:16:51.096297+0000","last_active":"2024-09-14T12:16:51.096297+0000","last_peered":"2024-09-14T12:16:51.096297+0000","last_clean":"2024-09-14T12:16:51.096297+0000","last_became_active":"2024-09-14T11:17:29.642538+0000","last_became_peered":"2024-09-14T11:17:29.642538+0000","last_unstale":"2024-09-14T12:16:51.096297+0000","last_undegraded":"2024-09-14T12:16:51.096297+0000","last_fullsized":"2024-09-14T12:16:51.096297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.096182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.096182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:46.596631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'168","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:55.228359+0000","last_change":"2024-09-14T12:16:55.228359+0000","last_active":"2024-09-14T12:16:55.228359+0000","last_peered":"2024-09-14T12:16:55.228359+0000","last_clean":"2024-09-14T12:16:55.228359+0000","last_became_active":"2024-09-14T11:17:31.659273+0000","last_became_peered":"2024-09-14T11:17:31.659273+0000","last_unstale":"2024-09-14T12:16:55.228359+0000","last_undegraded":"2024-09-14T12:16:55.228359+0000","last_fullsized":"2024-09-14T12:16:55.228359+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'168","last_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_deep_scrub":"263'168","last_deep_scrub_stamp":"2024-09-14T12:16:55.228265+0000","last_clean_scrub_stamp":"2024-09-14T12:16:55.228265+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:59.821910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":816,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":377,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'825","reported_seq":2440,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.565451+0000","last_change":"2024-09-14T12:16:28.565380+0000","last_active":"2024-09-14T12:16:28.565451+0000","last_peered":"2024-09-14T12:16:28.565451+0000","last_clean":"2024-09-14T12:16:28.565451+0000","last_became_active":"2024-09-14T11:17:23.603010+0000","last_became_peered":"2024-09-14T11:17:23.603010+0000","last_unstale":"2024-09-14T12:16:28.565451+0000","last_undegraded":"2024-09-14T12:16:28.565451+0000","last_fullsized":"2024-09-14T12:16:28.565451+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'825","last_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_deep_scrub":"263'825","last_deep_scrub_stamp":"2024-09-14T12:16:28.565300+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.565300+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:29.751301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4116,"num_read_kb":3738,"num_write":1103,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'403","reported_seq":1269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.799165+0000","last_change":"2024-09-14T12:16:25.799080+0000","last_active":"2024-09-14T12:16:25.799165+0000","last_peered":"2024-09-14T12:16:25.799165+0000","last_clean":"2024-09-14T12:16:25.799165+0000","last_became_active":"2024-09-14T11:17:21.585436+0000","last_became_peered":"2024-09-14T11:17:21.585436+0000","last_unstale":"2024-09-14T12:16:25.799165+0000","last_undegraded":"2024-09-14T12:16:25.799165+0000","last_fullsized":"2024-09-14T12:16:25.799165+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-14T12:16:25.798955+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.798955+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.565631+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1324,"num_read_kb":37458,"num_write":1300,"num_write_kb":30468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:44.862631+0000","last_change":"2024-09-14T12:16:44.862542+0000","last_active":"2024-09-14T12:16:44.862631+0000","last_peered":"2024-09-14T12:16:44.862631+0000","last_clean":"2024-09-14T12:16:44.862631+0000","last_became_active":"2024-09-14T11:17:25.616760+0000","last_became_peered":"2024-09-14T11:17:25.616760+0000","last_unstale":"2024-09-14T12:16:44.862631+0000","last_undegraded":"2024-09-14T12:16:44.862631+0000","last_fullsized":"2024-09-14T12:16:44.862631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:44.862406+0000","last_clean_scrub_stamp":"2024-09-14T12:16:44.862406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:59.669337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.955854+0000","last_change":"2024-09-14T12:16:46.955854+0000","last_active":"2024-09-14T12:16:46.955854+0000","last_peered":"2024-09-14T12:16:46.955854+0000","last_clean":"2024-09-14T12:16:46.955854+0000","last_became_active":"2024-09-14T11:17:27.635436+0000","last_became_peered":"2024-09-14T11:17:27.635436+0000","last_unstale":"2024-09-14T12:16:46.955854+0000","last_undegraded":"2024-09-14T12:16:46.955854+0000","last_fullsized":"2024-09-14T12:16:46.955854+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-14T12:16:46.955737+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.955737+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:59.807750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46067,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":1076,"num_write":376,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:41.482275+0000","last_change":"2024-09-14T12:16:41.482275+0000","last_active":"2024-09-14T12:16:41.482275+0000","last_peered":"2024-09-14T12:16:41.482275+0000","last_clean":"2024-09-14T12:16:41.482275+0000","last_became_active":"2024-09-14T11:17:29.642372+0000","last_became_peered":"2024-09-14T11:17:29.642372+0000","last_unstale":"2024-09-14T12:16:41.482275+0000","last_undegraded":"2024-09-14T12:16:41.482275+0000","last_fullsized":"2024-09-14T12:16:41.482275+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:41.482182+0000","last_clean_scrub_stamp":"2024-09-14T12:16:41.482182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:09.893270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'102","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:57.551081+0000","last_change":"2024-09-14T12:16:57.551081+0000","last_active":"2024-09-14T12:16:57.551081+0000","last_peered":"2024-09-14T12:16:57.551081+0000","last_clean":"2024-09-14T12:16:57.551081+0000","last_became_active":"2024-09-14T11:17:31.652087+0000","last_became_peered":"2024-09-14T11:17:31.652087+0000","last_unstale":"2024-09-14T12:16:57.551081+0000","last_undegraded":"2024-09-14T12:16:57.551081+0000","last_fullsized":"2024-09-14T12:16:57.551081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-14T12:16:57.550997+0000","last_clean_scrub_stamp":"2024-09-14T12:16:57.550997+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:04.907290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":231,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'468","reported_seq":2032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.595539+0000","last_change":"2024-09-14T12:16:36.595539+0000","last_active":"2024-09-14T12:16:36.595539+0000","last_peered":"2024-09-14T12:16:36.595539+0000","last_clean":"2024-09-14T12:16:36.595539+0000","last_became_active":"2024-09-14T11:17:23.597619+0000","last_became_peered":"2024-09-14T11:17:23.597619+0000","last_unstale":"2024-09-14T12:16:36.595539+0000","last_undegraded":"2024-09-14T12:16:36.595539+0000","last_fullsized":"2024-09-14T12:16:36.595539+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-14T12:16:36.595458+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.595458+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:19.327912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2658,"num_read_kb":2504,"num_write":562,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'363","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.521115+0000","last_change":"2024-09-14T12:16:25.520987+0000","last_active":"2024-09-14T12:16:25.521115+0000","last_peered":"2024-09-14T12:16:25.521115+0000","last_clean":"2024-09-14T12:16:25.521115+0000","last_became_active":"2024-09-14T11:17:21.588038+0000","last_became_peered":"2024-09-14T11:17:21.588038+0000","last_unstale":"2024-09-14T12:16:25.521115+0000","last_undegraded":"2024-09-14T12:16:25.521115+0000","last_fullsized":"2024-09-14T12:16:25.521115+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T12:16:25.520888+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.520888+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.356077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":9738,"num_write":1164,"num_write_kb":35533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:42.633463+0000","last_change":"2024-09-14T12:16:42.633463+0000","last_active":"2024-09-14T12:16:42.633463+0000","last_peered":"2024-09-14T12:16:42.633463+0000","last_clean":"2024-09-14T12:16:42.633463+0000","last_became_active":"2024-09-14T11:17:25.610279+0000","last_became_peered":"2024-09-14T11:17:25.610279+0000","last_unstale":"2024-09-14T12:16:42.633463+0000","last_undegraded":"2024-09-14T12:16:42.633463+0000","last_fullsized":"2024-09-14T12:16:42.633463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:42.633379+0000","last_clean_scrub_stamp":"2024-09-14T12:16:42.633379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:04.343825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'258","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.468483+0000","last_change":"2024-09-14T12:16:53.468390+0000","last_active":"2024-09-14T12:16:53.468483+0000","last_peered":"2024-09-14T12:16:53.468483+0000","last_clean":"2024-09-14T12:16:53.468483+0000","last_became_active":"2024-09-14T11:17:27.631055+0000","last_became_peered":"2024-09-14T11:17:27.631055+0000","last_unstale":"2024-09-14T12:16:53.468483+0000","last_undegraded":"2024-09-14T12:16:53.468483+0000","last_fullsized":"2024-09-14T12:16:53.468483+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'258","last_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_deep_scrub":"263'258","last_deep_scrub_stamp":"2024-09-14T12:16:53.468286+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.468286+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:13:55.124534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46060,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":1096,"num_write":366,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:51.613624+0000","last_change":"2024-09-14T12:16:51.613551+0000","last_active":"2024-09-14T12:16:51.613624+0000","last_peered":"2024-09-14T12:16:51.613624+0000","last_clean":"2024-09-14T12:16:51.613624+0000","last_became_active":"2024-09-14T11:17:29.642775+0000","last_became_peered":"2024-09-14T11:17:29.642775+0000","last_unstale":"2024-09-14T12:16:51.613624+0000","last_undegraded":"2024-09-14T12:16:51.613624+0000","last_fullsized":"2024-09-14T12:16:51.613624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:51.613450+0000","last_clean_scrub_stamp":"2024-09-14T12:16:51.613450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:42.650909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'191","reported_seq":1659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:54.260076+0000","last_change":"2024-09-14T12:16:54.260076+0000","last_active":"2024-09-14T12:16:54.260076+0000","last_peered":"2024-09-14T12:16:54.260076+0000","last_clean":"2024-09-14T12:16:54.260076+0000","last_became_active":"2024-09-14T11:17:31.657130+0000","last_became_peered":"2024-09-14T11:17:31.657130+0000","last_unstale":"2024-09-14T12:16:54.260076+0000","last_undegraded":"2024-09-14T12:16:54.260076+0000","last_fullsized":"2024-09-14T12:16:54.260076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-14T12:16:54.259974+0000","last_clean_scrub_stamp":"2024-09-14T12:16:54.259974+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:28.566983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1177,"num_read_kb":1176,"num_write":415,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'591","reported_seq":2199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.580916+0000","last_change":"2024-09-14T12:16:29.580916+0000","last_active":"2024-09-14T12:16:29.580916+0000","last_peered":"2024-09-14T12:16:29.580916+0000","last_clean":"2024-09-14T12:16:29.580916+0000","last_became_active":"2024-09-14T11:17:23.593721+0000","last_became_peered":"2024-09-14T11:17:23.593721+0000","last_unstale":"2024-09-14T12:16:29.580916+0000","last_undegraded":"2024-09-14T12:16:29.580916+0000","last_fullsized":"2024-09-14T12:16:29.580916+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'591","last_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_deep_scrub":"263'591","last_deep_scrub_stamp":"2024-09-14T12:16:29.580819+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.580819+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:36.205569+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3010,"num_read_kb":2746,"num_write":756,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'359","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.913612+0000","last_change":"2024-09-14T12:16:23.913612+0000","last_active":"2024-09-14T12:16:23.913612+0000","last_peered":"2024-09-14T12:16:23.913612+0000","last_clean":"2024-09-14T12:16:23.913612+0000","last_became_active":"2024-09-14T11:17:55.705741+0000","last_became_peered":"2024-09-14T11:17:55.705741+0000","last_unstale":"2024-09-14T12:16:23.913612+0000","last_undegraded":"2024-09-14T12:16:23.913612+0000","last_fullsized":"2024-09-14T12:16:23.913612+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:23.913491+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.913491+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:11.317852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":9181,"num_write":1146,"num_write_kb":24750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.227953+0000","last_change":"2024-09-14T12:16:38.227953+0000","last_active":"2024-09-14T12:16:38.227953+0000","last_peered":"2024-09-14T12:16:38.227953+0000","last_clean":"2024-09-14T12:16:38.227953+0000","last_became_active":"2024-09-14T11:17:25.611152+0000","last_became_peered":"2024-09-14T11:17:25.611152+0000","last_unstale":"2024-09-14T12:16:38.227953+0000","last_undegraded":"2024-09-14T12:16:38.227953+0000","last_fullsized":"2024-09-14T12:16:38.227953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T12:16:38.227869+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.227869+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:50.267903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'333","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:46.592967+0000","last_change":"2024-09-14T12:16:46.592874+0000","last_active":"2024-09-14T12:16:46.592967+0000","last_peered":"2024-09-14T12:16:46.592967+0000","last_clean":"2024-09-14T12:16:46.592967+0000","last_became_active":"2024-09-14T11:17:27.631290+0000","last_became_peered":"2024-09-14T11:17:27.631290+0000","last_unstale":"2024-09-14T12:16:46.592967+0000","last_undegraded":"2024-09-14T12:16:46.592967+0000","last_fullsized":"2024-09-14T12:16:46.592967+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:46.592758+0000","last_clean_scrub_stamp":"2024-09-14T12:16:46.592758+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:46.826509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1227,"num_write":442,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:52.130585+0000","last_change":"2024-09-14T12:16:52.130512+0000","last_active":"2024-09-14T12:16:52.130585+0000","last_peered":"2024-09-14T12:16:52.130585+0000","last_clean":"2024-09-14T12:16:52.130585+0000","last_became_active":"2024-09-14T11:17:29.642411+0000","last_became_peered":"2024-09-14T11:17:29.642411+0000","last_unstale":"2024-09-14T12:16:52.130585+0000","last_undegraded":"2024-09-14T12:16:52.130585+0000","last_fullsized":"2024-09-14T12:16:52.130585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:16:52.130423+0000","last_clean_scrub_stamp":"2024-09-14T12:16:52.130423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:21.040185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'101","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:53.641136+0000","last_change":"2024-09-14T12:16:53.641136+0000","last_active":"2024-09-14T12:16:53.641136+0000","last_peered":"2024-09-14T12:16:53.641136+0000","last_clean":"2024-09-14T12:16:53.641136+0000","last_became_active":"2024-09-14T11:17:31.656131+0000","last_became_peered":"2024-09-14T11:17:31.656131+0000","last_unstale":"2024-09-14T12:16:53.641136+0000","last_undegraded":"2024-09-14T12:16:53.641136+0000","last_fullsized":"2024-09-14T12:16:53.641136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'101","last_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_deep_scrub":"263'101","last_deep_scrub_stamp":"2024-09-14T12:16:53.641038+0000","last_clean_scrub_stamp":"2024-09-14T12:16:53.641038+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:10.270684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":96,"num_write":230,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'541","reported_seq":2222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.161351+0000","last_change":"2024-09-14T12:16:35.161351+0000","last_active":"2024-09-14T12:16:35.161351+0000","last_peered":"2024-09-14T12:16:35.161351+0000","last_clean":"2024-09-14T12:16:35.161351+0000","last_became_active":"2024-09-14T11:17:23.600590+0000","last_became_peered":"2024-09-14T11:17:23.600590+0000","last_unstale":"2024-09-14T12:16:35.161351+0000","last_undegraded":"2024-09-14T12:16:35.161351+0000","last_fullsized":"2024-09-14T12:16:35.161351+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'541","last_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_deep_scrub":"263'541","last_deep_scrub_stamp":"2024-09-14T12:16:35.161259+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.161259+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:47.150238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2939,"num_read_kb":2724,"num_write":683,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'399","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.437493+0000","last_change":"2024-09-14T12:16:26.437493+0000","last_active":"2024-09-14T12:16:26.437493+0000","last_peered":"2024-09-14T12:16:26.437493+0000","last_clean":"2024-09-14T12:16:26.437493+0000","last_became_active":"2024-09-14T11:17:21.582246+0000","last_became_peered":"2024-09-14T11:17:21.582246+0000","last_unstale":"2024-09-14T12:16:26.437493+0000","last_undegraded":"2024-09-14T12:16:26.437493+0000","last_fullsized":"2024-09-14T12:16:26.437493+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:26.437376+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.437376+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:56.164832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":657,"num_read_kb":34326,"num_write":1264,"num_write_kb":29870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'836","reported_seq":2425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.160886+0000","last_change":"2024-09-14T12:16:34.160886+0000","last_active":"2024-09-14T12:16:34.160886+0000","last_peered":"2024-09-14T12:16:34.160886+0000","last_clean":"2024-09-14T12:16:34.160886+0000","last_became_active":"2024-09-14T11:17:23.592850+0000","last_became_peered":"2024-09-14T11:17:23.592850+0000","last_unstale":"2024-09-14T12:16:34.160886+0000","last_undegraded":"2024-09-14T12:16:34.160886+0000","last_fullsized":"2024-09-14T12:16:34.160886+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'836","last_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_deep_scrub":"263'836","last_deep_scrub_stamp":"2024-09-14T12:16:34.160775+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.160775+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:02.536094+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4090,"num_read_kb":3694,"num_write":1112,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'458","reported_seq":1177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.178320+0000","last_change":"2024-09-14T12:16:24.178320+0000","last_active":"2024-09-14T12:16:24.178320+0000","last_peered":"2024-09-14T12:16:24.178320+0000","last_clean":"2024-09-14T12:16:24.178320+0000","last_became_active":"2024-09-14T11:17:21.586716+0000","last_became_peered":"2024-09-14T11:17:21.586716+0000","last_unstale":"2024-09-14T12:16:24.178320+0000","last_undegraded":"2024-09-14T12:16:24.178320+0000","last_fullsized":"2024-09-14T12:16:24.178320+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T12:16:24.178222+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.178222+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:00.886938+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":770,"num_read_kb":108296,"num_write":1392,"num_write_kb":54937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'491","reported_seq":2184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.910713+0000","last_change":"2024-09-14T12:16:38.910713+0000","last_active":"2024-09-14T12:16:38.910713+0000","last_peered":"2024-09-14T12:16:38.910713+0000","last_clean":"2024-09-14T12:16:38.910713+0000","last_became_active":"2024-09-14T11:17:23.593460+0000","last_became_peered":"2024-09-14T11:17:23.593460+0000","last_unstale":"2024-09-14T12:16:38.910713+0000","last_undegraded":"2024-09-14T12:16:38.910713+0000","last_fullsized":"2024-09-14T12:16:38.910713+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T12:16:38.910624+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.910624+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:52.858404+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2777,"num_read_kb":2620,"num_write":562,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'337","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.773355+0000","last_change":"2024-09-14T12:16:26.773355+0000","last_active":"2024-09-14T12:16:26.773355+0000","last_peered":"2024-09-14T12:16:26.773355+0000","last_clean":"2024-09-14T12:16:26.773355+0000","last_became_active":"2024-09-14T11:17:21.586459+0000","last_became_peered":"2024-09-14T11:17:21.586459+0000","last_unstale":"2024-09-14T12:16:26.773355+0000","last_undegraded":"2024-09-14T12:16:26.773355+0000","last_fullsized":"2024-09-14T12:16:26.773355+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'337","last_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_deep_scrub":"263'337","last_deep_scrub_stamp":"2024-09-14T12:16:26.773234+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.773234+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:32.185869+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":31259,"num_write":1097,"num_write_kb":23628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'1203","reported_seq":2742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.050987+0000","last_change":"2024-09-14T12:16:29.050987+0000","last_active":"2024-09-14T12:16:29.050987+0000","last_peered":"2024-09-14T12:16:29.050987+0000","last_clean":"2024-09-14T12:16:29.050987+0000","last_became_active":"2024-09-14T11:17:23.592451+0000","last_became_peered":"2024-09-14T11:17:23.592451+0000","last_unstale":"2024-09-14T12:16:29.050987+0000","last_undegraded":"2024-09-14T12:16:29.050987+0000","last_fullsized":"2024-09-14T12:16:29.050987+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1203","last_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_deep_scrub":"263'1203","last_deep_scrub_stamp":"2024-09-14T12:16:29.050902+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.050902+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":1100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:27.737996+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5426,"num_read_kb":4793,"num_write":1666,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.892822+0000","last_change":"2024-09-14T12:16:24.892822+0000","last_active":"2024-09-14T12:16:24.892822+0000","last_peered":"2024-09-14T12:16:24.892822+0000","last_clean":"2024-09-14T12:16:24.892822+0000","last_became_active":"2024-09-14T11:17:21.584929+0000","last_became_peered":"2024-09-14T11:17:21.584929+0000","last_unstale":"2024-09-14T12:16:24.892822+0000","last_undegraded":"2024-09-14T12:16:24.892822+0000","last_fullsized":"2024-09-14T12:16:24.892822+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T12:16:24.892704+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.892704+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:06.999544+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":720,"num_read_kb":15201,"num_write":1292,"num_write_kb":36138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'920","reported_seq":2583,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:39.627418+0000","last_change":"2024-09-14T12:16:39.627418+0000","last_active":"2024-09-14T12:16:39.627418+0000","last_peered":"2024-09-14T12:16:39.627418+0000","last_clean":"2024-09-14T12:16:39.627418+0000","last_became_active":"2024-09-14T11:17:23.600933+0000","last_became_peered":"2024-09-14T11:17:23.600933+0000","last_unstale":"2024-09-14T12:16:39.627418+0000","last_undegraded":"2024-09-14T12:16:39.627418+0000","last_fullsized":"2024-09-14T12:16:39.627418+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'920","last_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_deep_scrub":"263'920","last_deep_scrub_stamp":"2024-09-14T12:16:39.627337+0000","last_clean_scrub_stamp":"2024-09-14T12:16:39.627337+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":900,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:59.027510+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6573,"num_read_kb":6081,"num_write":1448,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'308","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:26.509875+0000","last_change":"2024-09-14T12:16:26.509875+0000","last_active":"2024-09-14T12:16:26.509875+0000","last_peered":"2024-09-14T12:16:26.509875+0000","last_clean":"2024-09-14T12:16:26.509875+0000","last_became_active":"2024-09-14T11:17:21.583940+0000","last_became_peered":"2024-09-14T11:17:21.583940+0000","last_unstale":"2024-09-14T12:16:26.509875+0000","last_undegraded":"2024-09-14T12:16:26.509875+0000","last_fullsized":"2024-09-14T12:16:26.509875+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-14T12:16:26.509772+0000","last_clean_scrub_stamp":"2024-09-14T12:16:26.509772+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.441645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306882,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":547,"num_read_kb":7710,"num_write":947,"num_write_kb":26959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'504","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.650472+0000","last_change":"2024-09-14T12:16:32.650472+0000","last_active":"2024-09-14T12:16:32.650472+0000","last_peered":"2024-09-14T12:16:32.650472+0000","last_clean":"2024-09-14T12:16:32.650472+0000","last_became_active":"2024-09-14T11:17:23.594543+0000","last_became_peered":"2024-09-14T11:17:23.594543+0000","last_unstale":"2024-09-14T12:16:32.650472+0000","last_undegraded":"2024-09-14T12:16:32.650472+0000","last_fullsized":"2024-09-14T12:16:32.650472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T12:16:32.650377+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.650377+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:57.980647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2699,"num_read_kb":2515,"num_write":638,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'416","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.053960+0000","last_change":"2024-09-14T12:16:28.053960+0000","last_active":"2024-09-14T12:16:28.053960+0000","last_peered":"2024-09-14T12:16:28.053960+0000","last_clean":"2024-09-14T12:16:28.053960+0000","last_became_active":"2024-09-14T11:17:21.579231+0000","last_became_peered":"2024-09-14T11:17:21.579231+0000","last_unstale":"2024-09-14T12:16:28.053960+0000","last_undegraded":"2024-09-14T12:16:28.053960+0000","last_fullsized":"2024-09-14T12:16:28.053960+0000","mapping_epoch":25,"log_start":"263'401","ondisk_log_start":"263'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T12:16:28.053860+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.053860+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:26.211944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":680,"num_read_kb":78819,"num_write":1261,"num_write_kb":48938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'834","reported_seq":2551,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:37.564900+0000","last_change":"2024-09-14T12:16:37.564900+0000","last_active":"2024-09-14T12:16:37.564900+0000","last_peered":"2024-09-14T12:16:37.564900+0000","last_clean":"2024-09-14T12:16:37.564900+0000","last_became_active":"2024-09-14T11:17:23.601618+0000","last_became_peered":"2024-09-14T11:17:23.601618+0000","last_unstale":"2024-09-14T12:16:37.564900+0000","last_undegraded":"2024-09-14T12:16:37.564900+0000","last_fullsized":"2024-09-14T12:16:37.564900+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'834","last_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_deep_scrub":"263'834","last_deep_scrub_stamp":"2024-09-14T12:16:37.564799+0000","last_clean_scrub_stamp":"2024-09-14T12:16:37.564799+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:22.157858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3720,"num_write":1080,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'453","reported_seq":1138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:23.477694+0000","last_change":"2024-09-14T12:16:23.477694+0000","last_active":"2024-09-14T12:16:23.477694+0000","last_peered":"2024-09-14T12:16:23.477694+0000","last_clean":"2024-09-14T12:16:23.477694+0000","last_became_active":"2024-09-14T11:17:21.587587+0000","last_became_peered":"2024-09-14T11:17:21.587587+0000","last_unstale":"2024-09-14T12:16:23.477694+0000","last_undegraded":"2024-09-14T12:16:23.477694+0000","last_fullsized":"2024-09-14T12:16:23.477694+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T12:16:23.477569+0000","last_clean_scrub_stamp":"2024-09-14T12:16:23.477569+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.655283+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":864,"num_read_kb":42747,"num_write":1601,"num_write_kb":32508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'1138","reported_seq":2634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.510021+0000","last_change":"2024-09-14T12:16:32.510021+0000","last_active":"2024-09-14T12:16:32.510021+0000","last_peered":"2024-09-14T12:16:32.510021+0000","last_clean":"2024-09-14T12:16:32.510021+0000","last_became_active":"2024-09-14T11:17:23.596045+0000","last_became_peered":"2024-09-14T11:17:23.596045+0000","last_unstale":"2024-09-14T12:16:32.510021+0000","last_undegraded":"2024-09-14T12:16:32.510021+0000","last_fullsized":"2024-09-14T12:16:32.510021+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1138","last_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_deep_scrub":"263'1138","last_deep_scrub_stamp":"2024-09-14T12:16:32.509908+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.509908+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:43.358006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5123,"num_read_kb":4527,"num_write":1554,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'368","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.603639+0000","last_change":"2024-09-14T12:16:28.603639+0000","last_active":"2024-09-14T12:16:28.603639+0000","last_peered":"2024-09-14T12:16:28.603639+0000","last_clean":"2024-09-14T12:16:28.603639+0000","last_became_active":"2024-09-14T11:17:21.582873+0000","last_became_peered":"2024-09-14T11:17:21.582873+0000","last_unstale":"2024-09-14T12:16:28.603639+0000","last_undegraded":"2024-09-14T12:16:28.603639+0000","last_fullsized":"2024-09-14T12:16:28.603639+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-14T12:16:28.603520+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.603520+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:07.583029+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":730,"num_read_kb":25685,"num_write":1212,"num_write_kb":27872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'725","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.853714+0000","last_change":"2024-09-14T12:16:34.853714+0000","last_active":"2024-09-14T12:16:34.853714+0000","last_peered":"2024-09-14T12:16:34.853714+0000","last_clean":"2024-09-14T12:16:34.853714+0000","last_became_active":"2024-09-14T11:17:23.603664+0000","last_became_peered":"2024-09-14T11:17:23.603664+0000","last_unstale":"2024-09-14T12:16:34.853714+0000","last_undegraded":"2024-09-14T12:16:34.853714+0000","last_fullsized":"2024-09-14T12:16:34.853714+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'725","last_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_deep_scrub":"263'725","last_deep_scrub_stamp":"2024-09-14T12:16:34.853630+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.853630+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:40.766897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3562,"num_read_kb":3247,"num_write":939,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'317","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:27.783873+0000","last_change":"2024-09-14T12:16:27.783873+0000","last_active":"2024-09-14T12:16:27.783873+0000","last_peered":"2024-09-14T12:16:27.783873+0000","last_clean":"2024-09-14T12:16:27.783873+0000","last_became_active":"2024-09-14T11:17:21.580347+0000","last_became_peered":"2024-09-14T11:17:21.580347+0000","last_unstale":"2024-09-14T12:16:27.783873+0000","last_undegraded":"2024-09-14T12:16:27.783873+0000","last_fullsized":"2024-09-14T12:16:27.783873+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-14T12:16:27.783754+0000","last_clean_scrub_stamp":"2024-09-14T12:16:27.783754+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:26.128419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":13781,"num_write":973,"num_write_kb":28479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'544","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.617175+0000","last_change":"2024-09-14T12:16:35.617175+0000","last_active":"2024-09-14T12:16:35.617175+0000","last_peered":"2024-09-14T12:16:35.617175+0000","last_clean":"2024-09-14T12:16:35.617175+0000","last_became_active":"2024-09-14T11:17:23.596752+0000","last_became_peered":"2024-09-14T11:17:23.596752+0000","last_unstale":"2024-09-14T12:16:35.617175+0000","last_undegraded":"2024-09-14T12:16:35.617175+0000","last_fullsized":"2024-09-14T12:16:35.617175+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'544","last_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_deep_scrub":"263'544","last_deep_scrub_stamp":"2024-09-14T12:16:35.617088+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.617088+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:52.504033+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":3105,"num_write":666,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'378","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:29.560326+0000","last_change":"2024-09-14T12:16:29.560326+0000","last_active":"2024-09-14T12:16:29.560326+0000","last_peered":"2024-09-14T12:16:29.560326+0000","last_clean":"2024-09-14T12:16:29.560326+0000","last_became_active":"2024-09-14T11:17:21.582821+0000","last_became_peered":"2024-09-14T11:17:21.582821+0000","last_unstale":"2024-09-14T12:16:29.560326+0000","last_undegraded":"2024-09-14T12:16:29.560326+0000","last_fullsized":"2024-09-14T12:16:29.560326+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T12:16:29.560203+0000","last_clean_scrub_stamp":"2024-09-14T12:16:29.560203+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:48.633237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":612,"num_read_kb":24861,"num_write":1154,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'887","reported_seq":2520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.214957+0000","last_change":"2024-09-14T12:16:25.214957+0000","last_active":"2024-09-14T12:16:25.214957+0000","last_peered":"2024-09-14T12:16:25.214957+0000","last_clean":"2024-09-14T12:16:25.214957+0000","last_became_active":"2024-09-14T11:17:23.590621+0000","last_became_peered":"2024-09-14T11:17:23.590621+0000","last_unstale":"2024-09-14T12:16:25.214957+0000","last_undegraded":"2024-09-14T12:16:25.214957+0000","last_fullsized":"2024-09-14T12:16:25.214957+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'887","last_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_deep_scrub":"263'887","last_deep_scrub_stamp":"2024-09-14T12:16:25.214874+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.214874+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:03.118395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4101,"num_read_kb":3676,"num_write":1160,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'399","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:28.777956+0000","last_change":"2024-09-14T12:16:28.777956+0000","last_active":"2024-09-14T12:16:28.777956+0000","last_peered":"2024-09-14T12:16:28.777956+0000","last_clean":"2024-09-14T12:16:28.777956+0000","last_became_active":"2024-09-14T11:17:21.588033+0000","last_became_peered":"2024-09-14T11:17:21.588033+0000","last_unstale":"2024-09-14T12:16:28.777956+0000","last_undegraded":"2024-09-14T12:16:28.777956+0000","last_fullsized":"2024-09-14T12:16:28.777956+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T12:16:28.777834+0000","last_clean_scrub_stamp":"2024-09-14T12:16:28.777834+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:20.454980+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":50704,"num_write":1241,"num_write_kb":37480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'684","reported_seq":2459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:34.605611+0000","last_change":"2024-09-14T12:16:34.605611+0000","last_active":"2024-09-14T12:16:34.605611+0000","last_peered":"2024-09-14T12:16:34.605611+0000","last_clean":"2024-09-14T12:16:34.605611+0000","last_became_active":"2024-09-14T11:17:23.595319+0000","last_became_peered":"2024-09-14T11:17:23.595319+0000","last_unstale":"2024-09-14T12:16:34.605611+0000","last_undegraded":"2024-09-14T12:16:34.605611+0000","last_fullsized":"2024-09-14T12:16:34.605611+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'684","last_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_deep_scrub":"263'684","last_deep_scrub_stamp":"2024-09-14T12:16:34.605515+0000","last_clean_scrub_stamp":"2024-09-14T12:16:34.605515+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:49.073360+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3693,"num_read_kb":3363,"num_write":997,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'359","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:25.891383+0000","last_change":"2024-09-14T12:16:25.891383+0000","last_active":"2024-09-14T12:16:25.891383+0000","last_peered":"2024-09-14T12:16:25.891383+0000","last_clean":"2024-09-14T12:16:25.891383+0000","last_became_active":"2024-09-14T11:17:21.588784+0000","last_became_peered":"2024-09-14T11:17:21.588784+0000","last_unstale":"2024-09-14T12:16:25.891383+0000","last_undegraded":"2024-09-14T12:16:25.891383+0000","last_fullsized":"2024-09-14T12:16:25.891383+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T12:16:25.891261+0000","last_clean_scrub_stamp":"2024-09-14T12:16:25.891261+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:39.670161+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":637,"num_read_kb":2146,"num_write":1056,"num_write_kb":11579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'755","reported_seq":2221,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.405692+0000","last_change":"2024-09-14T12:16:36.405692+0000","last_active":"2024-09-14T12:16:36.405692+0000","last_peered":"2024-09-14T12:16:36.405692+0000","last_clean":"2024-09-14T12:16:36.405692+0000","last_became_active":"2024-09-14T11:17:55.700437+0000","last_became_peered":"2024-09-14T11:17:55.700437+0000","last_unstale":"2024-09-14T12:16:36.405692+0000","last_undegraded":"2024-09-14T12:16:36.405692+0000","last_fullsized":"2024-09-14T12:16:36.405692+0000","mapping_epoch":38,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T12:16:36.405559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.405559+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:19.573245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3599,"num_read_kb":3249,"num_write":1003,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'333","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:24.520197+0000","last_change":"2024-09-14T12:16:24.520197+0000","last_active":"2024-09-14T12:16:24.520197+0000","last_peered":"2024-09-14T12:16:24.520197+0000","last_clean":"2024-09-14T12:16:24.520197+0000","last_became_active":"2024-09-14T11:17:21.582155+0000","last_became_peered":"2024-09-14T11:17:21.582155+0000","last_unstale":"2024-09-14T12:16:24.520197+0000","last_undegraded":"2024-09-14T12:16:24.520197+0000","last_fullsized":"2024-09-14T12:16:24.520197+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-14T12:16:24.520092+0000","last_clean_scrub_stamp":"2024-09-14T12:16:24.520092+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:01.332103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":46679,"num_write":958,"num_write_kb":29591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'471","reported_seq":1950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:33.895312+0000","last_change":"2024-09-14T12:16:33.895312+0000","last_active":"2024-09-14T12:16:33.895312+0000","last_peered":"2024-09-14T12:16:33.895312+0000","last_clean":"2024-09-14T12:16:33.895312+0000","last_became_active":"2024-09-14T11:17:23.606269+0000","last_became_peered":"2024-09-14T11:17:23.606269+0000","last_unstale":"2024-09-14T12:16:33.895312+0000","last_undegraded":"2024-09-14T12:16:33.895312+0000","last_fullsized":"2024-09-14T12:16:33.895312+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T12:16:33.895220+0000","last_clean_scrub_stamp":"2024-09-14T12:16:33.895220+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:21.754997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2565,"num_read_kb":2370,"num_write":583,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'348","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.097196+0000","last_change":"2024-09-14T12:16:31.097130+0000","last_active":"2024-09-14T12:16:31.097196+0000","last_peered":"2024-09-14T12:16:31.097196+0000","last_clean":"2024-09-14T12:16:31.097196+0000","last_became_active":"2024-09-14T11:17:55.703208+0000","last_became_peered":"2024-09-14T11:17:55.703208+0000","last_unstale":"2024-09-14T12:16:31.097196+0000","last_undegraded":"2024-09-14T12:16:31.097196+0000","last_fullsized":"2024-09-14T12:16:31.097196+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T12:16:31.097044+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.097044+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:55.804352+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":19021,"num_write":1018,"num_write_kb":18583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"263'444","reported_seq":2081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:38.596230+0000","last_change":"2024-09-14T12:16:38.596230+0000","last_active":"2024-09-14T12:16:38.596230+0000","last_peered":"2024-09-14T12:16:38.596230+0000","last_clean":"2024-09-14T12:16:38.596230+0000","last_became_active":"2024-09-14T11:17:23.601866+0000","last_became_peered":"2024-09-14T11:17:23.601866+0000","last_unstale":"2024-09-14T12:16:38.596230+0000","last_undegraded":"2024-09-14T12:16:38.596230+0000","last_fullsized":"2024-09-14T12:16:38.596230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T12:16:38.596131+0000","last_clean_scrub_stamp":"2024-09-14T12:16:38.596131+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:53.904204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2610,"num_read_kb":2464,"num_write":497,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4594,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'400","reported_seq":1099,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:21.185633+0000","last_change":"2024-09-14T12:16:21.185633+0000","last_active":"2024-09-14T12:16:21.185633+0000","last_peered":"2024-09-14T12:16:21.185633+0000","last_clean":"2024-09-14T12:16:21.185633+0000","last_became_active":"2024-09-14T11:17:21.578473+0000","last_became_peered":"2024-09-14T11:17:21.578473+0000","last_unstale":"2024-09-14T12:16:21.185633+0000","last_undegraded":"2024-09-14T12:16:21.185633+0000","last_fullsized":"2024-09-14T12:16:21.185633+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T12:16:21.185559+0000","last_clean_scrub_stamp":"2024-09-14T12:16:21.185559+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:24.059335+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":737,"num_read_kb":76781,"num_write":1270,"num_write_kb":65207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'460","reported_seq":2085,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.432720+0000","last_change":"2024-09-14T12:16:35.432720+0000","last_active":"2024-09-14T12:16:35.432720+0000","last_peered":"2024-09-14T12:16:35.432720+0000","last_clean":"2024-09-14T12:16:35.432720+0000","last_became_active":"2024-09-14T11:17:23.603487+0000","last_became_peered":"2024-09-14T11:17:23.603487+0000","last_unstale":"2024-09-14T12:16:35.432720+0000","last_undegraded":"2024-09-14T12:16:35.432720+0000","last_fullsized":"2024-09-14T12:16:35.432720+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T12:16:35.432637+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.432637+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:31.011136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2553,"num_read_kb":2411,"num_write":528,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'375","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.890775+0000","last_change":"2024-09-14T12:16:32.890775+0000","last_active":"2024-09-14T12:16:32.890775+0000","last_peered":"2024-09-14T12:16:32.890775+0000","last_clean":"2024-09-14T12:16:32.890775+0000","last_became_active":"2024-09-14T11:17:21.587158+0000","last_became_peered":"2024-09-14T11:17:21.587158+0000","last_unstale":"2024-09-14T12:16:32.890775+0000","last_undegraded":"2024-09-14T12:16:32.890775+0000","last_fullsized":"2024-09-14T12:16:32.890775+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'375","last_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_deep_scrub":"263'375","last_deep_scrub_stamp":"2024-09-14T12:16:32.890669+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.890669+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:26.033762+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":569,"num_read_kb":6459,"num_write":1212,"num_write_kb":30190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'316","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:31.839863+0000","last_change":"2024-09-14T12:16:31.839863+0000","last_active":"2024-09-14T12:16:31.839863+0000","last_peered":"2024-09-14T12:16:31.839863+0000","last_clean":"2024-09-14T12:16:31.839863+0000","last_became_active":"2024-09-14T11:17:21.582005+0000","last_became_peered":"2024-09-14T11:17:21.582005+0000","last_unstale":"2024-09-14T12:16:31.839863+0000","last_undegraded":"2024-09-14T12:16:31.839863+0000","last_fullsized":"2024-09-14T12:16:31.839863+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'316","last_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_deep_scrub":"263'316","last_deep_scrub_stamp":"2024-09-14T12:16:31.839755+0000","last_clean_scrub_stamp":"2024-09-14T12:16:31.839755+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:18.749494+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":649,"num_read_kb":1699,"num_write":1024,"num_write_kb":18540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'564","reported_seq":2268,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:35.882132+0000","last_change":"2024-09-14T12:16:35.882132+0000","last_active":"2024-09-14T12:16:35.882132+0000","last_peered":"2024-09-14T12:16:35.882132+0000","last_clean":"2024-09-14T12:16:35.882132+0000","last_became_active":"2024-09-14T11:17:23.604733+0000","last_became_peered":"2024-09-14T11:17:23.604733+0000","last_unstale":"2024-09-14T12:16:35.882132+0000","last_undegraded":"2024-09-14T12:16:35.882132+0000","last_fullsized":"2024-09-14T12:16:35.882132+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'564","last_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_deep_scrub":"263'564","last_deep_scrub_stamp":"2024-09-14T12:16:35.882034+0000","last_clean_scrub_stamp":"2024-09-14T12:16:35.882034+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":500,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:51:28.610668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2891,"num_read_kb":2697,"num_write":668,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'411","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:32.093411+0000","last_change":"2024-09-14T12:16:32.093411+0000","last_active":"2024-09-14T12:16:32.093411+0000","last_peered":"2024-09-14T12:16:32.093411+0000","last_clean":"2024-09-14T12:16:32.093411+0000","last_became_active":"2024-09-14T11:17:21.571269+0000","last_became_peered":"2024-09-14T11:17:21.571269+0000","last_unstale":"2024-09-14T12:16:32.093411+0000","last_undegraded":"2024-09-14T12:16:32.093411+0000","last_fullsized":"2024-09-14T12:16:32.093411+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'411","last_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_deep_scrub":"263'411","last_deep_scrub_stamp":"2024-09-14T12:16:32.093316+0000","last_clean_scrub_stamp":"2024-09-14T12:16:32.093316+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:14.969406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":16758,"num_write":1274,"num_write_kb":26231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'916","reported_seq":2589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T12:16:36.894057+0000","last_change":"2024-09-14T12:16:36.894057+0000","last_active":"2024-09-14T12:16:36.894057+0000","last_peered":"2024-09-14T12:16:36.894057+0000","last_clean":"2024-09-14T12:16:36.894057+0000","last_became_active":"2024-09-14T11:17:23.597235+0000","last_became_peered":"2024-09-14T11:17:23.597235+0000","last_unstale":"2024-09-14T12:16:36.894057+0000","last_undegraded":"2024-09-14T12:16:36.894057+0000","last_fullsized":"2024-09-14T12:16:36.894057+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'916","last_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_deep_scrub":"263'916","last_deep_scrub_stamp":"2024-09-14T12:16:36.893938+0000","last_clean_scrub_stamp":"2024-09-14T12:16:36.893938+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:11.186412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4376,"num_read_kb":3927,"num_write":1236,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10863,"num_read_kb":9150,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1009,"ondisk_log_size":1009,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15161,"num_read_kb":14820,"num_write":17065,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":590,"ondisk_log_size":590,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1705796,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18087,"num_read_kb":37833,"num_write":15249,"num_write_kb":12069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713408,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1989,"ondisk_log_size":1989,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2414,"num_read_kb":2877,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221656,"num_read_kb":202806,"num_write":56286,"num_write_kb":19344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35482,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3802,"ondisk_log_size":3802,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":22160993,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44528,"num_read_kb":1801342,"num_write":73962,"num_write_kb":2098453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45277184,"data_stored":44321986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4060,"ondisk_log_size":4060,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":187942,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":186673,"num_write":186,"num_write_kb":128291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510172,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277484,"kb_used_data":11676,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94094356,"statfs":{"total":96636764160,"available":96352620544,"internally_reserved":0,"allocated":11956224,"data_stored":10288647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":272169418},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510172,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249308,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94122532,"statfs":{"total":96636764160,"available":96381472768,"internally_reserved":0,"allocated":5844992,"data_stored":4296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510174,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137716,"kb_used_data":12196,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94234124,"statfs":{"total":96636764160,"available":96495742976,"internally_reserved":0,"allocated":12488704,"data_stored":10779353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510173,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98696,"kb_used_data":9208,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94273144,"statfs":{"total":96636764160,"available":96535699456,"internally_reserved":0,"allocated":9428992,"data_stored":7842152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510172,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256288,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115552,"statfs":{"total":96636764160,"available":96374325248,"internally_reserved":0,"allocated":12992512,"data_stored":11338592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510172,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92020,"kb_used_data":6756,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279820,"statfs":{"total":96636764160,"available":96542535680,"internally_reserved":0,"allocated":6918144,"data_stored":5375493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510172,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147548,"kb_used_data":8140,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94224292,"statfs":{"total":96636764160,"available":96485675008,"internally_reserved":0,"allocated":8335360,"data_stored":6711727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575581,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263468,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":94108372,"statfs":{"total":96636764160,"available":96366972928,"internally_reserved":0,"allocated":7630848,"data_stored":5968019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":262142408},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3383296,"data_stored":3240346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4706304,"data_stored":4574335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330048,"data_stored":3240066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9338880,"data_stored":9200737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5828608,"data_stored":5706939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8773632,"data_stored":8639695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2236416,"data_stored":2160102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7680000,"data_stored":7559766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":4817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:17:43.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:17:43.954 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:17:43.955 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:17:43.955 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:17:43.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.002 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:17:44.003 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:17:44.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.054 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:17:44.054 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:17:44.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.095 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:17:44.096 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:17:44.096 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.142 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:17:44.143 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:17:44.143 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.187 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:17:44.188 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:17:44.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.244 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:17:44.244 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:17:44.244 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.290 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:17:44.291 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:17:44.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.339 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:17:44.339 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:17:44.339 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:17:44.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.367 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:17:44.367 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:17:44.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.396 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:17:44.396 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:17:44.396 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:17:44.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.423 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:17:44.423 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:17:44.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.476 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:17:44.476 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:17:44.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:17:44.489 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:17:44.489 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:17:44.490 DEBUG:teuthology.orchestra.run.smithi116:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:17:44.578 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T12:17:44.579 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:17:44.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T12:17:44.690 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:17:44.806 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T12:17:44.806 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:17:44.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T12:17:44.877 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:17:44.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T12:17:44.951 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:17:45.114 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T12:17:45.114 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:17:45.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T12:17:45.200 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:17:45.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T12:17:45.289 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:17:45.380 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:17:45.381 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/data/mon.a.tgz 2024-09-14T12:17:45.381 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T12:17:45.411 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.1K6uX8uvfr 2024-09-14T12:17:45.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1K6uX8uvfr 2024-09-14T12:17:45.645 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.1K6uX8uvfr 2024-09-14T12:17:45.757 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.1K6uX8uvfr is 472KB 2024-09-14T12:17:45.858 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.1K6uX8uvfr 2024-09-14T12:17:45.887 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/data/mon.c.tgz 2024-09-14T12:17:45.887 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T12:17:45.955 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.BlrA13Ohks 2024-09-14T12:17:45.956 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BlrA13Ohks 2024-09-14T12:17:46.136 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.BlrA13Ohks 2024-09-14T12:17:46.248 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.BlrA13Ohks is 489KB 2024-09-14T12:17:46.347 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.BlrA13Ohks 2024-09-14T12:17:46.376 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/data/mon.b.tgz 2024-09-14T12:17:46.377 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-14T12:17:46.411 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.P29oCdEZHp 2024-09-14T12:17:46.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.P29oCdEZHp 2024-09-14T12:17:46.837 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.P29oCdEZHp 2024-09-14T12:17:46.948 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.P29oCdEZHp is 488KB 2024-09-14T12:17:47.050 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.P29oCdEZHp 2024-09-14T12:17:47.078 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:17:47.078 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:17:47.081 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:17:47.266 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:17:47.296 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:17:47.296 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:17:47.297 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi116/crash 2024-09-14T12:17:47.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:17:47.336 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi164/crash 2024-09-14T12:17:47.337 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:17:47.376 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:17:47.376 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:17:47.381 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:17:47.470 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-09-14T12:17:47.470 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32666.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32798.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32622.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32666.log.gz 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32798.log.gz 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32622.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32622.log.gz 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:17:47.471 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32930.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32842.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32930.log.gz 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.32842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32842.log.gz 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-09-14T12:17:47.472 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:17:47.489 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.32886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-09-14T12:17:47.509 INFO:teuthology.orchestra.run.smithi164.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:17:47.546 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:17:47.546 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2024-09-14T12:17:47.546 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165033.log 2024-09-14T12:17:47.546 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53630.log 2024-09-14T12:17:47.546 INFO:teuthology.orchestra.run.smithi116.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz/var/log/ceph/ceph-client.admin.165033.log: 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165033.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38897.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192548.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.53630.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177428.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38897.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42927.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192548.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.177428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116072.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.0.177428.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.42927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192272.log 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.42927.log.gz 2024-09-14T12:17:47.547 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.116072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63715.log 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116072.log.gz 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192272.log.gz 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58390.log 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.63715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192318.log 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63715.log.gz 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50048.log 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.58390.log.gz 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188331.log 2024-09-14T12:17:47.548 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192318.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66893.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.50048.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.188331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134923.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.188331.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.66893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127853.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.134923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144347.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134923.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.127853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191858.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.144347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144347.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38899.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191858.log.gz 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2024-09-14T12:17:47.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127853.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38899.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192456.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147881.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48233.log: /var/log/ceph/ceph-client.admin.192456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87799.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192456.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.147881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57164.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.147881.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.87799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.87799.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178037.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57164.log: /var/log/ceph/ceph-client.admin.38902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2024-09-14T12:17:47.550 INFO:teuthology.orchestra.run.smithi116.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.57164.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.178037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136101.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 80.0% 93.0% -- replaced with /var/log/ceph/ceph-client.0.178037.log.gz -- replaced with /var/log/ceph/ceph-client.admin.66893.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.136101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192226.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40258.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136101.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192226.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162040.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148470.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40258.log.gz 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.162040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189603.log 2024-09-14T12:17:47.551 INFO:teuthology.orchestra.run.smithi116.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.162040.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.148470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.148470.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.189603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63651.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189603.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.63651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121963.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 19.5% -- replaced with /var/log/ceph/ceph-client.admin.63651.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39654.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.121963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141991.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39987.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39654.log.gz 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.141991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63118.log 2024-09-14T12:17:47.552 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141991.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39987.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90744.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38903.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.63118.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121963.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.90744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130800.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63118.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38903.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.38903.log.gz --verbose 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.131389.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.130800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123730.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.130800.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.131389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127264.log 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90744.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.131389.log.gz 2024-09-14T12:17:47.553 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.123730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115483.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.123730.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93689.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.127264.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127264.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.115483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104881.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.93689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188991.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115483.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93689.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.104881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52452.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104881.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62851.log 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.188991.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.188991.log.gz 2024-09-14T12:17:47.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.52452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182909.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.62851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99580.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52452.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.62851.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.182909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153182.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.182909.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160252.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.99580.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.99580.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.153182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192640.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.160252.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.153182.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160252.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84265.log 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192640.log.gz 2024-09-14T12:17:47.555 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.1.log: -- /var/log/ceph/ceph-client.admin.130211.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.84265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60181.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.130211.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84265.log.gz 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.130211.log.gz 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39177.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60181.log.gz 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66274.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114894.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39177.log.gz 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.66274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104292.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.114894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75948.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.114894.log.gz 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.104292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191720.log 2024-09-14T12:17:47.556 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104292.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.75948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75357.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.75948.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159661.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191720.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.75357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44139.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.75357.log.gz/var/log/ceph/ceph-client.admin.159661.log: 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65655.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.159661.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.44139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94278.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44139.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.65655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45345.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146703.log 81.4% -- replaced with /var/log/ceph/ceph-client.admin.94278.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.45345.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.45345.log.gz 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77490.log 2024-09-14T12:17:47.557 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66274.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.146703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62930.log 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.77490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168919.log 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.62930.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65036.log 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62930.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101936.log 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.168919.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.146703.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.65036.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168919.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165057.log 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.101936.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.65036.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101936.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.165057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165057.log.gz 2024-09-14T12:17:47.558 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42324.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.77490.log.gz 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39272.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz --verbose 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.38591.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.42324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188967.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.42324.log.gz 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160273.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38591.log.gz 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.188967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188967.log.gz 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.160273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185954.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.160273.log.gz 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165670.log 2024-09-14T12:17:47.559 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173259.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.185954.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65655.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.165670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38693.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.185954.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.173259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150826.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.165670.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173259.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154360.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38693.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71895.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.150826.log: /var/log/ceph/ceph-client.admin.154360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56575.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192868.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 83.9%/var/log/ceph/ceph-client.admin.56575.log: -- replaced with /var/log/ceph/ceph-client.admin.71895.log.gz 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43536.log 2024-09-14T12:17:47.560 INFO:teuthology.orchestra.run.smithi116.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.56575.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.150826.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154360.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192868.log: /var/log/ceph/ceph-client.0.43536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192868.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136690.log 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.43536.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160862.log 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.33119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.136690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140813.log 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.136690.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.160862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60157.log 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5/var/log/ceph/ceph-client.admin.140813.log: --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160862.log.gz 2024-09-14T12:17:47.561 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60157.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140813.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40480.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5/var/log/ceph/ceph-client.admin.39276.log: --verbose -- /var/log/ceph/ceph-client.admin.151415.log 0.0% 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40480.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161451.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192410.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.151415.log: /var/log/ceph/ceph-client.admin.161451.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.151415.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67512.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.161451.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82498.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192410.log.gz 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.admin.67512.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.192824.log 2024-09-14T12:17:47.562 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.82498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176819.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82498.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126675.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192824.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49459.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.176819.log: /var/log/ceph/ceph-client.admin.126675.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.176819.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38398.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126675.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49459.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67512.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146114.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49459.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.admin.38398.log: -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.81909.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38398.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.146114.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.146114.log.gz 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191950.log 2024-09-14T12:17:47.563 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.admin.81909.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128442.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.81909.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191950.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191950.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38462.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.128442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140224.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128442.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38462.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156127.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117250.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.140224.log: /var/log/ceph/ceph-client.admin.156127.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140224.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152593.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.156127.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.117250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40041.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117250.log.gz 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.152593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63056.log 2024-09-14T12:17:47.564 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141402.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40041.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.63056.log: gzip -5 --verbose -- 55.8% -- replaced with /var/log/ceph/ceph-client.admin.63056.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr: /var/log/ceph/ceph-client.admin.38645.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.141402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125497.log 81.5% -- replaced with /var/log/ceph/ceph-client.admin.141402.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38645.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152593.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192686.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138457.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.125497.log: /var/log/ceph/ceph-client.admin.192686.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.125497.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88388.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192686.log.gz 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.138457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131978.log 2024-09-14T12:17:47.565 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.138457.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.88388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159072.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88388.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.131978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80142.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131978.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.159072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153771.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.159072.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.80142.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.80142.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.153771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96045.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153771.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83676.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.96045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89566.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96045.log.gz 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.83676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-09-14T12:17:47.566 INFO:teuthology.orchestra.run.smithi116.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.83676.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.89566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39546.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.89566.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39176.log: -- /var/log/ceph/ceph-client.admin.120196.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39546.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143758.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.120196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162629.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.143758.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120196.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40348.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.143758.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109593.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.162629.log: /var/log/ceph/ceph-client.admin.40348.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40348.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.182300.log 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162629.log.gz 2024-09-14T12:17:47.567 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.109593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109593.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.182300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.182300.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.50637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87210.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132567.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.87210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133156.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87210.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.132567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137868.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180473.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.133156.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.132567.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.137868.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.133156.log.gz 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38544.log 2024-09-14T12:17:47.568 INFO:teuthology.orchestra.run.smithi116.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137868.log.gz 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.180473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123141.log 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81320.log 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.180473.log.gz 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38544.log.gz 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.123141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192732.log 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123141.log.gz 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.81320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157894.log 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38485.log 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192732.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81320.log.gz 2024-09-14T12:17:47.569 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192732.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.157894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109004.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157894.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189627.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38485.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68131.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.109004.log: /var/log/ceph/ceph-client.admin.189627.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.189627.log.gz -5 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.119017.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109004.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191766.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.68131.log: /var/log/ceph/ceph-client.admin.119017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149648.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119017.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39644.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191766.log.gz 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T12:17:47.570 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.149648.log: /var/log/ceph/ceph-client.admin.39644.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149648.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.174475.log -- replaced with /var/log/ceph/ceph-client.admin.39644.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156716.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68131.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.174475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.174475.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.156716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84854.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62644.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156716.log.gz/var/log/ceph/ceph-client.admin.57777.log: 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.84854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68752.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84854.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76117.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.62644.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.62644.log.gz 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.68752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62534.log 2024-09-14T12:17:47.571 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.76117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142580.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 84.0%/var/log/ceph/ceph-client.admin.62534.log: -- replaced with /var/log/ceph/ceph-client.0.76117.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 55.3% -- replaced with /var/log/ceph/ceph-client.admin.62534.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173867.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.142580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165081.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.173867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192594.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.173867.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.165081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59568.log 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 86.7%/var/log/ceph/ceph-client.admin.192594.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.142580.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.165081.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192594.log.gz 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120785.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129622.log 2024-09-14T12:17:47.572 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.59568.log: /var/log/ceph/ceph-client.admin.120785.log: gzip -5 --verbose 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59568.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr: -- /var/log/ceph/ceph-client.admin.139046.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120785.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.129622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51815.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129622.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.139046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40392.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51815.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139046.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51815.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170071.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.admin.40392.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40392.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr: /var/log/ceph/ceph-client.admin.49411.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.170071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168311.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49411.log.gz 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60794.log 2024-09-14T12:17:47.573 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.168311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100169.log 93.7% -- replaced with /var/log/ceph/ceph-client.admin.170071.log.gz 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86032.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60794.log.gz/var/log/ceph/ceph-client.admin.100169.log: 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.100169.log.gz 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.86032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158483.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.c.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.86032.log.gz 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189676.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26700.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.158483.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158483.log.gz/var/log/ceph/ceph-client.admin.189676.log: 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189676.log.gz 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64416.log 2024-09-14T12:17:47.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.tmp-client.admin.26700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110771.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26700.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.64416.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168311.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.124319.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.110771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107826.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 88.3%/var/log/ceph/ceph-client.admin.124319.log: -- replaced with /var/log/ceph/ceph-client.admin.110771.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.124319.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119607.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.107826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61383.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 81.6%/var/log/ceph/ceph-client.admin.119607.log: -- replaced with /var/log/ceph/ceph-client.admin.107826.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119607.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92511.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.61383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39171.log 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr: 82.0%/var/log/ceph/ceph-client.admin.92511.log: -- replaced with /var/log/ceph/ceph-client.admin.61383.log.gz 2024-09-14T12:17:47.575 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107237.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92511.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39171.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41715.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.107237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.41715.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.41715.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107237.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134334.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137279.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.134334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113716.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.137279.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.137279.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111360.log 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.113716.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.134334.log.gz 2024-09-14T12:17:47.576 INFO:teuthology.orchestra.run.smithi116.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113716.log.gz 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102525.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79553.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111360.log.gz/var/log/ceph/ceph-client.admin.102525.log: 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.102525.log.gzgzip 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.178646.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.79553.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79553.log.gz 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74176.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.178646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76726.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.74176.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178646.log.gz 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54219.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.76726.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74176.log.gz 84.0% 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.0.76726.log.gz 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39275.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121374.log 2024-09-14T12:17:47.577 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54219.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39275.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189581.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68752.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.121374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51839.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 81.4%/var/log/ceph/ceph-client.admin.189581.log: -- replaced with /var/log/ceph/ceph-client.admin.121374.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144936.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.189581.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90155.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51839.log: /var/log/ceph/ceph-client.admin.144936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51839.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181691.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.144936.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.90155.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90155.log.gz 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53041.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.181691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135512.log 2024-09-14T12:17:47.578 INFO:teuthology.orchestra.run.smithi116.stderr: 83.8% 93.8% -- replaced with /var/log/ceph/ceph-client.0.181691.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64416.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.53041.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.53041.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.135512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44742.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135512.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57801.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.44742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163855.log 43.9% -- replaced with /var/log/ceph/ceph-client.0.44742.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126086.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57801.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.163855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122552.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.163855.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.126086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185345.log 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126086.log.gz 2024-09-14T12:17:47.579 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40304.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.122552.log: /var/log/ceph/ceph-client.0.185345.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122552.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.185345.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192502.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171287.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40304.log: gzip/var/log/ceph/ceph-client.admin.192502.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.149059.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192502.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0%/var/log/ceph/ceph-client.admin.171287.log: -- replaced with /var/log/ceph/ceph-client.admin.40304.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62282.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171287.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.149059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116661.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.149059.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114305.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.62282.log: /var/log/ceph/ceph-client.admin.116661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57753.log 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr: 59.7% -- replaced with /var/log/ceph/ceph-client.admin.62282.log.gz 2024-09-14T12:17:47.580 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.114305.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.116661.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175572.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114305.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40503.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.57753.log: /var/log/ceph/ceph-client.admin.175572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57753.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.40503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39477.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40503.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39477.log.gz 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-09-14T12:17:47.581 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60205.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.2.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.175572.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85443.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.60205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113127.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.85443.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.60205.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85443.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192180.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179864.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.113127.log: /var/log/ceph/ceph-client.admin.192180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192180.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113127.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192364.log 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.179864.log: /var/log/ceph/valgrind/ceph.client.0.log: 83.6% -- replaced with /var/log/ceph/ceph-client.0.179864.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr: 61.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T12:17:47.582 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105470.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95456.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192364.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.105470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167662.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105470.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.95456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189651.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.167662.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95456.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.167662.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39964.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.189651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189651.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39964.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106059.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91922.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.106059.log: /var/log/ceph/ceph-mgr.y.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106059.log.gz 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:17:47.583 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.91922.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.91922.log.gz 2024-09-14T12:17:47.584 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73584.log 2024-09-14T12:17:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:17:47.644 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69990.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.73584.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.73584.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163218.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.69990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69990.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.191088.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.163218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163218.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72995.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.191088.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166259.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.72995.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.72995.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190395.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.166259.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166259.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147292.log 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.190395.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.190395.log.gz 2024-09-14T12:17:47.645 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191904.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.147292.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.147292.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188943.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191904.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184127.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.188943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188943.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58979.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.184127.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.184127.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112538.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.58979.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.58979.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.112538.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112538.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55397.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.51226.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55397.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.55397.log.gz 2024-09-14T12:17:47.646 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39844.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192088.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39844.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187742.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192088.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155538.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.187742.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.187742.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63827.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.155538.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.155538.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164444.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.63827.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.63827.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.164444.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164444.log.gz 2024-09-14T12:17:47.647 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62992.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.47055.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188921.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.62992.log: 86.8% -- replaced with /var/log/ceph/ceph-client.0.191088.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179255.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.188921.log: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.188921.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163266.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.179255.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179255.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98402.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.163266.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163266.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40212.log 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.98402.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.98402.log.gz 2024-09-14T12:17:47.648 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183518.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40212.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124908.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.183518.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183518.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129031.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.124908.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.124908.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170679.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.129031.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129031.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86621.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.170679.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170679.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154949.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.86621.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.86621.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55986.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.154949.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.154949.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176180.log 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.55986.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55986.log.gz 2024-09-14T12:17:47.649 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62992.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91333.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.176180.log: -- /var/log/ceph/ceph-client.admin.80731.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176180.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.91333.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91333.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.80731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163242.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.80731.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103114.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.163242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163242.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93100.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.103114.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103114.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78964.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.93100.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93100.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111949.log 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.78964.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.78964.log.gz 2024-09-14T12:17:47.650 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143169.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.111949.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111949.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181082.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.143169.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.143169.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189700.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.181082.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.181082.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40436.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.189700.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.189700.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97812.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40436.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106648.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.97812.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97812.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.106648.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106648.log.gz 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40040.log 2024-09-14T12:17:47.651 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.49435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39547.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97223.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39547.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108415.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.97223.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97223.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77436.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108415.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.108415.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70611.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.77436.log: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.77436.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117839.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.70611.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70611.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.117839.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117839.log.gz 2024-09-14T12:17:47.652 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191812.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.48822.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186563.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191812.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145525.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.186563.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.186563.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152004.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.145525.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.145525.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139635.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.152004.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.152004.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191996.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.139635.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139635.log.gz 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150237.log 2024-09-14T12:17:47.653 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.191996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191996.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192042.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.150237.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150237.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96634.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192042.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171895.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.96634.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.96634.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101347.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.171895.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171895.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157305.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.101347.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101347.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78099.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.157305.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.157305.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184736.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.78099.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.78099.log.gz 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192134.log 2024-09-14T12:17:47.654 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.184736.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.184736.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133745.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192134.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192778.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.133745.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133745.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41112.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.192778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192778.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74766.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.0.41112.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41112.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38908.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.74766.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.74766.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110182.log 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38908.log.gz 2024-09-14T12:17:47.655 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T12:17:47.656 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.110182.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110182.log.gz 2024-09-14T12:17:47.656 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98991.log 2024-09-14T12:17:47.656 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39274.log 2024-09-14T12:17:47.656 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.98991.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.98991.log.gz 2024-09-14T12:17:47.665 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100758.log 2024-09-14T12:17:47.665 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39274.log.gz 2024-09-14T12:17:47.666 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83087.log 2024-09-14T12:17:47.666 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.100758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100758.log.gz 2024-09-14T12:17:47.679 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103703.log 2024-09-14T12:17:47.680 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.83087.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83087.log.gz 2024-09-14T12:17:47.691 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69371.log 2024-09-14T12:17:47.691 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.103703.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103703.log.gz 2024-09-14T12:17:47.699 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118428.log 2024-09-14T12:17:47.709 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.69371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-14T12:17:47.714 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.118428.log: 89.0% 92.5% -- replaced with /var/log/ceph/ceph-client.admin.69371.log.gz 2024-09-14T12:17:47.717 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118428.log.gz 2024-09-14T12:17:47.718 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71230.log 2024-09-14T12:17:47.718 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.54808.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-14T12:17:47.731 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39946.log 2024-09-14T12:17:47.735 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71230.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71230.log.gz 2024-09-14T12:17:47.743 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172651.log 2024-09-14T12:17:47.743 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39946.log.gz 2024-09-14T12:17:47.751 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39643.log 2024-09-14T12:17:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.172651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33292.log 2024-09-14T12:17:47.761 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39643.log.gz 2024-09-14T12:17:47.765 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.172651.log.gz 2024-09-14T12:17:47.770 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94867.log 2024-09-14T12:17:47.779 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.33292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88977.log 2024-09-14T12:17:47.779 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94867.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94867.log.gz 2024-09-14T12:17:47.782 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33292.log.gz 2024-09-14T12:17:47.801 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.88977.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88977.log.gz 2024-09-14T12:17:48.121 INFO:teuthology.orchestra.run.smithi116.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:17:48.584 INFO:teuthology.orchestra.run.smithi116.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:17:48.626 INFO:teuthology.orchestra.run.smithi164.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:17:50.432 INFO:teuthology.orchestra.run.smithi116.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:17:50.939 INFO:teuthology.orchestra.run.smithi116.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:17:54.545 INFO:teuthology.orchestra.run.smithi116.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:17:56.420 INFO:teuthology.orchestra.run.smithi116.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:17:56.444 INFO:teuthology.orchestra.run.smithi164.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:17:56.445 INFO:teuthology.orchestra.run.smithi164.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:17:56.689 INFO:teuthology.orchestra.run.smithi164.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:18:02.107 INFO:teuthology.orchestra.run.smithi116.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:18:05.286 INFO:teuthology.orchestra.run.smithi164.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:18:05.288 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-14T12:18:05.288 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m17.839s 2024-09-14T12:18:05.288 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m44.568s 2024-09-14T12:18:05.289 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m1.608s 2024-09-14T12:18:09.022 INFO:teuthology.orchestra.run.smithi116.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:18:09.024 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T12:18:09.024 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m21.618s 2024-09-14T12:18:09.024 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m58.314s 2024-09-14T12:18:09.024 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m2.203s 2024-09-14T12:18:09.025 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:18:09.025 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi116/log 2024-09-14T12:18:09.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:18:16.593 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi164/log 2024-09-14T12:18:16.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:18:22.509 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:18:22.519 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:18:22.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:18:22.522 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:18:22.632 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:18:22.642 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:18:22.642 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:18:22.645 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:18:22.673 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:18:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:18:22.678 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:18:22.678 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T12:18:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +2427us[+2377us] +/- 59ms 2024-09-14T12:18:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 +3764us[+3764us] +/- 75ms 2024-09-14T12:18:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -9251us[-9251us] +/- 93ms 2024-09-14T12:18:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:18:22.680 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:18:22.681 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-14T12:18:22.681 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +2419us[+2439us] +/- 59ms 2024-09-14T12:18:22.681 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 +3757us[+3757us] +/- 75ms 2024-09-14T12:18:22.681 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -9259us[-9259us] +/- 93ms 2024-09-14T12:18:22.681 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:18:22.682 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:18:22.691 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:18:22.692 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:18:22.700 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:18:22.800 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:18:22.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:18:22.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:18:22.920 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:18:22.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:18:22.962 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:18:22.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:18:22.981 INFO:teuthology.task.internal:Duration was 4130.622346 seconds 2024-09-14T12:18:22.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:18:22.990 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:18:22.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:18:22.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:18:23.043 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:18:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:18:23.355 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:18:23.355 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T12:18:23.356 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:18:23.390 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T12:18:23.390 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:18:23.429 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:18:23.429 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:18:23.433 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:18:23.509 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:18:23.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:18:23.514 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:18:23.663 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:18:23.674 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:18:23.674 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:18:23.713 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:18:23.751 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:18:23.761 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:18:23.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:18:23.797 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-14T12:18:23.828 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-14T12:18:23.851 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:18:23.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:18:23.880 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:18:23.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:18:23.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:18:23.930 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:18:23.931 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi116 2024-09-14T12:18:23.931 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:18:23.981 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904177/remote/smithi164 2024-09-14T12:18:23.981 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:18:24.027 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:18:24.028 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:18:24.030 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:18:24.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:18:24.103 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:18:24.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:18:24.113 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:18:24.113 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:18:24.115 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:18:24.141 INFO:teuthology.orchestra.run.smithi116.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:18 /home/ubuntu/cephtest 2024-09-14T12:18:24.161 INFO:teuthology.orchestra.run.smithi164.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:18 /home/ubuntu/cephtest 2024-09-14T12:18:24.162 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:18:24.172 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:18:24.196 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4130.622346401215 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:18:24.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:18:24.327 INFO:teuthology.run:pass